2023-11-18T20:37:57.998 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-18T20:37:57.999 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694 --name yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694/orig.config.yaml 2023-11-18T20:37:58.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-18T20:37:58.152 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694 branch: main description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7461694' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe valgrind: exit_on_first_error: false mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1491 sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC+ChscoCMEahRQFSUSGVJvVBQnKyYYPResF1d23B+3h1K0uen/ccLMt2ZvhB/2mkhj1XyLHksEObj5XIMC9sCc= smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFAPO3qbOCqVwT7ut+l2Er62zVXJOFja6maelkGd+Fwkr4k5lgYXopvJ7bSIskIqwcXP/cHqjLPzI8AgjjNx2VE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-18_13:51:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-18T20:37:58.153 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa; will attempt to use it 2023-11-18T20:37:58.153 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks 2023-11-18T20:37:58.153 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-18T20:37:58.155 INFO:teuthology.task.internal:Checking packages... 2023-11-18T20:37:58.179 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe' 2023-11-18T20:37:58.179 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-18T20:37:58.179 INFO:teuthology.packaging:ref: None 2023-11-18T20:37:58.179 INFO:teuthology.packaging:tag: None 2023-11-18T20:37:58.179 INFO:teuthology.packaging:branch: main 2023-11-18T20:37:58.179 INFO:teuthology.packaging:sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T20:37:58.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2023-11-18T20:37:58.541 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7424-g6adc03ac-1jammy 2023-11-18T20:37:58.541 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-18T20:37:58.548 INFO:teuthology.task.internal:no buildpackages task found 2023-11-18T20:37:58.548 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-18T20:37:58.598 INFO:teuthology.task.internal:Saving configuration 2023-11-18T20:37:58.614 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-18T20:37:58.621 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-18T20:37:58.647 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-18 20:30:19.614691', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIP9I7zZSM27W2jNSR3coUiBBths/QbMmPYh9ZP39HPJ+'} 2023-11-18T20:37:58.666 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-18 20:30:19.615985', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJxFfQNi3gMesbAtn7bAGGVqcgJOSJ6cAg02qECx3jrz'} 2023-11-18T20:37:58.666 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-18T20:37:58.674 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-11-18T20:37:58.674 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-11-18T20:37:58.674 INFO:teuthology.run_tasks:Running task console_log... 2023-11-18T20:37:58.748 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f30533250d0>, signals=[15]) 2023-11-18T20:37:58.748 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-18T20:37:58.756 INFO:teuthology.task.internal:Opening connections... 2023-11-18T20:37:58.757 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2023-11-18T20:37:58.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:37:58.833 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2023-11-18T20:37:58.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:37:58.906 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-18T20:37:58.913 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2023-11-18T20:37:58.918 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2023-11-18T20:37:58.918 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-11-18T20:37:58.967 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-18T20:37:58.967 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Ubuntu" 2023-11-18T20:37:58.967 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="22.04" 2023-11-18T20:37:58.967 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-18T20:37:58.967 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_CODENAME=jammy 2023-11-18T20:37:58.967 INFO:teuthology.orchestra.run.smithi049.stdout:ID=ubuntu 2023-11-18T20:37:58.967 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE=debian 2023-11-18T20:37:58.967 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-18T20:37:58.967 INFO:teuthology.orchestra.run.smithi049.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-18T20:37:58.967 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-18T20:37:58.968 INFO:teuthology.orchestra.run.smithi049.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-18T20:37:58.968 INFO:teuthology.orchestra.run.smithi049.stdout:UBUNTU_CODENAME=jammy 2023-11-18T20:37:58.968 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-11-18T20:37:58.993 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2023-11-18T20:37:58.998 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2023-11-18T20:37:58.998 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2023-11-18T20:37:59.044 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-18T20:37:59.044 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Ubuntu" 2023-11-18T20:37:59.044 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="22.04" 2023-11-18T20:37:59.044 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-18T20:37:59.044 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_CODENAME=jammy 2023-11-18T20:37:59.045 INFO:teuthology.orchestra.run.smithi106.stdout:ID=ubuntu 2023-11-18T20:37:59.045 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE=debian 2023-11-18T20:37:59.045 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-18T20:37:59.045 INFO:teuthology.orchestra.run.smithi106.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-18T20:37:59.045 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-18T20:37:59.045 INFO:teuthology.orchestra.run.smithi106.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-18T20:37:59.045 INFO:teuthology.orchestra.run.smithi106.stdout:UBUNTU_CODENAME=jammy 2023-11-18T20:37:59.045 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2023-11-18T20:37:59.067 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-18T20:37:59.077 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-18T20:37:59.086 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-18T20:37:59.086 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2023-11-18T20:37:59.088 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2023-11-18T20:37:59.093 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-18T20:37:59.101 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-18T20:37:59.101 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2023-11-18T20:37:59.136 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2023-11-18T20:37:59.142 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-18T20:37:59.198 INFO:teuthology.run_tasks:Running task kernel... 2023-11-18T20:37:59.215 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-18T20:37:59.215 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-18T20:37:59.215 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-18T20:37:59.216 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-18T20:37:59.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:37:59.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:37:59.221 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2023-11-18T20:37:59.221 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2023-11-18T20:37:59.268 INFO:teuthology.orchestra.run.smithi049.stdout:5.15.0-56-generic 2023-11-18T20:37:59.268 INFO:teuthology.task.kernel:Running kernel on smithi049: 5.15.0-56-generic 2023-11-18T20:37:59.268 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get clean 2023-11-18T20:37:59.269 INFO:teuthology.orchestra.run.smithi106.stdout:5.15.0-56-generic 2023-11-18T20:37:59.269 INFO:teuthology.task.kernel:Running kernel on smithi106: 5.15.0-56-generic 2023-11-18T20:37:59.269 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get clean 2023-11-18T20:37:59.379 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get update 2023-11-18T20:37:59.417 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2023-11-18T20:37:59.512 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-18T20:37:59.523 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-11-18T20:37:59.581 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-18T20:37:59.587 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-11-18T20:37:59.593 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-11-18T20:37:59.593 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-11-18T20:37:59.667 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-11-18T20:37:59.710 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-11-18T20:37:59.773 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,162 kB] 2023-11-18T20:37:59.824 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [953 kB] 2023-11-18T20:37:59.856 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [527 kB] 2023-11-18T20:37:59.862 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [248 kB] 2023-11-18T20:37:59.866 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2023-11-18T20:37:59.866 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.8 kB] 2023-11-18T20:37:59.867 INFO:teuthology.orchestra.run.smithi049.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,114 kB] 2023-11-18T20:37:59.878 INFO:teuthology.orchestra.run.smithi049.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [181 kB] 2023-11-18T20:37:59.880 INFO:teuthology.orchestra.run.smithi049.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2023-11-18T20:37:59.880 INFO:teuthology.orchestra.run.smithi049.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [998 kB] 2023-11-18T20:37:59.888 INFO:teuthology.orchestra.run.smithi049.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [664 kB] 2023-11-18T20:37:59.894 INFO:teuthology.orchestra.run.smithi049.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [219 kB] 2023-11-18T20:37:59.896 INFO:teuthology.orchestra.run.smithi049.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2023-11-18T20:37:59.898 INFO:teuthology.orchestra.run.smithi049.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-11-18T20:37:59.902 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,162 kB] 2023-11-18T20:37:59.917 INFO:teuthology.orchestra.run.smithi049.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-11-18T20:37:59.919 INFO:teuthology.orchestra.run.smithi049.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-11-18T20:37:59.919 INFO:teuthology.orchestra.run.smithi049.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-11-18T20:37:59.919 INFO:teuthology.orchestra.run.smithi049.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [64.2 kB] 2023-11-18T20:37:59.920 INFO:teuthology.orchestra.run.smithi049.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [56.3 kB] 2023-11-18T20:37:59.921 INFO:teuthology.orchestra.run.smithi049.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-11-18T20:37:59.921 INFO:teuthology.orchestra.run.smithi049.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-11-18T20:37:59.921 INFO:teuthology.orchestra.run.smithi049.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.8 kB] 2023-11-18T20:37:59.921 INFO:teuthology.orchestra.run.smithi049.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.9 kB] 2023-11-18T20:37:59.923 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [363 kB] 2023-11-18T20:37:59.928 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [188 kB] 2023-11-18T20:37:59.931 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-11-18T20:37:59.931 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,093 kB] 2023-11-18T20:37:59.935 INFO:teuthology.orchestra.run.smithi049.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-11-18T20:37:59.951 INFO:teuthology.orchestra.run.smithi049.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2023-11-18T20:37:59.954 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.4 kB] 2023-11-18T20:37:59.955 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [178 kB] 2023-11-18T20:37:59.956 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2023-11-18T20:37:59.956 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [795 kB] 2023-11-18T20:37:59.967 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [565 kB] 2023-11-18T20:37:59.970 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [147 kB] 2023-11-18T20:37:59.971 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-11-18T20:37:59.971 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-11-18T20:37:59.971 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-11-18T20:37:59.987 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [527 kB] 2023-11-18T20:37:59.990 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-11-18T20:37:59.991 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-11-18T20:37:59.993 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [248 kB] 2023-11-18T20:37:59.996 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2023-11-18T20:37:59.997 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.8 kB] 2023-11-18T20:37:59.997 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,114 kB] 2023-11-18T20:38:00.015 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [181 kB] 2023-11-18T20:38:00.017 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2023-11-18T20:38:00.017 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [664 kB] 2023-11-18T20:38:00.027 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [998 kB] 2023-11-18T20:38:00.037 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [219 kB] 2023-11-18T20:38:00.040 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2023-11-18T20:38:00.040 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-11-18T20:38:00.041 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-11-18T20:38:00.041 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-11-18T20:38:00.056 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-11-18T20:38:00.056 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [64.2 kB] 2023-11-18T20:38:00.056 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [56.3 kB] 2023-11-18T20:38:00.057 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-11-18T20:38:00.075 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-11-18T20:38:00.075 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.9 kB] 2023-11-18T20:38:00.076 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.8 kB] 2023-11-18T20:38:00.076 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-11-18T20:38:00.077 INFO:teuthology.orchestra.run.smithi106.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2023-11-18T20:38:00.136 INFO:teuthology.orchestra.run.smithi049.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [953 kB] 2023-11-18T20:38:00.506 INFO:teuthology.orchestra.run.smithi049.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [363 kB] 2023-11-18T20:38:00.527 INFO:teuthology.orchestra.run.smithi049.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [188 kB] 2023-11-18T20:38:00.538 INFO:teuthology.orchestra.run.smithi049.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-11-18T20:38:00.539 INFO:teuthology.orchestra.run.smithi049.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,093 kB] 2023-11-18T20:38:00.623 INFO:teuthology.orchestra.run.smithi049.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.4 kB] 2023-11-18T20:38:00.625 INFO:teuthology.orchestra.run.smithi049.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [178 kB] 2023-11-18T20:38:00.636 INFO:teuthology.orchestra.run.smithi049.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2023-11-18T20:38:00.636 INFO:teuthology.orchestra.run.smithi049.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [795 kB] 2023-11-18T20:38:00.673 INFO:teuthology.orchestra.run.smithi049.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [565 kB] 2023-11-18T20:38:00.852 INFO:teuthology.orchestra.run.smithi049.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [147 kB] 2023-11-18T20:38:01.235 INFO:teuthology.orchestra.run.smithi049.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-11-18T20:38:01.242 INFO:teuthology.orchestra.run.smithi049.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-11-18T20:38:01.243 INFO:teuthology.orchestra.run.smithi049.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-11-18T20:38:01.258 INFO:teuthology.orchestra.run.smithi049.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-11-18T20:38:01.261 INFO:teuthology.orchestra.run.smithi049.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-11-18T20:38:05.672 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 10.2 MB in 2s (6,635 kB/s) 2023-11-18T20:38:05.759 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 10.2 MB in 2s (5,596 kB/s) 2023-11-18T20:38:06.974 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2023-11-18T20:38:06.991 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-18T20:38:07.052 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2023-11-18T20:38:07.145 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2023-11-18T20:38:07.163 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-18T20:38:07.217 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2023-11-18T20:38:07.238 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2023-11-18T20:38:07.239 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2023-11-18T20:38:07.390 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2023-11-18T20:38:07.390 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2023-11-18T20:38:07.400 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2023-11-18T20:38:07.400 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-18T20:38:07.400 INFO:teuthology.orchestra.run.smithi106.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-18T20:38:07.400 INFO:teuthology.orchestra.run.smithi106.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-18T20:38:07.401 INFO:teuthology.orchestra.run.smithi106.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-18T20:38:07.401 INFO:teuthology.orchestra.run.smithi106.stdout: python2.7-minimal 2023-11-18T20:38:07.401 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-18T20:38:07.402 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2023-11-18T20:38:07.402 INFO:teuthology.orchestra.run.smithi106.stdout: linux-generic linux-headers-5.15.0-88 linux-headers-5.15.0-88-generic 2023-11-18T20:38:07.402 INFO:teuthology.orchestra.run.smithi106.stdout: linux-headers-generic linux-image-5.15.0-88-generic 2023-11-18T20:38:07.402 INFO:teuthology.orchestra.run.smithi106.stdout: linux-modules-5.15.0-88-generic linux-modules-extra-5.15.0-88-generic 2023-11-18T20:38:07.403 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2023-11-18T20:38:07.403 INFO:teuthology.orchestra.run.smithi106.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-11-18T20:38:07.403 INFO:teuthology.orchestra.run.smithi106.stdout:Recommended packages: 2023-11-18T20:38:07.404 INFO:teuthology.orchestra.run.smithi106.stdout: thermald 2023-11-18T20:38:07.449 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2023-11-18T20:38:07.449 INFO:teuthology.orchestra.run.smithi106.stdout: linux-headers-5.15.0-88 linux-headers-5.15.0-88-generic 2023-11-18T20:38:07.449 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.15.0-88-generic linux-modules-5.15.0-88-generic 2023-11-18T20:38:07.449 INFO:teuthology.orchestra.run.smithi106.stdout: linux-modules-extra-5.15.0-88-generic 2023-11-18T20:38:07.450 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages will be upgraded: 2023-11-18T20:38:07.451 INFO:teuthology.orchestra.run.smithi106.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-18T20:38:07.540 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2023-11-18T20:38:07.540 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-18T20:38:07.540 INFO:teuthology.orchestra.run.smithi049.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-18T20:38:07.541 INFO:teuthology.orchestra.run.smithi049.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-18T20:38:07.541 INFO:teuthology.orchestra.run.smithi049.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-18T20:38:07.541 INFO:teuthology.orchestra.run.smithi049.stdout: python2.7-minimal 2023-11-18T20:38:07.541 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-18T20:38:07.541 INFO:teuthology.orchestra.run.smithi049.stdout:The following additional packages will be installed: 2023-11-18T20:38:07.542 INFO:teuthology.orchestra.run.smithi049.stdout: linux-generic linux-headers-5.15.0-88 linux-headers-5.15.0-88-generic 2023-11-18T20:38:07.542 INFO:teuthology.orchestra.run.smithi049.stdout: linux-headers-generic linux-image-5.15.0-88-generic 2023-11-18T20:38:07.542 INFO:teuthology.orchestra.run.smithi049.stdout: linux-modules-5.15.0-88-generic linux-modules-extra-5.15.0-88-generic 2023-11-18T20:38:07.543 INFO:teuthology.orchestra.run.smithi049.stdout:Suggested packages: 2023-11-18T20:38:07.543 INFO:teuthology.orchestra.run.smithi049.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-11-18T20:38:07.543 INFO:teuthology.orchestra.run.smithi049.stdout:Recommended packages: 2023-11-18T20:38:07.543 INFO:teuthology.orchestra.run.smithi049.stdout: thermald 2023-11-18T20:38:07.599 INFO:teuthology.orchestra.run.smithi049.stdout:The following NEW packages will be installed: 2023-11-18T20:38:07.599 INFO:teuthology.orchestra.run.smithi049.stdout: linux-headers-5.15.0-88 linux-headers-5.15.0-88-generic 2023-11-18T20:38:07.599 INFO:teuthology.orchestra.run.smithi049.stdout: linux-image-5.15.0-88-generic linux-modules-5.15.0-88-generic 2023-11-18T20:38:07.599 INFO:teuthology.orchestra.run.smithi049.stdout: linux-modules-extra-5.15.0-88-generic 2023-11-18T20:38:07.600 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages will be upgraded: 2023-11-18T20:38:07.601 INFO:teuthology.orchestra.run.smithi049.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-18T20:38:07.629 INFO:teuthology.orchestra.run.smithi106.stdout:3 upgraded, 5 newly installed, 0 to remove and 272 not upgraded. 2023-11-18T20:38:07.630 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 113 MB of archives. 2023-11-18T20:38:07.630 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 582 MB of additional disk space will be used. 2023-11-18T20:38:07.630 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-88-generic amd64 5.15.0-88.98 [22.4 MB] 2023-11-18T20:38:07.651 INFO:teuthology.orchestra.run.smithi049.stdout:3 upgraded, 5 newly installed, 0 to remove and 272 not upgraded. 2023-11-18T20:38:07.651 INFO:teuthology.orchestra.run.smithi049.stdout:Need to get 113 MB of archives. 2023-11-18T20:38:07.651 INFO:teuthology.orchestra.run.smithi049.stdout:After this operation, 582 MB of additional disk space will be used. 2023-11-18T20:38:07.651 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-88-generic amd64 5.15.0-88.98 [22.4 MB] 2023-11-18T20:38:08.090 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-88-generic amd64 5.15.0-88.98 [11.5 MB] 2023-11-18T20:38:08.187 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-88-generic amd64 5.15.0-88.98 [64.0 MB] 2023-11-18T20:38:09.034 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.88.85 [1,698 B] 2023-11-18T20:38:09.035 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.88.85 [2,488 B] 2023-11-18T20:38:09.035 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-88 all 5.15.0-88.98 [12.3 MB] 2023-11-18T20:38:09.113 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-88-generic amd64 5.15.0-88.98 [11.5 MB] 2023-11-18T20:38:09.165 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-88-generic amd64 5.15.0-88.98 [2,878 kB] 2023-11-18T20:38:09.188 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.88.85 [2,340 B] 2023-11-18T20:38:09.457 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-88-generic amd64 5.15.0-88.98 [64.0 MB] 2023-11-18T20:38:09.606 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 113 MB in 2s (71.5 MB/s) 2023-11-18T20:38:09.784 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-modules-5.15.0-88-generic. 2023-11-18T20:38:11.671 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.88.85 [1,698 B] 2023-11-18T20:38:11.671 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.88.85 [2,488 B] 2023-11-18T20:38:11.672 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-88 all 5.15.0-88.98 [12.3 MB] 2023-11-18T20:38:11.808 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-11-18T20:38:11.813 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../0-linux-modules-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-18T20:38:11.898 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-modules-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:12.913 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-88-generic amd64 5.15.0-88.98 [2,878 kB] 2023-11-18T20:38:13.039 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.88.85 [2,340 B] 2023-11-18T20:38:13.461 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 113 MB in 6s (20.3 MB/s) 2023-11-18T20:38:13.642 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-modules-5.15.0-88-generic. 2023-11-18T20:38:13.924 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-image-5.15.0-88-generic. 2023-11-18T20:38:13.946 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../1-linux-image-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-18T20:38:14.034 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:14.511 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-88-generic. 2023-11-18T20:38:14.532 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-18T20:38:14.569 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-modules-extra-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:15.691 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-11-18T20:38:15.695 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../0-linux-modules-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-18T20:38:15.756 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-modules-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:18.348 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-image-5.15.0-88-generic. 2023-11-18T20:38:18.369 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../1-linux-image-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-18T20:38:18.448 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:18.942 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-88-generic. 2023-11-18T20:38:18.963 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-18T20:38:19.000 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-modules-extra-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:21.306 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../3-linux-generic_5.15.0.88.85_amd64.deb ... 2023-11-18T20:38:21.432 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-18T20:38:21.707 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.88.85_amd64.deb ... 2023-11-18T20:38:21.828 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-image-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-18T20:38:22.247 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-headers-5.15.0-88. 2023-11-18T20:38:22.270 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../5-linux-headers-5.15.0-88_5.15.0-88.98_all.deb ... 2023-11-18T20:38:22.314 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-headers-5.15.0-88 (5.15.0-88.98) ... 2023-11-18T20:38:25.201 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../3-linux-generic_5.15.0.88.85_amd64.deb ... 2023-11-18T20:38:25.325 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-18T20:38:25.650 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.88.85_amd64.deb ... 2023-11-18T20:38:25.745 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-image-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-18T20:38:26.040 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-headers-5.15.0-88. 2023-11-18T20:38:26.063 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../5-linux-headers-5.15.0-88_5.15.0-88.98_all.deb ... 2023-11-18T20:38:26.107 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-5.15.0-88 (5.15.0-88.98) ... 2023-11-18T20:38:28.403 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-headers-5.15.0-88-generic. 2023-11-18T20:38:28.440 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../6-linux-headers-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-18T20:38:28.477 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-headers-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:31.289 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.88.85_amd64.deb ... 2023-11-18T20:38:31.413 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-headers-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-18T20:38:31.747 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-headers-5.15.0-88 (5.15.0-88.98) ... 2023-11-18T20:38:31.868 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-headers-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:31.893 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-headers-5.15.0-88-generic. 2023-11-18T20:38:31.930 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../6-linux-headers-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-18T20:38:31.959 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:31.994 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-headers-generic (5.15.0.88.85) ... 2023-11-18T20:38:32.096 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:33.441 INFO:teuthology.orchestra.run.smithi049.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-11-18T20:38:33.441 INFO:teuthology.orchestra.run.smithi049.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-11-18T20:38:33.441 INFO:teuthology.orchestra.run.smithi049.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-88-generic 2023-11-18T20:38:33.441 INFO:teuthology.orchestra.run.smithi049.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-88-generic 2023-11-18T20:38:33.594 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-modules-extra-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:34.610 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.88.85_amd64.deb ... 2023-11-18T20:38:34.736 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-18T20:38:35.238 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-modules-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:35.625 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-5.15.0-88 (5.15.0-88.98) ... 2023-11-18T20:38:35.749 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:35.875 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-generic (5.15.0.88.85) ... 2023-11-18T20:38:36.002 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:36.913 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-image-generic (5.15.0.88.85) ... 2023-11-18T20:38:37.039 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-generic (5.15.0.88.85) ... 2023-11-18T20:38:37.165 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:37.223 INFO:teuthology.orchestra.run.smithi049.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-18T20:38:37.223 INFO:teuthology.orchestra.run.smithi049.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-88-generic 2023-11-18T20:38:37.323 INFO:teuthology.orchestra.run.smithi106.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-11-18T20:38:37.323 INFO:teuthology.orchestra.run.smithi106.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-11-18T20:38:37.324 INFO:teuthology.orchestra.run.smithi106.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-88-generic 2023-11-18T20:38:37.324 INFO:teuthology.orchestra.run.smithi106.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-88-generic 2023-11-18T20:38:37.481 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-modules-extra-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:38.881 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-modules-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:40.258 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-image-generic (5.15.0.88.85) ... 2023-11-18T20:38:40.384 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-generic (5.15.0.88.85) ... 2023-11-18T20:38:40.510 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-18T20:38:40.568 INFO:teuthology.orchestra.run.smithi106.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-18T20:38:40.568 INFO:teuthology.orchestra.run.smithi106.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-88-generic 2023-11-18T20:38:51.913 INFO:teuthology.orchestra.run.smithi049.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-18T20:38:51.913 INFO:teuthology.orchestra.run.smithi049.stdout:Sourcing file `/etc/default/grub' 2023-11-18T20:38:51.924 INFO:teuthology.orchestra.run.smithi049.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-18T20:38:51.940 INFO:teuthology.orchestra.run.smithi049.stdout:Generating grub configuration file ... 2023-11-18T20:38:52.175 INFO:teuthology.orchestra.run.smithi049.stdout:Found linux image: /boot/vmlinuz-5.15.0-88-generic 2023-11-18T20:38:52.191 INFO:teuthology.orchestra.run.smithi049.stdout:Found initrd image: /boot/initrd.img-5.15.0-88-generic 2023-11-18T20:38:52.470 INFO:teuthology.orchestra.run.smithi049.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-18T20:38:52.475 INFO:teuthology.orchestra.run.smithi049.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-18T20:38:52.542 INFO:teuthology.orchestra.run.smithi049.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-18T20:38:52.548 INFO:teuthology.orchestra.run.smithi049.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-18T20:38:52.711 INFO:teuthology.orchestra.run.smithi049.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-18T20:38:52.711 INFO:teuthology.orchestra.run.smithi049.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-11-18T20:38:52.711 INFO:teuthology.orchestra.run.smithi049.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-18T20:38:52.742 INFO:teuthology.orchestra.run.smithi049.stdout:done 2023-11-18T20:38:53.146 DEBUG:teuthology.orchestra.run.smithi049:> dpkg -s linux-image-generic 2023-11-18T20:38:53.207 INFO:teuthology.orchestra.run.smithi049.stdout:Package: linux-image-generic 2023-11-18T20:38:53.208 INFO:teuthology.orchestra.run.smithi049.stdout:Status: install ok installed 2023-11-18T20:38:53.208 INFO:teuthology.orchestra.run.smithi049.stdout:Priority: optional 2023-11-18T20:38:53.208 INFO:teuthology.orchestra.run.smithi049.stdout:Section: kernel 2023-11-18T20:38:53.208 INFO:teuthology.orchestra.run.smithi049.stdout:Installed-Size: 20 2023-11-18T20:38:53.208 INFO:teuthology.orchestra.run.smithi049.stdout:Maintainer: Ubuntu Kernel Team 2023-11-18T20:38:53.208 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: amd64 2023-11-18T20:38:53.208 INFO:teuthology.orchestra.run.smithi049.stdout:Source: linux-meta 2023-11-18T20:38:53.208 INFO:teuthology.orchestra.run.smithi049.stdout:Version: 5.15.0.88.85 2023-11-18T20:38:53.208 INFO:teuthology.orchestra.run.smithi049.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-88), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-18T20:38:53.208 INFO:teuthology.orchestra.run.smithi049.stdout:Depends: linux-image-5.15.0-88-generic, linux-modules-extra-5.15.0-88-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-18T20:38:53.208 INFO:teuthology.orchestra.run.smithi049.stdout:Recommends: thermald 2023-11-18T20:38:53.208 INFO:teuthology.orchestra.run.smithi049.stdout:Description: Generic Linux kernel image 2023-11-18T20:38:53.208 INFO:teuthology.orchestra.run.smithi049.stdout: This package will always depend on the latest generic kernel image 2023-11-18T20:38:53.209 INFO:teuthology.orchestra.run.smithi049.stdout: available. 2023-11-18T20:38:53.209 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-88-generic 2023-11-18T20:38:53.209 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-18T20:38:53.209 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-18T20:38:53.209 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-18T20:38:53.209 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi049.front.sepia.ceph.com, path=None, version=distro) 2023-11-18T20:38:53.209 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get clean 2023-11-18T20:38:53.508 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get update 2023-11-18T20:38:53.650 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-18T20:38:53.650 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-18T20:38:53.661 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-18T20:38:53.682 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-18T20:38:54.981 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2023-11-18T20:38:54.998 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-18T20:38:55.058 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2023-11-18T20:38:55.135 INFO:teuthology.orchestra.run.smithi106.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-18T20:38:55.136 INFO:teuthology.orchestra.run.smithi106.stdout:Sourcing file `/etc/default/grub' 2023-11-18T20:38:55.144 INFO:teuthology.orchestra.run.smithi106.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-18T20:38:55.185 INFO:teuthology.orchestra.run.smithi106.stdout:Generating grub configuration file ... 2023-11-18T20:38:55.248 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2023-11-18T20:38:55.250 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2023-11-18T20:38:55.424 INFO:teuthology.orchestra.run.smithi049.stdout:linux-image-generic is already the newest version (5.15.0.88.85). 2023-11-18T20:38:55.424 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2023-11-18T20:38:55.424 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-18T20:38:55.425 INFO:teuthology.orchestra.run.smithi049.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-18T20:38:55.425 INFO:teuthology.orchestra.run.smithi049.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-18T20:38:55.425 INFO:teuthology.orchestra.run.smithi049.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-18T20:38:55.425 INFO:teuthology.orchestra.run.smithi049.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-18T20:38:55.425 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-18T20:38:55.467 INFO:teuthology.orchestra.run.smithi049.stdout:0 upgraded, 0 newly installed, 0 to remove and 272 not upgraded. 2023-11-18T20:38:55.469 DEBUG:teuthology.orchestra.run.smithi049:> dpkg -s linux-image-generic 2023-11-18T20:38:55.482 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.15.0-88-generic 2023-11-18T20:38:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:Package: linux-image-generic 2023-11-18T20:38:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:Status: install ok installed 2023-11-18T20:38:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:Priority: optional 2023-11-18T20:38:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:Section: kernel 2023-11-18T20:38:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:Installed-Size: 20 2023-11-18T20:38:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:Maintainer: Ubuntu Kernel Team 2023-11-18T20:38:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: amd64 2023-11-18T20:38:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:Source: linux-meta 2023-11-18T20:38:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:Version: 5.15.0.88.85 2023-11-18T20:38:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-88), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-18T20:38:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:Depends: linux-image-5.15.0-88-generic, linux-modules-extra-5.15.0-88-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-18T20:38:55.486 INFO:teuthology.orchestra.run.smithi049.stdout:Recommends: thermald 2023-11-18T20:38:55.486 INFO:teuthology.orchestra.run.smithi049.stdout:Description: Generic Linux kernel image 2023-11-18T20:38:55.486 INFO:teuthology.orchestra.run.smithi049.stdout: This package will always depend on the latest generic kernel image 2023-11-18T20:38:55.486 INFO:teuthology.orchestra.run.smithi049.stdout: available. 2023-11-18T20:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2023-11-18T20:38:55.500 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.15.0-88-generic 2023-11-18T20:38:55.534 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.LaBpInpuxL 2023-11-18T20:38:55.534 DEBUG:teuthology.orchestra.run.smithi049:> sudo cp /boot/grub/grub.cfg /tmp/tmp.LaBpInpuxL 2023-11-18T20:38:55.591 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.LaBpInpuxL 2023-11-18T20:38:55.705 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.LaBpInpuxL is 10KB 2023-11-18T20:38:55.718 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.LaBpInpuxL 2023-11-18T20:38:55.724 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-18T20:38:55.778 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:38:55.778 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-18T20:38:55.778 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-18T20:38:55.798 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-18T20:38:55.805 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-18T20:38:55.851 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-88-generic 2023-11-18T20:38:55.851 DEBUG:teuthology.orchestra.run.smithi049:> sudo update-grub 2023-11-18T20:38:55.883 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-18T20:38:55.888 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-18T20:38:56.042 INFO:teuthology.orchestra.run.smithi106.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-18T20:38:56.042 INFO:teuthology.orchestra.run.smithi106.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-11-18T20:38:56.042 INFO:teuthology.orchestra.run.smithi106.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-18T20:38:56.081 INFO:teuthology.orchestra.run.smithi106.stdout:done 2023-11-18T20:38:56.597 DEBUG:teuthology.orchestra.run.smithi106:> dpkg -s linux-image-generic 2023-11-18T20:38:56.627 INFO:teuthology.orchestra.run.smithi106.stdout:Package: linux-image-generic 2023-11-18T20:38:56.627 INFO:teuthology.orchestra.run.smithi106.stdout:Status: install ok installed 2023-11-18T20:38:56.627 INFO:teuthology.orchestra.run.smithi106.stdout:Priority: optional 2023-11-18T20:38:56.627 INFO:teuthology.orchestra.run.smithi106.stdout:Section: kernel 2023-11-18T20:38:56.628 INFO:teuthology.orchestra.run.smithi106.stdout:Installed-Size: 20 2023-11-18T20:38:56.628 INFO:teuthology.orchestra.run.smithi106.stdout:Maintainer: Ubuntu Kernel Team 2023-11-18T20:38:56.628 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: amd64 2023-11-18T20:38:56.628 INFO:teuthology.orchestra.run.smithi106.stdout:Source: linux-meta 2023-11-18T20:38:56.628 INFO:teuthology.orchestra.run.smithi106.stdout:Version: 5.15.0.88.85 2023-11-18T20:38:56.628 INFO:teuthology.orchestra.run.smithi106.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-88), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-18T20:38:56.628 INFO:teuthology.orchestra.run.smithi106.stdout:Depends: linux-image-5.15.0-88-generic, linux-modules-extra-5.15.0-88-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-18T20:38:56.628 INFO:teuthology.orchestra.run.smithi106.stdout:Recommends: thermald 2023-11-18T20:38:56.628 INFO:teuthology.orchestra.run.smithi106.stdout:Description: Generic Linux kernel image 2023-11-18T20:38:56.628 INFO:teuthology.orchestra.run.smithi106.stdout: This package will always depend on the latest generic kernel image 2023-11-18T20:38:56.628 INFO:teuthology.orchestra.run.smithi106.stdout: available. 2023-11-18T20:38:56.629 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-88-generic 2023-11-18T20:38:56.629 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-18T20:38:56.629 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-18T20:38:56.629 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-18T20:38:56.629 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi106.front.sepia.ceph.com, path=None, version=distro) 2023-11-18T20:38:56.629 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get clean 2023-11-18T20:38:56.820 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2023-11-18T20:38:56.930 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-18T20:38:56.930 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-18T20:38:56.939 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-18T20:38:56.956 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-18T20:38:57.076 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub' 2023-11-18T20:38:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-18T20:38:57.079 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2023-11-18T20:38:57.249 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.15.0-88-generic 2023-11-18T20:38:57.255 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.15.0-88-generic 2023-11-18T20:38:57.492 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-18T20:38:57.498 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-18T20:38:57.536 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-18T20:38:57.541 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-18T20:38:57.651 INFO:teuthology.orchestra.run.smithi049.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-18T20:38:57.651 INFO:teuthology.orchestra.run.smithi049.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-18T20:38:57.651 INFO:teuthology.orchestra.run.smithi049.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-18T20:38:57.671 INFO:teuthology.orchestra.run.smithi049.stderr:done 2023-11-18T20:38:57.678 DEBUG:teuthology.orchestra.run.smithi049:> sudo shutdown -r now 2023-11-18T20:38:58.287 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2023-11-18T20:38:58.306 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-18T20:38:58.363 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2023-11-18T20:38:58.561 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2023-11-18T20:38:58.561 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2023-11-18T20:38:58.724 INFO:teuthology.orchestra.run.smithi106.stdout:linux-image-generic is already the newest version (5.15.0.88.85). 2023-11-18T20:38:58.724 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2023-11-18T20:38:58.724 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-18T20:38:58.724 INFO:teuthology.orchestra.run.smithi106.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-18T20:38:58.724 INFO:teuthology.orchestra.run.smithi106.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-18T20:38:58.724 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-18T20:38:58.725 INFO:teuthology.orchestra.run.smithi106.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-18T20:38:58.725 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-18T20:38:58.764 INFO:teuthology.orchestra.run.smithi106.stdout:0 upgraded, 0 newly installed, 0 to remove and 272 not upgraded. 2023-11-18T20:38:58.766 DEBUG:teuthology.orchestra.run.smithi106:> dpkg -s linux-image-generic 2023-11-18T20:38:58.781 INFO:teuthology.orchestra.run.smithi106.stdout:Package: linux-image-generic 2023-11-18T20:38:58.782 INFO:teuthology.orchestra.run.smithi106.stdout:Status: install ok installed 2023-11-18T20:38:58.782 INFO:teuthology.orchestra.run.smithi106.stdout:Priority: optional 2023-11-18T20:38:58.782 INFO:teuthology.orchestra.run.smithi106.stdout:Section: kernel 2023-11-18T20:38:58.782 INFO:teuthology.orchestra.run.smithi106.stdout:Installed-Size: 20 2023-11-18T20:38:58.782 INFO:teuthology.orchestra.run.smithi106.stdout:Maintainer: Ubuntu Kernel Team 2023-11-18T20:38:58.782 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: amd64 2023-11-18T20:38:58.782 INFO:teuthology.orchestra.run.smithi106.stdout:Source: linux-meta 2023-11-18T20:38:58.782 INFO:teuthology.orchestra.run.smithi106.stdout:Version: 5.15.0.88.85 2023-11-18T20:38:58.782 INFO:teuthology.orchestra.run.smithi106.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-88), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-18T20:38:58.782 INFO:teuthology.orchestra.run.smithi106.stdout:Depends: linux-image-5.15.0-88-generic, linux-modules-extra-5.15.0-88-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-18T20:38:58.782 INFO:teuthology.orchestra.run.smithi106.stdout:Recommends: thermald 2023-11-18T20:38:58.782 INFO:teuthology.orchestra.run.smithi106.stdout:Description: Generic Linux kernel image 2023-11-18T20:38:58.783 INFO:teuthology.orchestra.run.smithi106.stdout: This package will always depend on the latest generic kernel image 2023-11-18T20:38:58.783 INFO:teuthology.orchestra.run.smithi106.stdout: available. 2023-11-18T20:38:58.783 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2023-11-18T20:38:58.827 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.gwLvCuPsFd 2023-11-18T20:38:58.827 DEBUG:teuthology.orchestra.run.smithi106:> sudo cp /boot/grub/grub.cfg /tmp/tmp.gwLvCuPsFd 2023-11-18T20:38:58.882 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.gwLvCuPsFd 2023-11-18T20:38:58.995 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.gwLvCuPsFd is 10KB 2023-11-18T20:38:59.006 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.gwLvCuPsFd 2023-11-18T20:38:59.011 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-18T20:38:59.066 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:38:59.066 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-18T20:38:59.067 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-18T20:38:59.129 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-88-generic 2023-11-18T20:38:59.129 DEBUG:teuthology.orchestra.run.smithi106:> sudo update-grub 2023-11-18T20:39:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub' 2023-11-18T20:39:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-18T20:39:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2023-11-18T20:39:00.496 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.15.0-88-generic 2023-11-18T20:39:00.502 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.15.0-88-generic 2023-11-18T20:39:00.735 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-18T20:39:00.739 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-18T20:39:00.781 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-18T20:39:00.786 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-18T20:39:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-18T20:39:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-18T20:39:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-18T20:39:00.942 INFO:teuthology.orchestra.run.smithi106.stderr:done 2023-11-18T20:39:00.951 DEBUG:teuthology.orchestra.run.smithi106:> sudo shutdown -r now 2023-11-18T20:39:27.706 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-18T20:39:27.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-18T20:39:27.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:39:30.954 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-18T20:39:30.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-11-18T20:39:30.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:39:46.274 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-11-18T20:39:49.349 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2023-11-18T20:39:55.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-18T20:39:55.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:39:58.342 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-11-18T20:39:58.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-11-18T20:39:58.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:40:01.410 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2023-11-18T20:40:10.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-18T20:40:10.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:40:13.410 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-11-18T20:40:13.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-11-18T20:40:13.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:40:16.482 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2023-11-18T20:40:28.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-18T20:40:28.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:40:31.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-11-18T20:40:31.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:40:31.490 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-11-18T20:40:34.562 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2023-11-18T20:40:49.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-18T20:40:49.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:40:52.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-11-18T20:40:52.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:40:52.582 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-11-18T20:40:55.618 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2023-11-18T20:41:13.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-18T20:41:13.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:41:16.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-11-18T20:41:16.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:41:19.682 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2023-11-18T20:41:43.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-11-18T20:41:43.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:41:45.377 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-11-18T20:41:45.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-18T20:41:45.952 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-88-generic"... 2023-11-18T20:41:45.953 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2023-11-18T20:41:46.001 INFO:teuthology.orchestra.run.smithi049.stdout:5.15.0-88-generic 2023-11-18T20:41:46.001 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-88-generic vs 5.15.0-88-generic 2023-11-18T20:41:46.001 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-18T20:41:46.001 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-18T20:41:46.786 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2023-11-18T20:41:47.002 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-18T20:41:47.002 DEBUG:teuthology.orchestra.run.smithi049:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-18T20:41:47.073 INFO:teuthology.orchestra.run.smithi049.stdout:ttyS1 2023-11-18T20:41:47.106 DEBUG:teuthology.parallel:result is None 2023-11-18T20:42:13.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-11-18T20:42:13.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:42:29.091 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2023-11-18T20:42:59.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-11-18T20:42:59.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:42:59.387 DEBUG:teuthology.orchestra.run.smithi106:> true 2023-11-18T20:43:00.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-11-18T20:43:00.085 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-88-generic"... 2023-11-18T20:43:00.085 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2023-11-18T20:43:00.133 INFO:teuthology.orchestra.run.smithi106.stdout:5.15.0-88-generic 2023-11-18T20:43:00.134 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-88-generic vs 5.15.0-88-generic 2023-11-18T20:43:00.134 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-18T20:43:00.134 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-18T20:43:01.134 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-18T20:43:01.134 DEBUG:teuthology.orchestra.run.smithi106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-18T20:43:01.226 INFO:teuthology.orchestra.run.smithi106.stdout:ttyS1 2023-11-18T20:43:01.271 DEBUG:teuthology.parallel:result is None 2023-11-18T20:43:01.271 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-18T20:43:01.278 INFO:teuthology.task.internal:Creating test directory... 2023-11-18T20:43:01.279 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-18T20:43:01.281 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-18T20:43:01.286 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-18T20:43:01.302 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-18T20:43:01.313 INFO:teuthology.task.internal:Creating archive directory... 2023-11-18T20:43:01.313 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-18T20:43:01.328 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-18T20:43:01.354 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-18T20:43:01.361 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-18T20:43:01.361 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-18T20:43:01.380 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-18T20:43:01.396 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T20:43:01.405 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T20:43:01.407 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T20:43:01.415 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T20:43:01.416 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-18T20:43:01.427 INFO:teuthology.task.internal:Configuring sudo... 2023-11-18T20:43:01.427 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-18T20:43:01.452 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-18T20:43:01.473 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-18T20:43:01.482 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-18T20:43:01.482 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-18T20:43:01.508 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-18T20:43:01.521 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-18T20:43:01.560 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-18T20:43:01.607 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:43:01.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-18T20:43:01.669 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-18T20:43:01.674 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-18T20:43:01.721 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:43:01.722 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-18T20:43:01.780 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2023-11-18T20:43:01.782 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2023-11-18T20:43:01.885 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-18T20:43:01.893 INFO:teuthology.task.internal:Starting timer... 2023-11-18T20:43:01.893 INFO:teuthology.run_tasks:Running task pcp... 2023-11-18T20:43:01.902 INFO:teuthology.run_tasks:Running task selinux... 2023-11-18T20:43:01.910 DEBUG:teuthology.task.selinux:Excluding smithi049: OS 'ubuntu' does not support SELinux 2023-11-18T20:43:01.910 DEBUG:teuthology.task.selinux:Excluding smithi106: OS 'ubuntu' does not support SELinux 2023-11-18T20:43:01.910 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-18T20:43:01.910 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-18T20:43:01.910 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-18T20:43:01.910 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-18T20:43:01.919 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-18T20:43:01.919 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-18T20:43:01.935 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-18T20:43:01.936 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com,smithi106.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-18T20:50:40.591 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi106.front.sepia.ceph.com')] 2023-11-18T20:50:40.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-18T20:50:40.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:50:40.670 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-11-18T20:50:40.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-11-18T20:50:40.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-11-18T20:50:40.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T20:50:40.858 DEBUG:teuthology.orchestra.run.smithi106:> true 2023-11-18T20:50:40.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-11-18T20:50:40.959 INFO:teuthology.run_tasks:Running task clock... 2023-11-18T20:50:40.968 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-18T20:50:40.968 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-18T20:50:40.968 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-18T20:50:40.971 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-18T20:50:40.971 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-18T20:50:40.998 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-18T20:50:40.998 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: Command line: ntpd -gq 2023-11-18T20:50:40.998 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: ---------------------------------------------------- 2023-11-18T20:50:40.999 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: ntp-4 is maintained by Network Time Foundation, 2023-11-18T20:50:40.999 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-18T20:50:40.999 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: corporation. Support and training for ntp-4 are 2023-11-18T20:50:40.999 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: available at https://www.nwtime.org/support 2023-11-18T20:50:40.999 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: ---------------------------------------------------- 2023-11-18T20:50:40.999 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: proto: precision = 0.048 usec (-24) 2023-11-18T20:50:40.999 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: basedate set to 2022-02-04 2023-11-18T20:50:41.000 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: gps base set to 2022-02-06 (week 2196) 2023-11-18T20:50:41.000 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-18T20:50:41.000 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: restrict ::: KOD does nothing without LIMITED. 2023-11-18T20:50:41.000 INFO:teuthology.orchestra.run.smithi049.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-18T20:50:41.001 INFO:teuthology.orchestra.run.smithi049.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-18T20:50:41.002 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: Listen and drop on 0 v6wildcard [::]:123 2023-11-18T20:50:41.002 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-18T20:50:41.002 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: Listen normally on 2 lo 127.0.0.1:123 2023-11-18T20:50:41.002 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: Listen normally on 3 ens1f0 172.21.15.49:123 2023-11-18T20:50:41.002 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: Listen normally on 4 lo [::1]:123 2023-11-18T20:50:41.003 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1566%4]:123 2023-11-18T20:50:41.003 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:40 ntpd[27948]: Listening on routing socket on fd #22 for interface updates 2023-11-18T20:50:41.029 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-18T20:50:41.030 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: Command line: ntpd -gq 2023-11-18T20:50:41.030 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: ---------------------------------------------------- 2023-11-18T20:50:41.030 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: ntp-4 is maintained by Network Time Foundation, 2023-11-18T20:50:41.030 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-18T20:50:41.030 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: corporation. Support and training for ntp-4 are 2023-11-18T20:50:41.030 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: available at https://www.nwtime.org/support 2023-11-18T20:50:41.030 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: ---------------------------------------------------- 2023-11-18T20:50:41.031 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: proto: precision = 0.062 usec (-24) 2023-11-18T20:50:41.031 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: basedate set to 2022-02-04 2023-11-18T20:50:41.031 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: gps base set to 2022-02-06 (week 2196) 2023-11-18T20:50:41.031 INFO:teuthology.orchestra.run.smithi106.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-18T20:50:41.032 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-18T20:50:41.032 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: restrict ::: KOD does nothing without LIMITED. 2023-11-18T20:50:41.032 INFO:teuthology.orchestra.run.smithi106.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-18T20:50:41.033 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: Listen and drop on 0 v6wildcard [::]:123 2023-11-18T20:50:41.033 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-18T20:50:41.033 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: Listen normally on 2 lo 127.0.0.1:123 2023-11-18T20:50:41.033 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: Listen normally on 3 enp3s0f1 172.21.15.106:123 2023-11-18T20:50:41.033 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: Listen normally on 4 lo [::1]:123 2023-11-18T20:50:41.033 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce6d%5]:123 2023-11-18T20:50:41.033 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:41 ntpd[27970]: Listening on routing socket on fd #22 for interface updates 2023-11-18T20:50:41.998 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:41 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:41.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:41 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:41.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:41 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:41.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:41 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:41.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:41 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:41.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:41 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:41.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:41 ntpd[27948]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:41.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:41 ntpd[27948]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:41.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:41 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:41.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:41 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:41.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:41 ntpd[27948]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:41.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:41 ntpd[27948]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:42.998 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:42 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:42.998 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:42 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:42.998 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:42 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:42.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:42 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:42.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:42 ntpd[27948]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:42.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:42 ntpd[27948]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:43 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:43 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:43 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:43 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:43 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:43 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:43 ntpd[27948]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:43 ntpd[27948]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:43 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:43 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:43 ntpd[27948]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:44.001 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:43 ntpd[27948]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:44.998 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:44 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:44.998 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:44 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:44.998 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:44 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:44.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:44 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:44.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:44 ntpd[27948]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:44.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:44 ntpd[27948]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:45.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:45 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:45.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:45 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:45.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:45 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:45.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:45 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:45.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:45 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:45.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:45 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:45.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:45 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:45.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:45 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:45.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:45 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:45.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:45 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:45.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:45 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:45.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:45 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:45 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:45 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:45 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:45 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:45 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:45 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:45 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:45 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:45 ntpd[27948]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:45 ntpd[27948]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:45 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:45 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:45 ntpd[27948]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:45 ntpd[27948]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:46.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:46 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:46.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:46 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:46.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:46 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:46.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:46 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:46.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:46 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:46.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:46 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:46.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:46 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:46.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:46 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:46.998 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:46 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:46.998 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:46 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:46.998 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:46 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:46.998 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:46 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:46.998 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:46 ntpd[27948]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:46.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:46 ntpd[27948]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:47.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:47 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:47.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:47 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:47.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:47 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:47.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:47 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:47.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:47 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:47.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:47 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:47.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:47 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:47.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:47 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:47.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:47 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:47.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:47 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:47.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:47 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:47.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:47 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:47.998 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:47 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:47.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:47 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:47.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:47 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:47.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:47 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:47.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:47 ntpd[27948]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:47.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:47 ntpd[27948]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:47.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:47 ntpd[27948]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:47.999 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:47 ntpd[27948]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:47.999 INFO:teuthology.orchestra.run.smithi049.stdout:18 Nov 20:50:47 ntpd[27948]: ntpd: time slew -0.000694 s 2023-11-18T20:50:47.999 INFO:teuthology.orchestra.run.smithi049.stdout:ntpd: time slew -0.000694s 2023-11-18T20:50:48.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:47 ntpd[27948]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-18T20:50:48.000 INFO:teuthology.orchestra.run.smithi049.stderr:18 Nov 20:50:47 ntpd[27948]: can't open /var/log/ntpstats/loopstats.20231118: Permission denied 2023-11-18T20:50:48.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:48 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:48.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:48 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:48.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:48 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:48.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:48 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:48.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:48 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:48.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:48 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:48.140 INFO:teuthology.orchestra.run.smithi049.stdout: remote refid st t when poll reach delay offset jitter 2023-11-18T20:50:48.140 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================== 2023-11-18T20:50:48.140 INFO:teuthology.orchestra.run.smithi049.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-18T20:50:48.140 INFO:teuthology.orchestra.run.smithi049.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-18T20:50:48.140 INFO:teuthology.orchestra.run.smithi049.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-18T20:50:48.140 INFO:teuthology.orchestra.run.smithi049.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-18T20:50:49.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:49 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:49.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:49 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:49.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:49 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:49.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:49 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:49.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:49 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:49.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:49 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:49.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:49 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:49.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:49 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:49.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:49 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:49.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:49 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:49.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:49 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:49.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:49 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:50.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:50 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:50.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:50 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:50.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:50 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:50.030 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:50 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:50.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:50 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:50.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:50 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:51.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:51 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:51.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:51 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:51.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:51 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:51.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:51 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:51.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:51 ntpd[27970]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-18T20:50:51.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:51 ntpd[27970]: can't open /var/log/ntpstats/rawstats.20231118: Permission denied 2023-11-18T20:50:51.031 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:51 ntpd[27970]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-18T20:50:51.032 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:51 ntpd[27970]: can't open /var/log/ntpstats/peerstats.20231118: Permission denied 2023-11-18T20:50:51.032 INFO:teuthology.orchestra.run.smithi106.stdout:18 Nov 20:50:51 ntpd[27970]: ntpd: time slew -0.000412 s 2023-11-18T20:50:51.032 INFO:teuthology.orchestra.run.smithi106.stdout:ntpd: time slew -0.000412s 2023-11-18T20:50:51.033 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:51 ntpd[27970]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-18T20:50:51.033 INFO:teuthology.orchestra.run.smithi106.stderr:18 Nov 20:50:51 ntpd[27970]: can't open /var/log/ntpstats/loopstats.20231118: Permission denied 2023-11-18T20:50:51.188 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2023-11-18T20:50:51.188 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2023-11-18T20:50:51.189 INFO:teuthology.orchestra.run.smithi106.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-18T20:50:51.189 INFO:teuthology.orchestra.run.smithi106.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-18T20:50:51.189 INFO:teuthology.orchestra.run.smithi106.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-18T20:50:51.189 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-18T20:50:51.190 INFO:teuthology.run_tasks:Running task install... 2023-11-18T20:50:51.198 DEBUG:teuthology.task.install:project ceph 2023-11-18T20:50:51.198 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}} 2023-11-18T20:50:51.198 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'} 2023-11-18T20:50:51.198 INFO:teuthology.task.install:Using flavor: default 2023-11-18T20:50:51.203 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-11-18T20:50:51.204 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-18T20:50:51.204 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-key list | grep Ceph 2023-11-18T20:50:51.204 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-key list | grep Ceph 2023-11-18T20:50:51.269 INFO:teuthology.orchestra.run.smithi049.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-18T20:50:51.296 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-18T20:50:51.300 INFO:teuthology.orchestra.run.smithi049.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-18T20:50:51.300 INFO:teuthology.orchestra.run.smithi049.stdout:uid [ unknown] Ceph.com (release key) 2023-11-18T20:50:51.301 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-18T20:50:51.301 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-18T20:50:51.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T20:50:51.326 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-18T20:50:51.326 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph.com (release key) 2023-11-18T20:50:51.327 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-18T20:50:51.327 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-18T20:50:51.327 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T20:50:51.446 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default/ 2023-11-18T20:50:51.446 INFO:teuthology.task.install.deb:Package version is 18.0.0-7418-gb0f45a51-1jammy 2023-11-18T20:50:51.542 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default/ 2023-11-18T20:50:51.542 INFO:teuthology.task.install.deb:Package version is 18.0.0-7418-gb0f45a51-1jammy 2023-11-18T20:50:51.712 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:50:51.713 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-18T20:50:51.724 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:50:51.724 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-18T20:50:51.727 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get update 2023-11-18T20:50:51.738 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2023-11-18T20:50:51.899 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-18T20:50:51.909 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-18T20:50:51.910 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-18T20:50:51.926 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-18T20:50:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-18T20:50:52.024 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-18T20:50:52.106 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-18T20:50:52.166 INFO:teuthology.orchestra.run.smithi049.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy InRelease 2023-11-18T20:50:52.167 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy InRelease 2023-11-18T20:50:52.187 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-18T20:50:52.210 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-18T20:50:52.210 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-18T20:50:52.282 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-18T20:50:52.282 INFO:teuthology.orchestra.run.smithi049.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-18T20:50:52.348 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-18T20:50:52.349 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,403 B] 2023-11-18T20:50:52.431 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-18T20:50:52.511 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,403 B] 2023-11-18T20:50:52.599 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 28.5 kB in 1s (42.2 kB/s) 2023-11-18T20:50:52.606 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 28.5 kB in 1s (42.6 kB/s) 2023-11-18T20:50:53.508 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2023-11-18T20:50:53.524 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7418-gb0f45a51-1jammy cephadm=18.0.0-7418-gb0f45a51-1jammy ceph-mds=18.0.0-7418-gb0f45a51-1jammy ceph-mgr=18.0.0-7418-gb0f45a51-1jammy ceph-common=18.0.0-7418-gb0f45a51-1jammy ceph-fuse=18.0.0-7418-gb0f45a51-1jammy ceph-test=18.0.0-7418-gb0f45a51-1jammy ceph-volume=18.0.0-7418-gb0f45a51-1jammy radosgw=18.0.0-7418-gb0f45a51-1jammy python3-rados=18.0.0-7418-gb0f45a51-1jammy python3-rgw=18.0.0-7418-gb0f45a51-1jammy python3-cephfs=18.0.0-7418-gb0f45a51-1jammy python3-rbd=18.0.0-7418-gb0f45a51-1jammy libcephfs2=18.0.0-7418-gb0f45a51-1jammy libcephfs-dev=18.0.0-7418-gb0f45a51-1jammy librados2=18.0.0-7418-gb0f45a51-1jammy librbd1=18.0.0-7418-gb0f45a51-1jammy rbd-fuse=18.0.0-7418-gb0f45a51-1jammy ceph-common-dbg=18.0.0-7418-gb0f45a51-1jammy ceph-fuse-dbg=18.0.0-7418-gb0f45a51-1jammy ceph-mds-dbg=18.0.0-7418-gb0f45a51-1jammy ceph-mgr-dbg=18.0.0-7418-gb0f45a51-1jammy ceph-mon-dbg=18.0.0-7418-gb0f45a51-1jammy ceph-osd-dbg=18.0.0-7418-gb0f45a51-1jammy ceph-test-dbg=18.0.0-7418-gb0f45a51-1jammy libcephfs2-dbg=18.0.0-7418-gb0f45a51-1jammy librados2-dbg=18.0.0-7418-gb0f45a51-1jammy libradosstriper1-dbg=18.0.0-7418-gb0f45a51-1jammy librbd1-dbg=18.0.0-7418-gb0f45a51-1jammy librgw2-dbg=18.0.0-7418-gb0f45a51-1jammy radosgw-dbg=18.0.0-7418-gb0f45a51-1jammy rbd-fuse-dbg=18.0.0-7418-gb0f45a51-1jammy rbd-mirror-dbg=18.0.0-7418-gb0f45a51-1jammy rbd-nbd-dbg=18.0.0-7418-gb0f45a51-1jammy python3-cephfs=18.0.0-7418-gb0f45a51-1jammy cephfs-shell=18.0.0-7418-gb0f45a51-1jammy cephfs-top=18.0.0-7418-gb0f45a51-1jammy cephfs-mirror=18.0.0-7418-gb0f45a51-1jammy 2023-11-18T20:50:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2023-11-18T20:50:53.547 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7418-gb0f45a51-1jammy cephadm=18.0.0-7418-gb0f45a51-1jammy ceph-mds=18.0.0-7418-gb0f45a51-1jammy ceph-mgr=18.0.0-7418-gb0f45a51-1jammy ceph-common=18.0.0-7418-gb0f45a51-1jammy ceph-fuse=18.0.0-7418-gb0f45a51-1jammy ceph-test=18.0.0-7418-gb0f45a51-1jammy ceph-volume=18.0.0-7418-gb0f45a51-1jammy radosgw=18.0.0-7418-gb0f45a51-1jammy python3-rados=18.0.0-7418-gb0f45a51-1jammy python3-rgw=18.0.0-7418-gb0f45a51-1jammy python3-cephfs=18.0.0-7418-gb0f45a51-1jammy python3-rbd=18.0.0-7418-gb0f45a51-1jammy libcephfs2=18.0.0-7418-gb0f45a51-1jammy libcephfs-dev=18.0.0-7418-gb0f45a51-1jammy librados2=18.0.0-7418-gb0f45a51-1jammy librbd1=18.0.0-7418-gb0f45a51-1jammy rbd-fuse=18.0.0-7418-gb0f45a51-1jammy ceph-common-dbg=18.0.0-7418-gb0f45a51-1jammy ceph-fuse-dbg=18.0.0-7418-gb0f45a51-1jammy ceph-mds-dbg=18.0.0-7418-gb0f45a51-1jammy ceph-mgr-dbg=18.0.0-7418-gb0f45a51-1jammy ceph-mon-dbg=18.0.0-7418-gb0f45a51-1jammy ceph-osd-dbg=18.0.0-7418-gb0f45a51-1jammy ceph-test-dbg=18.0.0-7418-gb0f45a51-1jammy libcephfs2-dbg=18.0.0-7418-gb0f45a51-1jammy librados2-dbg=18.0.0-7418-gb0f45a51-1jammy libradosstriper1-dbg=18.0.0-7418-gb0f45a51-1jammy librbd1-dbg=18.0.0-7418-gb0f45a51-1jammy librgw2-dbg=18.0.0-7418-gb0f45a51-1jammy radosgw-dbg=18.0.0-7418-gb0f45a51-1jammy rbd-fuse-dbg=18.0.0-7418-gb0f45a51-1jammy rbd-mirror-dbg=18.0.0-7418-gb0f45a51-1jammy rbd-nbd-dbg=18.0.0-7418-gb0f45a51-1jammy python3-cephfs=18.0.0-7418-gb0f45a51-1jammy cephfs-shell=18.0.0-7418-gb0f45a51-1jammy cephfs-top=18.0.0-7418-gb0f45a51-1jammy cephfs-mirror=18.0.0-7418-gb0f45a51-1jammy 2023-11-18T20:50:53.587 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2023-11-18T20:50:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2023-11-18T20:50:53.775 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2023-11-18T20:50:53.776 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2023-11-18T20:50:53.793 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2023-11-18T20:50:53.794 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2023-11-18T20:50:53.952 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2023-11-18T20:50:53.952 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-18T20:50:53.953 INFO:teuthology.orchestra.run.smithi049.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-18T20:50:53.953 INFO:teuthology.orchestra.run.smithi049.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-18T20:50:53.953 INFO:teuthology.orchestra.run.smithi049.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-18T20:50:53.953 INFO:teuthology.orchestra.run.smithi049.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-18T20:50:53.953 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-18T20:50:53.954 INFO:teuthology.orchestra.run.smithi049.stdout:The following additional packages will be installed: 2023-11-18T20:50:53.954 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-18T20:50:53.955 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-18T20:50:53.955 INFO:teuthology.orchestra.run.smithi049.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-18T20:50:53.955 INFO:teuthology.orchestra.run.smithi049.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-18T20:50:53.955 INFO:teuthology.orchestra.run.smithi049.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-18T20:50:53.955 INFO:teuthology.orchestra.run.smithi049.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-18T20:50:53.955 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-18T20:50:53.955 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-18T20:50:53.955 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-18T20:50:53.955 INFO:teuthology.orchestra.run.smithi049.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-18T20:50:53.955 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-18T20:50:53.955 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-18T20:50:53.955 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-18T20:50:53.956 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-18T20:50:53.956 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-18T20:50:53.956 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-18T20:50:53.956 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-18T20:50:53.956 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-18T20:50:53.956 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-18T20:50:53.956 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-18T20:50:53.956 INFO:teuthology.orchestra.run.smithi049.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-18T20:50:53.956 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-18T20:50:53.956 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror rbd-nbd socat xmlstarlet 2023-11-18T20:50:53.957 INFO:teuthology.orchestra.run.smithi049.stdout:Suggested packages: 2023-11-18T20:50:53.957 INFO:teuthology.orchestra.run.smithi049.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-18T20:50:53.957 INFO:teuthology.orchestra.run.smithi049.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-18T20:50:53.957 INFO:teuthology.orchestra.run.smithi049.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-18T20:50:53.957 INFO:teuthology.orchestra.run.smithi049.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-18T20:50:53.957 INFO:teuthology.orchestra.run.smithi049.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-18T20:50:53.957 INFO:teuthology.orchestra.run.smithi049.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-18T20:50:53.957 INFO:teuthology.orchestra.run.smithi049.stdout: python3-watchdog 2023-11-18T20:50:53.958 INFO:teuthology.orchestra.run.smithi049.stdout:Recommended packages: 2023-11-18T20:50:53.958 INFO:teuthology.orchestra.run.smithi049.stdout: btrfs-tools 2023-11-18T20:50:53.959 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2023-11-18T20:50:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-18T20:50:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-18T20:50:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-18T20:50:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-18T20:50:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-18T20:50:53.960 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-18T20:50:53.960 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2023-11-18T20:50:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-18T20:50:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-18T20:50:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-18T20:50:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-18T20:50:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-18T20:50:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-18T20:50:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-18T20:50:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-18T20:50:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-18T20:50:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-18T20:50:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-18T20:50:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-18T20:50:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-18T20:50:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-18T20:50:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-18T20:50:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-18T20:50:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-18T20:50:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-18T20:50:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-18T20:50:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-18T20:50:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-18T20:50:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-18T20:50:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror rbd-nbd socat xmlstarlet 2023-11-18T20:50:53.962 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2023-11-18T20:50:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-18T20:50:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-18T20:50:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-18T20:50:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-18T20:50:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-18T20:50:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-18T20:50:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: python3-watchdog 2023-11-18T20:50:53.962 INFO:teuthology.orchestra.run.smithi106.stdout:Recommended packages: 2023-11-18T20:50:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: btrfs-tools 2023-11-18T20:50:54.081 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2023-11-18T20:50:54.081 INFO:teuthology.orchestra.run.smithi106.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2023-11-18T20:50:54.081 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2023-11-18T20:50:54.081 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2023-11-18T20:50:54.081 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2023-11-18T20:50:54.082 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2023-11-18T20:50:54.082 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2023-11-18T20:50:54.083 INFO:teuthology.orchestra.run.smithi106.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2023-11-18T20:50:54.083 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg librbd1 2023-11-18T20:50:54.083 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1-dbg librdkafka1 librgw2 librgw2-dbg libsqlite3-mod-ceph 2023-11-18T20:50:54.084 INFO:teuthology.orchestra.run.smithi106.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-11-18T20:50:54.084 INFO:teuthology.orchestra.run.smithi106.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-18T20:50:54.085 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-18T20:50:54.085 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-18T20:50:54.085 INFO:teuthology.orchestra.run.smithi106.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-18T20:50:54.085 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-18T20:50:54.085 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-18T20:50:54.085 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-18T20:50:54.086 INFO:teuthology.orchestra.run.smithi106.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-18T20:50:54.086 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-18T20:50:54.086 INFO:teuthology.orchestra.run.smithi106.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-18T20:50:54.086 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-18T20:50:54.089 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-18T20:50:54.089 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-18T20:50:54.089 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-18T20:50:54.089 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-18T20:50:54.089 INFO:teuthology.orchestra.run.smithi106.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-18T20:50:54.089 INFO:teuthology.orchestra.run.smithi106.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-18T20:50:54.089 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2023-11-18T20:50:54.089 INFO:teuthology.orchestra.run.smithi106.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2023-11-18T20:50:54.090 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd-dbg socat xmlstarlet 2023-11-18T20:50:54.091 INFO:teuthology.orchestra.run.smithi049.stdout:The following NEW packages will be installed: 2023-11-18T20:50:54.091 INFO:teuthology.orchestra.run.smithi049.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2023-11-18T20:50:54.091 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2023-11-18T20:50:54.091 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2023-11-18T20:50:54.092 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2023-11-18T20:50:54.092 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2023-11-18T20:50:54.093 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2023-11-18T20:50:54.093 INFO:teuthology.orchestra.run.smithi049.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2023-11-18T20:50:54.093 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg librbd1 2023-11-18T20:50:54.093 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-dbg librdkafka1 librgw2 librgw2-dbg libsqlite3-mod-ceph 2023-11-18T20:50:54.093 INFO:teuthology.orchestra.run.smithi049.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-11-18T20:50:54.093 INFO:teuthology.orchestra.run.smithi049.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-18T20:50:54.093 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-18T20:50:54.093 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-18T20:50:54.093 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-18T20:50:54.093 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-18T20:50:54.093 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-18T20:50:54.094 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-18T20:50:54.094 INFO:teuthology.orchestra.run.smithi049.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-18T20:50:54.094 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-18T20:50:54.094 INFO:teuthology.orchestra.run.smithi049.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-18T20:50:54.094 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-18T20:50:54.094 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-18T20:50:54.094 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-18T20:50:54.094 INFO:teuthology.orchestra.run.smithi049.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-18T20:50:54.094 INFO:teuthology.orchestra.run.smithi049.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-18T20:50:54.094 INFO:teuthology.orchestra.run.smithi049.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-18T20:50:54.094 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-18T20:50:54.094 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2023-11-18T20:50:54.095 INFO:teuthology.orchestra.run.smithi049.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2023-11-18T20:50:54.095 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-dbg socat xmlstarlet 2023-11-18T20:50:54.269 INFO:teuthology.orchestra.run.smithi106.stdout:0 upgraded, 132 newly installed, 0 to remove and 260 not upgraded. 2023-11-18T20:50:54.269 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 3,014 MB of archives. 2023-11-18T20:50:54.269 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 3,953 MB of additional disk space will be used. 2023-11-18T20:50:54.269 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-18T20:50:54.281 INFO:teuthology.orchestra.run.smithi049.stdout:0 upgraded, 132 newly installed, 0 to remove and 260 not upgraded. 2023-11-18T20:50:54.282 INFO:teuthology.orchestra.run.smithi049.stdout:Need to get 3,014 MB of archives. 2023-11-18T20:50:54.282 INFO:teuthology.orchestra.run.smithi049.stdout:After this operation, 3,953 MB of additional disk space will be used. 2023-11-18T20:50:54.282 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-18T20:50:54.322 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7418-gb0f45a51-1jammy [3,467 kB] 2023-11-18T20:50:54.351 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-18T20:50:54.364 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-18T20:50:54.397 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-18T20:50:54.410 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-18T20:50:54.420 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7418-gb0f45a51-1jammy [3,467 kB] 2023-11-18T20:50:54.592 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-18T20:50:54.605 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-18T20:50:54.691 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-18T20:50:54.703 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-18T20:50:54.704 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-18T20:50:54.716 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-18T20:50:54.756 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-18T20:50:54.768 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-18T20:50:54.908 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7418-gb0f45a51-1jammy [3,112 kB] 2023-11-18T20:50:54.930 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-18T20:50:54.939 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-18T20:50:54.944 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-18T20:50:54.952 INFO:teuthology.orchestra.run.smithi049.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-18T20:50:54.968 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-18T20:50:54.977 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-18T20:50:54.981 INFO:teuthology.orchestra.run.smithi049.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-18T20:50:54.990 INFO:teuthology.orchestra.run.smithi049.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-18T20:50:55.119 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7418-gb0f45a51-1jammy [691 kB] 2023-11-18T20:50:55.141 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-18T20:50:55.155 INFO:teuthology.orchestra.run.smithi049.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-18T20:50:55.158 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7418-gb0f45a51-1jammy [356 kB] 2023-11-18T20:50:55.165 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7418-gb0f45a51-1jammy [32.8 kB] 2023-11-18T20:50:55.178 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7418-gb0f45a51-1jammy [180 kB] 2023-11-18T20:50:55.182 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7418-gb0f45a51-1jammy [63.5 kB] 2023-11-18T20:50:55.183 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7418-gb0f45a51-1jammy [330 kB] 2023-11-18T20:50:55.201 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7418-gb0f45a51-1jammy [6,230 kB] 2023-11-18T20:50:55.443 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7418-gb0f45a51-1jammy [112 kB] 2023-11-18T20:50:55.445 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7418-gb0f45a51-1jammy [439 kB] 2023-11-18T20:50:55.459 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7418-gb0f45a51-1jammy [22.6 MB] 2023-11-18T20:50:55.474 INFO:teuthology.orchestra.run.smithi049.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7418-gb0f45a51-1jammy [3,112 kB] 2023-11-18T20:50:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-18T20:50:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-18T20:50:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-18T20:50:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-18T20:50:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-18T20:50:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-18T20:50:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-18T20:50:55.723 INFO:teuthology.orchestra.run.smithi049.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-18T20:50:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-18T20:50:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-18T20:50:55.726 INFO:teuthology.orchestra.run.smithi049.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-18T20:50:55.729 INFO:teuthology.orchestra.run.smithi049.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-18T20:50:55.734 INFO:teuthology.orchestra.run.smithi049.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-18T20:50:55.734 INFO:teuthology.orchestra.run.smithi049.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-18T20:50:55.735 INFO:teuthology.orchestra.run.smithi049.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-18T20:50:55.736 INFO:teuthology.orchestra.run.smithi049.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-18T20:50:55.738 INFO:teuthology.orchestra.run.smithi049.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-18T20:50:55.739 INFO:teuthology.orchestra.run.smithi049.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-18T20:50:55.789 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-18T20:50:55.805 INFO:teuthology.orchestra.run.smithi049.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-18T20:50:55.972 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-18T20:50:55.987 INFO:teuthology.orchestra.run.smithi049.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-18T20:50:56.081 INFO:teuthology.orchestra.run.smithi049.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7418-gb0f45a51-1jammy [691 kB] 2023-11-18T20:50:56.174 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-18T20:50:56.187 INFO:teuthology.orchestra.run.smithi049.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-18T20:50:56.203 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-18T20:50:56.217 INFO:teuthology.orchestra.run.smithi049.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-18T20:50:56.221 INFO:teuthology.orchestra.run.smithi049.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7418-gb0f45a51-1jammy [356 kB] 2023-11-18T20:50:56.228 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-18T20:50:56.241 INFO:teuthology.orchestra.run.smithi049.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-18T20:50:56.296 INFO:teuthology.orchestra.run.smithi049.stdout:Get:31 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7418-gb0f45a51-1jammy [32.8 kB] 2023-11-18T20:50:56.299 INFO:teuthology.orchestra.run.smithi049.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7418-gb0f45a51-1jammy [180 kB] 2023-11-18T20:50:56.331 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-18T20:50:56.341 INFO:teuthology.orchestra.run.smithi049.stdout:Get:33 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7418-gb0f45a51-1jammy [63.5 kB] 2023-11-18T20:50:56.345 INFO:teuthology.orchestra.run.smithi049.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-18T20:50:56.345 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-18T20:50:56.353 INFO:teuthology.orchestra.run.smithi049.stdout:Get:35 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7418-gb0f45a51-1jammy [330 kB] 2023-11-18T20:50:56.358 INFO:teuthology.orchestra.run.smithi049.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-18T20:50:56.366 INFO:teuthology.orchestra.run.smithi049.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-18T20:50:56.417 INFO:teuthology.orchestra.run.smithi049.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7418-gb0f45a51-1jammy [6,230 kB] 2023-11-18T20:50:56.417 INFO:teuthology.orchestra.run.smithi049.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-18T20:50:56.420 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-18T20:50:56.421 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7418-gb0f45a51-1jammy [6,900 kB] 2023-11-18T20:50:56.422 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-18T20:50:56.432 INFO:teuthology.orchestra.run.smithi106.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-18T20:50:56.441 INFO:teuthology.orchestra.run.smithi106.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-18T20:50:56.445 INFO:teuthology.orchestra.run.smithi049.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-18T20:50:56.454 INFO:teuthology.orchestra.run.smithi049.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-18T20:50:56.567 INFO:teuthology.orchestra.run.smithi106.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-18T20:50:56.568 INFO:teuthology.orchestra.run.smithi049.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-18T20:50:56.649 INFO:teuthology.orchestra.run.smithi106.stdout:Get:47 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7418-gb0f45a51-1jammy [238 kB] 2023-11-18T20:50:56.652 INFO:teuthology.orchestra.run.smithi106.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7418-gb0f45a51-1jammy [124 kB] 2023-11-18T20:50:56.654 INFO:teuthology.orchestra.run.smithi106.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7418-gb0f45a51-1jammy [1,496 kB] 2023-11-18T20:50:56.699 INFO:teuthology.orchestra.run.smithi106.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7418-gb0f45a51-1jammy [9,955 kB] 2023-11-18T20:50:56.731 INFO:teuthology.orchestra.run.smithi106.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-18T20:50:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-18T20:50:56.915 INFO:teuthology.orchestra.run.smithi106.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-18T20:50:56.917 INFO:teuthology.orchestra.run.smithi049.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-18T20:50:56.964 INFO:teuthology.orchestra.run.smithi106.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-18T20:50:56.966 INFO:teuthology.orchestra.run.smithi049.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-18T20:50:57.097 INFO:teuthology.orchestra.run.smithi106.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-18T20:50:57.099 INFO:teuthology.orchestra.run.smithi049.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-18T20:50:57.105 INFO:teuthology.orchestra.run.smithi106.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7418-gb0f45a51-1jammy [31.8 MB] 2023-11-18T20:50:57.189 INFO:teuthology.orchestra.run.smithi106.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-18T20:50:57.191 INFO:teuthology.orchestra.run.smithi049.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-18T20:50:57.207 INFO:teuthology.orchestra.run.smithi106.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-18T20:50:57.210 INFO:teuthology.orchestra.run.smithi049.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-18T20:50:57.236 INFO:teuthology.orchestra.run.smithi106.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-18T20:50:57.238 INFO:teuthology.orchestra.run.smithi049.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-18T20:50:57.248 INFO:teuthology.orchestra.run.smithi106.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-18T20:50:57.250 INFO:teuthology.orchestra.run.smithi049.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-18T20:50:57.287 INFO:teuthology.orchestra.run.smithi106.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-18T20:50:57.289 INFO:teuthology.orchestra.run.smithi049.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-18T20:50:57.294 INFO:teuthology.orchestra.run.smithi106.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-18T20:50:57.297 INFO:teuthology.orchestra.run.smithi049.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-18T20:50:57.323 INFO:teuthology.orchestra.run.smithi106.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-18T20:50:57.326 INFO:teuthology.orchestra.run.smithi049.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-18T20:50:57.486 INFO:teuthology.orchestra.run.smithi049.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7418-gb0f45a51-1jammy [112 kB] 2023-11-18T20:50:57.505 INFO:teuthology.orchestra.run.smithi049.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7418-gb0f45a51-1jammy [439 kB] 2023-11-18T20:50:57.580 INFO:teuthology.orchestra.run.smithi049.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7418-gb0f45a51-1jammy [22.6 MB] 2023-11-18T20:50:57.708 INFO:teuthology.orchestra.run.smithi106.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-18T20:50:57.710 INFO:teuthology.orchestra.run.smithi049.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-18T20:50:58.025 INFO:teuthology.orchestra.run.smithi106.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-18T20:50:58.028 INFO:teuthology.orchestra.run.smithi049.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-18T20:50:58.112 INFO:teuthology.orchestra.run.smithi106.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-18T20:50:58.118 INFO:teuthology.orchestra.run.smithi049.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-18T20:50:58.136 INFO:teuthology.orchestra.run.smithi106.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-18T20:50:58.144 INFO:teuthology.orchestra.run.smithi049.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-18T20:50:58.147 INFO:teuthology.orchestra.run.smithi106.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-18T20:50:58.155 INFO:teuthology.orchestra.run.smithi049.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-18T20:50:58.197 INFO:teuthology.orchestra.run.smithi106.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-18T20:50:58.204 INFO:teuthology.orchestra.run.smithi049.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-18T20:50:58.455 INFO:teuthology.orchestra.run.smithi049.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-18T20:50:58.464 INFO:teuthology.orchestra.run.smithi049.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-18T20:50:58.466 INFO:teuthology.orchestra.run.smithi049.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-18T20:50:58.476 INFO:teuthology.orchestra.run.smithi106.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-18T20:50:58.531 INFO:teuthology.orchestra.run.smithi049.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-18T20:50:58.531 INFO:teuthology.orchestra.run.smithi049.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-18T20:50:58.552 INFO:teuthology.orchestra.run.smithi106.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-18T20:50:58.552 INFO:teuthology.orchestra.run.smithi106.stdout:Get:71 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7418-gb0f45a51-1jammy [14.0 kB] 2023-11-18T20:50:58.553 INFO:teuthology.orchestra.run.smithi106.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-18T20:50:58.553 INFO:teuthology.orchestra.run.smithi106.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7418-gb0f45a51-1jammy [839 kB] 2023-11-18T20:50:58.569 INFO:teuthology.orchestra.run.smithi106.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7418-gb0f45a51-1jammy [2,144 kB] 2023-11-18T20:50:58.594 INFO:teuthology.orchestra.run.smithi106.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-18T20:50:58.594 INFO:teuthology.orchestra.run.smithi106.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-18T20:50:58.608 INFO:teuthology.orchestra.run.smithi106.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7418-gb0f45a51-1jammy [801 kB] 2023-11-18T20:50:58.619 INFO:teuthology.orchestra.run.smithi106.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7418-gb0f45a51-1jammy [139 kB] 2023-11-18T20:50:58.621 INFO:teuthology.orchestra.run.smithi106.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7418-gb0f45a51-1jammy [1,900 kB] 2023-11-18T20:50:58.654 INFO:teuthology.orchestra.run.smithi106.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7418-gb0f45a51-1jammy [8,625 kB] 2023-11-18T20:50:58.697 INFO:teuthology.orchestra.run.smithi049.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-18T20:50:58.759 INFO:teuthology.orchestra.run.smithi106.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-18T20:50:58.893 INFO:teuthology.orchestra.run.smithi049.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-18T20:50:58.942 INFO:teuthology.orchestra.run.smithi049.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-18T20:50:58.954 INFO:teuthology.orchestra.run.smithi106.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-18T20:50:59.004 INFO:teuthology.orchestra.run.smithi106.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-18T20:50:59.004 INFO:teuthology.orchestra.run.smithi106.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7418-gb0f45a51-1jammy [14.2 kB] 2023-11-18T20:50:59.005 INFO:teuthology.orchestra.run.smithi106.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7418-gb0f45a51-1jammy [48.6 MB] 2023-11-18T20:50:59.006 INFO:teuthology.orchestra.run.smithi049.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-18T20:50:59.039 INFO:teuthology.orchestra.run.smithi049.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-18T20:50:59.067 INFO:teuthology.orchestra.run.smithi106.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-18T20:50:59.074 INFO:teuthology.orchestra.run.smithi049.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-18T20:50:59.100 INFO:teuthology.orchestra.run.smithi106.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-18T20:50:59.135 INFO:teuthology.orchestra.run.smithi106.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-18T20:50:59.225 INFO:teuthology.orchestra.run.smithi049.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-18T20:50:59.260 INFO:teuthology.orchestra.run.smithi049.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-18T20:50:59.283 INFO:teuthology.orchestra.run.smithi049.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-18T20:50:59.285 INFO:teuthology.orchestra.run.smithi106.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-18T20:50:59.291 INFO:teuthology.orchestra.run.smithi049.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-18T20:50:59.321 INFO:teuthology.orchestra.run.smithi106.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-18T20:50:59.331 INFO:teuthology.orchestra.run.smithi049.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-18T20:50:59.343 INFO:teuthology.orchestra.run.smithi106.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-18T20:50:59.351 INFO:teuthology.orchestra.run.smithi106.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-18T20:50:59.391 INFO:teuthology.orchestra.run.smithi106.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-18T20:50:59.518 INFO:teuthology.orchestra.run.smithi049.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-18T20:50:59.577 INFO:teuthology.orchestra.run.smithi106.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-18T20:50:59.696 INFO:teuthology.orchestra.run.smithi049.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-18T20:50:59.758 INFO:teuthology.orchestra.run.smithi106.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-18T20:51:00.037 INFO:teuthology.orchestra.run.smithi049.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-18T20:51:00.098 INFO:teuthology.orchestra.run.smithi106.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-18T20:51:00.099 INFO:teuthology.orchestra.run.smithi049.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-18T20:51:00.099 INFO:teuthology.orchestra.run.smithi049.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-18T20:51:00.107 INFO:teuthology.orchestra.run.smithi049.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-18T20:51:00.110 INFO:teuthology.orchestra.run.smithi049.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-18T20:51:00.128 INFO:teuthology.orchestra.run.smithi049.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-18T20:51:00.136 INFO:teuthology.orchestra.run.smithi049.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-18T20:51:00.159 INFO:teuthology.orchestra.run.smithi106.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-18T20:51:00.160 INFO:teuthology.orchestra.run.smithi106.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-18T20:51:00.168 INFO:teuthology.orchestra.run.smithi106.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-18T20:51:00.170 INFO:teuthology.orchestra.run.smithi106.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-18T20:51:00.189 INFO:teuthology.orchestra.run.smithi106.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-18T20:51:00.196 INFO:teuthology.orchestra.run.smithi049.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-18T20:51:00.197 INFO:teuthology.orchestra.run.smithi106.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-18T20:51:00.198 INFO:teuthology.orchestra.run.smithi049.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-18T20:51:00.257 INFO:teuthology.orchestra.run.smithi106.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-18T20:51:00.258 INFO:teuthology.orchestra.run.smithi106.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-18T20:51:00.363 INFO:teuthology.orchestra.run.smithi049.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-18T20:51:00.423 INFO:teuthology.orchestra.run.smithi106.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-18T20:51:00.798 INFO:teuthology.orchestra.run.smithi049.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-18T20:51:00.812 INFO:teuthology.orchestra.run.smithi049.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-18T20:51:00.858 INFO:teuthology.orchestra.run.smithi106.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-18T20:51:00.873 INFO:teuthology.orchestra.run.smithi106.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-18T20:51:01.197 INFO:teuthology.orchestra.run.smithi106.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7418-gb0f45a51-1jammy [121 kB] 2023-11-18T20:51:01.199 INFO:teuthology.orchestra.run.smithi106.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7418-gb0f45a51-1jammy [226 kB] 2023-11-18T20:51:01.204 INFO:teuthology.orchestra.run.smithi106.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7418-gb0f45a51-1jammy [34.0 kB] 2023-11-18T20:51:01.205 INFO:teuthology.orchestra.run.smithi106.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7418-gb0f45a51-1jammy [23.4 kB] 2023-11-18T20:51:01.207 INFO:teuthology.orchestra.run.smithi106.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7418-gb0f45a51-1jammy [38.3 kB] 2023-11-18T20:51:01.208 INFO:teuthology.orchestra.run.smithi106.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7418-gb0f45a51-1jammy [12.3 MB] 2023-11-18T20:51:01.308 INFO:teuthology.orchestra.run.smithi049.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7418-gb0f45a51-1jammy [6,900 kB] 2023-11-18T20:51:01.557 INFO:teuthology.orchestra.run.smithi106.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7418-gb0f45a51-1jammy [91.2 kB] 2023-11-18T20:51:01.559 INFO:teuthology.orchestra.run.smithi106.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 18.0.0-7418-gb0f45a51-1jammy [3,048 kB] 2023-11-18T20:51:01.677 INFO:teuthology.orchestra.run.smithi106.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 18.0.0-7418-gb0f45a51-1jammy [180 kB] 2023-11-18T20:51:01.682 INFO:teuthology.orchestra.run.smithi106.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [691 MB] 2023-11-18T20:51:02.561 INFO:teuthology.orchestra.run.smithi049.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7418-gb0f45a51-1jammy [238 kB] 2023-11-18T20:51:02.608 INFO:teuthology.orchestra.run.smithi049.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7418-gb0f45a51-1jammy [124 kB] 2023-11-18T20:51:02.617 INFO:teuthology.orchestra.run.smithi049.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7418-gb0f45a51-1jammy [1,496 kB] 2023-11-18T20:51:03.814 INFO:teuthology.orchestra.run.smithi049.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7418-gb0f45a51-1jammy [9,955 kB] 2023-11-18T20:51:06.000 INFO:teuthology.orchestra.run.smithi049.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7418-gb0f45a51-1jammy [31.8 MB] 2023-11-18T20:51:11.514 INFO:teuthology.orchestra.run.smithi049.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7418-gb0f45a51-1jammy [14.0 kB] 2023-11-18T20:51:11.514 INFO:teuthology.orchestra.run.smithi049.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7418-gb0f45a51-1jammy [839 kB] 2023-11-18T20:51:11.529 INFO:teuthology.orchestra.run.smithi049.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7418-gb0f45a51-1jammy [2,144 kB] 2023-11-18T20:51:11.800 INFO:teuthology.orchestra.run.smithi049.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7418-gb0f45a51-1jammy [801 kB] 2023-11-18T20:51:11.905 INFO:teuthology.orchestra.run.smithi049.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7418-gb0f45a51-1jammy [139 kB] 2023-11-18T20:51:11.918 INFO:teuthology.orchestra.run.smithi049.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7418-gb0f45a51-1jammy [1,900 kB] 2023-11-18T20:51:12.168 INFO:teuthology.orchestra.run.smithi049.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7418-gb0f45a51-1jammy [8,625 kB] 2023-11-18T20:51:13.295 INFO:teuthology.orchestra.run.smithi049.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7418-gb0f45a51-1jammy [14.2 kB] 2023-11-18T20:51:13.295 INFO:teuthology.orchestra.run.smithi049.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7418-gb0f45a51-1jammy [48.6 MB] 2023-11-18T20:51:17.808 INFO:teuthology.orchestra.run.smithi049.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7418-gb0f45a51-1jammy [121 kB] 2023-11-18T20:51:17.811 INFO:teuthology.orchestra.run.smithi049.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7418-gb0f45a51-1jammy [226 kB] 2023-11-18T20:51:17.816 INFO:teuthology.orchestra.run.smithi049.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7418-gb0f45a51-1jammy [34.0 kB] 2023-11-18T20:51:17.817 INFO:teuthology.orchestra.run.smithi049.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7418-gb0f45a51-1jammy [23.4 kB] 2023-11-18T20:51:17.818 INFO:teuthology.orchestra.run.smithi049.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7418-gb0f45a51-1jammy [38.3 kB] 2023-11-18T20:51:17.866 INFO:teuthology.orchestra.run.smithi049.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7418-gb0f45a51-1jammy [12.3 MB] 2023-11-18T20:51:18.636 INFO:teuthology.orchestra.run.smithi049.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7418-gb0f45a51-1jammy [91.2 kB] 2023-11-18T20:51:18.638 INFO:teuthology.orchestra.run.smithi049.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 18.0.0-7418-gb0f45a51-1jammy [3,048 kB] 2023-11-18T20:51:18.866 INFO:teuthology.orchestra.run.smithi049.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 18.0.0-7418-gb0f45a51-1jammy [180 kB] 2023-11-18T20:51:18.875 INFO:teuthology.orchestra.run.smithi049.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [691 MB] 2023-11-18T20:51:41.934 INFO:teuthology.orchestra.run.smithi106.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [17.3 MB] 2023-11-18T20:51:42.907 INFO:teuthology.orchestra.run.smithi106.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [75.6 MB] 2023-11-18T20:51:48.509 INFO:teuthology.orchestra.run.smithi106.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [39.8 MB] 2023-11-18T20:51:51.545 INFO:teuthology.orchestra.run.smithi106.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [47.8 MB] 2023-11-18T20:51:54.766 INFO:teuthology.orchestra.run.smithi106.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [247 MB] 2023-11-18T20:52:16.283 INFO:teuthology.orchestra.run.smithi106.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [916 MB] 2023-11-18T20:52:16.432 INFO:teuthology.orchestra.run.smithi049.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [17.3 MB] 2023-11-18T20:52:17.544 INFO:teuthology.orchestra.run.smithi049.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [75.6 MB] 2023-11-18T20:52:23.508 INFO:teuthology.orchestra.run.smithi049.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [39.8 MB] 2023-11-18T20:52:26.530 INFO:teuthology.orchestra.run.smithi049.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [47.8 MB] 2023-11-18T20:52:29.922 INFO:teuthology.orchestra.run.smithi049.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [247 MB] 2023-11-18T20:52:49.009 INFO:teuthology.orchestra.run.smithi049.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [916 MB] 2023-11-18T20:53:17.910 INFO:teuthology.orchestra.run.smithi106.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [15.6 MB] 2023-11-18T20:53:18.730 INFO:teuthology.orchestra.run.smithi106.stdout:Get:125 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [79.1 MB] 2023-11-18T20:53:23.702 INFO:teuthology.orchestra.run.smithi106.stdout:Get:126 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [10.5 MB] 2023-11-18T20:53:24.071 INFO:teuthology.orchestra.run.smithi106.stdout:Get:127 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [98.5 MB] 2023-11-18T20:53:31.239 INFO:teuthology.orchestra.run.smithi106.stdout:Get:128 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [166 MB] 2023-11-18T20:53:41.379 INFO:teuthology.orchestra.run.smithi106.stdout:Get:129 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [324 MB] 2023-11-18T20:53:55.244 INFO:teuthology.orchestra.run.smithi049.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [15.6 MB] 2023-11-18T20:53:56.745 INFO:teuthology.orchestra.run.smithi049.stdout:Get:125 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [79.1 MB] 2023-11-18T20:54:02.634 INFO:teuthology.orchestra.run.smithi049.stdout:Get:126 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [10.5 MB] 2023-11-18T20:54:02.884 INFO:teuthology.orchestra.run.smithi049.stdout:Get:127 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [98.5 MB] 2023-11-18T20:54:02.970 INFO:teuthology.orchestra.run.smithi106.stdout:Get:130 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [1,684 kB] 2023-11-18T20:54:03.001 INFO:teuthology.orchestra.run.smithi106.stdout:Get:131 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [93.5 MB] 2023-11-18T20:54:09.403 INFO:teuthology.orchestra.run.smithi106.stdout:Get:132 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [2,947 kB] 2023-11-18T20:54:09.680 INFO:teuthology.orchestra.run.smithi049.stdout:Get:128 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [166 MB] 2023-11-18T20:54:10.070 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 3,014 MB in 3min 15s (15.4 MB/s) 2023-11-18T20:54:10.212 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-18T20:54:10.311 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165983 files and directories currently installed.) 2023-11-18T20:54:10.316 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-18T20:54:10.361 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-18T20:54:10.663 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-18T20:54:10.689 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-18T20:54:10.730 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-18T20:54:11.050 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cmd2. 2023-11-18T20:54:11.075 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-18T20:54:11.116 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-18T20:54:11.544 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-18T20:54:11.570 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-18T20:54:11.644 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-18T20:54:11.990 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-18T20:54:12.016 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-18T20:54:12.048 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-18T20:54:12.384 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-18T20:54:12.411 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-18T20:54:12.451 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-18T20:54:12.896 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-18T20:54:12.926 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-18T20:54:12.970 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-18T20:54:13.374 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-18T20:54:13.401 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-18T20:54:13.441 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-18T20:54:13.794 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-18T20:54:13.821 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-18T20:54:13.861 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-18T20:54:14.214 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-18T20:54:14.240 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-18T20:54:14.289 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-18T20:54:14.550 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librados2. 2023-11-18T20:54:14.577 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../010-librados2_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:14.616 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librados2 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:15.061 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librbd1. 2023-11-18T20:54:15.088 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../011-librbd1_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librbd1 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:15.580 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs2. 2023-11-18T20:54:15.607 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:15.656 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs2 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:15.849 INFO:teuthology.orchestra.run.smithi049.stdout:Get:129 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [324 MB] 2023-11-18T20:54:15.933 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rados. 2023-11-18T20:54:15.960 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:15.991 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rados (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:16.294 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-18T20:54:16.321 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:54:16.361 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-argparse (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:16.638 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cephfs. 2023-11-18T20:54:16.665 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:16.713 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cephfs (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:17.100 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-18T20:54:17.126 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:54:17.174 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-common (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:17.561 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-prettytable. 2023-11-18T20:54:17.588 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-18T20:54:17.628 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-18T20:54:17.888 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rbd. 2023-11-18T20:54:17.915 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:17.955 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rbd (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:18.350 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-18T20:54:18.377 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-18T20:54:18.425 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-18T20:54:18.844 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librgw2. 2023-11-18T20:54:18.874 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../020-librgw2_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:18.919 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librgw2 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:19.613 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rgw. 2023-11-18T20:54:19.629 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:19.671 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rgw (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:19.991 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-18T20:54:20.018 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-18T20:54:20.058 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-18T20:54:20.427 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libradosstriper1. 2023-11-18T20:54:20.454 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:20.502 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libradosstriper1 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:21.022 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-common. 2023-11-18T20:54:21.049 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:21.088 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-common (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:22.445 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-base. 2023-11-18T20:54:22.472 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:22.529 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-base (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:23.249 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-18T20:54:23.276 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-18T20:54:23.316 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-18T20:54:23.569 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cheroot. 2023-11-18T20:54:23.584 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-18T20:54:23.618 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-18T20:54:23.930 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-18T20:54:23.957 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-18T20:54:23.996 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-18T20:54:24.308 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-18T20:54:24.335 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-18T20:54:24.374 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-18T20:54:24.677 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-18T20:54:24.704 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-18T20:54:24.744 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-18T20:54:25.005 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempora. 2023-11-18T20:54:25.032 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-18T20:54:25.063 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-18T20:54:25.400 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-portend. 2023-11-18T20:54:25.426 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-18T20:54:25.466 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-18T20:54:25.769 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-18T20:54:25.796 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-18T20:54:25.835 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-18T20:54:26.105 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-18T20:54:26.131 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-18T20:54:26.163 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-18T20:54:26.492 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-natsort. 2023-11-18T20:54:26.519 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-18T20:54:26.559 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-18T20:54:26.862 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-logutils. 2023-11-18T20:54:26.888 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-18T20:54:26.928 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-18T20:54:27.231 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-18T20:54:27.257 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-18T20:54:27.298 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-18T20:54:27.551 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-mako. 2023-11-18T20:54:27.577 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-18T20:54:27.609 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-18T20:54:27.929 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-18T20:54:27.945 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-18T20:54:27.987 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-18T20:54:28.088 INFO:teuthology.orchestra.run.smithi049.stdout:Get:130 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [1,684 kB] 2023-11-18T20:54:28.120 INFO:teuthology.orchestra.run.smithi049.stdout:Get:131 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [93.5 MB] 2023-11-18T20:54:28.290 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-18T20:54:28.317 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-18T20:54:28.357 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-18T20:54:28.676 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webob. 2023-11-18T20:54:28.702 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-18T20:54:28.743 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-18T20:54:29.054 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-waitress. 2023-11-18T20:54:29.080 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-18T20:54:29.115 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-18T20:54:29.441 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempita. 2023-11-18T20:54:29.467 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-18T20:54:29.507 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-18T20:54:29.793 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-paste. 2023-11-18T20:54:29.820 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-18T20:54:29.860 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-18T20:54:30.188 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-18T20:54:30.204 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-18T20:54:30.246 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-18T20:54:30.558 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-18T20:54:30.584 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-18T20:54:30.624 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-18T20:54:30.868 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webtest. 2023-11-18T20:54:30.884 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-18T20:54:30.918 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-18T20:54:31.188 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pecan. 2023-11-18T20:54:31.215 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-18T20:54:31.255 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-18T20:54:31.593 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-certifi. 2023-11-18T20:54:31.609 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-18T20:54:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:Get:132 https://4.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 18.0.0-7418-gb0f45a51-1jammy [2,947 kB] 2023-11-18T20:54:31.643 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-18T20:54:31.971 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-idna. 2023-11-18T20:54:31.998 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-18T20:54:32.037 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-18T20:54:32.349 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-urllib3. 2023-11-18T20:54:32.364 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 3,014 MB in 3min 38s (13.9 MB/s) 2023-11-18T20:54:32.375 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-18T20:54:32.424 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-18T20:54:32.510 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-18T20:54:32.612 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165983 files and directories currently installed.) 2023-11-18T20:54:32.617 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-18T20:54:32.666 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-18T20:54:32.743 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-requests. 2023-11-18T20:54:32.770 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-18T20:54:32.810 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-18T20:54:32.961 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-18T20:54:32.988 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-18T20:54:33.028 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-18T20:54:33.088 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-18T20:54:33.103 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-18T20:54:33.138 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-18T20:54:33.347 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cmd2. 2023-11-18T20:54:33.374 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-18T20:54:33.414 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-18T20:54:33.433 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-18T20:54:33.459 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:54:33.499 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:33.766 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-18T20:54:33.793 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-18T20:54:33.829 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-18T20:54:33.856 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:33.875 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-18T20:54:33.895 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:34.207 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-openssl. 2023-11-18T20:54:34.233 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-18T20:54:34.273 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-18T20:54:34.303 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-18T20:54:34.330 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-18T20:54:34.362 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-18T20:54:34.570 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr. 2023-11-18T20:54:34.597 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:34.628 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-18T20:54:34.708 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-18T20:54:34.748 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-18T20:54:34.982 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mon. 2023-11-18T20:54:35.008 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:35.048 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mon (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:35.185 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-18T20:54:35.211 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-18T20:54:35.260 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-18T20:54:35.596 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-18T20:54:35.620 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-18T20:54:35.654 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-18T20:54:35.974 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-18T20:54:35.994 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-osd. 2023-11-18T20:54:36.000 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-18T20:54:36.020 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:36.040 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-18T20:54:36.060 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-osd (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:36.394 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-18T20:54:36.420 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-18T20:54:36.460 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-18T20:54:36.813 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librados2. 2023-11-18T20:54:36.840 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../010-librados2_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:36.879 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librados2 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:37.440 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librbd1. 2023-11-18T20:54:37.467 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../011-librbd1_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:37.507 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librbd1 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:37.888 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph. 2023-11-18T20:54:37.903 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../060-ceph_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:37.938 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:37.952 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcephfs2. 2023-11-18T20:54:37.978 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:38.018 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcephfs2 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:38.224 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-fuse. 2023-11-18T20:54:38.251 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:38.290 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-fuse (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:38.296 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rados. 2023-11-18T20:54:38.322 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:38.362 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rados (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:38.656 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-18T20:54:38.672 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:54:38.686 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mds. 2023-11-18T20:54:38.706 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-ceph-argparse (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:38.712 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:38.752 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mds (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:38.925 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cephfs. 2023-11-18T20:54:38.941 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:39.000 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cephfs (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:39.114 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephadm. 2023-11-18T20:54:39.140 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../063-cephadm_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:39.180 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephadm (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:39.312 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-18T20:54:39.338 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:54:39.378 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-ceph-common (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:39.458 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-18T20:54:39.485 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-18T20:54:39.525 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-18T20:54:39.648 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-prettytable. 2023-11-18T20:54:39.674 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-18T20:54:39.714 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-18T20:54:39.828 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-18T20:54:39.852 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-18T20:54:39.886 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-18T20:54:39.967 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rbd. 2023-11-18T20:54:39.982 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:40.025 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rbd (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:40.378 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-18T20:54:40.405 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-18T20:54:40.445 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-18T20:54:40.764 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librgw2. 2023-11-18T20:54:40.791 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../020-librgw2_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:40.831 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librgw2 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:40.908 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-babel. 2023-11-18T20:54:40.935 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-18T20:54:40.974 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-18T20:54:41.278 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jinja2. 2023-11-18T20:54:41.304 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-18T20:54:41.316 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rgw. 2023-11-18T20:54:41.332 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:41.344 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-18T20:54:41.366 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rgw (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:41.681 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-18T20:54:41.708 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:54:41.711 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-18T20:54:41.738 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-18T20:54:41.747 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:41.777 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-18T20:54:42.088 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libradosstriper1. 2023-11-18T20:54:42.109 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-18T20:54:42.115 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:42.136 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-18T20:54:42.155 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libradosstriper1 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:42.176 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-18T20:54:42.470 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-18T20:54:42.483 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-common. 2023-11-18T20:54:42.497 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-18T20:54:42.499 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:42.533 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-common (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:42.537 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-18T20:54:42.782 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-routes. 2023-11-18T20:54:42.797 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-18T20:54:42.831 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-18T20:54:43.177 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-18T20:54:43.204 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:54:43.243 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:43.680 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-18T20:54:43.696 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-18T20:54:43.738 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-18T20:54:43.897 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-base. 2023-11-18T20:54:43.924 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:43.973 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-base (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:44.267 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-joblib. 2023-11-18T20:54:44.294 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-18T20:54:44.333 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-18T20:54:44.651 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-18T20:54:44.667 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-18T20:54:44.671 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-18T20:54:44.698 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-18T20:54:44.710 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-18T20:54:44.729 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-18T20:54:45.015 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn. 2023-11-18T20:54:45.038 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cheroot. 2023-11-18T20:54:45.043 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-18T20:54:45.065 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-18T20:54:45.081 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-18T20:54:45.104 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-18T20:54:45.390 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-18T20:54:45.417 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-18T20:54:45.448 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-18T20:54:45.710 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-18T20:54:45.736 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-18T20:54:45.765 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-18T20:54:45.776 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-18T20:54:45.781 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:54:45.823 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:46.088 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-18T20:54:46.115 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-18T20:54:46.154 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-18T20:54:46.457 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-tempora. 2023-11-18T20:54:46.484 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-18T20:54:46.523 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-18T20:54:46.776 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-portend. 2023-11-18T20:54:46.792 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-18T20:54:46.818 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cachetools. 2023-11-18T20:54:46.826 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-18T20:54:46.846 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-18T20:54:46.884 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-18T20:54:47.129 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-18T20:54:47.156 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-18T20:54:47.188 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-18T20:54:47.195 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-18T20:54:47.214 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-18T20:54:47.254 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-18T20:54:47.498 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-18T20:54:47.525 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-18T20:54:47.565 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-18T20:54:47.599 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-18T20:54:47.626 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-18T20:54:47.665 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-18T20:54:47.902 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-natsort. 2023-11-18T20:54:47.929 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-18T20:54:47.976 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rsa. 2023-11-18T20:54:47.977 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-18T20:54:48.003 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-18T20:54:48.043 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-18T20:54:48.288 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-logutils. 2023-11-18T20:54:48.305 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-google-auth. 2023-11-18T20:54:48.315 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-18T20:54:48.332 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-18T20:54:48.355 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-18T20:54:48.363 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-18T20:54:48.657 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-18T20:54:48.684 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-18T20:54:48.740 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-18T20:54:48.793 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-18T20:54:48.820 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-18T20:54:48.859 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-18T20:54:49.018 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-mako. 2023-11-18T20:54:49.045 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-18T20:54:49.077 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-18T20:54:49.171 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-websocket. 2023-11-18T20:54:49.198 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-18T20:54:49.238 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-18T20:54:49.380 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-18T20:54:49.407 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-18T20:54:49.446 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-18T20:54:49.558 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-18T20:54:49.585 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-18T20:54:49.624 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-18T20:54:49.749 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-18T20:54:49.776 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-18T20:54:49.816 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-18T20:54:50.118 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-webob. 2023-11-18T20:54:50.145 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-18T20:54:50.185 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-18T20:54:50.230 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-18T20:54:50.258 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:54:50.296 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:50.505 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-waitress. 2023-11-18T20:54:50.532 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-18T20:54:50.575 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-18T20:54:50.824 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-18T20:54:50.849 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-tempita. 2023-11-18T20:54:50.851 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-18T20:54:50.876 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-18T20:54:50.882 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-18T20:54:50.907 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-18T20:54:51.193 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-paste. 2023-11-18T20:54:51.219 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-18T20:54:51.220 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-18T20:54:51.246 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-18T20:54:51.260 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-18T20:54:51.294 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-18T20:54:51.547 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-18T20:54:51.547 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package jq. 2023-11-18T20:54:51.563 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-18T20:54:51.573 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-18T20:54:51.596 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-18T20:54:51.613 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-18T20:54:51.857 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-18T20:54:51.882 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package socat. 2023-11-18T20:54:51.885 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-18T20:54:51.910 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-18T20:54:51.924 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-18T20:54:51.949 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-18T20:54:52.227 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-webtest. 2023-11-18T20:54:52.227 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package xmlstarlet. 2023-11-18T20:54:52.243 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-18T20:54:52.254 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-18T20:54:52.277 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-18T20:54:52.293 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-18T20:54:52.605 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pecan. 2023-11-18T20:54:52.615 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-test. 2023-11-18T20:54:52.632 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-18T20:54:52.642 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:52.671 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-18T20:54:52.681 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-test (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:53.026 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-certifi. 2023-11-18T20:54:53.053 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-18T20:54:53.092 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-18T20:54:53.422 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-idna. 2023-11-18T20:54:53.450 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-18T20:54:53.489 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-18T20:54:53.800 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-urllib3. 2023-11-18T20:54:53.827 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-18T20:54:53.867 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-18T20:54:54.170 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-requests. 2023-11-18T20:54:54.197 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-18T20:54:54.236 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-18T20:54:54.556 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-18T20:54:54.583 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-18T20:54:54.622 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-18T20:54:54.925 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-18T20:54:54.953 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:54:54.960 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-volume. 2023-11-18T20:54:54.976 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:54:54.992 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:55.010 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-volume (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:55.372 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-18T20:54:55.399 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:55.414 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-18T20:54:55.438 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:55.442 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:55.481 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephfs-mirror (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:55.741 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-openssl. 2023-11-18T20:54:55.767 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-colorama. 2023-11-18T20:54:55.768 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-18T20:54:55.783 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-18T20:54:55.807 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-18T20:54:55.817 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-18T20:54:56.037 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephfs-shell. 2023-11-18T20:54:56.052 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:54:56.095 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephfs-shell (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:56.127 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr. 2023-11-18T20:54:56.154 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:56.193 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:56.364 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephfs-top. 2023-11-18T20:54:56.397 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:54:56.423 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephfs-top (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:56.555 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mon. 2023-11-18T20:54:56.582 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:56.613 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mon (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:56.676 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-18T20:54:56.691 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:56.734 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs-dev (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:57.037 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package nvme-cli. 2023-11-18T20:54:57.064 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-18T20:54:57.095 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-18T20:54:57.434 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-18T20:54:57.461 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-18T20:54:57.500 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-18T20:54:57.550 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-osd. 2023-11-18T20:54:57.578 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:57.617 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-osd (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:57.937 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-18T20:54:57.964 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-18T20:54:58.003 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-18T20:54:58.247 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastescript. 2023-11-18T20:54:58.263 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-18T20:54:58.297 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-18T20:54:58.609 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pluggy. 2023-11-18T20:54:58.636 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-18T20:54:58.676 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-18T20:54:59.004 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-psutil. 2023-11-18T20:54:59.031 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-18T20:54:59.070 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-18T20:54:59.407 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-py. 2023-11-18T20:54:59.434 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-18T20:54:59.473 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-18T20:54:59.511 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph. 2023-11-18T20:54:59.538 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../060-ceph_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:59.577 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:54:59.776 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pygments. 2023-11-18T20:54:59.804 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-18T20:54:59.843 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-18T20:54:59.889 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-fuse. 2023-11-18T20:54:59.916 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:54:59.955 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-fuse (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:00.289 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-18T20:55:00.301 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mds. 2023-11-18T20:55:00.316 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-18T20:55:00.327 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:00.355 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-18T20:55:00.366 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mds (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:00.666 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-toml. 2023-11-18T20:55:00.694 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-18T20:55:00.733 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-18T20:55:00.753 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephadm. 2023-11-18T20:55:00.780 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../063-cephadm_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:00.819 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephadm (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:01.036 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pytest. 2023-11-18T20:55:01.063 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-18T20:55:01.102 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-18T20:55:01.156 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-18T20:55:01.183 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-18T20:55:01.222 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-18T20:55:01.456 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplejson. 2023-11-18T20:55:01.483 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-18T20:55:01.522 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-18T20:55:01.525 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-18T20:55:01.541 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-18T20:55:01.583 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-18T20:55:01.817 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-18T20:55:01.833 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-18T20:55:01.892 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-18T20:55:02.572 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-babel. 2023-11-18T20:55:02.589 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-18T20:55:02.613 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package radosgw. 2023-11-18T20:55:02.622 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-18T20:55:02.640 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../112-radosgw_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:02.679 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking radosgw (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:02.891 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jinja2. 2023-11-18T20:55:02.908 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-18T20:55:03.133 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-18T20:55:03.423 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-fuse. 2023-11-18T20:55:03.439 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:03.473 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-fuse (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:03.486 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-18T20:55:03.514 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:55:03.553 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:03.793 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-mirror. 2023-11-18T20:55:03.821 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../114-rbd-mirror_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:03.859 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-mirror (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:03.881 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-18T20:55:03.909 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-18T20:55:03.948 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-18T20:55:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-18T20:55:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-18T20:55:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-18T20:55:04.312 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-nbd. 2023-11-18T20:55:04.329 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../115-rbd-nbd_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:04.370 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-nbd (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:04.578 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-routes. 2023-11-18T20:55:04.605 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-18T20:55:04.640 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-common-dbg. 2023-11-18T20:55:04.645 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-18T20:55:04.668 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../116-ceph-common-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:04.706 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-common-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-18T20:55:04.993 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:55:05.031 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:05.493 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-18T20:55:05.509 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-18T20:55:05.543 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-18T20:55:05.980 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-joblib. 2023-11-18T20:55:06.008 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-18T20:55:06.047 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-18T20:55:06.375 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-18T20:55:06.392 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-18T20:55:06.425 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-18T20:55:06.728 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-sklearn. 2023-11-18T20:55:06.755 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-18T20:55:06.794 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-18T20:55:07.578 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-18T20:55:07.606 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:55:07.636 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:08.597 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cachetools. 2023-11-18T20:55:08.625 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-18T20:55:08.664 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-18T20:55:08.950 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-18T20:55:08.977 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-18T20:55:09.016 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-18T20:55:09.378 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-18T20:55:09.405 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-18T20:55:09.444 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-18T20:55:09.772 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rsa. 2023-11-18T20:55:09.800 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-18T20:55:09.838 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-18T20:55:10.159 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-google-auth. 2023-11-18T20:55:10.187 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-18T20:55:10.217 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-18T20:55:10.605 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-18T20:55:10.633 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-18T20:55:10.672 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-18T20:55:10.966 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-websocket. 2023-11-18T20:55:10.994 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-18T20:55:11.033 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-18T20:55:11.353 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-18T20:55:11.380 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-18T20:55:11.419 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-18T20:55:11.894 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-fuse-dbg. 2023-11-18T20:55:11.921 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../117-ceph-fuse-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:11.960 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-fuse-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:12.083 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-18T20:55:12.100 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:55:12.133 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:12.404 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mds-dbg. 2023-11-18T20:55:12.420 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../118-ceph-mds-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:12.427 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-18T20:55:12.455 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-18T20:55:12.462 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mds-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:12.493 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-18T20:55:12.839 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-18T20:55:12.867 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-18T20:55:12.905 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-18T20:55:13.166 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package jq. 2023-11-18T20:55:13.182 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-18T20:55:13.224 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-18T20:55:13.448 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-dbg. 2023-11-18T20:55:13.464 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../119-ceph-mgr-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:13.468 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package socat. 2023-11-18T20:55:13.485 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-18T20:55:13.506 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:13.527 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-18T20:55:13.838 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package xmlstarlet. 2023-11-18T20:55:13.866 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-18T20:55:13.905 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-18T20:55:14.184 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mon-dbg. 2023-11-18T20:55:14.211 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../120-ceph-mon-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:14.226 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-test. 2023-11-18T20:55:14.242 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:14.250 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mon-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:14.283 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-test (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-osd-dbg. 2023-11-18T20:55:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../121-ceph-osd-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-osd-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:16.754 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-volume. 2023-11-18T20:55:16.782 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:55:16.820 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-volume (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:17.183 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-18T20:55:17.204 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:17.241 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephfs-mirror (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:17.503 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-colorama. 2023-11-18T20:55:17.531 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-18T20:55:17.578 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-18T20:55:17.847 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephfs-shell. 2023-11-18T20:55:17.864 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:55:17.905 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephfs-shell (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:18.125 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephfs-top. 2023-11-18T20:55:18.142 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7418-gb0f45a51-1jammy_all.deb ... 2023-11-18T20:55:18.175 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephfs-top (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:18.264 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-test-dbg. 2023-11-18T20:55:18.280 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../122-ceph-test-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:18.314 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-test-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:18.419 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-18T20:55:18.435 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:18.477 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcephfs-dev (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package nvme-cli. 2023-11-18T20:55:18.875 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-18T20:55:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-18T20:55:19.252 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-18T20:55:19.280 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-18T20:55:19.318 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-18T20:55:19.738 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-18T20:55:19.766 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-18T20:55:19.813 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-18T20:55:20.116 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pastescript. 2023-11-18T20:55:20.144 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-18T20:55:20.182 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-18T20:55:20.519 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pluggy. 2023-11-18T20:55:20.547 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-18T20:55:20.585 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-18T20:55:20.896 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-psutil. 2023-11-18T20:55:20.925 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-18T20:55:20.971 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-18T20:55:21.325 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-py. 2023-11-18T20:55:21.353 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-18T20:55:21.399 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-18T20:55:21.727 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pygments. 2023-11-18T20:55:21.756 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-18T20:55:21.794 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-18T20:55:22.240 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-18T20:55:22.268 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-18T20:55:22.306 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-18T20:55:22.617 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-toml. 2023-11-18T20:55:22.646 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-18T20:55:22.683 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-18T20:55:22.986 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pytest. 2023-11-18T20:55:23.015 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-18T20:55:23.053 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-18T20:55:23.406 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-simplejson. 2023-11-18T20:55:23.435 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-18T20:55:23.473 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-18T20:55:23.742 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-18T20:55:23.759 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-18T20:55:23.800 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-18T20:55:24.529 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package radosgw. 2023-11-18T20:55:24.558 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../112-radosgw_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:24.595 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking radosgw (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:25.415 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package rbd-fuse. 2023-11-18T20:55:25.432 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:25.473 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking rbd-fuse (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:25.801 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package rbd-mirror. 2023-11-18T20:55:25.829 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../114-rbd-mirror_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:25.867 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking rbd-mirror (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:26.237 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package rbd-nbd. 2023-11-18T20:55:26.253 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../115-rbd-nbd_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:26.287 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking rbd-nbd (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:26.531 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-common-dbg. 2023-11-18T20:55:26.548 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../116-ceph-common-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:26.581 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-common-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:27.346 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs2-dbg. 2023-11-18T20:55:27.374 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../123-libcephfs2-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:27.413 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs2-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:27.857 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librados2-dbg. 2023-11-18T20:55:27.884 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../124-librados2-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:27.923 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librados2-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:29.026 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libradosstriper1-dbg. 2023-11-18T20:55:29.054 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../125-libradosstriper1-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:29.093 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libradosstriper1-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:29.445 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librbd1-dbg. 2023-11-18T20:55:29.461 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../126-librbd1-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:29.495 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librbd1-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:30.589 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librgw2-dbg. 2023-11-18T20:55:32.116 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../127-librgw2-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:32.117 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librgw2-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:32.599 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package radosgw-dbg. 2023-11-18T20:55:32.615 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../128-radosgw-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:32.658 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking radosgw-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:33.692 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-fuse-dbg. 2023-11-18T20:55:33.709 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../117-ceph-fuse-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:33.742 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-fuse-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:34.478 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mds-dbg. 2023-11-18T20:55:34.494 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../118-ceph-mds-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:34.527 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mds-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:35.472 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-dbg. 2023-11-18T20:55:35.488 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../119-ceph-mgr-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:35.530 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:35.919 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-fuse-dbg. 2023-11-18T20:55:35.946 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../129-rbd-fuse-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:35.985 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-fuse-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:36.182 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mon-dbg. 2023-11-18T20:55:36.199 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../120-ceph-mon-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:36.240 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mon-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:36.263 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-mirror-dbg. 2023-11-18T20:55:36.279 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../130-rbd-mirror-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:36.313 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-mirror-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:37.110 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-osd-dbg. 2023-11-18T20:55:37.135 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../121-ceph-osd-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:37.176 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-osd-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:37.440 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-nbd-dbg. 2023-11-18T20:55:37.456 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../131-rbd-nbd-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:37.490 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-nbd-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:37.821 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-18T20:55:38.095 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-18T20:55:38.221 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-18T20:55:38.462 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-18T20:55:38.797 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-18T20:55:39.232 INFO:teuthology.orchestra.run.smithi106.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-18T20:55:39.315 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephadm (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:39.858 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user cephadm....done 2023-11-18T20:55:39.996 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-18T20:55:40.171 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-test-dbg. 2023-11-18T20:55:40.187 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../122-ceph-test-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:40.229 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-test-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:40.281 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-18T20:55:40.523 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-18T20:55:40.649 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-18T20:55:40.903 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-18T20:55:41.154 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-18T20:55:41.255 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-18T20:55:41.531 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-18T20:55:41.883 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-18T20:55:42.143 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-18T20:55:42.603 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-18T20:55:42.887 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-18T20:55:43.130 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-18T20:55:43.381 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-18T20:55:43.715 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-argparse (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:43.975 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-18T20:55:44.101 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-18T20:55:44.377 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-18T20:55:44.645 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-18T20:55:44.754 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-18T20:55:45.122 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-18T20:55:45.231 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-18T20:55:45.482 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-18T20:55:45.742 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-18T20:55:46.043 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-18T20:55:46.761 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-18T20:55:47.013 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-18T20:55:47.139 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-18T20:55:47.239 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-18T20:55:47.515 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-18T20:55:47.892 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-18T20:55:48.143 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-18T20:55:48.536 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-18T20:55:48.821 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-18T20:55:49.130 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-18T20:55:49.152 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcephfs2-dbg. 2023-11-18T20:55:49.181 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../123-libcephfs2-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:49.219 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcephfs2-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:49.448 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-18T20:55:49.663 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librados2-dbg. 2023-11-18T20:55:49.679 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../124-librados2-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:49.699 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-18T20:55:49.721 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librados2-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:49.842 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-common (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:50.135 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-idna (3.3-1) ... 2023-11-18T20:55:50.486 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-18T20:55:50.698 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libradosstriper1-dbg. 2023-11-18T20:55:50.727 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../125-libradosstriper1-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:50.765 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libradosstriper1-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:51.150 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librbd1-dbg. 2023-11-18T20:55:51.167 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../126-librbd1-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:51.200 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librbd1-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:51.608 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-18T20:55:51.742 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-18T20:55:52.052 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-18T20:55:52.178 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-18T20:55:52.287 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-18T20:55:52.378 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librgw2-dbg. 2023-11-18T20:55:52.395 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../127-librgw2-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:52.436 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librgw2-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:52.589 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-18T20:55:52.831 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-18T20:55:53.066 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-18T20:55:53.192 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-18T20:55:53.501 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-18T20:55:53.761 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-18T20:55:54.020 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-18T20:55:54.205 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package radosgw-dbg. 2023-11-18T20:55:54.233 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../128-radosgw-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:54.263 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-18T20:55:54.271 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking radosgw-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:54.506 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-18T20:55:54.765 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-18T20:55:54.891 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-18T20:55:55.167 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-18T20:55:55.293 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-18T20:55:55.586 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-18T20:55:55.887 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-18T20:55:56.122 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-18T20:55:56.502 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-18T20:55:56.741 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-18T20:55:56.867 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-18T20:55:57.268 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-18T20:55:57.490 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package rbd-fuse-dbg. 2023-11-18T20:55:57.507 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../129-rbd-fuse-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:57.528 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-18T20:55:57.540 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking rbd-fuse-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:57.779 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-18T20:55:57.784 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package rbd-mirror-dbg. 2023-11-18T20:55:57.803 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../130-rbd-mirror-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:57.851 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking rbd-mirror-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:57.880 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-18T20:55:58.189 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-18T20:55:58.483 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-18T20:55:58.758 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-18T20:55:58.884 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-18T20:55:59.012 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package rbd-nbd-dbg. 2023-11-18T20:55:59.029 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../131-rbd-nbd-dbg_18.0.0-7418-gb0f45a51-1jammy_amd64.deb ... 2023-11-18T20:55:59.070 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking rbd-nbd-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:55:59.169 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-18T20:55:59.400 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-18T20:55:59.445 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-18T20:55:59.658 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-18T20:55:59.696 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-18T20:55:59.761 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-18T20:56:00.035 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-18T20:56:00.073 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-18T20:56:00.365 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-18T20:56:00.416 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-18T20:56:00.693 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-18T20:56:00.818 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librados2 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:00.886 INFO:teuthology.orchestra.run.smithi049.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-18T20:56:00.945 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librgw2 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:00.963 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephadm (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:01.062 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:01.274 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librgw2-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:01.400 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs2 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:01.526 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libradosstriper1 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:01.582 INFO:teuthology.orchestra.run.smithi049.stdout:Adding system user cephadm....done 2023-11-18T20:56:01.652 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-18T20:56:01.729 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-18T20:56:01.945 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librados2-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:02.063 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librbd1 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:02.181 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs2-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:02.282 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-modules-core (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:02.348 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-18T20:56:02.408 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-fuse (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:02.615 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-18T20:56:02.623 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-18T20:56:02.623 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-18T20:56:02.725 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-18T20:56:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-18T20:56:03.159 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libradosstriper1-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:03.235 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-18T20:56:03.285 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs-dev (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:03.370 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-18T20:56:03.420 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-fuse-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:03.562 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rados (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:03.663 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephfs-top (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:03.680 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-18T20:56:03.764 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-18T20:56:04.057 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-18T20:56:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-18T20:56:04.535 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-18T20:56:04.819 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-18T20:56:04.985 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librbd1-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:05.136 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rbd (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:05.262 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-fuse (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:05.380 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-nbd (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:05.404 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-18T20:56:05.489 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rgw (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:05.590 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cephfs (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:05.671 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-18T20:56:05.716 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-nbd-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:05.842 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephfs-shell (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:05.939 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-ceph-argparse (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:05.968 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-fuse-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:06.102 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-common (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:06.206 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-18T20:56:06.324 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-18T20:56:06.584 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-18T20:56:06.604 INFO:teuthology.orchestra.run.smithi106.stdout:Adding group ceph....done 2023-11-18T20:56:06.826 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-18T20:56:06.921 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user ceph....done 2023-11-18T20:56:06.961 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-18T20:56:07.109 INFO:teuthology.orchestra.run.smithi106.stdout:Setting system user ceph properties....done 2023-11-18T20:56:07.124 INFO:teuthology.orchestra.run.smithi106.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-18T20:56:07.263 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-18T20:56:07.354 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-18T20:56:07.480 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-18T20:56:07.636 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-18T20:56:07.747 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-18T20:56:08.015 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-18T20:56:08.195 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephfs-mirror (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:08.300 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-18T20:56:08.401 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-18T20:56:08.402 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-18T20:56:08.905 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-test (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:08.985 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-18T20:56:09.014 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up radosgw (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:09.253 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-18T20:56:09.379 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-18T20:56:09.457 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-18T20:56:09.457 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-18T20:56:09.505 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-18T20:56:09.814 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-18T20:56:09.966 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-base (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:10.215 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-18T20:56:10.450 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-18T20:56:10.686 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-18T20:56:10.827 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-18T20:56:11.128 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-18T20:56:11.252 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mds (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:11.446 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-18T20:56:11.470 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-18T20:56:11.470 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-18T20:56:11.814 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-18T20:56:12.012 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-common-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:12.073 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-18T20:56:12.113 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-mirror (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:12.183 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-ceph-common (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:12.309 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T20:56:12.309 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T20:56:12.467 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-idna (3.3-1) ... 2023-11-18T20:56:12.785 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-18T20:56:12.839 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:13.044 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-18T20:56:13.044 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-18T20:56:13.566 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mds-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:13.692 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up radosgw-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:13.818 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-test-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:13.944 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-osd (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:14.016 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-18T20:56:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-18T20:56:14.245 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-18T20:56:14.245 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-18T20:56:14.376 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-18T20:56:14.511 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-18T20:56:14.637 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-18T20:56:14.821 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:14.930 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-osd-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:14.946 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-18T20:56:15.040 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-mirror-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:15.174 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:15.214 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-18T20:56:15.300 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:15.451 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mon (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:15.465 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-18T20:56:15.566 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-18T20:56:15.665 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-18T20:56:15.665 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-18T20:56:15.868 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-18T20:56:16.161 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-18T20:56:16.227 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-cephadm (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:16.378 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:16.429 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-18T20:56:16.487 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-dashboard (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:16.614 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mon-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:16.688 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-18T20:56:16.714 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-volume (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:16.947 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-18T20:56:17.051 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-18T20:56:17.223 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-18T20:56:17.324 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-18T20:56:17.592 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-18T20:56:17.718 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-18T20:56:18.028 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-18T20:56:18.052 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-18T20:56:18.338 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-18T20:56:18.605 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-18T20:56:18.674 INFO:teuthology.orchestra.run.smithi106.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-18T20:56:18.677 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-18T20:56:18.729 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2023-11-18T20:56:18.916 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2023-11-18T20:56:18.916 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2023-11-18T20:56:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-18T20:56:19.084 INFO:teuthology.orchestra.run.smithi106.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-18T20:56:19.084 INFO:teuthology.orchestra.run.smithi106.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-18T20:56:19.084 INFO:teuthology.orchestra.run.smithi106.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-18T20:56:19.084 INFO:teuthology.orchestra.run.smithi106.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-18T20:56:19.084 INFO:teuthology.orchestra.run.smithi106.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-18T20:56:19.084 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2023-11-18T20:56:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-18T20:56:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-18T20:56:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-18T20:56:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-18T20:56:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-18T20:56:19.085 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-18T20:56:19.086 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2023-11-18T20:56:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-18T20:56:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-18T20:56:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-18T20:56:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-18T20:56:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-18T20:56:19.087 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2023-11-18T20:56:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-18T20:56:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-18T20:56:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: libengine-pkcs11-openssl 2023-11-18T20:56:19.127 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2023-11-18T20:56:19.128 INFO:teuthology.orchestra.run.smithi106.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-18T20:56:19.128 INFO:teuthology.orchestra.run.smithi106.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-18T20:56:19.128 INFO:teuthology.orchestra.run.smithi106.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-18T20:56:19.128 INFO:teuthology.orchestra.run.smithi106.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-18T20:56:19.129 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-18T20:56:19.129 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-18T20:56:19.129 INFO:teuthology.orchestra.run.smithi106.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-18T20:56:19.130 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages will be upgraded: 2023-11-18T20:56:19.130 INFO:teuthology.orchestra.run.smithi106.stdout: libssl3 2023-11-18T20:56:19.250 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-18T20:56:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:1 upgraded, 39 newly installed, 0 to remove and 259 not upgraded. 2023-11-18T20:56:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 54.6 MB of archives. 2023-11-18T20:56:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-18T20:56:19.312 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-18T20:56:19.368 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-18T20:56:19.761 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-18T20:56:19.789 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-18T20:56:20.037 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-18T20:56:20.046 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-18T20:56:20.081 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-18T20:56:20.083 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-18T20:56:20.088 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-18T20:56:20.091 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-18T20:56:20.092 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-18T20:56:20.095 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-18T20:56:20.097 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-18T20:56:20.263 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-18T20:56:20.263 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-18T20:56:20.313 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-18T20:56:20.439 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-18T20:56:20.508 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-18T20:56:20.765 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-18T20:56:21.049 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-18T20:56:21.309 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-18T20:56:21.435 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-18T20:56:21.647 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-18T20:56:21.652 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-18T20:56:21.652 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-18T20:56:21.659 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-18T20:56:21.660 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-18T20:56:21.670 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-18T20:56:21.674 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-18T20:56:21.691 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-18T20:56:21.720 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-18T20:56:21.856 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-18T20:56:21.996 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-18T20:56:22.264 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-18T20:56:22.575 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-18T20:56:22.576 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-18T20:56:22.602 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-18T20:56:22.657 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-18T20:56:22.680 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-18T20:56:22.687 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-18T20:56:22.689 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-18T20:56:22.689 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-18T20:56:22.690 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-18T20:56:22.719 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-18T20:56:22.723 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-18T20:56:22.941 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-18T20:56:23.285 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-18T20:56:23.379 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-18T20:56:23.395 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librados2 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:23.462 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-18T20:56:23.463 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-18T20:56:23.463 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-18T20:56:23.521 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librgw2 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:23.553 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-18T20:56:23.558 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-18T20:56:23.647 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:23.850 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librgw2-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:23.993 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcephfs2 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:24.014 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-18T20:56:24.017 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-18T20:56:24.144 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libradosstriper1 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:24.245 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-18T20:56:24.417 INFO:teuthology.orchestra.run.smithi106.stdout:Preconfiguring packages ... 2023-11-18T20:56:24.530 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librados2-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:24.581 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 54.6 MB in 5s (11.2 MB/s) 2023-11-18T20:56:24.648 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librbd1 (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:24.720 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package flex. 2023-11-18T20:56:24.749 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcephfs2-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:24.819 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173176 files and directories currently installed.) 2023-11-18T20:56:24.824 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-18T20:56:24.850 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-modules-core (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:24.876 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-18T20:56:24.976 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-fuse (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:25.239 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-18T20:56:25.239 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-18T20:56:25.459 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-18T20:56:25.599 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-18T20:56:25.795 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libradosstriper1-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:25.921 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcephfs-dev (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:26.025 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-18T20:56:26.047 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-fuse-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:26.173 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rados (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:26.274 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephfs-top (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:26.375 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-18T20:56:26.525 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package bison. 2023-11-18T20:56:26.626 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173249 files and directories currently installed.) 2023-11-18T20:56:26.632 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-18T20:56:26.677 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-18T20:56:27.044 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-18T20:56:27.072 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-18T20:56:27.102 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-18T20:56:27.430 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package dump. 2023-11-18T20:56:27.458 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-18T20:56:27.497 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking dump (0.4b47-3) ... 2023-11-18T20:56:27.663 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librbd1-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:27.767 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package indent. 2023-11-18T20:56:27.783 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-18T20:56:27.789 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rbd (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:27.825 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-18T20:56:27.915 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up rbd-fuse (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:28.041 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up rbd-nbd (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:28.103 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-18T20:56:28.119 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-18T20:56:28.161 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-18T20:56:28.186 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rgw (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:28.352 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cephfs (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:28.461 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up rbd-nbd-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:28.549 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-18T20:56:28.570 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephfs-shell (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:28.577 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-18T20:56:28.615 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-18T20:56:28.696 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up rbd-fuse-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:28.806 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-common (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:28.884 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-18T20:56:28.900 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-18T20:56:28.942 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-18T20:56:29.221 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-18T20:56:29.249 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-18T20:56:29.279 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-18T20:56:29.340 INFO:teuthology.orchestra.run.smithi049.stdout:Adding group ceph....done 2023-11-18T20:56:29.481 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-18T20:56:29.498 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-18T20:56:29.539 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-18T20:56:29.717 INFO:teuthology.orchestra.run.smithi049.stdout:Adding system user ceph....done 2023-11-18T20:56:29.792 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjson-perl. 2023-11-18T20:56:29.808 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-18T20:56:29.850 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-18T20:56:29.860 INFO:teuthology.orchestra.run.smithi049.stdout:Setting system user ceph properties....done 2023-11-18T20:56:29.874 INFO:teuthology.orchestra.run.smithi049.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-18T20:56:30.026 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-18T20:56:30.145 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-18T20:56:30.173 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-18T20:56:30.212 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-18T20:56:30.381 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-18T20:56:30.982 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephfs-mirror (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:31.202 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-18T20:56:31.202 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-18T20:56:31.742 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-test (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:31.873 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-18T20:56:31.876 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up radosgw (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:31.900 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-18T20:56:31.931 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-18T20:56:32.175 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-18T20:56:32.202 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-18T20:56:32.241 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-18T20:56:32.388 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-18T20:56:32.389 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-18T20:56:32.569 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-18T20:56:32.597 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-18T20:56:32.636 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-18T20:56:32.929 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-base (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:32.989 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-18T20:56:33.017 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-18T20:56:33.055 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-18T20:56:33.310 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-18T20:56:33.366 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-18T20:56:33.391 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-18T20:56:33.424 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-18T20:56:33.819 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-18T20:56:33.847 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-18T20:56:33.886 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-18T20:56:33.927 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mds (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:34.247 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-18T20:56:34.275 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-18T20:56:34.282 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-18T20:56:34.282 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-18T20:56:34.313 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-18T20:56:34.599 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-18T20:56:34.615 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-18T20:56:34.649 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-18T20:56:34.860 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-18T20:56:34.866 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-common-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:34.888 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-18T20:56:34.926 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-18T20:56:34.992 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up rbd-mirror (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:35.212 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T20:56:35.212 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T20:56:35.480 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-18T20:56:35.508 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-18T20:56:35.547 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-18T20:56:35.769 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:35.849 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package modemmanager. 2023-11-18T20:56:35.866 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-18T20:56:35.899 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-18T20:56:36.031 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-18T20:56:36.031 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-18T20:56:36.539 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package network-manager. 2023-11-18T20:56:36.567 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-18T20:56:36.571 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mds-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:36.614 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-18T20:56:36.697 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up radosgw-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:36.806 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-test-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:36.907 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-osd (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:37.198 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ppp. 2023-11-18T20:56:37.224 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-18T20:56:37.224 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-18T20:56:37.225 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-18T20:56:37.541 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-18T20:56:37.775 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:37.852 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package pptp-linux. 2023-11-18T20:56:37.880 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-18T20:56:37.901 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-osd-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:37.918 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-18T20:56:38.028 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up rbd-mirror-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:38.137 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:38.171 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-18T20:56:38.187 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-18T20:56:38.229 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-18T20:56:38.238 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:38.389 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mon (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:38.557 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-18T20:56:38.585 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-18T20:56:38.599 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-18T20:56:38.600 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-18T20:56:38.759 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-client-common (238) ... 2023-11-18T20:56:39.063 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-18T20:56:39.093 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-18T20:56:39.130 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-18T20:56:39.140 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-cephadm (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:39.283 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:39.409 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-dashboard (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:39.560 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mon-dbg (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:39.676 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-common. 2023-11-18T20:56:39.694 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-volume (18.0.0-7418-gb0f45a51-1jammy) ... 2023-11-18T20:56:39.705 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-18T20:56:39.761 INFO:teuthology.orchestra.run.smithi106.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-18T20:56:39.791 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-common (238) ... 2023-11-18T20:56:40.039 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-18T20:56:40.283 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-14. 2023-11-18T20:56:40.311 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-18T20:56:40.352 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-18T20:56:40.923 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-18T20:56:41.407 INFO:teuthology.orchestra.run.smithi049.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-18T20:56:41.409 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-18T20:56:41.465 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2023-11-18T20:56:41.656 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2023-11-18T20:56:41.657 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2023-11-18T20:56:41.761 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql. 2023-11-18T20:56:41.790 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-18T20:56:41.827 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql (14+238) ... 2023-11-18T20:56:41.829 INFO:teuthology.orchestra.run.smithi049.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-18T20:56:41.829 INFO:teuthology.orchestra.run.smithi049.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-18T20:56:41.829 INFO:teuthology.orchestra.run.smithi049.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-18T20:56:41.829 INFO:teuthology.orchestra.run.smithi049.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-18T20:56:41.829 INFO:teuthology.orchestra.run.smithi049.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-18T20:56:41.830 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2023-11-18T20:56:41.830 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-18T20:56:41.830 INFO:teuthology.orchestra.run.smithi049.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-18T20:56:41.830 INFO:teuthology.orchestra.run.smithi049.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-18T20:56:41.830 INFO:teuthology.orchestra.run.smithi049.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-18T20:56:41.830 INFO:teuthology.orchestra.run.smithi049.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-18T20:56:41.831 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-18T20:56:41.831 INFO:teuthology.orchestra.run.smithi049.stdout:The following additional packages will be installed: 2023-11-18T20:56:41.831 INFO:teuthology.orchestra.run.smithi049.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-18T20:56:41.831 INFO:teuthology.orchestra.run.smithi049.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-18T20:56:41.832 INFO:teuthology.orchestra.run.smithi049.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-18T20:56:41.832 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-18T20:56:41.832 INFO:teuthology.orchestra.run.smithi049.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-18T20:56:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:Suggested packages: 2023-11-18T20:56:41.833 INFO:teuthology.orchestra.run.smithi049.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-18T20:56:41.833 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-18T20:56:41.834 INFO:teuthology.orchestra.run.smithi049.stdout: libengine-pkcs11-openssl 2023-11-18T20:56:41.873 INFO:teuthology.orchestra.run.smithi049.stdout:The following NEW packages will be installed: 2023-11-18T20:56:41.873 INFO:teuthology.orchestra.run.smithi049.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-18T20:56:41.873 INFO:teuthology.orchestra.run.smithi049.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-18T20:56:41.874 INFO:teuthology.orchestra.run.smithi049.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-18T20:56:41.874 INFO:teuthology.orchestra.run.smithi049.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-18T20:56:41.874 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-18T20:56:41.874 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-18T20:56:41.874 INFO:teuthology.orchestra.run.smithi049.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-18T20:56:41.875 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages will be upgraded: 2023-11-18T20:56:41.876 INFO:teuthology.orchestra.run.smithi049.stdout: libssl3 2023-11-18T20:56:41.933 INFO:teuthology.orchestra.run.smithi049.stdout:1 upgraded, 39 newly installed, 0 to remove and 259 not upgraded. 2023-11-18T20:56:41.933 INFO:teuthology.orchestra.run.smithi049.stdout:Need to get 54.6 MB of archives. 2023-11-18T20:56:41.933 INFO:teuthology.orchestra.run.smithi049.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-18T20:56:41.933 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-18T20:56:42.047 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-18T20:56:42.071 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-client. 2023-11-18T20:56:42.087 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-18T20:56:42.114 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-18T20:56:42.129 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-18T20:56:42.129 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-client (14+238) ... 2023-11-18T20:56:42.130 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-18T20:56:42.133 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-18T20:56:42.135 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-18T20:56:42.135 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-18T20:56:42.137 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-18T20:56:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-18T20:56:42.139 INFO:teuthology.orchestra.run.smithi049.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-18T20:56:42.139 INFO:teuthology.orchestra.run.smithi049.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-18T20:56:42.159 INFO:teuthology.orchestra.run.smithi049.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-18T20:56:42.365 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-18T20:56:42.393 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-18T20:56:42.431 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-18T20:56:42.487 INFO:teuthology.orchestra.run.smithi049.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-18T20:56:42.489 INFO:teuthology.orchestra.run.smithi049.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-18T20:56:42.489 INFO:teuthology.orchestra.run.smithi049.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-18T20:56:42.492 INFO:teuthology.orchestra.run.smithi049.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-18T20:56:42.492 INFO:teuthology.orchestra.run.smithi049.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-18T20:56:42.497 INFO:teuthology.orchestra.run.smithi049.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-18T20:56:42.498 INFO:teuthology.orchestra.run.smithi049.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-18T20:56:42.506 INFO:teuthology.orchestra.run.smithi049.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-18T20:56:42.506 INFO:teuthology.orchestra.run.smithi049.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-18T20:56:42.530 INFO:teuthology.orchestra.run.smithi049.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-18T20:56:42.530 INFO:teuthology.orchestra.run.smithi049.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-18T20:56:42.541 INFO:teuthology.orchestra.run.smithi049.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-18T20:56:42.563 INFO:teuthology.orchestra.run.smithi049.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-18T20:56:42.566 INFO:teuthology.orchestra.run.smithi049.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-18T20:56:42.567 INFO:teuthology.orchestra.run.smithi049.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-18T20:56:42.567 INFO:teuthology.orchestra.run.smithi049.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-18T20:56:42.569 INFO:teuthology.orchestra.run.smithi049.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-18T20:56:42.579 INFO:teuthology.orchestra.run.smithi049.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-18T20:56:42.581 INFO:teuthology.orchestra.run.smithi049.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-18T20:56:42.692 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package tcl8.6. 2023-11-18T20:56:42.720 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-18T20:56:42.750 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-18T20:56:42.823 INFO:teuthology.orchestra.run.smithi049.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-18T20:56:42.823 INFO:teuthology.orchestra.run.smithi049.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-18T20:56:42.823 INFO:teuthology.orchestra.run.smithi049.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-18T20:56:42.823 INFO:teuthology.orchestra.run.smithi049.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-18T20:56:42.823 INFO:teuthology.orchestra.run.smithi049.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-18T20:56:42.823 INFO:teuthology.orchestra.run.smithi049.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-18T20:56:42.835 INFO:teuthology.orchestra.run.smithi049.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-18T20:56:42.835 INFO:teuthology.orchestra.run.smithi049.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-18T20:56:43.037 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package tcl. 2023-11-18T20:56:43.064 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-18T20:56:43.108 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-18T20:56:43.248 INFO:teuthology.orchestra.run.smithi049.stdout:Preconfiguring packages ... 2023-11-18T20:56:43.420 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 54.6 MB in 1s (57.3 MB/s) 2023-11-18T20:56:43.456 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package wpasupplicant. 2023-11-18T20:56:43.484 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-18T20:56:43.531 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-18T20:56:43.531 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package flex. 2023-11-18T20:56:43.625 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173176 files and directories currently installed.) 2023-11-18T20:56:43.628 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-18T20:56:43.672 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-18T20:56:44.263 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-18T20:56:44.327 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-18T20:56:44.343 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-18T20:56:44.376 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-18T20:56:44.437 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-18T20:56:44.713 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-18T20:56:44.740 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-18T20:56:44.788 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-18T20:56:44.880 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-18T20:56:45.108 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-client-common (238) ... 2023-11-18T20:56:45.302 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-18T20:56:45.403 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-18T20:56:45.430 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package bison. 2023-11-18T20:56:45.503 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-18T20:56:45.536 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173249 files and directories currently installed.) 2023-11-18T20:56:45.542 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-18T20:56:45.598 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-18T20:56:45.630 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-18T20:56:45.764 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-18T20:56:45.890 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-18T20:56:46.041 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-18T20:56:46.069 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-18T20:56:46.157 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-18T20:56:46.326 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-18T20:56:46.395 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-18T20:56:46.587 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package dump. 2023-11-18T20:56:46.615 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-18T20:56:46.653 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking dump (0.4b47-3) ... 2023-11-18T20:56:46.772 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-18T20:56:46.772 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-18T20:56:46.940 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package indent. 2023-11-18T20:56:46.968 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-18T20:56:47.007 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-18T20:56:47.268 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-18T20:56:47.273 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-18T20:56:47.296 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-18T20:56:47.334 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-18T20:56:47.399 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-18T20:56:47.525 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-18T20:56:47.630 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-18T20:56:47.651 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-18T20:56:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-18T20:56:47.696 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-18T20:56:47.760 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-18T20:56:47.861 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-18T20:56:47.932 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-18T20:56:47.960 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-18T20:56:47.962 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-18T20:56:47.999 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-18T20:56:48.344 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-18T20:56:48.372 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-18T20:56:48.410 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-18T20:56:48.688 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-18T20:56:48.716 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-18T20:56:48.717 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-18T20:56:48.755 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-18T20:56:48.852 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up dump (0.4b47-3) ... 2023-11-18T20:56:48.929 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-18T20:56:48.986 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-18T20:56:48.991 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libjson-perl. 2023-11-18T20:56:49.008 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-18T20:56:49.049 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-18T20:56:49.369 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-18T20:56:49.371 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-18T20:56:49.397 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-18T20:56:49.435 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-18T20:56:49.614 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-18T20:56:49.757 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-18T20:56:49.908 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-18T20:56:50.014 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-18T20:56:50.084 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-18T20:56:50.243 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-18T20:56:50.428 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-18T20:56:50.554 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-18T20:56:50.680 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-18T20:56:50.873 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-client (14+238) ... 2023-11-18T20:56:51.024 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-18T20:56:51.098 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-18T20:56:51.126 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-18T20:56:51.156 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-18T20:56:51.384 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-18T20:56:51.412 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-18T20:56:51.450 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-18T20:56:51.550 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:56:51.551 INFO:teuthology.orchestra.run.smithi106.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-18T20:56:51.551 INFO:teuthology.orchestra.run.smithi106.stdout:which means they are currently configured by ifupdown: 2023-11-18T20:56:51.551 INFO:teuthology.orchestra.run.smithi106.stdout:- enp3s0f1 2023-11-18T20:56:51.551 INFO:teuthology.orchestra.run.smithi106.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-18T20:56:51.551 INFO:teuthology.orchestra.run.smithi106.stdout:remove their configuration from /etc/network/interfaces. 2023-11-18T20:56:51.551 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:56:51.660 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-18T20:56:51.820 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-18T20:56:51.849 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-18T20:56:51.887 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-18T20:56:52.012 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-18T20:56:52.240 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-18T20:56:52.268 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-18T20:56:52.307 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-18T20:56:52.330 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-18T20:56:52.601 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-18T20:56:52.629 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-18T20:56:52.667 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-18T20:56:52.935 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-18T20:56:53.054 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-18T20:56:53.062 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-18T20:56:53.082 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-18T20:56:53.120 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-18T20:56:53.188 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-18T20:56:53.314 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-common (238) ... 2023-11-18T20:56:53.465 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-18T20:56:53.493 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-18T20:56:53.531 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-18T20:56:53.809 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-18T20:56:53.825 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-18T20:56:53.859 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-18T20:56:54.086 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-18T20:56:54.114 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-18T20:56:54.153 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-18T20:56:54.199 INFO:teuthology.orchestra.run.smithi106.stdout:Adding user postgres to group ssl-cert 2023-11-18T20:56:54.426 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:56:54.426 INFO:teuthology.orchestra.run.smithi106.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-18T20:56:54.607 INFO:teuthology.orchestra.run.smithi106.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-18T20:56:54.607 INFO:teuthology.orchestra.run.smithi106.stdout:Removing obsolete dictionary files: 2023-11-18T20:56:54.648 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-18T20:56:54.676 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-18T20:56:54.714 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-18T20:56:55.068 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package modemmanager. 2023-11-18T20:56:55.096 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-18T20:56:55.134 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-18T20:56:55.189 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-18T20:56:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-18T20:56:55.725 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package network-manager. 2023-11-18T20:56:55.752 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-18T20:56:55.790 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-18T20:56:55.976 INFO:teuthology.orchestra.run.smithi106.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-18T20:56:55.988 INFO:teuthology.orchestra.run.smithi106.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-18T20:56:56.046 INFO:teuthology.orchestra.run.smithi106.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-18T20:56:56.046 INFO:teuthology.orchestra.run.smithi106.stdout:This user must also own the server process. 2023-11-18T20:56:56.046 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:56:56.046 INFO:teuthology.orchestra.run.smithi106.stdout:The database cluster will be initialized with locale "en_US". 2023-11-18T20:56:56.046 INFO:teuthology.orchestra.run.smithi106.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-18T20:56:56.046 INFO:teuthology.orchestra.run.smithi106.stdout:The default text search configuration will be set to "english". 2023-11-18T20:56:56.046 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:56:56.046 INFO:teuthology.orchestra.run.smithi106.stdout:Data page checksums are disabled. 2023-11-18T20:56:56.046 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:56:56.046 INFO:teuthology.orchestra.run.smithi106.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-18T20:56:56.047 INFO:teuthology.orchestra.run.smithi106.stdout:creating subdirectories ... ok 2023-11-18T20:56:56.047 INFO:teuthology.orchestra.run.smithi106.stdout:selecting dynamic shared memory implementation ... posix 2023-11-18T20:56:56.063 INFO:teuthology.orchestra.run.smithi106.stdout:selecting default max_connections ... 100 2023-11-18T20:56:56.083 INFO:teuthology.orchestra.run.smithi106.stdout:selecting default shared_buffers ... 128MB 2023-11-18T20:56:56.102 INFO:teuthology.orchestra.run.smithi106.stdout:selecting default time zone ... Etc/UTC 2023-11-18T20:56:56.103 INFO:teuthology.orchestra.run.smithi106.stdout:creating configuration files ... ok 2023-11-18T20:56:56.226 INFO:teuthology.orchestra.run.smithi106.stdout:running bootstrap script ... ok 2023-11-18T20:56:56.339 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ppp. 2023-11-18T20:56:56.368 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-18T20:56:56.671 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-18T20:56:56.868 INFO:teuthology.orchestra.run.smithi106.stdout:performing post-bootstrap initialization ... ok 2023-11-18T20:56:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package pptp-linux. 2023-11-18T20:56:56.986 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-18T20:56:57.019 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-18T20:56:57.247 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-18T20:56:57.264 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-18T20:56:57.305 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-18T20:56:57.494 INFO:teuthology.orchestra.run.smithi106.stdout:syncing data to disk ... ok 2023-11-18T20:56:57.584 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-18T20:56:57.612 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-18T20:56:57.650 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-client-common (238) ... 2023-11-18T20:56:57.884 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-18T20:56:57.954 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-18T20:56:57.982 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-18T20:56:58.020 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-18T20:56:58.634 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-common. 2023-11-18T20:56:58.663 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-18T20:56:58.719 INFO:teuthology.orchestra.run.smithi049.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-18T20:56:58.749 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-common (238) ... 2023-11-18T20:56:59.200 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-14. 2023-11-18T20:56:59.228 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-18T20:56:59.269 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-18T20:57:00.603 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql. 2023-11-18T20:57:00.633 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-18T20:57:00.669 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql (14+238) ... 2023-11-18T20:57:00.763 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-18T20:57:00.888 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-18T20:57:00.913 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-client. 2023-11-18T20:57:00.930 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-18T20:57:00.988 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-client (14+238) ... 2023-11-18T20:57:01.023 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql (14+238) ... 2023-11-18T20:57:01.174 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-18T20:57:01.224 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-18T20:57:01.241 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-18T20:57:01.274 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-18T20:57:01.325 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-18T20:57:01.560 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package tcl8.6. 2023-11-18T20:57:01.589 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-18T20:57:01.604 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-18T20:57:01.604 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-18T20:57:01.626 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-18T20:57:02.049 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package tcl. 2023-11-18T20:57:02.078 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-18T20:57:02.119 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-18T20:57:02.245 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-18T20:57:02.418 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package wpasupplicant. 2023-11-18T20:57:02.447 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-18T20:57:02.476 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-18T20:57:02.588 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-18T20:57:02.740 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-18T20:57:02.831 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-18T20:57:02.860 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-18T20:57:02.897 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-18T20:57:03.275 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-18T20:57:03.304 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-18T20:57:03.350 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-18T20:57:03.629 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-client-common (238) ... 2023-11-18T20:57:03.848 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-18T20:57:03.974 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-18T20:57:04.100 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-18T20:57:04.226 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-18T20:57:04.335 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-18T20:57:04.359 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-18T20:57:04.436 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-18T20:57:04.468 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-18T20:57:05.017 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-18T20:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-18T20:57:05.113 DEBUG:teuthology.parallel:result is None 2023-11-18T20:57:05.125 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-18T20:57:05.513 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-18T20:57:05.513 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-18T20:57:06.104 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-18T20:57:06.204 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-18T20:57:06.322 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-18T20:57:06.448 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-18T20:57:06.574 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-18T20:57:06.700 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-18T20:57:06.923 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-18T20:57:07.982 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-18T20:57:08.108 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up dump (0.4b47-3) ... 2023-11-18T20:57:08.201 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-18T20:57:08.268 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-18T20:57:08.377 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-18T20:57:08.478 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-18T20:57:08.588 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-18T20:57:08.713 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-18T20:57:08.803 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-18T20:57:08.874 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-18T20:57:09.000 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-18T20:57:09.193 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-18T20:57:09.310 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-18T20:57:09.411 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-18T20:57:09.546 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-client (14+238) ... 2023-11-18T20:57:09.672 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-18T20:57:10.189 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:10.189 INFO:teuthology.orchestra.run.smithi049.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-18T20:57:10.189 INFO:teuthology.orchestra.run.smithi049.stdout:which means they are currently configured by ifupdown: 2023-11-18T20:57:10.189 INFO:teuthology.orchestra.run.smithi049.stdout:- ens1f0 2023-11-18T20:57:10.189 INFO:teuthology.orchestra.run.smithi049.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-18T20:57:10.189 INFO:teuthology.orchestra.run.smithi049.stdout:remove their configuration from /etc/network/interfaces. 2023-11-18T20:57:10.190 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:10.323 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-18T20:57:10.675 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-18T20:57:11.053 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-18T20:57:11.658 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-18T20:57:11.826 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-18T20:57:11.944 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-18T20:57:12.045 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-common (238) ... 2023-11-18T20:57:13.253 INFO:teuthology.orchestra.run.smithi049.stdout:Adding user postgres to group ssl-cert 2023-11-18T20:57:13.473 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:13.473 INFO:teuthology.orchestra.run.smithi049.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-18T20:57:13.650 INFO:teuthology.orchestra.run.smithi049.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-18T20:57:13.650 INFO:teuthology.orchestra.run.smithi049.stdout:Removing obsolete dictionary files: 2023-11-18T20:57:14.296 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-18T20:57:14.747 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-18T20:57:15.095 INFO:teuthology.orchestra.run.smithi049.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-18T20:57:15.130 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-18T20:57:15.176 INFO:teuthology.orchestra.run.smithi049.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-18T20:57:15.176 INFO:teuthology.orchestra.run.smithi049.stdout:This user must also own the server process. 2023-11-18T20:57:15.176 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:15.176 INFO:teuthology.orchestra.run.smithi049.stdout:The database cluster will be initialized with locale "en_US". 2023-11-18T20:57:15.176 INFO:teuthology.orchestra.run.smithi049.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-18T20:57:15.176 INFO:teuthology.orchestra.run.smithi049.stdout:The default text search configuration will be set to "english". 2023-11-18T20:57:15.176 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:15.176 INFO:teuthology.orchestra.run.smithi049.stdout:Data page checksums are disabled. 2023-11-18T20:57:15.177 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:15.177 INFO:teuthology.orchestra.run.smithi049.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-18T20:57:15.177 INFO:teuthology.orchestra.run.smithi049.stdout:creating subdirectories ... ok 2023-11-18T20:57:15.177 INFO:teuthology.orchestra.run.smithi049.stdout:selecting dynamic shared memory implementation ... posix 2023-11-18T20:57:15.192 INFO:teuthology.orchestra.run.smithi049.stdout:selecting default max_connections ... 100 2023-11-18T20:57:15.211 INFO:teuthology.orchestra.run.smithi049.stdout:selecting default shared_buffers ... 128MB 2023-11-18T20:57:15.221 INFO:teuthology.orchestra.run.smithi049.stdout:selecting default time zone ... Etc/UTC 2023-11-18T20:57:15.222 INFO:teuthology.orchestra.run.smithi049.stdout:creating configuration files ... ok 2023-11-18T20:57:15.338 INFO:teuthology.orchestra.run.smithi049.stdout:running bootstrap script ... ok 2023-11-18T20:57:15.962 INFO:teuthology.orchestra.run.smithi049.stdout:performing post-bootstrap initialization ... ok 2023-11-18T20:57:16.666 INFO:teuthology.orchestra.run.smithi049.stdout:syncing data to disk ... ok 2023-11-18T20:57:17.111 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-18T20:57:19.946 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-18T20:57:20.071 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-18T20:57:20.197 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql (14+238) ... 2023-11-18T20:57:20.323 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-18T20:57:20.449 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-18T20:57:20.722 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-18T20:57:20.722 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-18T20:57:21.352 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-18T20:57:21.654 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-18T20:57:21.806 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-18T20:57:23.109 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-18T20:57:23.209 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-18T20:57:23.872 INFO:teuthology.orchestra.run.smithi049.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-18T20:57:23.875 DEBUG:teuthology.parallel:result is None 2023-11-18T20:57:23.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T20:57:24.093 DEBUG:teuthology.orchestra.run.smithi049:> dpkg-query -W -f '${Version}' ceph 2023-11-18T20:57:24.113 INFO:teuthology.orchestra.run.smithi049.stdout:18.0.0-7418-gb0f45a51-1jammy 2023-11-18T20:57:24.114 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7418-gb0f45a51-1jammy 2023-11-18T20:57:24.114 INFO:teuthology.task.install:The correct ceph version 18.0.0-7418-gb0f45a51-1jammy is installed. 2023-11-18T20:57:24.114 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T20:57:24.253 DEBUG:teuthology.orchestra.run.smithi106:> dpkg-query -W -f '${Version}' ceph 2023-11-18T20:57:24.272 INFO:teuthology.orchestra.run.smithi106.stdout:18.0.0-7418-gb0f45a51-1jammy 2023-11-18T20:57:24.273 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7418-gb0f45a51-1jammy 2023-11-18T20:57:24.273 INFO:teuthology.task.install:The correct ceph version 18.0.0-7418-gb0f45a51-1jammy is installed. 2023-11-18T20:57:24.273 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-18T20:57:24.274 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:24.274 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-18T20:57:24.289 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:24.290 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-18T20:57:24.327 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-18T20:57:24.327 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:24.328 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2023-11-18T20:57:24.345 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-18T20:57:24.404 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:24.404 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2023-11-18T20:57:24.419 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-18T20:57:24.474 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-18T20:57:24.475 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:24.475 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-18T20:57:24.489 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-18T20:57:24.544 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:24.544 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-18T20:57:24.557 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-18T20:57:24.611 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-18T20:57:24.611 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:24.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2023-11-18T20:57:24.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-18T20:57:24.680 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:24.680 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2023-11-18T20:57:24.693 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-18T20:57:24.747 INFO:teuthology.run_tasks:Running task ceph... 2023-11-18T20:57:24.809 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-18T20:57:24.809 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /var/log/ceph 2023-11-18T20:57:24.812 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2023-11-18T20:57:24.824 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-18T20:57:24.825 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-18T20:57:24.865 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-18T20:57:24.878 INFO:tasks.ceph:Creating extra log directories... 2023-11-18T20:57:24.878 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-18T20:57:24.922 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-18T20:57:24.941 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-18T20:57:24.941 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-18T20:57:24.941 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-18T20:57:24.941 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:24.941 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-18T20:57:24.981 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-18T20:57:25.056 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:25.057 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-18T20:57:25.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-18T20:57:25.139 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-18T20:57:25.139 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-18T20:57:25.139 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694', 'branch': 'main', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7461694', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1491, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi049.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC+ChscoCMEahRQFSUSGVJvVBQnKyYYPResF1d23B+3h1K0uen/ccLMt2ZvhB/2mkhj1XyLHksEObj5XIMC9sCc=', 'smithi106.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFAPO3qbOCqVwT7ut+l2Er62zVXJOFja6maelkGd+Fwkr4k5lgYXopvJ7bSIskIqwcXP/cHqjLPzI8AgjjNx2VE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-18_13:51:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-18T20:57:25.140 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-18T20:57:25.142 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-18T20:57:25.180 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/run/ceph 2023-11-18T20:57:25.189 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2023-11-18T20:57:25.235 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:25.235 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2023-11-18T20:57:25.248 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-18T20:57:25.249 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2023-11-18T20:57:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-18T20:57:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:57:25.297 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 876 Links: 1 2023-11-18T20:57:25.297 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:57:25.297 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-11-18 20:47:21.170188080 +0000 2023-11-18T20:57:25.297 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-11-18 20:47:20.810191295 +0000 2023-11-18T20:57:25.297 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-11-18 20:47:20.810191295 +0000 2023-11-18T20:57:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-11-18T20:57:25.298 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-18T20:57:25.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-11-18T20:57:25.351 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-11-18T20:57:25.351 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000283935 s, 1.8 MB/s 2023-11-18T20:57:25.352 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-18T20:57:25.401 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2023-11-18T20:57:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-18T20:57:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:57:25.449 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 892 Links: 1 2023-11-18T20:57:25.449 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:57:25.449 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-11-18 20:47:21.742182970 +0000 2023-11-18T20:57:25.449 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-11-18 20:47:21.394186079 +0000 2023-11-18T20:57:25.449 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-11-18 20:47:21.394186079 +0000 2023-11-18T20:57:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-11-18T20:57:25.449 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-18T20:57:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-11-18T20:57:25.504 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-11-18T20:57:25.504 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000300115 s, 1.7 MB/s 2023-11-18T20:57:25.505 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-18T20:57:25.554 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2023-11-18T20:57:25.601 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-18T20:57:25.601 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:57:25.601 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 905 Links: 1 2023-11-18T20:57:25.601 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:57:25.601 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-11-18 20:47:22.082179934 +0000 2023-11-18T20:57:25.601 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-11-18 20:47:22.078179970 +0000 2023-11-18T20:57:25.601 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-11-18 20:47:22.078179970 +0000 2023-11-18T20:57:25.601 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-11-18T20:57:25.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-18T20:57:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-11-18T20:57:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-11-18T20:57:25.656 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000173803 s, 2.9 MB/s 2023-11-18T20:57:25.657 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-18T20:57:25.705 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2023-11-18T20:57:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-18T20:57:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:57:25.753 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 928 Links: 1 2023-11-18T20:57:25.753 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:57:25.753 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-11-18 20:47:22.662174753 +0000 2023-11-18T20:57:25.753 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-11-18 20:47:22.658174789 +0000 2023-11-18T20:57:25.753 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-11-18 20:47:22.658174789 +0000 2023-11-18T20:57:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-11-18T20:57:25.753 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-18T20:57:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-11-18T20:57:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-11-18T20:57:25.808 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000239176 s, 2.1 MB/s 2023-11-18T20:57:25.809 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-18T20:57:25.858 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T20:57:25.858 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:25.858 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2023-11-18T20:57:25.863 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-18T20:57:25.863 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2023-11-18T20:57:25.912 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-18T20:57:25.912 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:57:25.912 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 886 Links: 1 2023-11-18T20:57:25.912 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:57:25.912 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-11-18 20:47:21.186098526 +0000 2023-11-18T20:57:25.912 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-11-18 20:47:20.830101707 +0000 2023-11-18T20:57:25.912 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-11-18 20:47:20.830101707 +0000 2023-11-18T20:57:25.912 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2023-11-18T20:57:25.913 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-18T20:57:25.966 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-11-18T20:57:25.966 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-11-18T20:57:25.966 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000446824 s, 1.1 MB/s 2023-11-18T20:57:25.968 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-18T20:57:26.017 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2023-11-18T20:57:26.063 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-18T20:57:26.063 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:57:26.064 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 904 Links: 1 2023-11-18T20:57:26.064 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:57:26.064 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-11-18 20:47:21.782093203 +0000 2023-11-18T20:57:26.064 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-11-18 20:47:21.414096490 +0000 2023-11-18T20:57:26.064 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-11-18 20:47:21.414096490 +0000 2023-11-18T20:57:26.064 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2023-11-18T20:57:26.064 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-18T20:57:26.118 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-11-18T20:57:26.118 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-11-18T20:57:26.118 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000422992 s, 1.2 MB/s 2023-11-18T20:57:26.119 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-18T20:57:26.169 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2023-11-18T20:57:26.216 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-18T20:57:26.216 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:57:26.216 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 927 Links: 1 2023-11-18T20:57:26.216 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:57:26.216 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-11-18 20:47:22.346088164 +0000 2023-11-18T20:57:26.216 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-11-18 20:47:22.014091130 +0000 2023-11-18T20:57:26.216 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-11-18 20:47:22.014091130 +0000 2023-11-18T20:57:26.216 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2023-11-18T20:57:26.217 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-18T20:57:26.269 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-11-18T20:57:26.269 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-11-18T20:57:26.270 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000376622 s, 1.4 MB/s 2023-11-18T20:57:26.271 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-18T20:57:26.321 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2023-11-18T20:57:26.367 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-18T20:57:26.367 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T20:57:26.368 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 943 Links: 1 2023-11-18T20:57:26.368 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T20:57:26.368 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-11-18 20:47:22.582086057 +0000 2023-11-18T20:57:26.368 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-11-18 20:47:22.578086092 +0000 2023-11-18T20:57:26.368 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-11-18 20:47:22.578086092 +0000 2023-11-18T20:57:26.368 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2023-11-18T20:57:26.368 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-18T20:57:26.425 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-11-18T20:57:26.425 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-11-18T20:57:26.426 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000378667 s, 1.4 MB/s 2023-11-18T20:57:26.427 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-18T20:57:26.476 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T20:57:26.477 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-18T20:57:26.477 INFO:tasks.ceph:Generating config... 2023-11-18T20:57:26.478 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-18T20:57:26.478 INFO:tasks.ceph:[client] debug client = 20 2023-11-18T20:57:26.478 INFO:tasks.ceph:[client] debug ms = 1 2023-11-18T20:57:26.478 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-18T20:57:26.478 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-18T20:57:26.478 INFO:tasks.ceph:[global] mds beacon grace = 60 2023-11-18T20:57:26.478 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2023-11-18T20:57:26.478 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2023-11-18T20:57:26.478 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-18T20:57:26.479 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-18T20:57:26.479 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-18T20:57:26.479 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-18T20:57:26.479 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-18T20:57:26.479 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-18T20:57:26.479 INFO:tasks.ceph:[mds] mds valgrind exit = True 2023-11-18T20:57:26.479 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-18T20:57:26.479 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-18T20:57:26.479 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-18T20:57:26.479 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-18T20:57:26.479 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-18T20:57:26.479 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-18T20:57:26.480 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-18T20:57:26.480 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-18T20:57:26.480 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-18T20:57:26.480 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-18T20:57:26.480 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-11-18T20:57:26.480 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-18T20:57:26.480 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-18T20:57:26.480 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-18T20:57:26.480 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-18T20:57:26.480 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-18T20:57:26.480 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-18T20:57:26.480 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-18T20:57:26.480 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-18T20:57:26.481 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-18T20:57:26.481 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-18T20:57:26.481 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-18T20:57:26.481 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-11-18T20:57:26.481 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-18T20:57:26.481 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-18T20:57:26.481 INFO:tasks.ceph:Setting up mon.a... 2023-11-18T20:57:26.481 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-18T20:57:26.517 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.keyring 2023-11-18T20:57:26.539 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-18T20:57:26.617 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-18T20:57:26.672 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.49'), ('mon.b', '172.21.15.106'), ('mon.c', '[v2:172.21.15.106:3301,v1:172.21.15.106:6790]')] 2023-11-18T20:57:26.672 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.49,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-18T20:57:26.673 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:26.673 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-18T20:57:26.720 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.49 --add b 172.21.15.106 --addv c '[v2:172.21.15.106:3301,v1:172.21.15.106:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:57:26.807 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:57:26.807 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: generated fsid 4b788c4a-a91a-4c5d-8f44-e74d82d94e56 2023-11-18T20:57:26.807 INFO:teuthology.orchestra.run.smithi049.stdout:setting min_mon_release = pacific 2023-11-18T20:57:26.807 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 0 2023-11-18T20:57:26.807 INFO:teuthology.orchestra.run.smithi049.stdout:fsid 4b788c4a-a91a-4c5d-8f44-e74d82d94e56 2023-11-18T20:57:26.807 INFO:teuthology.orchestra.run.smithi049.stdout:last_changed 2023-11-18T20:57:26.808074+0000 2023-11-18T20:57:26.807 INFO:teuthology.orchestra.run.smithi049.stdout:created 2023-11-18T20:57:26.808074+0000 2023-11-18T20:57:26.807 INFO:teuthology.orchestra.run.smithi049.stdout:min_mon_release 16 (pacific) 2023-11-18T20:57:26.807 INFO:teuthology.orchestra.run.smithi049.stdout:election_strategy: 1 2023-11-18T20:57:26.808 INFO:teuthology.orchestra.run.smithi049.stdout:0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2023-11-18T20:57:26.808 INFO:teuthology.orchestra.run.smithi049.stdout:1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.b 2023-11-18T20:57:26.808 INFO:teuthology.orchestra.run.smithi049.stdout:2: [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] mon.c 2023-11-18T20:57:26.808 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-18T20:57:26.809 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-18T20:57:26.856 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4b788c4a-a91a-4c5d-8f44-e74d82d94e56... 2023-11-18T20:57:26.857 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-18T20:57:26.902 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-18T20:57:26.931 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2023-11-18T20:57:26.931 INFO:teuthology.orchestra.run.smithi049.stdout: chdir = "" 2023-11-18T20:57:26.931 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-18T20:57:26.931 INFO:teuthology.orchestra.run.smithi049.stdout: auth supported = cephx 2023-11-18T20:57:26.931 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.931 INFO:teuthology.orchestra.run.smithi049.stdout: filestore xattr use omap = true 2023-11-18T20:57:26.932 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.932 INFO:teuthology.orchestra.run.smithi049.stdout: mon clock drift allowed = 1.000 2023-11-18T20:57:26.932 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.932 INFO:teuthology.orchestra.run.smithi049.stdout: osd crush chooseleaf type = 0 2023-11-18T20:57:26.932 INFO:teuthology.orchestra.run.smithi049.stdout: auth debug = true 2023-11-18T20:57:26.932 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.932 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on old message = true 2023-11-18T20:57:26.932 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on bug = true 2023-11-18T20:57:26.932 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.932 INFO:teuthology.orchestra.run.smithi049.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-18T20:57:26.932 INFO:teuthology.orchestra.run.smithi049.stdout: mon pg warn max object skew = 0 2023-11-18T20:57:26.932 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.932 INFO:teuthology.orchestra.run.smithi049.stdout: # disable pg_autoscaler by default for new pools 2023-11-18T20:57:26.933 INFO:teuthology.orchestra.run.smithi049.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-18T20:57:26.933 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.933 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default size = 2 2023-11-18T20:57:26.933 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.933 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow primary affinity = true 2023-11-18T20:57:26.933 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow pg remap = true 2023-11-18T20:57:26.933 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on legacy crush tunables = false 2023-11-18T20:57:26.933 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on crush straw calc version zero = false 2023-11-18T20:57:26.933 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on no sortbitwise = false 2023-11-18T20:57:26.933 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on osd down out interval zero = false 2023-11-18T20:57:26.933 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on too few osds = false 2023-11-18T20:57:26.933 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-18T20:57:26.933 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-18T20:57:26.933 INFO:teuthology.orchestra.run.smithi049.stdout: mon_allow_pool_size_one = true 2023-11-18T20:57:26.934 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.934 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-18T20:57:26.934 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.934 INFO:teuthology.orchestra.run.smithi049.stdout: osd default data pool replay window = 5 2023-11-18T20:57:26.934 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.934 INFO:teuthology.orchestra.run.smithi049.stdout: mon allow pool delete = true 2023-11-18T20:57:26.934 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.934 INFO:teuthology.orchestra.run.smithi049.stdout: mon cluster log file level = debug 2023-11-18T20:57:26.934 INFO:teuthology.orchestra.run.smithi049.stdout: debug asserts on shutdown = true 2023-11-18T20:57:26.934 INFO:teuthology.orchestra.run.smithi049.stdout: mon health detail to clog = false 2023-11-18T20:57:26.934 INFO:teuthology.orchestra.run.smithi049.stdout: mon host = "172.21.15.49,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2023-11-18T20:57:26.934 INFO:teuthology.orchestra.run.smithi049.stdout: mds beacon grace = 60 2023-11-18T20:57:26.934 INFO:teuthology.orchestra.run.smithi049.stdout: mds heartbeat grace = 60 2023-11-18T20:57:26.935 INFO:teuthology.orchestra.run.smithi049.stdout: osd heartbeat grace = 60 2023-11-18T20:57:26.935 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = 4b788c4a-a91a-4c5d-8f44-e74d82d94e56 2023-11-18T20:57:26.935 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.935 INFO:teuthology.orchestra.run.smithi049.stdout:[osd] 2023-11-18T20:57:26.935 INFO:teuthology.orchestra.run.smithi049.stdout: osd journal size = 100 2023-11-18T20:57:26.935 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.935 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub load threshold = 5.0 2023-11-18T20:57:26.935 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub max interval = 600 2023-11-18T20:57:26.935 INFO:teuthology.orchestra.run.smithi049.stdout: osd mclock profile = high_recovery_ops 2023-11-18T20:57:26.935 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.935 INFO:teuthology.orchestra.run.smithi049.stdout: osd recover clone overlap = true 2023-11-18T20:57:26.935 INFO:teuthology.orchestra.run.smithi049.stdout: osd recovery max chunk = 1048576 2023-11-18T20:57:26.935 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.936 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug shutdown = true 2023-11-18T20:57:26.936 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug op order = true 2023-11-18T20:57:26.936 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug verify stray on activate = true 2023-11-18T20:57:26.936 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug trim objects = true 2023-11-18T20:57:26.936 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.936 INFO:teuthology.orchestra.run.smithi049.stdout: osd open classes on start = true 2023-11-18T20:57:26.936 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug pg log writeout = true 2023-11-18T20:57:26.936 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.936 INFO:teuthology.orchestra.run.smithi049.stdout: osd deep scrub update digest min age = 30 2023-11-18T20:57:26.936 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.936 INFO:teuthology.orchestra.run.smithi049.stdout: osd map max advance = 10 2023-11-18T20:57:26.936 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.936 INFO:teuthology.orchestra.run.smithi049.stdout: journal zero on create = true 2023-11-18T20:57:26.936 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.937 INFO:teuthology.orchestra.run.smithi049.stdout: filestore ondisk finisher threads = 3 2023-11-18T20:57:26.937 INFO:teuthology.orchestra.run.smithi049.stdout: filestore apply finisher threads = 3 2023-11-18T20:57:26.937 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.937 INFO:teuthology.orchestra.run.smithi049.stdout: bdev debug aio = true 2023-11-18T20:57:26.937 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug misdirected ops = true 2023-11-18T20:57:26.937 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore block size = 96636764160 2023-11-18T20:57:26.937 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore fsck on mount = True 2023-11-18T20:57:26.937 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluefs = 20 2023-11-18T20:57:26.937 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluestore = 20 2023-11-18T20:57:26.937 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-11-18T20:57:26.937 INFO:teuthology.orchestra.run.smithi049.stdout: debug osd = 20 2023-11-18T20:57:26.937 INFO:teuthology.orchestra.run.smithi049.stdout: debug rocksdb = 10 2023-11-18T20:57:26.937 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd backfillfull_ratio = 0.85 2023-11-18T20:57:26.938 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd full ratio = 0.9 2023-11-18T20:57:26.938 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd nearfull ratio = 0.8 2023-11-18T20:57:26.938 INFO:teuthology.orchestra.run.smithi049.stdout: osd failsafe full ratio = 0.95 2023-11-18T20:57:26.938 INFO:teuthology.orchestra.run.smithi049.stdout: osd fast shutdown = False 2023-11-18T20:57:26.938 INFO:teuthology.orchestra.run.smithi049.stdout: osd objectstore = bluestore 2023-11-18T20:57:26.938 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2023-11-18T20:57:26.938 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.938 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr] 2023-11-18T20:57:26.938 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-11-18T20:57:26.938 INFO:teuthology.orchestra.run.smithi049.stdout: debug mgr = 20 2023-11-18T20:57:26.938 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2023-11-18T20:57:26.938 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2023-11-18T20:57:26.938 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2023-11-18T20:57:26.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2023-11-18T20:57:26.939 INFO:teuthology.orchestra.run.smithi049.stdout: mgr/telemetry/nag = false 2023-11-18T20:57:26.939 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.939 INFO:teuthology.orchestra.run.smithi049.stdout:[mon] 2023-11-18T20:57:26.939 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-11-18T20:57:26.939 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2023-11-18T20:57:26.939 INFO:teuthology.orchestra.run.smithi049.stdout: debug paxos = 20 2023-11-18T20:57:26.939 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2023-11-18T20:57:26.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon data avail warn = 5 2023-11-18T20:57:26.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon mgr mkfs grace = 240 2023-11-18T20:57:26.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2023-11-18T20:57:26.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd reporter subtree level = osd 2023-11-18T20:57:26.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd prime pg temp = true 2023-11-18T20:57:26.939 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2023-11-18T20:57:26.940 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.940 INFO:teuthology.orchestra.run.smithi049.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-18T20:57:26.940 INFO:teuthology.orchestra.run.smithi049.stdout: auth mon ticket ttl = 660 # 11m 2023-11-18T20:57:26.940 INFO:teuthology.orchestra.run.smithi049.stdout: auth service ticket ttl = 240 # 4m 2023-11-18T20:57:26.940 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.940 INFO:teuthology.orchestra.run.smithi049.stdout: # don't complain about insecure global_id in the test suite 2023-11-18T20:57:26.940 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-18T20:57:26.940 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-18T20:57:26.940 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.940 INFO:teuthology.orchestra.run.smithi049.stdout: # 1m isn't quite enough 2023-11-18T20:57:26.940 INFO:teuthology.orchestra.run.smithi049.stdout: mon_down_mkfs_grace = 2m 2023-11-18T20:57:26.940 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.940 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_filestore_osds = false 2023-11-18T20:57:26.941 INFO:teuthology.orchestra.run.smithi049.stdout: mon op complaint time = 120 2023-11-18T20:57:26.941 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd crush smoke test = False 2023-11-18T20:57:26.941 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:57:26.941 INFO:teuthology.orchestra.run.smithi049.stdout:[client] 2023-11-18T20:57:26.941 INFO:teuthology.orchestra.run.smithi049.stdout: rgw cache enabled = true 2023-11-18T20:57:26.941 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable ops log = true 2023-11-18T20:57:26.941 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable usage log = true 2023-11-18T20:57:26.941 INFO:teuthology.orchestra.run.smithi049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-18T20:57:26.941 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-18T20:57:26.941 INFO:teuthology.orchestra.run.smithi049.stdout: client mount timeout = 600 2023-11-18T20:57:26.941 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2023-11-18T20:57:26.941 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-11-18T20:57:26.941 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2023-11-18T20:57:26.941 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2023-11-18T20:57:26.942 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.a] 2023-11-18T20:57:26.942 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.b] 2023-11-18T20:57:26.942 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.c] 2023-11-18T20:57:26.942 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2023-11-18T20:57:26.942 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2023-11-18T20:57:26.942 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.e] 2023-11-18T20:57:26.942 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2023-11-18T20:57:26.942 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2023-11-18T20:57:26.942 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.f] 2023-11-18T20:57:26.942 INFO:teuthology.orchestra.run.smithi049.stdout:[mds] 2023-11-18T20:57:26.942 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds = 20 2023-11-18T20:57:26.942 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds balancer = 20 2023-11-18T20:57:26.942 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2023-11-18T20:57:26.943 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug frag = True 2023-11-18T20:57:26.943 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug scatterstat = True 2023-11-18T20:57:26.943 INFO:teuthology.orchestra.run.smithi049.stdout: mds op complaint time = 180 2023-11-18T20:57:26.943 INFO:teuthology.orchestra.run.smithi049.stdout: mds valgrind exit = True 2023-11-18T20:57:26.943 INFO:teuthology.orchestra.run.smithi049.stdout: mds verify scatter = True 2023-11-18T20:57:26.943 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2023-11-18T20:57:26.943 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2023-11-18T20:57:26.943 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2023-11-18T20:57:26.944 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2023-11-18T20:57:26.945 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2023-11-18T20:57:26.945 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-18T20:57:26.945 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2023-11-18T20:57:26.945 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.945 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2023-11-18T20:57:26.945 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.945 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2023-11-18T20:57:26.945 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.945 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2023-11-18T20:57:26.945 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2023-11-18T20:57:26.945 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.945 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2023-11-18T20:57:26.945 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2023-11-18T20:57:26.946 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.946 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-18T20:57:26.946 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2023-11-18T20:57:26.946 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.946 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2023-11-18T20:57:26.946 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-18T20:57:26.946 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.946 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2023-11-18T20:57:26.946 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.946 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2023-11-18T20:57:26.946 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2023-11-18T20:57:26.946 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2023-11-18T20:57:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2023-11-18T20:57:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2023-11-18T20:57:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2023-11-18T20:57:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2023-11-18T20:57:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-18T20:57:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-18T20:57:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2023-11-18T20:57:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-18T20:57:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2023-11-18T20:57:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2023-11-18T20:57:26.948 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.948 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2023-11-18T20:57:26.948 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2023-11-18T20:57:26.948 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2023-11-18T20:57:26.948 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.49,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2023-11-18T20:57:26.948 INFO:teuthology.orchestra.run.smithi106.stdout: mds beacon grace = 60 2023-11-18T20:57:26.948 INFO:teuthology.orchestra.run.smithi106.stdout: mds heartbeat grace = 60 2023-11-18T20:57:26.948 INFO:teuthology.orchestra.run.smithi106.stdout: osd heartbeat grace = 60 2023-11-18T20:57:26.948 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 4b788c4a-a91a-4c5d-8f44-e74d82d94e56 2023-11-18T20:57:26.948 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.948 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2023-11-18T20:57:26.948 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2023-11-18T20:57:26.948 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug trim objects = true 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2023-11-18T20:57:26.949 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.950 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2023-11-18T20:57:26.950 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.950 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2023-11-18T20:57:26.950 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.950 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2023-11-18T20:57:26.950 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.950 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2023-11-18T20:57:26.950 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2023-11-18T20:57:26.950 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.950 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2023-11-18T20:57:26.950 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2023-11-18T20:57:26.950 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2023-11-18T20:57:26.950 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2023-11-18T20:57:26.951 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 20 2023-11-18T20:57:26.951 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 20 2023-11-18T20:57:26.951 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-11-18T20:57:26.951 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2023-11-18T20:57:26.951 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 10 2023-11-18T20:57:26.951 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2023-11-18T20:57:26.951 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2023-11-18T20:57:26.951 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2023-11-18T20:57:26.951 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2023-11-18T20:57:26.951 INFO:teuthology.orchestra.run.smithi106.stdout: osd fast shutdown = False 2023-11-18T20:57:26.951 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2023-11-18T20:57:26.951 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2023-11-18T20:57:26.951 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.952 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2023-11-18T20:57:26.952 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-11-18T20:57:26.952 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2023-11-18T20:57:26.952 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2023-11-18T20:57:26.952 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2023-11-18T20:57:26.952 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2023-11-18T20:57:26.952 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2023-11-18T20:57:26.952 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2023-11-18T20:57:26.952 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.952 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2023-11-18T20:57:26.952 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-11-18T20:57:26.952 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2023-11-18T20:57:26.952 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2023-11-18T20:57:26.953 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2023-11-18T20:57:26.953 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2023-11-18T20:57:26.953 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2023-11-18T20:57:26.953 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2023-11-18T20:57:26.953 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2023-11-18T20:57:26.953 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2023-11-18T20:57:26.953 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2023-11-18T20:57:26.953 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.953 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-18T20:57:26.953 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2023-11-18T20:57:26.953 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2023-11-18T20:57:26.953 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.953 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2023-11-18T20:57:26.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-18T20:57:26.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-18T20:57:26.954 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.954 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2023-11-18T20:57:26.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2023-11-18T20:57:26.954 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2023-11-18T20:57:26.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon op complaint time = 120 2023-11-18T20:57:26.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd crush smoke test = False 2023-11-18T20:57:26.954 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-18T20:57:26.954 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2023-11-18T20:57:26.954 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2023-11-18T20:57:26.954 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2023-11-18T20:57:26.955 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2023-11-18T20:57:26.955 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-18T20:57:26.955 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-18T20:57:26.955 INFO:teuthology.orchestra.run.smithi106.stdout: client mount timeout = 600 2023-11-18T20:57:26.955 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2023-11-18T20:57:26.955 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-11-18T20:57:26.955 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2023-11-18T20:57:26.955 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2023-11-18T20:57:26.955 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2023-11-18T20:57:26.955 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2023-11-18T20:57:26.955 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2023-11-18T20:57:26.955 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2023-11-18T20:57:26.955 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2023-11-18T20:57:26.956 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.e] 2023-11-18T20:57:26.956 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2023-11-18T20:57:26.956 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2023-11-18T20:57:26.956 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.f] 2023-11-18T20:57:26.956 INFO:teuthology.orchestra.run.smithi106.stdout:[mds] 2023-11-18T20:57:26.956 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds = 20 2023-11-18T20:57:26.956 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds balancer = 20 2023-11-18T20:57:26.956 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-11-18T20:57:26.956 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug frag = True 2023-11-18T20:57:26.956 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug scatterstat = True 2023-11-18T20:57:26.956 INFO:teuthology.orchestra.run.smithi106.stdout: mds op complaint time = 180 2023-11-18T20:57:26.956 INFO:teuthology.orchestra.run.smithi106.stdout: mds valgrind exit = True 2023-11-18T20:57:26.956 INFO:teuthology.orchestra.run.smithi106.stdout: mds verify scatter = True 2023-11-18T20:57:26.956 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2023-11-18T20:57:26.957 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2023-11-18T20:57:26.957 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2023-11-18T20:57:26.957 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-18T20:57:26.957 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-18T20:57:27.039 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-18T20:57:27.039 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:27.039 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-18T20:57:27.045 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:27.045 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-18T20:57:27.092 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi049.front.sepia.ceph.com 2023-11-18T20:57:27.092 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:27.092 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-18T20:57:27.093 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-18T20:57:27.157 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:27.157 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:57:27.204 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2023-11-18T20:57:27.204 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:27.205 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-18T20:57:27.205 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-18T20:57:27.226 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:27.227 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:57:27.275 INFO:tasks.ceph:Setting up mon nodes... 2023-11-18T20:57:27.275 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-18T20:57:27.276 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-18T20:57:27.321 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-18T20:57:27.324 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-18T20:57:27.368 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-18T20:57:27.390 INFO:tasks.ceph:Setting up mds nodes... 2023-11-18T20:57:27.390 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-18T20:57:27.434 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-18T20:57:27.437 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-18T20:57:27.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-18T20:57:27.578 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-18T20:57:27.581 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-18T20:57:27.636 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-11-18T20:57:27.718 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-11-18T20:57:27.721 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-11-18T20:57:27.776 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-18T20:57:27.821 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-18T20:57:27.824 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-18T20:57:27.879 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-18T20:57:27.962 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-18T20:57:27.965 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-18T20:57:28.019 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-11-18T20:57:28.105 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-11-18T20:57:28.108 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-11-18T20:57:28.163 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-18T20:57:28.164 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-18T20:57:28.201 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-18T20:57:28.212 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-18T20:57:28.213 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-18T20:57:28.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-18T20:57:28.269 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T20:57:28.269 INFO:tasks.ceph:role: osd.0 2023-11-18T20:57:28.269 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-18T20:57:28.269 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-18T20:57:28.325 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:57:28.325 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:57:28.325 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:57:28.325 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-18T20:57:28.325 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:57:28.325 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:57:28.325 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:57:28.326 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-18T20:57:28.326 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:57:28.326 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:57:28.349 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2023-11-18T20:57:28.352 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-11-18T20:57:28.353 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-18T20:57:28.415 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-18T20:57:28.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:57:28.466 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2023-11-18T20:57:28.467 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-18T20:57:28.519 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T20:57:28.519 INFO:tasks.ceph:role: osd.1 2023-11-18T20:57:28.519 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-18T20:57:28.519 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-18T20:57:28.571 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:57:28.572 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:57:28.572 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:57:28.572 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-18T20:57:28.572 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:57:28.572 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:57:28.572 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:57:28.572 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-18T20:57:28.572 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:57:28.572 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:57:28.595 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2023-11-18T20:57:28.597 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-11-18T20:57:28.597 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-18T20:57:28.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-18T20:57:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2023-11-18T20:57:28.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:57:28.710 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-18T20:57:28.764 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T20:57:28.764 INFO:tasks.ceph:role: osd.2 2023-11-18T20:57:28.764 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-18T20:57:28.765 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-18T20:57:28.820 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:57:28.820 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:57:28.820 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:57:28.820 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-18T20:57:28.820 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:57:28.821 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:57:28.821 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:57:28.821 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-18T20:57:28.821 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:57:28.821 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:57:28.844 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2023-11-18T20:57:28.846 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-11-18T20:57:28.846 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-18T20:57:28.904 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-18T20:57:28.958 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2023-11-18T20:57:28.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:57:28.959 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-18T20:57:29.016 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T20:57:29.016 INFO:tasks.ceph:role: osd.3 2023-11-18T20:57:29.016 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-18T20:57:29.016 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-18T20:57:29.072 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:57:29.072 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:57:29.072 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:57:29.072 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-18T20:57:29.072 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:57:29.072 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:57:29.072 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:57:29.072 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-18T20:57:29.072 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:57:29.072 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:57:29.097 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2023-11-18T20:57:29.099 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2023-11-18T20:57:29.099 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-18T20:57:29.157 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-18T20:57:29.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:57:29.209 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2023-11-18T20:57:29.210 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:57:29.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:29.315+0000 7fcd71d39640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-18T20:57:29.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:29.315+0000 7fcd71d39640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-18T20:57:29.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:29.315+0000 7fcd71d39640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-18T20:57:29.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:29.315+0000 7fcd71d39640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-18T20:57:29.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:29.315+0000 7fcd71d39640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-18T20:57:29.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:29.315+0000 7fcd71d39640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-18T20:57:32.332 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-18T20:57:32.346 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:57:32.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:32.431+0000 7fc52283e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-18T20:57:32.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:32.431+0000 7fc52283e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-18T20:57:32.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:32.431+0000 7fc52283e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-18T20:57:32.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:32.431+0000 7fc52283e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-18T20:57:32.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:32.431+0000 7fc52283e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-18T20:57:32.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:32.431+0000 7fc52283e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-18T20:57:35.437 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-18T20:57:35.493 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:57:35.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:35.575+0000 7f4bf1ecc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-18T20:57:35.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:35.575+0000 7f4bf1ecc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-18T20:57:35.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:35.575+0000 7f4bf1ecc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-18T20:57:35.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:35.575+0000 7f4bf1ecc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-18T20:57:35.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:35.575+0000 7f4bf1ecc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-18T20:57:35.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:35.575+0000 7f4bf1ecc640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-18T20:57:38.591 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-18T20:57:38.646 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:57:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:38.727+0000 7fe598747640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-18T20:57:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:38.727+0000 7fe598747640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-18T20:57:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:38.727+0000 7fe598747640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-18T20:57:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:38.727+0000 7fe598747640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-18T20:57:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:38.727+0000 7fe598747640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-18T20:57:38.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:38.727+0000 7fe598747640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-18T20:57:41.762 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-18T20:57:41.817 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-18T20:57:41.832 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T20:57:41.832 INFO:tasks.ceph:role: osd.4 2023-11-18T20:57:41.832 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-18T20:57:41.832 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-18T20:57:41.895 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:57:41.895 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:57:41.895 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:57:41.895 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-18T20:57:41.895 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:57:41.895 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:57:41.895 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:57:41.895 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-18T20:57:41.895 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:57:41.895 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:57:42.354 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2023-11-18T20:57:42.356 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-11-18T20:57:42.357 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-18T20:57:42.454 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-18T20:57:42.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:57:42.466 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2023-11-18T20:57:42.466 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-18T20:57:42.518 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T20:57:42.518 INFO:tasks.ceph:role: osd.5 2023-11-18T20:57:42.518 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-18T20:57:42.518 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-18T20:57:42.581 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:57:42.581 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:57:42.581 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:57:42.581 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-18T20:57:42.581 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:57:42.582 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:57:42.582 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:57:42.582 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-18T20:57:42.582 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:57:42.582 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:57:43.047 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2023-11-18T20:57:43.050 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-11-18T20:57:43.050 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-18T20:57:43.187 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-18T20:57:43.198 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2023-11-18T20:57:43.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:57:43.199 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-18T20:57:43.255 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T20:57:43.255 INFO:tasks.ceph:role: osd.6 2023-11-18T20:57:43.256 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-18T20:57:43.256 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-18T20:57:43.318 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:57:43.319 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:57:43.319 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:57:43.319 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-18T20:57:43.319 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:57:43.319 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:57:43.319 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:57:43.319 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-18T20:57:43.319 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:57:43.319 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:57:43.773 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2023-11-18T20:57:43.775 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-11-18T20:57:43.775 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-18T20:57:43.923 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-18T20:57:43.935 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2023-11-18T20:57:43.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:57:43.936 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-18T20:57:43.991 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T20:57:43.992 INFO:tasks.ceph:role: osd.7 2023-11-18T20:57:43.992 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-18T20:57:43.992 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-18T20:57:44.055 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T20:57:44.055 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T20:57:44.055 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T20:57:44.056 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-18T20:57:44.056 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T20:57:44.056 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-11-18T20:57:44.056 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T20:57:44.056 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-18T20:57:44.056 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T20:57:44.056 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T20:57:44.490 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2023-11-18T20:57:44.492 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-11-18T20:57:44.493 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-18T20:57:44.581 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-18T20:57:44.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T20:57:44.591 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2023-11-18T20:57:44.591 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:57:44.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:44.713+0000 7f0a5c372640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-18T20:57:44.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:44.713+0000 7f0a5c372640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-18T20:57:44.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:44.713+0000 7f0a5c372640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-18T20:57:44.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:44.713+0000 7f0a5c372640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-18T20:57:44.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:44.713+0000 7f0a5c372640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-18T20:57:44.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:44.717+0000 7f0a5c372640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-18T20:57:47.729 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-18T20:57:47.743 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:57:47.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:47.821+0000 7fd2f6bae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-18T20:57:47.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:47.821+0000 7fd2f6bae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-18T20:57:47.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:47.821+0000 7fd2f6bae640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-18T20:57:47.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:47.821+0000 7fd2f6bae640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-18T20:57:47.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:47.821+0000 7fd2f6bae640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-18T20:57:47.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:47.825+0000 7fd2f6bae640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-18T20:57:50.827 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-18T20:57:50.884 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:57:50.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:50.965+0000 7ff5283e9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-18T20:57:50.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:50.965+0000 7ff5283e9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-18T20:57:50.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:50.965+0000 7ff5283e9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-18T20:57:50.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:50.965+0000 7ff5283e9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-18T20:57:50.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:50.965+0000 7ff5283e9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-18T20:57:50.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:50.965+0000 7ff5283e9640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-18T20:57:53.976 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-18T20:57:54.032 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:57:54.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:54.108+0000 7f7b826fa640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-18T20:57:54.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:54.108+0000 7f7b826fa640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-18T20:57:54.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:54.108+0000 7f7b826fa640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-18T20:57:54.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:54.108+0000 7f7b826fa640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-18T20:57:54.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:54.108+0000 7f7b826fa640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-18T20:57:54.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:57:54.112+0000 7f7b826fa640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-18T20:57:55.141 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:57:55.144 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:57:57.132 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-18T20:57:57.145 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-18T20:57:57.145 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:57.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-18T20:57:57.160 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:57.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-18T20:57:57.216 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:57.217 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-18T20:57:57.273 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:57.273 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-11-18T20:57:57.329 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:57.329 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-18T20:57:57.385 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:57.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-18T20:57:57.443 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:57.443 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-18T20:57:57.496 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:57.497 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-18T20:57:57.557 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:57.557 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-18T20:57:57.571 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:57.571 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-18T20:57:57.627 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:57.627 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-18T20:57:57.683 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:57.683 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-11-18T20:57:57.739 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:57.739 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-18T20:57:57.795 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:57.795 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-18T20:57:57.853 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:57.853 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-18T20:57:57.907 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:57:57.907 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-18T20:57:57.963 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:57:57.963 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-18T20:57:57.969 INFO:tasks.ceph:Adding keys to all mons... 2023-11-18T20:57:57.969 DEBUG:teuthology.orchestra.run.smithi049:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-18T20:57:58.014 DEBUG:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-18T20:57:58.023 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.y] 2023-11-18T20:57:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA3JVll6aQ2ExAAyfYn10knTE1gRnJNKMlL8A== 2023-11-18T20:57:58.023 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2023-11-18T20:57:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA3JVllwe7yGRAA+uNTlhZy3103VMNRVPxQkw== 2023-11-18T20:57:58.024 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2023-11-18T20:57:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA3JVllXwSMIhAA2eQVWi2Fjpv91D/u92MDSQ== 2023-11-18T20:57:58.024 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.e] 2023-11-18T20:57:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA3JVll4dzoKhAAQvce93U9FU06Exv/ygRF6g== 2023-11-18T20:57:58.024 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.0] 2023-11-18T20:57:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA5JVllAQj+EhAAiRxIb/ACv4IbWr/CaZNKpQ== 2023-11-18T20:57:58.025 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.1] 2023-11-18T20:57:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA8JVll7Z7oGRAAAd4U8Z8+qtMItEV4qN17Yg== 2023-11-18T20:57:58.025 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.2] 2023-11-18T20:57:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA/JVllcFN/IhAAGmWRzE/lNZEcqspt4WRhXQ== 2023-11-18T20:57:58.025 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.3] 2023-11-18T20:57:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBCJVllKVCNKxAAe17W6h8Hl8ntY+j4KzzrZQ== 2023-11-18T20:57:58.026 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.x] 2023-11-18T20:57:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA3JVllAMH9FRAAwcagFQgM+ClyOpfCQIVu+A== 2023-11-18T20:57:58.026 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2023-11-18T20:57:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA3JVllrSn8MBAAEYV63LTVShWu5zREZn7YHQ== 2023-11-18T20:57:58.026 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2023-11-18T20:57:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA3JVllW+ZhORAASweXs8LZ/qd+vb7QxQAlfQ== 2023-11-18T20:57:58.027 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.f] 2023-11-18T20:57:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA4JVllM8BUBhAAuqQXBrKnFhTwasCzyezS1A== 2023-11-18T20:57:58.027 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.4] 2023-11-18T20:57:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBIJVllkouvKhAAwgxy+81fzHyDMcTnm8acXw== 2023-11-18T20:57:58.027 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.5] 2023-11-18T20:57:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBLJVll2gpFMRAAMamKCoKE8ThRAcEs5Lu/Lg== 2023-11-18T20:57:58.028 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.6] 2023-11-18T20:57:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBOJVllTB7GORAAHh74RyDtZeVzq9nXeN/JEQ== 2023-11-18T20:57:58.028 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.7] 2023-11-18T20:57:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBSJVll0e3QBhAAZHGYIYvgZgd4p/Me67OGZA== 2023-11-18T20:57:58.028 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2023-11-18T20:57:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA4JVll704KDBAAj6Lw+QBOpO/Ae+AqcGpSvg== 2023-11-18T20:57:58.031 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.y] 2023-11-18T20:57:58.031 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA3JVll6aQ2ExAAyfYn10knTE1gRnJNKMlL8A== 2023-11-18T20:57:58.031 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2023-11-18T20:57:58.031 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA3JVllwe7yGRAA+uNTlhZy3103VMNRVPxQkw== 2023-11-18T20:57:58.031 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2023-11-18T20:57:58.031 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA3JVllXwSMIhAA2eQVWi2Fjpv91D/u92MDSQ== 2023-11-18T20:57:58.031 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.e] 2023-11-18T20:57:58.031 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA3JVll4dzoKhAAQvce93U9FU06Exv/ygRF6g== 2023-11-18T20:57:58.032 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2023-11-18T20:57:58.032 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA5JVllAQj+EhAAiRxIb/ACv4IbWr/CaZNKpQ== 2023-11-18T20:57:58.032 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2023-11-18T20:57:58.032 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA8JVll7Z7oGRAAAd4U8Z8+qtMItEV4qN17Yg== 2023-11-18T20:57:58.032 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2023-11-18T20:57:58.032 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA/JVllcFN/IhAAGmWRzE/lNZEcqspt4WRhXQ== 2023-11-18T20:57:58.032 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.3] 2023-11-18T20:57:58.032 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBCJVllKVCNKxAAe17W6h8Hl8ntY+j4KzzrZQ== 2023-11-18T20:57:58.032 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2023-11-18T20:57:58.032 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA3JVllAMH9FRAAwcagFQgM+ClyOpfCQIVu+A== 2023-11-18T20:57:58.032 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2023-11-18T20:57:58.033 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA3JVllrSn8MBAAEYV63LTVShWu5zREZn7YHQ== 2023-11-18T20:57:58.033 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2023-11-18T20:57:58.033 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA3JVllW+ZhORAASweXs8LZ/qd+vb7QxQAlfQ== 2023-11-18T20:57:58.033 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.f] 2023-11-18T20:57:58.033 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA4JVllM8BUBhAAuqQXBrKnFhTwasCzyezS1A== 2023-11-18T20:57:58.033 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.4] 2023-11-18T20:57:58.033 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBIJVllkouvKhAAwgxy+81fzHyDMcTnm8acXw== 2023-11-18T20:57:58.033 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.5] 2023-11-18T20:57:58.033 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBLJVll2gpFMRAAMamKCoKE8ThRAcEs5Lu/Lg== 2023-11-18T20:57:58.033 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.6] 2023-11-18T20:57:58.033 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBOJVllTB7GORAAHh74RyDtZeVzq9nXeN/JEQ== 2023-11-18T20:57:58.034 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.7] 2023-11-18T20:57:58.034 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBSJVll0e3QBhAAZHGYIYvgZgd4p/Me67OGZA== 2023-11-18T20:57:58.034 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2023-11-18T20:57:58.034 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA4JVll704KDBAAj6Lw+QBOpO/Ae+AqcGpSvg== 2023-11-18T20:57:58.034 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T20:57:58.074 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T20:57:58.119 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:57:58.122 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:57:58.207 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:57:58.209 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:57:58.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:57:58.293 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:57:58.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:58.340 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:58.420 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:58.422 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:58.501 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:58.504 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:58.586 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:58.588 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:58.666 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T20:57:58.673 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T20:57:58.750 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:57:58.757 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:57:58.841 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:57:58.845 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:57:58.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:57:58.896 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T20:57:58.975 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:58.978 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:59.064 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:59.066 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:59.111 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:59.113 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:59.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:59.198 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T20:57:59.269 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T20:57:59.283 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T20:57:59.358 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-18T20:57:59.358 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-18T20:57:59.371 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-18T20:57:59.471 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-18T20:57:59.483 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-18T20:57:59.497 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-18T20:57:59.596 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-18T20:57:59.607 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-18T20:57:59.665 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-18T20:57:59.764 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-18T20:57:59.774 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:57:59.776 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-18T20:57:59.819 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-18T20:57:59.819 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-18T20:57:59.819 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-18T20:57:59.819 DEBUG:teuthology.orchestra.run.smithi049:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-11-18T20:57:59.825 INFO:tasks.ceph.mon.a:Started 2023-11-18T20:57:59.825 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-18T20:57:59.826 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-18T20:57:59.826 DEBUG:teuthology.orchestra.run.smithi106:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-11-18T20:57:59.865 INFO:tasks.ceph.mon.b:Started 2023-11-18T20:57:59.865 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-18T20:57:59.865 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-18T20:57:59.865 DEBUG:teuthology.orchestra.run.smithi106:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-11-18T20:57:59.867 INFO:tasks.ceph.mon.c:Started 2023-11-18T20:57:59.867 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-18T20:57:59.868 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-18T20:57:59.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-11-18T20:57:59.871 INFO:tasks.ceph.mgr.y:Started 2023-11-18T20:57:59.871 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-18T20:57:59.871 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-11-18T20:57:59.873 INFO:tasks.ceph.mgr.x:Started 2023-11-18T20:57:59.873 INFO:tasks.ceph:Setting crush tunables to default 2023-11-18T20:57:59.874 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd crush tunables default 2023-11-18T20:57:59.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:59.994+0000 7f8c72ca8640 1 Processor -- start 2023-11-18T20:57:59.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:59.994+0000 7f8c72ca8640 1 -- start start 2023-11-18T20:58:00.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:59.998+0000 7f8c72ca8640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c0cbd50 0x7f8c6c0c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:00.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:59.998+0000 7f8c72ca8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 0x7f8c6c156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:00.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:59.998+0000 7f8c72ca8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0c1570 con 0x7f8c6c0c0ee0 2023-11-18T20:58:00.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:59.998+0000 7f8c72ca8640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c1370 con 0x7f8c6c0cc130 2023-11-18T20:58:00.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:59.998+0000 7f8c72ca8640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c1810 con 0x7f8c6c0cbd50 2023-11-18T20:58:00.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:59.998+0000 7f8c6bfff640 1 -- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 msgr2=0x7f8c6c156d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.49:3300/0 2023-11-18T20:58:00.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:59.998+0000 7f8c6bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 0x7f8c6c156d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-18T20:58:00.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:59.998+0000 7f8c70a44640 1 -- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c0cbd50 msgr2=0x7f8c6c0c8490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3301/0 2023-11-18T20:58:00.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:59.998+0000 7f8c70a44640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c0cbd50 0x7f8c6c0c8490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-18T20:58:00.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:57:59.998+0000 7f8c71245640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f8c6c0c0ee0 legacy=0x7f8c6c0c6820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2023-11-18T20:58:00.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:00.202+0000 7f8c6bfff640 1 -- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 msgr2=0x7f8c6c156d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.49:3300/0 2023-11-18T20:58:00.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:00.202+0000 7f8c6bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 0x7f8c6c156d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-18T20:58:00.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:00.202+0000 7f8c71245640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f8c6c0c0ee0 legacy=0x7f8c6c0c6820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2023-11-18T20:58:00.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:00.202+0000 7f8c70a44640 1 -- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c0cbd50 msgr2=0x7f8c6c0c8490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3301/0 2023-11-18T20:58:00.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:00.202+0000 7f8c70a44640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c0cbd50 0x7f8c6c0c8490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-18T20:58:00.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:00.606+0000 7f8c6bfff640 1 -- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 msgr2=0x7f8c6c156d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.49:3300/0 2023-11-18T20:58:00.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:00.606+0000 7f8c6bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 0x7f8c6c156d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-18T20:58:00.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:00.606+0000 7f8c71245640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f8c6c0c0ee0 legacy=0x7f8c6c0c6820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2023-11-18T20:58:00.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:00.606+0000 7f8c70a44640 1 -- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c0cbd50 msgr2=0x7f8c6c0c8490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3301/0 2023-11-18T20:58:00.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:00.606+0000 7f8c70a44640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c0cbd50 0x7f8c6c0c8490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-18T20:58:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:01.410+0000 7f8c6bfff640 1 -- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 msgr2=0x7f8c6c156d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.49:3300/0 2023-11-18T20:58:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:01.410+0000 7f8c6bfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 0x7f8c6c156d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-18T20:58:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:01.410+0000 7f8c71245640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f8c6c0c0ee0 legacy=0x7f8c6c0c6820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2023-11-18T20:58:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:01.410+0000 7f8c70a44640 1 -- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c0cbd50 msgr2=0x7f8c6c0c8490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3301/0 2023-11-18T20:58:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:01.410+0000 7f8c70a44640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c0cbd50 0x7f8c6c0c8490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-18T20:58:03.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:02.998+0000 7f8c6a7fc640 1 -- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c0cbd50 msgr2=0x7f8c6c0c8490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:58:03.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:02.998+0000 7f8c6a7fc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c0cbd50 0x7f8c6c0c8490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:03.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:02.998+0000 7f8c6a7fc640 1 -- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 msgr2=0x7f8c6c156d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:58:03.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:02.998+0000 7f8c6a7fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 0x7f8c6c156d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:03.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:02.998+0000 7f8c6a7fc640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f8c6c0c0ee0 legacy=0x7f8c6c0c6820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:58:03.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:02.998+0000 7f8c6a7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c580036d0 0x7f8c58005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:03.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:02.998+0000 7f8c6a7fc640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0c1af0 con 0x7f8c580061a0 2023-11-18T20:58:03.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:02.998+0000 7f8c6a7fc640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c1370 con 0x7f8c580036d0 2023-11-18T20:58:03.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:02.998+0000 7f8c6bfff640 1 -- >> v1:172.21.15.49:6789/0 conn(0x7f8c580061a0 legacy=0x7f8c58008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.49:6789/0 2023-11-18T20:58:03.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:02.998+0000 7f8c70a44640 1 -- >> v2:172.21.15.106:3300/0 conn(0x7f8c580036d0 msgr2=0x7f8c58005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3300/0 2023-11-18T20:58:03.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:02.998+0000 7f8c70a44640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c580036d0 0x7f8c58005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-18T20:58:03.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:03.202+0000 7f8c6bfff640 1 -- >> v1:172.21.15.49:6789/0 conn(0x7f8c580061a0 legacy=0x7f8c58008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.49:6789/0 2023-11-18T20:58:03.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:03.202+0000 7f8c70a44640 1 -- >> v2:172.21.15.106:3300/0 conn(0x7f8c580036d0 msgr2=0x7f8c58005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3300/0 2023-11-18T20:58:03.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:03.202+0000 7f8c70a44640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c580036d0 0x7f8c58005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-18T20:58:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:03.606+0000 7f8c6bfff640 1 -- >> v1:172.21.15.49:6789/0 conn(0x7f8c580061a0 legacy=0x7f8c58008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.49:6789/0 2023-11-18T20:58:03.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:03.606+0000 7f8c70a44640 1 -- >> v2:172.21.15.106:3300/0 conn(0x7f8c580036d0 msgr2=0x7f8c58005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3300/0 2023-11-18T20:58:03.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:03.606+0000 7f8c70a44640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c580036d0 0x7f8c58005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-18T20:58:04.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:04.410+0000 7f8c6bfff640 1 -- >> v1:172.21.15.49:6789/0 conn(0x7f8c580061a0 legacy=0x7f8c58008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.49:6789/0 2023-11-18T20:58:04.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:04.410+0000 7f8c70a44640 1 -- >> v2:172.21.15.106:3300/0 conn(0x7f8c580036d0 msgr2=0x7f8c58005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3300/0 2023-11-18T20:58:04.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:04.410+0000 7f8c70a44640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c580036d0 0x7f8c58005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-18T20:58:06.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:05.998+0000 7f8c6a7fc640 1 -- >> v2:172.21.15.106:3300/0 conn(0x7f8c580036d0 msgr2=0x7f8c58005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:58:06.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:05.998+0000 7f8c6a7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c580036d0 0x7f8c58005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:06.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:05.998+0000 7f8c6a7fc640 1 -- >> v1:172.21.15.49:6789/0 conn(0x7f8c580061a0 legacy=0x7f8c58008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:58:06.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:05.998+0000 7f8c6a7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c5800a070 0x7f8c5800c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:06.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:05.998+0000 7f8c71245640 1 -- reap_dead start 2023-11-18T20:58:06.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:05.998+0000 7f8c6a7fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 0x7f8c58016d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:06.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:05.998+0000 7f8c6a7fc640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0c1570 con 0x7f8c5800caf0 2023-11-18T20:58:06.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:05.998+0000 7f8c6a7fc640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c1370 con 0x7f8c6c0cc130 2023-11-18T20:58:06.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:05.998+0000 7f8c6a7fc640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c1810 con 0x7f8c5800a070 2023-11-18T20:58:06.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:05.998+0000 7f8c6bfff640 1 -- >> v1:172.21.15.49:6789/0 conn(0x7f8c5800caf0 legacy=0x7f8c580135a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.49:6789/0 2023-11-18T20:58:06.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:05.998+0000 7f8c71245640 1 -- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 msgr2=0x7f8c58016d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.49:3300/0 2023-11-18T20:58:06.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:05.998+0000 7f8c71245640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 0x7f8c58016d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-18T20:58:06.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:05.998+0000 7f8c70a44640 1 -- >> v2:172.21.15.106:3300/0 conn(0x7f8c5800a070 msgr2=0x7f8c5800c4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3300/0 2023-11-18T20:58:06.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:05.998+0000 7f8c70a44640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c5800a070 0x7f8c5800c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-18T20:58:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:06.202+0000 7f8c6bfff640 1 -- >> v1:172.21.15.49:6789/0 conn(0x7f8c5800caf0 legacy=0x7f8c580135a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.49:6789/0 2023-11-18T20:58:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:06.202+0000 7f8c71245640 1 -- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 msgr2=0x7f8c58016d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.49:3300/0 2023-11-18T20:58:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:06.202+0000 7f8c71245640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 0x7f8c58016d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-18T20:58:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:06.202+0000 7f8c70a44640 1 -- >> v2:172.21.15.106:3300/0 conn(0x7f8c5800a070 msgr2=0x7f8c5800c4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3300/0 2023-11-18T20:58:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:06.202+0000 7f8c70a44640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c5800a070 0x7f8c5800c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-18T20:58:06.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:06.606+0000 7f8c6bfff640 1 -- >> v1:172.21.15.49:6789/0 conn(0x7f8c5800caf0 legacy=0x7f8c580135a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.49:6789/0 2023-11-18T20:58:06.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:06.606+0000 7f8c71245640 1 -- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 msgr2=0x7f8c58016d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.49:3300/0 2023-11-18T20:58:06.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:06.606+0000 7f8c71245640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 0x7f8c58016d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-18T20:58:06.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:06.606+0000 7f8c70a44640 1 -- >> v2:172.21.15.106:3300/0 conn(0x7f8c5800a070 msgr2=0x7f8c5800c4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3300/0 2023-11-18T20:58:06.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:06.606+0000 7f8c70a44640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c5800a070 0x7f8c5800c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-18T20:58:07.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:07.410+0000 7f8c6bfff640 1 -- >> v1:172.21.15.49:6789/0 conn(0x7f8c5800caf0 legacy=0x7f8c580135a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.49:6789/0 2023-11-18T20:58:07.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:07.410+0000 7f8c71245640 1 -- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 msgr2=0x7f8c58016d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.49:3300/0 2023-11-18T20:58:07.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:07.410+0000 7f8c71245640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 0x7f8c58016d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-18T20:58:07.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:07.410+0000 7f8c70a44640 1 -- >> v2:172.21.15.106:3300/0 conn(0x7f8c5800a070 msgr2=0x7f8c5800c4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3300/0 2023-11-18T20:58:07.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:07.410+0000 7f8c70a44640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c5800a070 0x7f8c5800c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-18T20:58:09.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:08.998+0000 7f8c6a7fc640 1 -- >> v2:172.21.15.106:3300/0 conn(0x7f8c5800a070 msgr2=0x7f8c5800c4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:58:09.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:08.998+0000 7f8c6a7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c5800a070 0x7f8c5800c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:09.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:08.998+0000 7f8c6a7fc640 1 -- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 msgr2=0x7f8c58016d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:58:09.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:08.998+0000 7f8c6a7fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c6c0cc130 0x7f8c58016d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:09.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:08.998+0000 7f8c6a7fc640 1 -- >> v1:172.21.15.49:6789/0 conn(0x7f8c5800caf0 legacy=0x7f8c580135a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:58:09.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:08.998+0000 7f8c6a7fc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c58005b80 0x7f8c58007750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:09.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:08.998+0000 7f8c6a7fc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0c1af0 con 0x7f8c58008e30 2023-11-18T20:58:09.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:08.998+0000 7f8c6a7fc640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c1370 con 0x7f8c58005b80 2023-11-18T20:58:09.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:08.998+0000 7f8c6bfff640 1 -- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c58005b80 msgr2=0x7f8c58007750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3301/0 2023-11-18T20:58:09.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:08.998+0000 7f8c70a44640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f8c58008e30 legacy=0x7f8c58009240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2023-11-18T20:58:09.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:08.998+0000 7f8c6bfff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c58005b80 0x7f8c58007750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-18T20:58:09.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:09.202+0000 7f8c6bfff640 1 -- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c58005b80 msgr2=0x7f8c58007750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3301/0 2023-11-18T20:58:09.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:09.202+0000 7f8c70a44640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f8c58008e30 legacy=0x7f8c58009240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2023-11-18T20:58:09.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:09.202+0000 7f8c6bfff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c58005b80 0x7f8c58007750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-18T20:58:09.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:09.606+0000 7f8c6bfff640 1 -- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c58005b80 msgr2=0x7f8c58007750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3301/0 2023-11-18T20:58:09.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:09.606+0000 7f8c70a44640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f8c58008e30 legacy=0x7f8c58009240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2023-11-18T20:58:09.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:09.606+0000 7f8c6bfff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c58005b80 0x7f8c58007750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-18T20:58:09.617 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:00:09.602 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T20:58:09.648 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:00:09.634 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T20:58:10.109 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:00:10.151 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T20:58:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:10.410+0000 7f8c70a44640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f8c58008e30 legacy=0x7f8c58009240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2023-11-18T20:58:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:10.410+0000 7f8c6bfff640 1 -- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c58005b80 msgr2=0x7f8c58007750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3301/0 2023-11-18T20:58:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:10.410+0000 7f8c6bfff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c58005b80 0x7f8c58007750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-18T20:58:10.451 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:00:10.435 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T20:58:10.482 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:00:10.468 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T20:58:11.000 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:00:11.042 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T20:58:12.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:11.998+0000 7f8c6a7fc640 1 -- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c58005b80 msgr2=0x7f8c58007750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:58:12.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:11.998+0000 7f8c6a7fc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c58005b80 0x7f8c58007750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:12.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:11.998+0000 7f8c6a7fc640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f8c58008e30 legacy=0x7f8c58009240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:58:12.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:11.998+0000 7f8c71245640 1 -- reap_dead start 2023-11-18T20:58:12.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:11.998+0000 7f8c6a7fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c58009240 0x7f8c5800a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:12.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:11.998+0000 7f8c6a7fc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 0x7f8c58008750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:12.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:11.998+0000 7f8c6a7fc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0c1570 con 0x7f8c5800a990 2023-11-18T20:58:12.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:11.998+0000 7f8c6a7fc640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c1370 con 0x7f8c58009240 2023-11-18T20:58:12.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:11.998+0000 7f8c6a7fc640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c1810 con 0x7f8c5800c490 2023-11-18T20:58:12.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:11.998+0000 7f8c70a44640 1 -- >> v2:172.21.15.49:3300/0 conn(0x7f8c58009240 msgr2=0x7f8c5800a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.49:3300/0 2023-11-18T20:58:12.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:11.998+0000 7f8c70a44640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c58009240 0x7f8c5800a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-18T20:58:12.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:11.998+0000 7f8c6bfff640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f8c5800a990 legacy=0x7f8c5800ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2023-11-18T20:58:12.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:11.998+0000 7f8c71245640 1 -- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 msgr2=0x7f8c58008750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3301/0 2023-11-18T20:58:12.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:11.998+0000 7f8c71245640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 0x7f8c58008750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-18T20:58:12.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:12.202+0000 7f8c70a44640 1 -- >> v2:172.21.15.49:3300/0 conn(0x7f8c58009240 msgr2=0x7f8c5800a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.49:3300/0 2023-11-18T20:58:12.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:12.202+0000 7f8c70a44640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c58009240 0x7f8c5800a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-18T20:58:12.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:12.202+0000 7f8c6bfff640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f8c5800a990 legacy=0x7f8c5800ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2023-11-18T20:58:12.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:12.202+0000 7f8c71245640 1 -- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 msgr2=0x7f8c58008750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.106:3301/0 2023-11-18T20:58:12.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:12.202+0000 7f8c71245640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 0x7f8c58008750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-18T20:58:12.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:12.606+0000 7f8c70a44640 1 -- >> v2:172.21.15.49:3300/0 conn(0x7f8c58009240 msgr2=0x7f8c5800a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.49:3300/0 2023-11-18T20:58:12.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:12.606+0000 7f8c70a44640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c58009240 0x7f8c5800a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-18T20:58:12.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:12.606+0000 7f8c6bfff640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f8c5800a990 legacy=0x7f8c5800ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2023-11-18T20:58:13.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:13.002+0000 7f8c71245640 1 -- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 msgr2=0x7f8c58008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-18T20:58:13.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:13.002+0000 7f8c71245640 1 -- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 msgr2=0x7f8c58008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:58:13.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:13.002+0000 7f8c71245640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 0x7f8c58008750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2023-11-18T20:58:13.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:13.002+0000 7f8c71245640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 0x7f8c58008750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-18T20:58:13.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:13.806+0000 7f8c71245640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 0x7f8c58008750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:13.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:13.806+0000 7f8c71245640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 0x7f8c58008750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:57990/0 (socket says 172.21.15.49:57990) 2023-11-18T20:58:13.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:13.806+0000 7f8c71245640 1 -- 172.21.15.49:0/1696934954 learned_addr learned my addr 172.21.15.49:0/1696934954 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:58:13.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:13.810+0000 7f8c71245640 1 -- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 msgr2=0x7f8c58008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-18T20:58:13.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:13.810+0000 7f8c71245640 1 -- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 msgr2=0x7f8c58008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:58:13.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:13.810+0000 7f8c71245640 1 --2- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 0x7f8c58008750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T20:58:13.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:13.810+0000 7f8c71245640 1 --2- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 0x7f8c58008750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-18T20:58:14.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:14.326+0000 7f8c70a44640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c58009240 0x7f8c5800a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:14.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:14.430+0000 7f8c70a44640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c58009240 msgr2=0x7f8c5800a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-18T20:58:14.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:14.430+0000 7f8c70a44640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c58009240 msgr2=0x7f8c5800a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:58:14.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:14.430+0000 7f8c70a44640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c58009240 0x7f8c5800a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T20:58:14.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:14.434+0000 7f8c70a44640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c58009240 0x7f8c5800a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-18T20:58:15.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:14.998+0000 7f8c6a7fc640 1 -- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 msgr2=0x7f8c58008750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:58:15.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:14.998+0000 7f8c6a7fc640 1 --2- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c5800c490 0x7f8c58008750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:15.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:14.998+0000 7f8c6a7fc640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c58009240 msgr2=0x7f8c5800a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:58:15.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:14.998+0000 7f8c6a7fc640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c58009240 0x7f8c5800a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:15.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:14.998+0000 7f8c6a7fc640 1 -- 172.21.15.49:0/1696934954 >> v1:172.21.15.106:6789/0 conn(0x7f8c5800a990 legacy=0x7f8c5800ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:15.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:14.998+0000 7f8c6a7fc640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 0x7f8c580194a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:15.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:14.998+0000 7f8c6a7fc640 1 -- 172.21.15.49:0/1696934954 --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0c1af0 con 0x7f8c580135a0 2023-11-18T20:58:15.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:14.998+0000 7f8c6a7fc640 1 -- 172.21.15.49:0/1696934954 --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c1370 con 0x7f8c580170b0 2023-11-18T20:58:15.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.050+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 0x7f8c580194a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.058+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 msgr2=0x7f8c580194a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-18T20:58:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.058+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 msgr2=0x7f8c580194a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:58:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.058+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 0x7f8c580194a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T20:58:15.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.058+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 0x7f8c580194a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-18T20:58:15.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.266+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 0x7f8c580194a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:15.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.270+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 msgr2=0x7f8c580194a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-18T20:58:15.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.270+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 msgr2=0x7f8c580194a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:58:15.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.270+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 0x7f8c580194a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T20:58:15.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.270+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 0x7f8c580194a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-18T20:58:15.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.722+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 0x7f8c580194a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:15.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.722+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 msgr2=0x7f8c580194a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-18T20:58:15.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.722+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 msgr2=0x7f8c580194a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:58:15.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.722+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 0x7f8c580194a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T20:58:15.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:15.722+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 0x7f8c580194a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-18T20:58:16.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:16.526+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 0x7f8c580194a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:16.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:16.530+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 msgr2=0x7f8c580194a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-18T20:58:16.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:16.530+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 msgr2=0x7f8c580194a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:58:16.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:16.530+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 0x7f8c580194a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T20:58:16.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:16.530+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 0x7f8c580194a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-18T20:58:18.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:17.998+0000 7f8c6a7fc640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 msgr2=0x7f8c580194a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:58:18.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:17.998+0000 7f8c6a7fc640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c580170b0 0x7f8c580194a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:18.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:17.998+0000 7f8c6a7fc640 1 -- 172.21.15.49:0/1696934954 >> v1:172.21.15.49:6789/0 conn(0x7f8c580135a0 legacy=0x7f8c58015990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:18.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:17.998+0000 7f8c71245640 1 -- 172.21.15.49:0/1696934954 reap_dead start 2023-11-18T20:58:18.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:17.998+0000 7f8c6a7fc640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 0x7f8c58008750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:18.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:17.998+0000 7f8c6a7fc640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 0x7f8c580135a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:18.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:17.998+0000 7f8c6a7fc640 1 -- 172.21.15.49:0/1696934954 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c58009690 con 0x7f8c58009240 2023-11-18T20:58:18.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:17.998+0000 7f8c6a7fc640 1 -- 172.21.15.49:0/1696934954 --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c1370 con 0x7f8c5800bb70 2023-11-18T20:58:18.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:17.998+0000 7f8c6a7fc640 1 -- 172.21.15.49:0/1696934954 --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c1810 con 0x7f8c5800bf50 2023-11-18T20:58:18.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.046+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 0x7f8c58008750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:18.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.050+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 msgr2=0x7f8c58008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-18T20:58:18.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.050+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 msgr2=0x7f8c58008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:58:18.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.050+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 0x7f8c58008750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T20:58:18.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.050+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 0x7f8c58008750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-18T20:58:18.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.082+0000 7f8c71245640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 0x7f8c580135a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:18.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.162+0000 7f8c71245640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 msgr2=0x7f8c580135a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-18T20:58:18.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.162+0000 7f8c71245640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 msgr2=0x7f8c580135a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:58:18.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.162+0000 7f8c71245640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 0x7f8c580135a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T20:58:18.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.162+0000 7f8c71245640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 0x7f8c580135a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-18T20:58:18.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.366+0000 7f8c71245640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 0x7f8c580135a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.370+0000 7f8c71245640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 msgr2=0x7f8c580135a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-18T20:58:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.370+0000 7f8c71245640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 msgr2=0x7f8c580135a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:58:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.370+0000 7f8c71245640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 0x7f8c580135a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T20:58:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.370+0000 7f8c71245640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 0x7f8c580135a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-18T20:58:18.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.386+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 0x7f8c58008750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.390+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 msgr2=0x7f8c58008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-18T20:58:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.390+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 msgr2=0x7f8c58008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:58:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.390+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 0x7f8c58008750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T20:58:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.390+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 0x7f8c58008750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-18T20:58:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.834+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 0x7f8c58008750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:18.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.862+0000 7f8c71245640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 0x7f8c580135a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:18.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.866+0000 7f8c71245640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 msgr2=0x7f8c580135a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-18T20:58:18.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.866+0000 7f8c71245640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 msgr2=0x7f8c580135a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:58:18.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.866+0000 7f8c71245640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 0x7f8c580135a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T20:58:18.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.866+0000 7f8c71245640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 0x7f8c580135a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-18T20:58:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.922+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 msgr2=0x7f8c58008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-18T20:58:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.922+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 msgr2=0x7f8c58008750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T20:58:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.922+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 0x7f8c58008750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T20:58:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:18.922+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 0x7f8c58008750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-18T20:58:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.374+0000 7f8c6b7fe640 1 -- 172.21.15.49:0/1696934954 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578589439 0 0) 0x7f8c58009690 con 0x7f8c58009240 2023-11-18T20:58:19.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.374+0000 7f8c6b7fe640 1 -- 172.21.15.49:0/1696934954 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c54003530 con 0x7f8c58009240 2023-11-18T20:58:19.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.694+0000 7f8c6b7fe640 1 -- 172.21.15.49:0/1696934954 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 685597183 0 0) 0x7f8c54003530 con 0x7f8c58009240 2023-11-18T20:58:19.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.694+0000 7f8c6b7fe640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 msgr2=0x7f8c580135a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:19.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.694+0000 7f8c6b7fe640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.106:3300/0 conn(0x7f8c5800bf50 0x7f8c580135a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:19.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.694+0000 7f8c6b7fe640 1 -- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 msgr2=0x7f8c58008750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T20:58:19.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.694+0000 7f8c6b7fe640 1 --2- 172.21.15.49:0/1696934954 >> v2:172.21.15.49:3300/0 conn(0x7f8c5800bb70 0x7f8c58008750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:19.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.694+0000 7f8c6b7fe640 1 -- 172.21.15.49:0/1696934954 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5800c3c0 con 0x7f8c58009240 2023-11-18T20:58:19.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.694+0000 7f8c6b7fe640 1 -- 172.21.15.49:0/1696934954 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7f8c5c009930 con 0x7f8c58009240 2023-11-18T20:58:19.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.694+0000 7f8c6b7fe640 1 -- 172.21.15.49:0/1696934954 >> v1:172.21.15.106:6789/0 conn(0x7f8c58009240 legacy=0x7f8c5800a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:19.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.694+0000 7f8c6b7fe640 1 --2- 172.21.15.49:0/1696934954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c540039f0 0x7f8c54003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:19.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.694+0000 7f8c6b7fe640 1 --2- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c540047d0 0x7f8c54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:19.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.694+0000 7f8c6b7fe640 1 --2- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c54005190 0x7f8c5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:19.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.694+0000 7f8c6b7fe640 1 -- 172.21.15.49:0/1696934954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c1370 con 0x7f8c540039f0 2023-11-18T20:58:19.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.694+0000 7f8c6b7fe640 1 -- 172.21.15.49:0/1696934954 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c1810 con 0x7f8c540047d0 2023-11-18T20:58:19.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.694+0000 7f8c6b7fe640 1 -- 172.21.15.49:0/1696934954 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5400c140 con 0x7f8c54005190 2023-11-18T20:58:19.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.702+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c540047d0 0x7f8c54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:19.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.726+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c54005190 msgr2=0x7f8c5400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:19.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.726+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c54005190 0x7f8c5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:19.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.726+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c540039f0 msgr2=0x7f8c54003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:19.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.726+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c540039f0 0x7f8c54003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:19.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.726+0000 7f8c6bfff640 1 -- 172.21.15.49:0/1696934954 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c54003530 con 0x7f8c540047d0 2023-11-18T20:58:19.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.726+0000 7f8c71245640 1 -- 172.21.15.49:0/1696934954 reap_dead start 2023-11-18T20:58:19.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.762+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c540047d0 0x7f8c54004c50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009400 tx=0x7f8c6001db00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc6f2932da3ad6d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:19.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.854+0000 7f8c6b7fe640 1 -- 172.21.15.49:0/1696934954 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600a6910 con 0x7f8c540047d0 2023-11-18T20:58:19.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.854+0000 7f8c6b7fe640 1 -- 172.21.15.49:0/1696934954 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c60012040 con 0x7f8c540047d0 2023-11-18T20:58:19.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.854+0000 7f8c6b7fe640 1 -- 172.21.15.49:0/1696934954 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600a6cd0 con 0x7f8c540047d0 2023-11-18T20:58:19.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.854+0000 7f8c72ca8640 1 -- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c540047d0 msgr2=0x7f8c54004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:19.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.854+0000 7f8c72ca8640 1 --2- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c540047d0 0x7f8c54004c50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009400 tx=0x7f8c6001db00 comp rx=0 tx=0).stop 2023-11-18T20:58:19.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.854+0000 7f8c72ca8640 1 -- 172.21.15.49:0/1696934954 shutdown_connections 2023-11-18T20:58:19.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.854+0000 7f8c72ca8640 1 --2- 172.21.15.49:0/1696934954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c540047d0 0x7f8c54004c50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:19.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.854+0000 7f8c72ca8640 1 -- 172.21.15.49:0/1696934954 >> 172.21.15.49:0/1696934954 conn(0x7f8c6c070160 msgr2=0x7f8c6c06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:19.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.854+0000 7f8c72ca8640 1 -- 172.21.15.49:0/1696934954 shutdown_connections 2023-11-18T20:58:19.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.854+0000 7f8c72ca8640 1 -- 172.21.15.49:0/1696934954 wait complete. 2023-11-18T20:58:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.858+0000 7f8c72ca8640 1 Processor -- start 2023-11-18T20:58:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.858+0000 7f8c72ca8640 1 -- start start 2023-11-18T20:58:19.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.858+0000 7f8c72ca8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c540047d0 0x7f8c6c0c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:19.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.858+0000 7f8c72ca8640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c14b670 0x7f8c6c143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:19.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.858+0000 7f8c72ca8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c6c1ebab0 0x7f8c6c1ebf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:19.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.858+0000 7f8c72ca8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c4c40 con 0x7f8c6c1ebab0 2023-11-18T20:58:19.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.858+0000 7f8c72ca8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c4960 con 0x7f8c540047d0 2023-11-18T20:58:19.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.858+0000 7f8c72ca8640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c1ef0c0 con 0x7f8c6c14b670 2023-11-18T20:58:19.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.866+0000 7f8c6bfff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c14b670 0x7f8c6c143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:19.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.866+0000 7f8c6bfff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c14b670 0x7f8c6c143700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:45622/0 (socket says 172.21.15.49:45622) 2023-11-18T20:58:19.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.866+0000 7f8c6bfff640 1 -- 172.21.15.49:0/846898677 learned_addr learned my addr 172.21.15.49:0/846898677 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:58:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.866+0000 7f8c70a44640 1 --2- 172.21.15.49:0/846898677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c540047d0 0x7f8c6c0c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.874+0000 7f8c6bfff640 1 -- 172.21.15.49:0/846898677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c540047d0 msgr2=0x7f8c6c0c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.874+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/846898677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c540047d0 0x7f8c6c0c42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.874+0000 7f8c6bfff640 1 -- 172.21.15.49:0/846898677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c6c1ebab0 msgr2=0x7f8c6c1ebf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.874+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/846898677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c6c1ebab0 0x7f8c6c1ebf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:19.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.874+0000 7f8c6bfff640 1 -- 172.21.15.49:0/846898677 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c1ef3a0 con 0x7f8c6c14b670 2023-11-18T20:58:19.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:19.954+0000 7f8c6bfff640 1 --2- 172.21.15.49:0/846898677 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c14b670 0x7f8c6c143700 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8c60000eb0 tx=0x7f8c54005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:20.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:20.006+0000 7f8c697fa640 1 -- 172.21.15.49:0/846898677 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600c0070 con 0x7f8c6c14b670 2023-11-18T20:58:20.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:20.006+0000 7f8c697fa640 1 -- 172.21.15.49:0/846898677 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c60009630 con 0x7f8c6c14b670 2023-11-18T20:58:20.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:20.006+0000 7f8c72ca8640 1 -- 172.21.15.49:0/846898677 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c1ef680 con 0x7f8c6c14b670 2023-11-18T20:58:20.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:20.006+0000 7f8c697fa640 1 -- 172.21.15.49:0/846898677 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600ae6a0 con 0x7f8c6c14b670 2023-11-18T20:58:20.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:20.006+0000 7f8c72ca8640 1 -- 172.21.15.49:0/846898677 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c0c53c0 con 0x7f8c6c14b670 2023-11-18T20:58:20.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:20.010+0000 7f8c72ca8640 1 -- 172.21.15.49:0/846898677 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c073e70 con 0x7f8c6c14b670 2023-11-18T20:58:20.186 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:20.180+0000 7f53f8382180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-18T20:58:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:20.282+0000 7f8c697fa640 1 -- 172.21.15.49:0/846898677 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8c600b5050 con 0x7f8c6c14b670 2023-11-18T20:58:20.285 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:20.282+0000 7f79d28e1180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-18T20:58:20.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:20.290+0000 7f8c697fa640 1 -- 172.21.15.49:0/846898677 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8c600c5690 con 0x7f8c6c14b670 2023-11-18T20:58:20.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:20.290+0000 7f8c697fa640 1 -- 172.21.15.49:0/846898677 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8c600b3070 con 0x7f8c6c14b670 2023-11-18T20:58:20.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:20.374+0000 7f8c72ca8640 1 -- 172.21.15.49:0/846898677 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8c6c1ef200 con 0x7f8c6c14b670 2023-11-18T20:58:20.718 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:20.712+0000 7f53f8382180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-18T20:58:20.850 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:20.846+0000 7f79d28e1180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-18T20:58:20.904 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:20.900+0000 7f53f8382180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-18T20:58:21.040 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:21.034+0000 7f79d28e1180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-18T20:58:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:21.306+0000 7f8c697fa640 1 -- 172.21.15.49:0/846898677 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8c6c1ef200 con 0x7f8c6c14b670 2023-11-18T20:58:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2023-11-18T20:58:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:21.310+0000 7f8c72ca8640 1 -- 172.21.15.49:0/846898677 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c14b670 msgr2=0x7f8c6c143700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:21.310+0000 7f8c72ca8640 1 --2- 172.21.15.49:0/846898677 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c14b670 0x7f8c6c143700 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8c60000eb0 tx=0x7f8c54005800 comp rx=0 tx=0).stop 2023-11-18T20:58:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:21.310+0000 7f8c72ca8640 1 -- 172.21.15.49:0/846898677 shutdown_connections 2023-11-18T20:58:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:21.310+0000 7f8c72ca8640 1 --2- 172.21.15.49:0/846898677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c6c1ebab0 0x7f8c6c1ebf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:21.310+0000 7f8c72ca8640 1 --2- 172.21.15.49:0/846898677 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c6c14b670 0x7f8c6c143700 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:21.310+0000 7f8c72ca8640 1 --2- 172.21.15.49:0/846898677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c540047d0 0x7f8c6c0c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:21.310+0000 7f8c72ca8640 1 -- 172.21.15.49:0/846898677 >> 172.21.15.49:0/846898677 conn(0x7f8c6c070160 msgr2=0x7f8c6c14e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:21.310+0000 7f8c72ca8640 1 -- 172.21.15.49:0/846898677 shutdown_connections 2023-11-18T20:58:21.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:21.310+0000 7f8c72ca8640 1 -- 172.21.15.49:0/846898677 wait complete. 2023-11-18T20:58:21.335 INFO:tasks.ceph:check_enable_crimson: False 2023-11-18T20:58:21.336 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-18T20:58:21.336 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:58:21.336 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-18T20:58:21.348 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:58:21.348 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-18T20:58:21.403 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:58:21.403 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-18T20:58:21.455 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:58:21.455 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-18T20:58:21.507 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:58:21.507 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-18T20:58:21.508 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:21.504+0000 7f53f8382180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-18T20:58:21.518 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:58:21.519 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-18T20:58:21.563 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:21.556+0000 7f53f8382180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-18T20:58:21.570 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:58:21.571 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-18T20:58:21.621 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:21.616+0000 7f53f8382180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-18T20:58:21.630 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-18T20:58:21.630 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-18T20:58:21.658 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:21.654+0000 7f79d28e1180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-18T20:58:21.683 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 2e82789c-653c-439e-bcd4-3c0cdef4c063 0 2023-11-18T20:58:21.704 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:21.700+0000 7f53f8382180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-18T20:58:21.714 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:21.710+0000 7f79d28e1180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-18T20:58:21.762 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:21.756+0000 7f53f8382180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-18T20:58:21.769 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:21.766+0000 7f79d28e1180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-18T20:58:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.820+0000 7f19aedbc640 1 Processor -- start 2023-11-18T20:58:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.820+0000 7f19aedbc640 1 -- start start 2023-11-18T20:58:21.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.820+0000 7f19aedbc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f19a80726d0 0x7f19a8159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:21.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.820+0000 7f19aedbc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19a8159f60 0x7f19a8160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:21.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.820+0000 7f19aedbc640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a8159590 con 0x7f19a80722f0 2023-11-18T20:58:21.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.820+0000 7f19aedbc640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a8155fa0 con 0x7f19a80726d0 2023-11-18T20:58:21.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.820+0000 7f19aedbc640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a815a3d0 con 0x7f19a8159f60 2023-11-18T20:58:21.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.824+0000 7f19ad359640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19a8159f60 0x7f19a8160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:21.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.824+0000 7f19ad359640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19a8159f60 0x7f19a8160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:54320/0 (socket says 172.21.15.106:54320) 2023-11-18T20:58:21.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.824+0000 7f19ad359640 1 -- 172.21.15.106:0/417684241 learned_addr learned my addr 172.21.15.106:0/417684241 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-18T20:58:21.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.824+0000 7f19a7fff640 1 --2- 172.21.15.106:0/417684241 >> v2:172.21.15.49:3300/0 conn(0x7f19a80726d0 0x7f19a8159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.824+0000 7f19ad359640 1 -- 172.21.15.106:0/417684241 >> v2:172.21.15.49:3300/0 conn(0x7f19a80726d0 msgr2=0x7f19a8159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.824+0000 7f19ad359640 1 --2- 172.21.15.106:0/417684241 >> v2:172.21.15.49:3300/0 conn(0x7f19a80726d0 0x7f19a8159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.824+0000 7f19ad359640 1 -- 172.21.15.106:0/417684241 >> v1:172.21.15.49:6789/0 conn(0x7f19a80722f0 legacy=0x7f19a80c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.824+0000 7f19ad359640 1 -- 172.21.15.106:0/417684241 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a8156190 con 0x7f19a8159f60 2023-11-18T20:58:21.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.828+0000 7f19ad359640 1 --2- 172.21.15.106:0/417684241 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19a8159f60 0x7f19a8160920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009870 tx=0x7f19a001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d8edfb847c98bcf server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:21.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.832+0000 7f19a77fe640 1 -- 172.21.15.106:0/417684241 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a00ab600 con 0x7f19a8159f60 2023-11-18T20:58:21.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.832+0000 7f19a77fe640 1 -- 172.21.15.106:0/417684241 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a00ab760 con 0x7f19a8159f60 2023-11-18T20:58:21.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.832+0000 7f19a77fe640 1 -- 172.21.15.106:0/417684241 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a00abaf0 con 0x7f19a8159f60 2023-11-18T20:58:21.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.832+0000 7f19aedbc640 1 -- 172.21.15.106:0/417684241 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19a8159f60 msgr2=0x7f19a8160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:21.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.832+0000 7f19aedbc640 1 --2- 172.21.15.106:0/417684241 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19a8159f60 0x7f19a8160920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009870 tx=0x7f19a001c440 comp rx=0 tx=0).stop 2023-11-18T20:58:21.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.832+0000 7f19aedbc640 1 -- 172.21.15.106:0/417684241 shutdown_connections 2023-11-18T20:58:21.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.832+0000 7f19aedbc640 1 --2- 172.21.15.106:0/417684241 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19a8159f60 0x7f19a8160920 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:21.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.832+0000 7f19aedbc640 1 --2- 172.21.15.106:0/417684241 >> v2:172.21.15.49:3300/0 conn(0x7f19a80726d0 0x7f19a8159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:21.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.832+0000 7f19aedbc640 1 -- 172.21.15.106:0/417684241 >> 172.21.15.106:0/417684241 conn(0x7f19a806b670 msgr2=0x7f19a806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:21.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.832+0000 7f19aedbc640 1 -- 172.21.15.106:0/417684241 shutdown_connections 2023-11-18T20:58:21.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.832+0000 7f19aedbc640 1 -- 172.21.15.106:0/417684241 wait complete. 2023-11-18T20:58:21.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.836+0000 7f19aedbc640 1 Processor -- start 2023-11-18T20:58:21.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.836+0000 7f19aedbc640 1 -- start start 2023-11-18T20:58:21.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.836+0000 7f19aedbc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19a80722f0 0x7f19a8155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:21.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.836+0000 7f19aedbc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19a80726d0 0x7f19a8152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:21.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.836+0000 7f19aedbc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a8159f60 0x7f19a81526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:21.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.836+0000 7f19aedbc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a8142870 con 0x7f19a8159f60 2023-11-18T20:58:21.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.836+0000 7f19aedbc640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a81ee380 con 0x7f19a80726d0 2023-11-18T20:58:21.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.836+0000 7f19aedbc640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a8142520 con 0x7f19a80722f0 2023-11-18T20:58:21.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.836+0000 7f19a7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19a80726d0 0x7f19a8152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:21.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.836+0000 7f19a7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19a80726d0 0x7f19a8152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42198/0 (socket says 172.21.15.106:42198) 2023-11-18T20:58:21.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.836+0000 7f19acb58640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19a80722f0 0x7f19a8155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:21.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.836+0000 7f19a7fff640 1 -- 172.21.15.106:0/3642443679 learned_addr learned my addr 172.21.15.106:0/3642443679 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-18T20:58:21.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.840+0000 7f19a7fff640 1 -- 172.21.15.106:0/3642443679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19a80722f0 msgr2=0x7f19a8155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:21.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.840+0000 7f19a7fff640 1 --2- 172.21.15.106:0/3642443679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19a80722f0 0x7f19a8155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:21.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.840+0000 7f19a7fff640 1 -- 172.21.15.106:0/3642443679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a8159f60 msgr2=0x7f19a81526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:21.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.840+0000 7f19a7fff640 1 --2- 172.21.15.106:0/3642443679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a8159f60 0x7f19a81526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:21.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.840+0000 7f19a7fff640 1 -- 172.21.15.106:0/3642443679 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00094d0 con 0x7f19a80726d0 2023-11-18T20:58:21.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.844+0000 7f19a7fff640 1 --2- 172.21.15.106:0/3642443679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19a80726d0 0x7f19a8152190 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f199000d5f0 tx=0x7f199000dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:21.849 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:21.846+0000 7f79d28e1180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-18T20:58:21.851 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:21.844+0000 7f53f8382180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-18T20:58:21.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.848+0000 7f19a57fa640 1 -- 172.21.15.106:0/3642443679 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900125f0 con 0x7f19a80726d0 2023-11-18T20:58:21.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.848+0000 7f19a57fa640 1 -- 172.21.15.106:0/3642443679 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1990012750 con 0x7f19a80726d0 2023-11-18T20:58:21.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.848+0000 7f19a57fa640 1 -- 172.21.15.106:0/3642443679 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990012ae0 con 0x7f19a80726d0 2023-11-18T20:58:21.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.848+0000 7f19aedbc640 1 -- 172.21.15.106:0/3642443679 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a81ee620 con 0x7f19a80726d0 2023-11-18T20:58:21.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.848+0000 7f19aedbc640 1 -- 172.21.15.106:0/3642443679 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a8153520 con 0x7f19a80726d0 2023-11-18T20:58:21.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:21.848+0000 7f19aedbc640 1 -- 172.21.15.106:0/3642443679 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a8142a20 con 0x7f19a80726d0 2023-11-18T20:58:21.904 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:21.902+0000 7f79d28e1180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-18T20:58:21.907 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:21.904+0000 7f53f8382180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-18T20:58:21.984 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:21.982+0000 7f79d28e1180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-18T20:58:22.038 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:22.034+0000 7f79d28e1180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-18T20:58:22.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.048+0000 7f19a57fa640 1 -- 172.21.15.106:0/3642443679 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f199001e460 con 0x7f19a80726d0 2023-11-18T20:58:22.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.048+0000 7f19a57fa640 1 -- 172.21.15.106:0/3642443679 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1990028430 con 0x7f19a80726d0 2023-11-18T20:58:22.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.048+0000 7f19a57fa640 1 -- 172.21.15.106:0/3642443679 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f19a8142a20 con 0x7f19a80726d0 2023-11-18T20:58:22.062 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:22.056+0000 7f53f8382180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-18T20:58:22.124 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:22.116+0000 7f53f8382180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-18T20:58:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.120+0000 7f19aedbc640 1 -- 172.21.15.106:0/3642443679 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2e82789c-653c-439e-bcd4-3c0cdef4c063", "id": 0} v 0) v1 -- 0x7f19a8073e70 con 0x7f19a80726d0 2023-11-18T20:58:22.185 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:22.182+0000 7f79d28e1180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-18T20:58:22.248 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:22.242+0000 7f79d28e1180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-18T20:58:22.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.556+0000 7f19a57fa640 1 -- 172.21.15.106:0/3642443679 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e82789c-653c-439e-bcd4-3c0cdef4c063", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f199001ea90 con 0x7f19a80726d0 2023-11-18T20:58:22.561 INFO:teuthology.orchestra.run.smithi106.stdout:0 2023-11-18T20:58:22.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.556+0000 7f19aedbc640 1 -- 172.21.15.106:0/3642443679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19a80726d0 msgr2=0x7f19a8152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:22.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.556+0000 7f19aedbc640 1 --2- 172.21.15.106:0/3642443679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19a80726d0 0x7f19a8152190 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f199000d5f0 tx=0x7f199000dab0 comp rx=0 tx=0).stop 2023-11-18T20:58:22.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.556+0000 7f19aedbc640 1 -- 172.21.15.106:0/3642443679 shutdown_connections 2023-11-18T20:58:22.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.556+0000 7f19aedbc640 1 --2- 172.21.15.106:0/3642443679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19a8159f60 0x7f19a81526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:22.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.556+0000 7f19aedbc640 1 --2- 172.21.15.106:0/3642443679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19a80726d0 0x7f19a8152190 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:22.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.556+0000 7f19aedbc640 1 --2- 172.21.15.106:0/3642443679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19a80722f0 0x7f19a8155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:22.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.556+0000 7f19aedbc640 1 -- 172.21.15.106:0/3642443679 >> 172.21.15.106:0/3642443679 conn(0x7f19a806b670 msgr2=0x7f19a80c5220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:22.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.556+0000 7f19aedbc640 1 -- 172.21.15.106:0/3642443679 shutdown_connections 2023-11-18T20:58:22.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.556+0000 7f19aedbc640 1 -- 172.21.15.106:0/3642443679 wait complete. 2023-11-18T20:58:22.577 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new c32343bd-4898-436a-b4ec-567e6e297acb 1 2023-11-18T20:58:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.688+0000 7ff852504640 1 Processor -- start 2023-11-18T20:58:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.692+0000 7ff852504640 1 -- start start 2023-11-18T20:58:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.692+0000 7ff852504640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff84c15a280 0x7ff84c0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.692+0000 7ff852504640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84c0cd9a0 con 0x7ff84c0ce0c0 2023-11-18T20:58:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.692+0000 7ff852504640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84c1596c0 con 0x7ff84c0cc3c0 2023-11-18T20:58:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.692+0000 7ff852504640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84c0ca550 con 0x7ff84c15a280 2023-11-18T20:58:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.692+0000 7ff84b7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff84c0cc3c0 0x7ff84c161e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:35766/0 (socket says 172.21.15.106:35766) 2023-11-18T20:58:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.692+0000 7ff84b7fe640 1 -- 172.21.15.106:0/1316869735 learned_addr learned my addr 172.21.15.106:0/1316869735 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-18T20:58:22.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.696+0000 7ff84affd640 1 -- 172.21.15.106:0/1316869735 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639951343 0 0) 0x7ff84c1596c0 con 0x7ff84c0cc3c0 2023-11-18T20:58:22.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.696+0000 7ff84affd640 1 -- 172.21.15.106:0/1316869735 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff834003530 con 0x7ff84c0cc3c0 2023-11-18T20:58:22.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84affd640 1 -- 172.21.15.106:0/1316869735 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4058661288 0 0) 0x7ff834003530 con 0x7ff84c0cc3c0 2023-11-18T20:58:22.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84affd640 1 -- 172.21.15.106:0/1316869735 >> v2:172.21.15.49:3300/0 conn(0x7ff84c15a280 msgr2=0x7ff84c0ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:22.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84affd640 1 --2- 172.21.15.106:0/1316869735 >> v2:172.21.15.49:3300/0 conn(0x7ff84c15a280 0x7ff84c0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:22.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84affd640 1 -- 172.21.15.106:0/1316869735 >> v1:172.21.15.49:6789/0 conn(0x7ff84c0ce0c0 legacy=0x7ff84c159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:22.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84affd640 1 -- 172.21.15.106:0/1316869735 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c0cd6c0 con 0x7ff84c0cc3c0 2023-11-18T20:58:22.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84affd640 1 -- 172.21.15.106:0/1316869735 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7ff840001680 con 0x7ff84c0cc3c0 2023-11-18T20:58:22.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84affd640 1 -- 172.21.15.106:0/1316869735 >> v1:172.21.15.106:6789/0 conn(0x7ff84c0cc3c0 legacy=0x7ff84c161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:22.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84affd640 1 --2- 172.21.15.106:0/1316869735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff834003a40 0x7ff834003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:22.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84affd640 1 --2- 172.21.15.106:0/1316869735 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8340047d0 0x7ff834004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:22.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84affd640 1 --2- 172.21.15.106:0/1316869735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff834005390 0x7ff83400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:22.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84affd640 1 -- 172.21.15.106:0/1316869735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83400c220 con 0x7ff834003a40 2023-11-18T20:58:22.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84affd640 1 -- 172.21.15.106:0/1316869735 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83400c390 con 0x7ff834005390 2023-11-18T20:58:22.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84affd640 1 -- 172.21.15.106:0/1316869735 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83400c550 con 0x7ff8340047d0 2023-11-18T20:58:22.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84b7fe640 1 --2- 172.21.15.106:0/1316869735 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8340047d0 0x7ff834004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:22.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff850aa1640 1 --2- 172.21.15.106:0/1316869735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff834005390 0x7ff83400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:22.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.700+0000 7ff84bfff640 1 --2- 172.21.15.106:0/1316869735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff834003a40 0x7ff834003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:22.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.708+0000 7ff850aa1640 1 -- 172.21.15.106:0/1316869735 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8340047d0 msgr2=0x7ff834004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:22.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.708+0000 7ff850aa1640 1 --2- 172.21.15.106:0/1316869735 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8340047d0 0x7ff834004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:22.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.708+0000 7ff850aa1640 1 -- 172.21.15.106:0/1316869735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff834003a40 msgr2=0x7ff834003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:22.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.708+0000 7ff850aa1640 1 --2- 172.21.15.106:0/1316869735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff834003a40 0x7ff834003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:22.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.708+0000 7ff850aa1640 1 -- 172.21.15.106:0/1316869735 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834003530 con 0x7ff834005390 2023-11-18T20:58:22.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.708+0000 7ff850aa1640 1 -- 172.21.15.106:0/1316869735 reap_dead start 2023-11-18T20:58:22.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.712+0000 7ff850aa1640 1 --2- 172.21.15.106:0/1316869735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff834005390 0x7ff83400b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff844009ca0 tx=0x7ff84401cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33e08b03e60bf3ab server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:22.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.716+0000 7ff84affd640 1 -- 172.21.15.106:0/1316869735 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff844003ba0 con 0x7ff834005390 2023-11-18T20:58:22.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.716+0000 7ff84affd640 1 -- 172.21.15.106:0/1316869735 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff844003d20 con 0x7ff834005390 2023-11-18T20:58:22.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.716+0000 7ff84affd640 1 -- 172.21.15.106:0/1316869735 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8440a5b90 con 0x7ff834005390 2023-11-18T20:58:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.716+0000 7ff852504640 1 -- 172.21.15.106:0/1316869735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff834005390 msgr2=0x7ff83400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.716+0000 7ff852504640 1 --2- 172.21.15.106:0/1316869735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff834005390 0x7ff83400b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff844009ca0 tx=0x7ff84401cc50 comp rx=0 tx=0).stop 2023-11-18T20:58:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.716+0000 7ff852504640 1 -- 172.21.15.106:0/1316869735 shutdown_connections 2023-11-18T20:58:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.716+0000 7ff852504640 1 --2- 172.21.15.106:0/1316869735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff834005390 0x7ff83400b990 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.716+0000 7ff852504640 1 -- 172.21.15.106:0/1316869735 >> 172.21.15.106:0/1316869735 conn(0x7ff84c0b07c0 msgr2=0x7ff84c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.716+0000 7ff852504640 1 -- 172.21.15.106:0/1316869735 shutdown_connections 2023-11-18T20:58:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.716+0000 7ff852504640 1 -- 172.21.15.106:0/1316869735 wait complete. 2023-11-18T20:58:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.720+0000 7ff852504640 1 Processor -- start 2023-11-18T20:58:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.720+0000 7ff852504640 1 -- start start 2023-11-18T20:58:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.720+0000 7ff852504640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff834005390 0x7ff84c14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.720+0000 7ff852504640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff84c14bfb0 0x7ff84c1f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.720+0000 7ff852504640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff84c1f63b0 0x7ff84c0c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.720+0000 7ff852504640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c1505c0 con 0x7ff84c1f63b0 2023-11-18T20:58:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.720+0000 7ff852504640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c14b020 con 0x7ff84c14bfb0 2023-11-18T20:58:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.720+0000 7ff852504640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c14c3f0 con 0x7ff834005390 2023-11-18T20:58:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.720+0000 7ff84bfff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff834005390 0x7ff84c14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.720+0000 7ff84b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff84c14bfb0 0x7ff84c1f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.720+0000 7ff84bfff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff834005390 0x7ff84c14ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:54342/0 (socket says 172.21.15.106:54342) 2023-11-18T20:58:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.720+0000 7ff84bfff640 1 -- 172.21.15.106:0/2767900362 learned_addr learned my addr 172.21.15.106:0/2767900362 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-18T20:58:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.724+0000 7ff84bfff640 1 -- 172.21.15.106:0/2767900362 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff84c14bfb0 msgr2=0x7ff84c1f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.724+0000 7ff84bfff640 1 --2- 172.21.15.106:0/2767900362 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff84c14bfb0 0x7ff84c1f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.724+0000 7ff84bfff640 1 -- 172.21.15.106:0/2767900362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff84c1f63b0 msgr2=0x7ff84c0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.724+0000 7ff84bfff640 1 --2- 172.21.15.106:0/2767900362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff84c1f63b0 0x7ff84c0c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.724+0000 7ff84bfff640 1 -- 172.21.15.106:0/2767900362 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c1f6830 con 0x7ff834005390 2023-11-18T20:58:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.728+0000 7ff84bfff640 1 --2- 172.21.15.106:0/2767900362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff834005390 0x7ff84c14ba70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00f670 tx=0x7ff83c00fb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.732+0000 7ff848ff9640 1 -- 172.21.15.106:0/2767900362 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0050d0 con 0x7ff834005390 2023-11-18T20:58:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.732+0000 7ff848ff9640 1 -- 172.21.15.106:0/2767900362 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c005250 con 0x7ff834005390 2023-11-18T20:58:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.732+0000 7ff852504640 1 -- 172.21.15.106:0/2767900362 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84c1507b0 con 0x7ff834005390 2023-11-18T20:58:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.732+0000 7ff848ff9640 1 -- 172.21.15.106:0/2767900362 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00d730 con 0x7ff834005390 2023-11-18T20:58:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.732+0000 7ff852504640 1 -- 172.21.15.106:0/2767900362 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84c14b270 con 0x7ff834005390 2023-11-18T20:58:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.732+0000 7ff852504640 1 -- 172.21.15.106:0/2767900362 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84c150c60 con 0x7ff834005390 2023-11-18T20:58:22.771 INFO:tasks.ceph.mgr.x.smithi106.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-18T20:58:22.772 INFO:tasks.ceph.mgr.x.smithi106.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-18T20:58:22.772 INFO:tasks.ceph.mgr.x.smithi106.stderr: from numpy import show_config as show_numpy_config 2023-11-18T20:58:22.829 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:22.824+0000 7f53f8382180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-18T20:58:22.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.852+0000 7ff848ff9640 1 -- 172.21.15.106:0/2767900362 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff83c00db90 con 0x7ff834005390 2023-11-18T20:58:22.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.852+0000 7ff848ff9640 1 -- 172.21.15.106:0/2767900362 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7ff83c01d810 con 0x7ff834005390 2023-11-18T20:58:22.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.852+0000 7ff848ff9640 1 -- 172.21.15.106:0/2767900362 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff83c003ce0 con 0x7ff834005390 2023-11-18T20:58:22.872 INFO:tasks.ceph.mgr.y.smithi049.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-18T20:58:22.872 INFO:tasks.ceph.mgr.y.smithi049.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-18T20:58:22.872 INFO:tasks.ceph.mgr.y.smithi049.stderr: from numpy import show_config as show_numpy_config 2023-11-18T20:58:22.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:22.928+0000 7ff852504640 1 -- 172.21.15.106:0/2767900362 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c32343bd-4898-436a-b4ec-567e6e297acb", "id": 1} v 0) v1 -- 0x7ff84c067520 con 0x7ff834005390 2023-11-18T20:58:22.950 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:22.946+0000 7f79d28e1180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-18T20:58:22.966 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:22.960+0000 7f53f8382180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-18T20:58:23.127 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:23.122+0000 7f79d28e1180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-18T20:58:23.135 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:23.132+0000 7f53f8382180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-18T20:58:23.201 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:23.196+0000 7f53f8382180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-18T20:58:23.291 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.284+0000 7ff848ff9640 1 -- 172.21.15.106:0/2767900362 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c32343bd-4898-436a-b4ec-567e6e297acb", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff83c003600 con 0x7ff834005390 2023-11-18T20:58:23.291 INFO:teuthology.orchestra.run.smithi106.stdout:1 2023-11-18T20:58:23.292 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.288+0000 7ff852504640 1 -- 172.21.15.106:0/2767900362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff834005390 msgr2=0x7ff84c14ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:23.292 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.288+0000 7ff852504640 1 --2- 172.21.15.106:0/2767900362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff834005390 0x7ff84c14ba70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00f670 tx=0x7ff83c00fb30 comp rx=0 tx=0).stop 2023-11-18T20:58:23.292 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.288+0000 7ff852504640 1 -- 172.21.15.106:0/2767900362 shutdown_connections 2023-11-18T20:58:23.292 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.288+0000 7ff852504640 1 --2- 172.21.15.106:0/2767900362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff84c1f63b0 0x7ff84c0c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:23.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.288+0000 7ff852504640 1 --2- 172.21.15.106:0/2767900362 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff84c14bfb0 0x7ff84c1f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:23.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.288+0000 7ff852504640 1 --2- 172.21.15.106:0/2767900362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff834005390 0x7ff84c14ba70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:23.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.288+0000 7ff852504640 1 -- 172.21.15.106:0/2767900362 >> 172.21.15.106:0/2767900362 conn(0x7ff84c0b07c0 msgr2=0x7ff84c0735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:23.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.288+0000 7ff852504640 1 -- 172.21.15.106:0/2767900362 shutdown_connections 2023-11-18T20:58:23.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.288+0000 7ff852504640 1 -- 172.21.15.106:0/2767900362 wait complete. 2023-11-18T20:58:23.293 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:23.290+0000 7f79d28e1180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-18T20:58:23.308 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new f32e9aed-e0ed-46c2-85c7-b425ab0a4948 2 2023-11-18T20:58:23.332 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:23.328+0000 7f53f8382180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-18T20:58:23.360 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:23.358+0000 7f79d28e1180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-18T20:58:23.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.420+0000 7fdf3ad81640 1 Processor -- start 2023-11-18T20:58:23.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.420+0000 7fdf3ad81640 1 -- start start 2023-11-18T20:58:23.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.420+0000 7fdf3ad81640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdf340ccfb0 0x7fdf340cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:23.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.420+0000 7fdf3ad81640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf341572c0 0x7fdf340c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:23.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.420+0000 7fdf3ad81640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf340c9aa0 con 0x7fdf3415a830 2023-11-18T20:58:23.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.420+0000 7fdf3ad81640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf341576f0 con 0x7fdf340ccfb0 2023-11-18T20:58:23.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.420+0000 7fdf3ad81640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3415adb0 con 0x7fdf341572c0 2023-11-18T20:58:23.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.424+0000 7fdf38b1d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdf340ccfb0 0x7fdf340cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:23.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.424+0000 7fdf3931e640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf341572c0 0x7fdf340c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:23.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.424+0000 7fdf38b1d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdf340ccfb0 0x7fdf340cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42222/0 (socket says 172.21.15.106:42222) 2023-11-18T20:58:23.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.424+0000 7fdf38b1d640 1 -- 172.21.15.106:0/3183196140 learned_addr learned my addr 172.21.15.106:0/3183196140 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-18T20:58:23.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.424+0000 7fdf3931e640 1 -- 172.21.15.106:0/3183196140 >> v2:172.21.15.106:3300/0 conn(0x7fdf340ccfb0 msgr2=0x7fdf340cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:23.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.424+0000 7fdf3931e640 1 --2- 172.21.15.106:0/3183196140 >> v2:172.21.15.106:3300/0 conn(0x7fdf340ccfb0 0x7fdf340cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:23.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.424+0000 7fdf3931e640 1 -- 172.21.15.106:0/3183196140 >> v1:172.21.15.106:6789/0 conn(0x7fdf3415a830 legacy=0x7fdf34151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:23.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.424+0000 7fdf3931e640 1 -- 172.21.15.106:0/3183196140 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3415b050 con 0x7fdf341572c0 2023-11-18T20:58:23.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.424+0000 7fdf38b1d640 1 --2- 172.21.15.106:0/3183196140 >> v2:172.21.15.106:3300/0 conn(0x7fdf340ccfb0 0x7fdf340cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T20:58:23.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.428+0000 7fdf3931e640 1 --2- 172.21.15.106:0/3183196140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf341572c0 0x7fdf340c9f30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdf240097c0 tx=0x7fdf2401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42ee9b35f2668937 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:23.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.432+0000 7fdf337fe640 1 -- 172.21.15.106:0/3183196140 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240a8970 con 0x7fdf341572c0 2023-11-18T20:58:23.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.432+0000 7fdf337fe640 1 -- 172.21.15.106:0/3183196140 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf240a8ad0 con 0x7fdf341572c0 2023-11-18T20:58:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.432+0000 7fdf337fe640 1 -- 172.21.15.106:0/3183196140 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240a8e60 con 0x7fdf341572c0 2023-11-18T20:58:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 -- 172.21.15.106:0/3183196140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf341572c0 msgr2=0x7fdf340c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 --2- 172.21.15.106:0/3183196140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf341572c0 0x7fdf340c9f30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdf240097c0 tx=0x7fdf2401ec70 comp rx=0 tx=0).stop 2023-11-18T20:58:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 -- 172.21.15.106:0/3183196140 shutdown_connections 2023-11-18T20:58:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 --2- 172.21.15.106:0/3183196140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf341572c0 0x7fdf340c9f30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 --2- 172.21.15.106:0/3183196140 >> v2:172.21.15.106:3300/0 conn(0x7fdf340ccfb0 0x7fdf340cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 -- 172.21.15.106:0/3183196140 >> 172.21.15.106:0/3183196140 conn(0x7fdf34061400 msgr2=0x7fdf34061810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 -- 172.21.15.106:0/3183196140 shutdown_connections 2023-11-18T20:58:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 -- 172.21.15.106:0/3183196140 wait complete. 2023-11-18T20:58:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 Processor -- start 2023-11-18T20:58:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 -- start start 2023-11-18T20:58:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf340ccfb0 0x7fdf341ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf341572c0 0x7fdf34159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3415a830 0x7fdf341463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3414a300 con 0x7fdf3415a830 2023-11-18T20:58:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3414ae80 con 0x7fdf340ccfb0 2023-11-18T20:58:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.436+0000 7fdf3ad81640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf341edc10 con 0x7fdf341572c0 2023-11-18T20:58:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.440+0000 7fdf33fff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf341572c0 0x7fdf34159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.440+0000 7fdf38b1d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf340ccfb0 0x7fdf341ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.440+0000 7fdf33fff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf341572c0 0x7fdf34159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:54358/0 (socket says 172.21.15.106:54358) 2023-11-18T20:58:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.440+0000 7fdf33fff640 1 -- 172.21.15.106:0/3559179473 learned_addr learned my addr 172.21.15.106:0/3559179473 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-18T20:58:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.440+0000 7fdf3931e640 1 --2- 172.21.15.106:0/3559179473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3415a830 0x7fdf341463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:23.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.444+0000 7fdf33fff640 1 -- 172.21.15.106:0/3559179473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf340ccfb0 msgr2=0x7fdf341ed6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:23.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.444+0000 7fdf33fff640 1 --2- 172.21.15.106:0/3559179473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf340ccfb0 0x7fdf341ed6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:23.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.444+0000 7fdf33fff640 1 -- 172.21.15.106:0/3559179473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3415a830 msgr2=0x7fdf341463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:23.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.444+0000 7fdf33fff640 1 --2- 172.21.15.106:0/3559179473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3415a830 0x7fdf341463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:23.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.444+0000 7fdf33fff640 1 -- 172.21.15.106:0/3559179473 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c009b30 con 0x7fdf341572c0 2023-11-18T20:58:23.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.444+0000 7fdf33fff640 1 --2- 172.21.15.106:0/3559179473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf341572c0 0x7fdf34159a10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800c530 tx=0x7fdf2800c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:23.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.448+0000 7fdf317fa640 1 -- 172.21.15.106:0/3559179473 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28005220 con 0x7fdf341572c0 2023-11-18T20:58:23.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.448+0000 7fdf317fa640 1 -- 172.21.15.106:0/3559179473 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf28005380 con 0x7fdf341572c0 2023-11-18T20:58:23.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.448+0000 7fdf317fa640 1 -- 172.21.15.106:0/3559179473 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28007270 con 0x7fdf341572c0 2023-11-18T20:58:23.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.448+0000 7fdf3ad81640 1 -- 172.21.15.106:0/3559179473 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf24009420 con 0x7fdf341572c0 2023-11-18T20:58:23.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.448+0000 7fdf3ad81640 1 -- 172.21.15.106:0/3559179473 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3414a870 con 0x7fdf341572c0 2023-11-18T20:58:23.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.448+0000 7fdf3ad81640 1 -- 172.21.15.106:0/3559179473 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3414a6d0 con 0x7fdf341572c0 2023-11-18T20:58:23.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.452+0000 7fdf317fa640 1 -- 172.21.15.106:0/3559179473 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdf280067e0 con 0x7fdf341572c0 2023-11-18T20:58:23.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.452+0000 7fdf317fa640 1 -- 172.21.15.106:0/3559179473 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fdf28012d60 con 0x7fdf341572c0 2023-11-18T20:58:23.493 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:23.486+0000 7f79d28e1180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-18T20:58:23.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.564+0000 7fdf317fa640 1 -- 172.21.15.106:0/3559179473 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fdf3414a6d0 con 0x7fdf341572c0 2023-11-18T20:58:23.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:23.640+0000 7fdf3ad81640 1 -- 172.21.15.106:0/3559179473 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f32e9aed-e0ed-46c2-85c7-b425ab0a4948", "id": 2} v 0) v1 -- 0x7fdf341f01c0 con 0x7fdf341572c0 2023-11-18T20:58:23.957 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:23.952+0000 7f53f8382180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-18T20:58:24.034 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:24.028+0000 7f53f8382180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-18T20:58:24.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.044+0000 7fdf317fa640 1 -- 172.21.15.106:0/3559179473 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f32e9aed-e0ed-46c2-85c7-b425ab0a4948", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdf2802a0b0 con 0x7fdf341572c0 2023-11-18T20:58:24.051 INFO:teuthology.orchestra.run.smithi106.stdout:2 2023-11-18T20:58:24.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.048+0000 7fdf3ad81640 1 -- 172.21.15.106:0/3559179473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf341572c0 msgr2=0x7fdf34159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:24.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.048+0000 7fdf3ad81640 1 --2- 172.21.15.106:0/3559179473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf341572c0 0x7fdf34159a10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800c530 tx=0x7fdf2800c9f0 comp rx=0 tx=0).stop 2023-11-18T20:58:24.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.048+0000 7fdf3ad81640 1 -- 172.21.15.106:0/3559179473 shutdown_connections 2023-11-18T20:58:24.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.048+0000 7fdf3ad81640 1 --2- 172.21.15.106:0/3559179473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3415a830 0x7fdf341463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:24.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.048+0000 7fdf3ad81640 1 --2- 172.21.15.106:0/3559179473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf341572c0 0x7fdf34159a10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:24.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.048+0000 7fdf3ad81640 1 --2- 172.21.15.106:0/3559179473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf340ccfb0 0x7fdf341ed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:24.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.048+0000 7fdf3ad81640 1 -- 172.21.15.106:0/3559179473 >> 172.21.15.106:0/3559179473 conn(0x7fdf34061400 msgr2=0x7fdf3414e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:24.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.048+0000 7fdf3ad81640 1 -- 172.21.15.106:0/3559179473 shutdown_connections 2023-11-18T20:58:24.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.048+0000 7fdf3ad81640 1 -- 172.21.15.106:0/3559179473 wait complete. 2023-11-18T20:58:24.072 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new a7c2f5ac-b626-488c-af87-849bc58080e6 3 2023-11-18T20:58:24.133 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:24.130+0000 7f79d28e1180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-18T20:58:24.214 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:24.210+0000 7f79d28e1180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-18T20:58:24.215 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:24.212+0000 7f53f8382180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-18T20:58:24.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.248+0000 7fac275af640 1 Processor -- start 2023-11-18T20:58:24.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.248+0000 7fac275af640 1 -- start start 2023-11-18T20:58:24.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.252+0000 7fac275af640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac200c4bb0 0x7fac201559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:24.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.252+0000 7fac275af640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac200cb2c0 0x7fac200cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:24.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.252+0000 7fac275af640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac20150180 con 0x7fac2014fda0 2023-11-18T20:58:24.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.252+0000 7fac275af640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac200c7270 con 0x7fac200c4bb0 2023-11-18T20:58:24.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.252+0000 7fac275af640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac200c5020 con 0x7fac200cb2c0 2023-11-18T20:58:24.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.252+0000 7fac25b4c640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac200cb2c0 0x7fac200cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:24.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.252+0000 7fac25b4c640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac200cb2c0 0x7fac200cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:54366/0 (socket says 172.21.15.106:54366) 2023-11-18T20:58:24.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.252+0000 7fac25b4c640 1 -- 172.21.15.106:0/3135560135 learned_addr learned my addr 172.21.15.106:0/3135560135 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-18T20:58:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.256+0000 7fac25b4c640 1 -- 172.21.15.106:0/3135560135 >> v2:172.21.15.49:3300/0 conn(0x7fac200c4bb0 msgr2=0x7fac201559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.256+0000 7fac25b4c640 1 --2- 172.21.15.106:0/3135560135 >> v2:172.21.15.49:3300/0 conn(0x7fac200c4bb0 0x7fac201559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:24.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.256+0000 7fac25b4c640 1 -- 172.21.15.106:0/3135560135 >> v1:172.21.15.106:6789/0 conn(0x7fac2014fda0 legacy=0x7fac200c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:24.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.256+0000 7fac25b4c640 1 -- 172.21.15.106:0/3135560135 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac200c6f90 con 0x7fac200cb2c0 2023-11-18T20:58:24.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.260+0000 7fac25b4c640 1 --2- 172.21.15.106:0/3135560135 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac200cb2c0 0x7fac200cb6f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fac18009e50 tx=0x7fac1801f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=588e7fd7049d5a95 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:24.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac17fff640 1 -- 172.21.15.106:0/3135560135 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180af400 con 0x7fac200cb2c0 2023-11-18T20:58:24.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac17fff640 1 -- 172.21.15.106:0/3135560135 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac180ab050 con 0x7fac200cb2c0 2023-11-18T20:58:24.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac17fff640 1 -- 172.21.15.106:0/3135560135 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180af780 con 0x7fac200cb2c0 2023-11-18T20:58:24.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 -- 172.21.15.106:0/3135560135 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac200cb2c0 msgr2=0x7fac200cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:24.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 --2- 172.21.15.106:0/3135560135 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac200cb2c0 0x7fac200cb6f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fac18009e50 tx=0x7fac1801f1f0 comp rx=0 tx=0).stop 2023-11-18T20:58:24.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 -- 172.21.15.106:0/3135560135 shutdown_connections 2023-11-18T20:58:24.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 --2- 172.21.15.106:0/3135560135 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac200cb2c0 0x7fac200cb6f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:24.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 --2- 172.21.15.106:0/3135560135 >> v2:172.21.15.49:3300/0 conn(0x7fac200c4bb0 0x7fac201559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:24.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 -- 172.21.15.106:0/3135560135 >> 172.21.15.106:0/3135560135 conn(0x7fac2006d200 msgr2=0x7fac2006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:24.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 -- 172.21.15.106:0/3135560135 shutdown_connections 2023-11-18T20:58:24.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 -- 172.21.15.106:0/3135560135 wait complete. 2023-11-18T20:58:24.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 Processor -- start 2023-11-18T20:58:24.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 -- start start 2023-11-18T20:58:24.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac200c4bb0 0x7fac20154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:24.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac200cb2c0 0x7fac20142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:24.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac2014fda0 0x7fac201f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:24.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac20157410 con 0x7fac200c4bb0 2023-11-18T20:58:24.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac20152490 con 0x7fac2014fda0 2023-11-18T20:58:24.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.264+0000 7fac275af640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac20150ec0 con 0x7fac200cb2c0 2023-11-18T20:58:24.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.268+0000 7fac25b4c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac2014fda0 0x7fac201f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:24.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.268+0000 7fac24b4a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac200cb2c0 0x7fac20142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:24.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.268+0000 7fac24b4a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac200cb2c0 0x7fac20142f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:54370/0 (socket says 172.21.15.106:54370) 2023-11-18T20:58:24.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.268+0000 7fac24b4a640 1 -- 172.21.15.106:0/3724804063 learned_addr learned my addr 172.21.15.106:0/3724804063 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-18T20:58:24.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.268+0000 7fac2534b640 1 --2- 172.21.15.106:0/3724804063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac200c4bb0 0x7fac20154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:24.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.268+0000 7fac24b4a640 1 -- 172.21.15.106:0/3724804063 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac2014fda0 msgr2=0x7fac201f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:24.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.268+0000 7fac24b4a640 1 --2- 172.21.15.106:0/3724804063 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac2014fda0 0x7fac201f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:24.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.268+0000 7fac24b4a640 1 -- 172.21.15.106:0/3724804063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac200c4bb0 msgr2=0x7fac20154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:24.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.268+0000 7fac24b4a640 1 --2- 172.21.15.106:0/3724804063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac200c4bb0 0x7fac20154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:24.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.268+0000 7fac24b4a640 1 -- 172.21.15.106:0/3724804063 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac18009b30 con 0x7fac200cb2c0 2023-11-18T20:58:24.277 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.272+0000 7fac24b4a640 1 --2- 172.21.15.106:0/3724804063 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac200cb2c0 0x7fac20142f70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fac1000b550 tx=0x7fac1000ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:24.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.276+0000 7fac15ffb640 1 -- 172.21.15.106:0/3724804063 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10010610 con 0x7fac200cb2c0 2023-11-18T20:58:24.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.276+0000 7fac15ffb640 1 -- 172.21.15.106:0/3724804063 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac10010790 con 0x7fac200cb2c0 2023-11-18T20:58:24.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.276+0000 7fac275af640 1 -- 172.21.15.106:0/3724804063 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac20151b80 con 0x7fac200cb2c0 2023-11-18T20:58:24.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.276+0000 7fac15ffb640 1 -- 172.21.15.106:0/3724804063 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10010b40 con 0x7fac200cb2c0 2023-11-18T20:58:24.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.276+0000 7fac275af640 1 -- 172.21.15.106:0/3724804063 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac20152120 con 0x7fac200cb2c0 2023-11-18T20:58:24.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.276+0000 7fac275af640 1 -- 172.21.15.106:0/3724804063 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac20073e70 con 0x7fac200cb2c0 2023-11-18T20:58:24.285 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.280+0000 7fac15ffb640 1 -- 172.21.15.106:0/3724804063 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fac10023480 con 0x7fac200cb2c0 2023-11-18T20:58:24.285 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.280+0000 7fac15ffb640 1 -- 172.21.15.106:0/3724804063 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fac10022870 con 0x7fac200cb2c0 2023-11-18T20:58:24.297 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:24.292+0000 7f53f8382180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-18T20:58:24.394 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.388+0000 7fac15ffb640 1 -- 172.21.15.106:0/3724804063 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fac1001e060 con 0x7fac200cb2c0 2023-11-18T20:58:24.397 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:24.394+0000 7f79d28e1180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-18T20:58:24.464 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.460+0000 7fac275af640 1 -- 172.21.15.106:0/3724804063 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a7c2f5ac-b626-488c-af87-849bc58080e6", "id": 3} v 0) v1 -- 0x7fac201525d0 con 0x7fac200cb2c0 2023-11-18T20:58:24.474 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:24.470+0000 7f79d28e1180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-18T20:58:24.589 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:24.584+0000 7f53f8382180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-18T20:58:24.648 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:24.644+0000 7f53f8382180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-18T20:58:24.781 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:24.778+0000 7f79d28e1180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-18T20:58:24.843 INFO:tasks.ceph.mgr.y.smithi049.stderr:2023-11-18T20:58:24.838+0000 7f79d28e1180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-18T20:58:24.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.860+0000 7fac15ffb640 1 -- 172.21.15.106:0/3724804063 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7c2f5ac-b626-488c-af87-849bc58080e6", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fac100280b0 con 0x7fac200cb2c0 2023-11-18T20:58:24.867 INFO:teuthology.orchestra.run.smithi106.stdout:3 2023-11-18T20:58:24.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.864+0000 7fac275af640 1 -- 172.21.15.106:0/3724804063 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac200cb2c0 msgr2=0x7fac20142f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:24.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.864+0000 7fac275af640 1 --2- 172.21.15.106:0/3724804063 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac200cb2c0 0x7fac20142f70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fac1000b550 tx=0x7fac1000ba10 comp rx=0 tx=0).stop 2023-11-18T20:58:24.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.864+0000 7fac275af640 1 -- 172.21.15.106:0/3724804063 shutdown_connections 2023-11-18T20:58:24.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.864+0000 7fac275af640 1 --2- 172.21.15.106:0/3724804063 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac2014fda0 0x7fac201f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:24.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.864+0000 7fac275af640 1 --2- 172.21.15.106:0/3724804063 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac200cb2c0 0x7fac20142f70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:24.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.864+0000 7fac275af640 1 --2- 172.21.15.106:0/3724804063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac200c4bb0 0x7fac20154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:24.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.864+0000 7fac275af640 1 -- 172.21.15.106:0/3724804063 >> 172.21.15.106:0/3724804063 conn(0x7fac2006d200 msgr2=0x7fac200c5160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:24.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.864+0000 7fac275af640 1 -- 172.21.15.106:0/3724804063 shutdown_connections 2023-11-18T20:58:24.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.864+0000 7fac275af640 1 -- 172.21.15.106:0/3724804063 wait complete. 2023-11-18T20:58:24.886 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 821c3fe8-e191-46b9-9423-0894312d43b4 4 2023-11-18T20:58:25.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.996+0000 7f29dead0640 1 Processor -- start 2023-11-18T20:58:25.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.996+0000 7f29dead0640 1 -- start start 2023-11-18T20:58:25.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.996+0000 7f29dead0640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f29d80c1ed0 0x7f29d806e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:25.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.996+0000 7f29dead0640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29d8070ab0 0x7f29d806ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:25.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.996+0000 7f29dead0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d80c3b10 con 0x7f29d814f850 2023-11-18T20:58:25.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.996+0000 7f29dead0640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d80c46b0 con 0x7f29d80c1ed0 2023-11-18T20:58:25.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.996+0000 7f29dead0640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d814fc30 con 0x7f29d8070ab0 2023-11-18T20:58:25.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.996+0000 7f29dd06d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29d8070ab0 0x7f29d806ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:25.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.996+0000 7f29dc86c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f29d814f850 0x7f29d80c3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:35806/0 (socket says 172.21.15.106:35806) 2023-11-18T20:58:25.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:24.996+0000 7f29dc86c640 1 -- 172.21.15.106:0/3078433509 learned_addr learned my addr 172.21.15.106:0/3078433509 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-18T20:58:25.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.000+0000 7f29dd06d640 1 -- 172.21.15.106:0/3078433509 >> v2:172.21.15.49:3300/0 conn(0x7f29d80c1ed0 msgr2=0x7f29d806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:25.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.000+0000 7f29dd06d640 1 --2- 172.21.15.106:0/3078433509 >> v2:172.21.15.49:3300/0 conn(0x7f29d80c1ed0 0x7f29d806e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:25.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.000+0000 7f29dd06d640 1 -- 172.21.15.106:0/3078433509 >> v1:172.21.15.106:6789/0 conn(0x7f29d814f850 legacy=0x7f29d80c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:25.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.000+0000 7f29dd06d640 1 -- 172.21.15.106:0/3078433509 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d80c11e0 con 0x7f29d8070ab0 2023-11-18T20:58:25.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.004+0000 7f29dd06d640 1 --2- 172.21.15.106:0/3078433509 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29d8070ab0 0x7f29d806ea70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29d000a960 tx=0x7f29d001d820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80dbd91abfa7a0e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:25.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.008+0000 7f29d77fe640 1 -- 172.21.15.106:0/3078433509 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d00a68d0 con 0x7f29d8070ab0 2023-11-18T20:58:25.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.008+0000 7f29d77fe640 1 -- 172.21.15.106:0/3078433509 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d00a6a30 con 0x7f29d8070ab0 2023-11-18T20:58:25.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.008+0000 7f29d77fe640 1 -- 172.21.15.106:0/3078433509 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d00a6dc0 con 0x7f29d8070ab0 2023-11-18T20:58:25.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.008+0000 7f29dead0640 1 -- 172.21.15.106:0/3078433509 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29d8070ab0 msgr2=0x7f29d806ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:25.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.008+0000 7f29dead0640 1 --2- 172.21.15.106:0/3078433509 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29d8070ab0 0x7f29d806ea70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29d000a960 tx=0x7f29d001d820 comp rx=0 tx=0).stop 2023-11-18T20:58:25.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.008+0000 7f29dead0640 1 -- 172.21.15.106:0/3078433509 shutdown_connections 2023-11-18T20:58:25.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.008+0000 7f29dead0640 1 --2- 172.21.15.106:0/3078433509 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29d8070ab0 0x7f29d806ea70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:25.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.008+0000 7f29dead0640 1 --2- 172.21.15.106:0/3078433509 >> v2:172.21.15.49:3300/0 conn(0x7f29d80c1ed0 0x7f29d806e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:25.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.008+0000 7f29dead0640 1 -- 172.21.15.106:0/3078433509 >> 172.21.15.106:0/3078433509 conn(0x7f29d806c6a0 msgr2=0x7f29d806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:25.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.008+0000 7f29dead0640 1 -- 172.21.15.106:0/3078433509 shutdown_connections 2023-11-18T20:58:25.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.008+0000 7f29dead0640 1 -- 172.21.15.106:0/3078433509 wait complete. 2023-11-18T20:58:25.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.012+0000 7f29dead0640 1 Processor -- start 2023-11-18T20:58:25.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.012+0000 7f29dead0640 1 -- start start 2023-11-18T20:58:25.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.012+0000 7f29dead0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8070ab0 0x7f29d8155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:25.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.012+0000 7f29dead0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29d80c1ed0 0x7f29d81f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:25.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.012+0000 7f29dead0640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29d814f850 0x7f29d806e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:25.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.012+0000 7f29dead0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8155b50 con 0x7f29d80c1ed0 2023-11-18T20:58:25.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.012+0000 7f29dead0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8156ef0 con 0x7f29d8070ab0 2023-11-18T20:58:25.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.012+0000 7f29dead0640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d81552b0 con 0x7f29d814f850 2023-11-18T20:58:25.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.012+0000 7f29dc86c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8070ab0 0x7f29d8155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:25.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.012+0000 7f29dd06d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29d814f850 0x7f29d806e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:25.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.012+0000 7f29dd06d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29d814f850 0x7f29d806e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:54390/0 (socket says 172.21.15.106:54390) 2023-11-18T20:58:25.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.012+0000 7f29dd06d640 1 -- 172.21.15.106:0/2436737813 learned_addr learned my addr 172.21.15.106:0/2436737813 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-18T20:58:25.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.016+0000 7f29dd06d640 1 -- 172.21.15.106:0/2436737813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8070ab0 msgr2=0x7f29d8155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:25.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.016+0000 7f29dd06d640 1 --2- 172.21.15.106:0/2436737813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8070ab0 0x7f29d8155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:25.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.016+0000 7f29dd06d640 1 -- 172.21.15.106:0/2436737813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29d80c1ed0 msgr2=0x7f29d81f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:25.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.016+0000 7f29dd06d640 1 --2- 172.21.15.106:0/2436737813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29d80c1ed0 0x7f29d81f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:25.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.016+0000 7f29dd06d640 1 -- 172.21.15.106:0/2436737813 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d000a5c0 con 0x7f29d814f850 2023-11-18T20:58:25.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.020+0000 7f29dd06d640 1 --2- 172.21.15.106:0/2436737813 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29d814f850 0x7f29d806e580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f29d001b450 tx=0x7f29d001a5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:25.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.020+0000 7f29d57fa640 1 -- 172.21.15.106:0/2436737813 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d00af9a0 con 0x7f29d814f850 2023-11-18T20:58:25.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.020+0000 7f29dead0640 1 -- 172.21.15.106:0/2436737813 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d8157140 con 0x7f29d814f850 2023-11-18T20:58:25.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.020+0000 7f29dead0640 1 -- 172.21.15.106:0/2436737813 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d8157700 con 0x7f29d814f850 2023-11-18T20:58:25.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.020+0000 7f29dead0640 1 -- 172.21.15.106:0/2436737813 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d8155c90 con 0x7f29d814f850 2023-11-18T20:58:25.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.024+0000 7f29d57fa640 1 -- 172.21.15.106:0/2436737813 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d00afb00 con 0x7f29d814f850 2023-11-18T20:58:25.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.024+0000 7f29d57fa640 1 -- 172.21.15.106:0/2436737813 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d00afe90 con 0x7f29d814f850 2023-11-18T20:58:25.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.148+0000 7f29d57fa640 1 -- 172.21.15.106:0/2436737813 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f29d00b5040 con 0x7f29d814f850 2023-11-18T20:58:25.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.148+0000 7f29d57fa640 1 -- 172.21.15.106:0/2436737813 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f29d00cda30 con 0x7f29d814f850 2023-11-18T20:58:25.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.148+0000 7f29d57fa640 1 -- 172.21.15.106:0/2436737813 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f29d8155c90 con 0x7f29d814f850 2023-11-18T20:58:25.220 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:58:25.223 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:58:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.220+0000 7f29dead0640 1 -- 172.21.15.106:0/2436737813 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "821c3fe8-e191-46b9-9423-0894312d43b4", "id": 4} v 0) v1 -- 0x7f29d8067520 con 0x7f29d814f850 2023-11-18T20:58:25.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:25.776+0000 7f29d57fa640 1 -- 172.21.15.106:0/2436737813 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mgrmap(e 2) v1 ==== 42894+0+0 (secure 0 0 0) 0x7f29d00cdd40 con 0x7f29d814f850 2023-11-18T20:58:26.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.600+0000 7f29d57fa640 1 -- 172.21.15.106:0/2436737813 <== mon.2 v2:172.21.15.106:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "821c3fe8-e191-46b9-9423-0894312d43b4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f29d00acd10 con 0x7f29d814f850 2023-11-18T20:58:26.606 INFO:teuthology.orchestra.run.smithi106.stdout:4 2023-11-18T20:58:26.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.600+0000 7f29dead0640 1 -- 172.21.15.106:0/2436737813 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29d814f850 msgr2=0x7f29d806e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:26.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.600+0000 7f29dead0640 1 --2- 172.21.15.106:0/2436737813 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29d814f850 0x7f29d806e580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f29d001b450 tx=0x7f29d001a5c0 comp rx=0 tx=0).stop 2023-11-18T20:58:26.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.600+0000 7f29dead0640 1 -- 172.21.15.106:0/2436737813 shutdown_connections 2023-11-18T20:58:26.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.600+0000 7f29dead0640 1 --2- 172.21.15.106:0/2436737813 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29d814f850 0x7f29d806e580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:26.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.600+0000 7f29dead0640 1 --2- 172.21.15.106:0/2436737813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29d80c1ed0 0x7f29d81f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:26.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.600+0000 7f29dead0640 1 --2- 172.21.15.106:0/2436737813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8070ab0 0x7f29d8155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:26.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.600+0000 7f29dead0640 1 -- 172.21.15.106:0/2436737813 >> 172.21.15.106:0/2436737813 conn(0x7f29d806c6a0 msgr2=0x7f29d815f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:26.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.604+0000 7f29dead0640 1 -- 172.21.15.106:0/2436737813 shutdown_connections 2023-11-18T20:58:26.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.604+0000 7f29dead0640 1 -- 172.21.15.106:0/2436737813 wait complete. 2023-11-18T20:58:26.630 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 5545dbc5-bd88-48b0-bc93-8543097d1f24 5 2023-11-18T20:58:26.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.748+0000 7f2021016640 1 Processor -- start 2023-11-18T20:58:26.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.748+0000 7f2021016640 1 -- start start 2023-11-18T20:58:26.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.748+0000 7f2021016640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f201c14f850 0x7f201c0c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:26.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.748+0000 7f2021016640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f201c0c1ed0 0x7f201c06e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:26.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.748+0000 7f2021016640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c0c3b10 con 0x7f201c070ab0 2023-11-18T20:58:26.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.748+0000 7f2021016640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c14fc30 con 0x7f201c0c1ed0 2023-11-18T20:58:26.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.748+0000 7f2021016640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c0c11e0 con 0x7f201c14f850 2023-11-18T20:58:26.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.752+0000 7f201ad9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f201c14f850 0x7f201c0c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:26.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.752+0000 7f201b59e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f201c070ab0 0x7f201c158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:35808/0 (socket says 172.21.15.106:35808) 2023-11-18T20:58:26.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.752+0000 7f201b59e640 1 -- 172.21.15.106:0/3442703585 learned_addr learned my addr 172.21.15.106:0/3442703585 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-18T20:58:26.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.752+0000 7f201ad9d640 1 -- 172.21.15.106:0/3442703585 >> v2:172.21.15.49:3300/0 conn(0x7f201c0c1ed0 msgr2=0x7f201c06e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.752+0000 7f201ad9d640 1 --2- 172.21.15.106:0/3442703585 >> v2:172.21.15.49:3300/0 conn(0x7f201c0c1ed0 0x7f201c06e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.752+0000 7f201ad9d640 1 -- 172.21.15.106:0/3442703585 >> v1:172.21.15.106:6789/0 conn(0x7f201c070ab0 legacy=0x7f201c158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:26.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.752+0000 7f201ad9d640 1 -- 172.21.15.106:0/3442703585 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0c2410 con 0x7f201c14f850 2023-11-18T20:58:26.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.756+0000 7f201ad9d640 1 --2- 172.21.15.106:0/3442703585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201c14f850 0x7f201c0c3fa0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f201c06f120 tx=0x7f200c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf7be1bc3e558798 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:26.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.764+0000 7f201a59c640 1 -- 172.21.15.106:0/3442703585 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c0ab600 con 0x7f201c14f850 2023-11-18T20:58:26.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.764+0000 7f201a59c640 1 -- 172.21.15.106:0/3442703585 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c0a7050 con 0x7f201c14f850 2023-11-18T20:58:26.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.764+0000 7f201a59c640 1 -- 172.21.15.106:0/3442703585 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c0ab980 con 0x7f201c14f850 2023-11-18T20:58:26.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.764+0000 7f2021016640 1 -- 172.21.15.106:0/3442703585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201c14f850 msgr2=0x7f201c0c3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:26.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.764+0000 7f2021016640 1 --2- 172.21.15.106:0/3442703585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201c14f850 0x7f201c0c3fa0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f201c06f120 tx=0x7f200c01c3f0 comp rx=0 tx=0).stop 2023-11-18T20:58:26.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.764+0000 7f2021016640 1 -- 172.21.15.106:0/3442703585 shutdown_connections 2023-11-18T20:58:26.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.764+0000 7f2021016640 1 --2- 172.21.15.106:0/3442703585 >> v2:172.21.15.49:3300/0 conn(0x7f201c0c1ed0 0x7f201c06e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:26.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.764+0000 7f2021016640 1 --2- 172.21.15.106:0/3442703585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201c14f850 0x7f201c0c3fa0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:26.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.764+0000 7f2021016640 1 -- 172.21.15.106:0/3442703585 >> 172.21.15.106:0/3442703585 conn(0x7f201c06c6a0 msgr2=0x7f201c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:26.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.764+0000 7f2021016640 1 -- 172.21.15.106:0/3442703585 shutdown_connections 2023-11-18T20:58:26.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.764+0000 7f2021016640 1 -- 172.21.15.106:0/3442703585 wait complete. 2023-11-18T20:58:26.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.768+0000 7f2021016640 1 Processor -- start 2023-11-18T20:58:26.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.768+0000 7f2021016640 1 -- start start 2023-11-18T20:58:26.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.768+0000 7f2021016640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201c070ab0 0x7f201c1528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:26.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.768+0000 7f2021016640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f201c0c1ed0 0x7f201c1425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:26.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.768+0000 7f2021016640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f201c14f850 0x7f201c1f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:26.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.768+0000 7f2021016640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c1f04e0 con 0x7f201c14f850 2023-11-18T20:58:26.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.768+0000 7f2021016640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c150270 con 0x7f201c070ab0 2023-11-18T20:58:26.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.768+0000 7f2021016640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c150550 con 0x7f201c0c1ed0 2023-11-18T20:58:26.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.768+0000 7f201ad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201c070ab0 0x7f201c1528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:26.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.768+0000 7f2013fff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f201c0c1ed0 0x7f201c1425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:26.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.768+0000 7f201ad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201c070ab0 0x7f201c1528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42306/0 (socket says 172.21.15.106:42306) 2023-11-18T20:58:26.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.768+0000 7f201ad9d640 1 -- 172.21.15.106:0/2168674469 learned_addr learned my addr 172.21.15.106:0/2168674469 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-18T20:58:26.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.772+0000 7f201ad9d640 1 -- 172.21.15.106:0/2168674469 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f201c0c1ed0 msgr2=0x7f201c1425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:26.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.772+0000 7f201ad9d640 1 --2- 172.21.15.106:0/2168674469 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f201c0c1ed0 0x7f201c1425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:26.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.772+0000 7f201ad9d640 1 -- 172.21.15.106:0/2168674469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f201c14f850 msgr2=0x7f201c1f38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:26.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.772+0000 7f201ad9d640 1 --2- 172.21.15.106:0/2168674469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f201c14f850 0x7f201c1f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:26.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.772+0000 7f201ad9d640 1 -- 172.21.15.106:0/2168674469 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200c009420 con 0x7f201c070ab0 2023-11-18T20:58:26.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.776+0000 7f201ad9d640 1 --2- 172.21.15.106:0/2168674469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201c070ab0 0x7f201c1528e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f200c019000 tx=0x7f200c019190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:26.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.780+0000 7f20137fe640 1 -- 172.21.15.106:0/2168674469 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c0b4600 con 0x7f201c070ab0 2023-11-18T20:58:26.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.780+0000 7f20137fe640 1 -- 172.21.15.106:0/2168674469 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c0b4780 con 0x7f201c070ab0 2023-11-18T20:58:26.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.780+0000 7f20137fe640 1 -- 172.21.15.106:0/2168674469 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c0b4b30 con 0x7f201c070ab0 2023-11-18T20:58:26.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.780+0000 7f2021016640 1 -- 172.21.15.106:0/2168674469 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201c150830 con 0x7f201c070ab0 2023-11-18T20:58:26.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.780+0000 7f2021016640 1 -- 172.21.15.106:0/2168674469 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c152e20 con 0x7f201c070ab0 2023-11-18T20:58:26.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.780+0000 7f2021016640 1 -- 172.21.15.106:0/2168674469 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201c150e80 con 0x7f201c070ab0 2023-11-18T20:58:26.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.892+0000 7f20137fe640 1 -- 172.21.15.106:0/2168674469 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 2) v1 ==== 42894+0+0 (secure 0 0 0) 0x7f200c0b2040 con 0x7f201c070ab0 2023-11-18T20:58:26.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.896+0000 7f20137fe640 1 -- 172.21.15.106:0/2168674469 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f200c0c7480 con 0x7f201c070ab0 2023-11-18T20:58:26.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:26.900+0000 7f20137fe640 1 -- 172.21.15.106:0/2168674469 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f200c0bd7c0 con 0x7f201c070ab0 2023-11-18T20:58:27.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:27.016+0000 7f2021016640 1 -- 172.21.15.106:0/2168674469 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5545dbc5-bd88-48b0-bc93-8543097d1f24", "id": 5} v 0) v1 -- 0x7f201c067520 con 0x7f201c070ab0 2023-11-18T20:58:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:27.744+0000 7f20137fe640 1 -- 172.21.15.106:0/2168674469 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mgrmap(e 3) v1 ==== 85563+0+0 (secure 0 0 0) 0x7f200c0b4c90 con 0x7f201c070ab0 2023-11-18T20:58:28.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.100+0000 7f20137fe640 1 -- 172.21.15.106:0/2168674469 <== mon.1 v2:172.21.15.106:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5545dbc5-bd88-48b0-bc93-8543097d1f24", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f200c0d9740 con 0x7f201c070ab0 2023-11-18T20:58:28.107 INFO:teuthology.orchestra.run.smithi106.stdout:5 2023-11-18T20:58:28.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.104+0000 7f2021016640 1 -- 172.21.15.106:0/2168674469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201c070ab0 msgr2=0x7f201c1528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:28.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.104+0000 7f2021016640 1 --2- 172.21.15.106:0/2168674469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201c070ab0 0x7f201c1528e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f200c019000 tx=0x7f200c019190 comp rx=0 tx=0).stop 2023-11-18T20:58:28.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.104+0000 7f2021016640 1 -- 172.21.15.106:0/2168674469 shutdown_connections 2023-11-18T20:58:28.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.104+0000 7f2021016640 1 --2- 172.21.15.106:0/2168674469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f201c14f850 0x7f201c1f38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:28.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.104+0000 7f2021016640 1 --2- 172.21.15.106:0/2168674469 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f201c0c1ed0 0x7f201c1425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:28.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.104+0000 7f2021016640 1 --2- 172.21.15.106:0/2168674469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201c070ab0 0x7f201c1528e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:28.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.104+0000 7f2021016640 1 -- 172.21.15.106:0/2168674469 >> 172.21.15.106:0/2168674469 conn(0x7f201c06c6a0 msgr2=0x7f201c14d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:28.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.104+0000 7f2021016640 1 -- 172.21.15.106:0/2168674469 shutdown_connections 2023-11-18T20:58:28.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.104+0000 7f2021016640 1 -- 172.21.15.106:0/2168674469 wait complete. 2023-11-18T20:58:28.126 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 86a4a7ca-400e-4aea-ae0c-360adbf409b0 6 2023-11-18T20:58:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.236+0000 7f9572d1a640 1 Processor -- start 2023-11-18T20:58:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.236+0000 7f9572d1a640 1 -- start start 2023-11-18T20:58:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.240+0000 7f9572d1a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f956c14fb80 0x7f956c0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.240+0000 7f9572d1a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956c0c2830 con 0x7f956c06af20 2023-11-18T20:58:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.240+0000 7f9572d1a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956c06b410 con 0x7f956c0c6a80 2023-11-18T20:58:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.240+0000 7f9572d1a640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f956c06beb0 con 0x7f956c14fb80 2023-11-18T20:58:28.312 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.308+0000 7f95712b7640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f956c06af20 0x7f956c160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.106:58292/0 (socket says 172.21.15.106:58292) 2023-11-18T20:58:28.312 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.308+0000 7f95712b7640 1 -- 172.21.15.106:0/533218418 learned_addr learned my addr 172.21.15.106:0/533218418 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-18T20:58:28.312 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.308+0000 7f9570ab6640 1 --2- 172.21.15.106:0/533218418 >> v2:172.21.15.106:3300/0 conn(0x7f956c14fb80 0x7f956c0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.320+0000 7f9570ab6640 1 -- 172.21.15.106:0/533218418 >> v1:172.21.15.106:6789/0 conn(0x7f956c0c6a80 legacy=0x7f956c0cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.320+0000 7f9570ab6640 1 -- 172.21.15.106:0/533218418 >> v1:172.21.15.49:6789/0 conn(0x7f956c06af20 legacy=0x7f956c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:28.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.320+0000 7f9570ab6640 1 -- 172.21.15.106:0/533218418 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c0c74c0 con 0x7f956c14fb80 2023-11-18T20:58:28.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.332+0000 7f9570ab6640 1 --2- 172.21.15.106:0/533218418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956c14fb80 0x7f956c0c6540 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f956400aea0 tx=0x7f956401d9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d90d92deb031a57 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:28.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.336+0000 7f956b7fe640 1 -- 172.21.15.106:0/533218418 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956400a2d0 con 0x7f956c14fb80 2023-11-18T20:58:28.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.336+0000 7f956b7fe640 1 -- 172.21.15.106:0/533218418 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95640a66f0 con 0x7f956c14fb80 2023-11-18T20:58:28.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.336+0000 7f956b7fe640 1 -- 172.21.15.106:0/533218418 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95640a6a80 con 0x7f956c14fb80 2023-11-18T20:58:28.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 -- 172.21.15.106:0/533218418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956c14fb80 msgr2=0x7f956c0c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:28.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 --2- 172.21.15.106:0/533218418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956c14fb80 0x7f956c0c6540 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f956400aea0 tx=0x7f956401d9c0 comp rx=0 tx=0).stop 2023-11-18T20:58:28.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 -- 172.21.15.106:0/533218418 shutdown_connections 2023-11-18T20:58:28.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 --2- 172.21.15.106:0/533218418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956c14fb80 0x7f956c0c6540 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:28.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 -- 172.21.15.106:0/533218418 >> 172.21.15.106:0/533218418 conn(0x7f956c06d220 msgr2=0x7f956c06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:28.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 -- 172.21.15.106:0/533218418 shutdown_connections 2023-11-18T20:58:28.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 -- 172.21.15.106:0/533218418 wait complete. 2023-11-18T20:58:28.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 Processor -- start 2023-11-18T20:58:28.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 -- start start 2023-11-18T20:58:28.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956c06af20 0x7f956c14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:28.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f956c0c6a80 0x7f956c14ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:28.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f956c14fb80 0x7f956c1416a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:28.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c1f4030 con 0x7f956c14fb80 2023-11-18T20:58:28.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c1efb70 con 0x7f956c06af20 2023-11-18T20:58:28.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.340+0000 7f9572d1a640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956c156d20 con 0x7f956c0c6a80 2023-11-18T20:58:28.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.344+0000 7f9570ab6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956c06af20 0x7f956c14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:28.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.344+0000 7f9570ab6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956c06af20 0x7f956c14ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42338/0 (socket says 172.21.15.106:42338) 2023-11-18T20:58:28.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.344+0000 7f9570ab6640 1 -- 172.21.15.106:0/1621756669 learned_addr learned my addr 172.21.15.106:0/1621756669 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-18T20:58:28.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.348+0000 7f9570ab6640 1 -- 172.21.15.106:0/1621756669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f956c0c6a80 msgr2=0x7f956c14ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:28.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.348+0000 7f9570ab6640 1 --2- 172.21.15.106:0/1621756669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f956c0c6a80 0x7f956c14ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:28.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.348+0000 7f9570ab6640 1 -- 172.21.15.106:0/1621756669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f956c14fb80 msgr2=0x7f956c1416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:28.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.348+0000 7f9570ab6640 1 --2- 172.21.15.106:0/1621756669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f956c14fb80 0x7f956c1416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:28.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.348+0000 7f9570ab6640 1 -- 172.21.15.106:0/1621756669 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956400ab80 con 0x7f956c06af20 2023-11-18T20:58:28.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.348+0000 7f9570ab6640 1 --2- 172.21.15.106:0/1621756669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956c06af20 0x7f956c14ea10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f956401b5f0 tx=0x7f956401a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:28.359 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.356+0000 7f95697fa640 1 -- 172.21.15.106:0/1621756669 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95640b7680 con 0x7f956c06af20 2023-11-18T20:58:28.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.356+0000 7f95697fa640 1 -- 172.21.15.106:0/1621756669 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95640b77e0 con 0x7f956c06af20 2023-11-18T20:58:28.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.356+0000 7f95697fa640 1 -- 172.21.15.106:0/1621756669 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95640b7b90 con 0x7f956c06af20 2023-11-18T20:58:28.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.356+0000 7f9572d1a640 1 -- 172.21.15.106:0/1621756669 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956c157000 con 0x7f956c06af20 2023-11-18T20:58:28.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.356+0000 7f9572d1a640 1 -- 172.21.15.106:0/1621756669 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956c1575c0 con 0x7f956c06af20 2023-11-18T20:58:28.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.356+0000 7f9572d1a640 1 -- 172.21.15.106:0/1621756669 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956c1efd90 con 0x7f956c06af20 2023-11-18T20:58:28.489 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.484+0000 7f95697fa640 1 -- 172.21.15.106:0/1621756669 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 3) v1 ==== 85563+0+0 (secure 0 0 0) 0x7f95640b7cf0 con 0x7f956c06af20 2023-11-18T20:58:28.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.500+0000 7f95697fa640 1 -- 172.21.15.106:0/1621756669 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f95640f0c40 con 0x7f956c06af20 2023-11-18T20:58:28.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.500+0000 7f95697fa640 1 -- 172.21.15.106:0/1621756669 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f95640ec880 con 0x7f956c06af20 2023-11-18T20:58:28.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:28.584+0000 7f9572d1a640 1 -- 172.21.15.106:0/1621756669 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "86a4a7ca-400e-4aea-ae0c-360adbf409b0", "id": 6} v 0) v1 -- 0x7f956c1efd90 con 0x7f956c06af20 2023-11-18T20:58:29.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:29.684+0000 7f95697fa640 1 -- 172.21.15.106:0/1621756669 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f95640ec330 con 0x7f956c06af20 2023-11-18T20:58:29.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:29.684+0000 7f95697fa640 1 --2- 172.21.15.106:0/1621756669 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f95580674a0 0x7f9558069890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:29.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:29.684+0000 7f956bfff640 1 --2- 172.21.15.106:0/1621756669 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f95580674a0 0x7f9558069890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:29.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:29.684+0000 7f956bfff640 1 --2- 172.21.15.106:0/1621756669 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f95580674a0 0x7f9558069890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9560000f70 tx=0x7f95600079e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:29.693 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:29.688+0000 7f539fc0a640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-18T20:58:30.002 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T20:58:29.996+0000 7f539fc0a640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-18T20:58:30.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.008+0000 7f95697fa640 1 -- 172.21.15.106:0/1621756669 <== mon.1 v2:172.21.15.106:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86a4a7ca-400e-4aea-ae0c-360adbf409b0", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f956410cb60 con 0x7f956c06af20 2023-11-18T20:58:30.011 INFO:teuthology.orchestra.run.smithi106.stdout:6 2023-11-18T20:58:30.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.008+0000 7f9572d1a640 1 -- 172.21.15.106:0/1621756669 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f95580674a0 msgr2=0x7f9558069890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:30.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.008+0000 7f9572d1a640 1 --2- 172.21.15.106:0/1621756669 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f95580674a0 0x7f9558069890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9560000f70 tx=0x7f95600079e0 comp rx=0 tx=0).stop 2023-11-18T20:58:30.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.008+0000 7f9572d1a640 1 -- 172.21.15.106:0/1621756669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956c06af20 msgr2=0x7f956c14ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:30.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.008+0000 7f9572d1a640 1 --2- 172.21.15.106:0/1621756669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956c06af20 0x7f956c14ea10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f956401b5f0 tx=0x7f956401a760 comp rx=0 tx=0).stop 2023-11-18T20:58:30.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.008+0000 7f9572d1a640 1 -- 172.21.15.106:0/1621756669 shutdown_connections 2023-11-18T20:58:30.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.008+0000 7f9572d1a640 1 --2- 172.21.15.106:0/1621756669 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f95580674a0 0x7f9558069890 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:30.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.008+0000 7f9572d1a640 1 --2- 172.21.15.106:0/1621756669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f956c14fb80 0x7f956c1416a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:30.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.008+0000 7f9572d1a640 1 --2- 172.21.15.106:0/1621756669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f956c0c6a80 0x7f956c14ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:30.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.008+0000 7f9572d1a640 1 --2- 172.21.15.106:0/1621756669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956c06af20 0x7f956c14ea10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:30.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.008+0000 7f9572d1a640 1 -- 172.21.15.106:0/1621756669 >> 172.21.15.106:0/1621756669 conn(0x7f956c06d220 msgr2=0x7f956c06eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:30.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.008+0000 7f9572d1a640 1 -- 172.21.15.106:0/1621756669 shutdown_connections 2023-11-18T20:58:30.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.008+0000 7f9572d1a640 1 -- 172.21.15.106:0/1621756669 wait complete. 2023-11-18T20:58:30.034 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 5031f219-8897-4960-870b-9946c5ab2901 7 2023-11-18T20:58:30.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.160+0000 7fce4afbc640 1 Processor -- start 2023-11-18T20:58:30.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.160+0000 7fce4afbc640 1 -- start start 2023-11-18T20:58:30.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.160+0000 7fce4afbc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fce440cb520 0x7fce4406b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:30.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.160+0000 7fce4afbc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce440cb900 0x7fce440c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:30.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.160+0000 7fce4afbc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4406bdb0 con 0x7fce440c6270 2023-11-18T20:58:30.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.160+0000 7fce4afbc640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce44156eb0 con 0x7fce440cb520 2023-11-18T20:58:30.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.160+0000 7fce4afbc640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce440c6700 con 0x7fce440cb900 2023-11-18T20:58:30.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.168+0000 7fce49559640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fce440c6270 0x7fce440c2830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42680/0 (socket says 172.21.15.106:42680) 2023-11-18T20:58:30.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.168+0000 7fce49559640 1 -- 172.21.15.106:0/1174139198 learned_addr learned my addr 172.21.15.106:0/1174139198 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-18T20:58:30.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.176+0000 7fce43fff640 1 --2- 172.21.15.106:0/1174139198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce440cb900 0x7fce440c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:30.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.180+0000 7fce43fff640 1 -- 172.21.15.106:0/1174139198 >> v2:172.21.15.49:3300/0 conn(0x7fce440cb520 msgr2=0x7fce4406b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:30.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.180+0000 7fce43fff640 1 --2- 172.21.15.106:0/1174139198 >> v2:172.21.15.49:3300/0 conn(0x7fce440cb520 0x7fce4406b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:30.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.180+0000 7fce43fff640 1 -- 172.21.15.106:0/1174139198 >> v1:172.21.15.106:6789/0 conn(0x7fce440c6270 legacy=0x7fce440c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:30.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.180+0000 7fce43fff640 1 -- 172.21.15.106:0/1174139198 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce44156580 con 0x7fce440cb900 2023-11-18T20:58:30.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.184+0000 7fce43fff640 1 --2- 172.21.15.106:0/1174139198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce440cb900 0x7fce440c5d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fce300097c0 tx=0x7fce3001ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b1ebae1508429a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.256+0000 7fce437fe640 1 -- 172.21.15.106:0/1174139198 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce300a8970 con 0x7fce440cb900 2023-11-18T20:58:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.256+0000 7fce437fe640 1 -- 172.21.15.106:0/1174139198 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce300a8ad0 con 0x7fce440cb900 2023-11-18T20:58:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.256+0000 7fce437fe640 1 -- 172.21.15.106:0/1174139198 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce300a8e60 con 0x7fce440cb900 2023-11-18T20:58:30.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.256+0000 7fce4afbc640 1 -- 172.21.15.106:0/1174139198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce440cb900 msgr2=0x7fce440c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:30.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.256+0000 7fce4afbc640 1 --2- 172.21.15.106:0/1174139198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce440cb900 0x7fce440c5d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fce300097c0 tx=0x7fce3001ec70 comp rx=0 tx=0).stop 2023-11-18T20:58:30.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.256+0000 7fce4afbc640 1 -- 172.21.15.106:0/1174139198 shutdown_connections 2023-11-18T20:58:30.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.256+0000 7fce4afbc640 1 --2- 172.21.15.106:0/1174139198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce440cb900 0x7fce440c5d30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:30.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.256+0000 7fce4afbc640 1 --2- 172.21.15.106:0/1174139198 >> v2:172.21.15.49:3300/0 conn(0x7fce440cb520 0x7fce4406b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:30.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.256+0000 7fce4afbc640 1 -- 172.21.15.106:0/1174139198 >> 172.21.15.106:0/1174139198 conn(0x7fce4406d220 msgr2=0x7fce4406d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:30.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.256+0000 7fce4afbc640 1 -- 172.21.15.106:0/1174139198 shutdown_connections 2023-11-18T20:58:30.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.256+0000 7fce4afbc640 1 -- 172.21.15.106:0/1174139198 wait complete. 2023-11-18T20:58:30.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.260+0000 7fce4afbc640 1 Processor -- start 2023-11-18T20:58:30.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.260+0000 7fce4afbc640 1 -- start start 2023-11-18T20:58:30.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.260+0000 7fce4afbc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce440cb520 0x7fce44155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:30.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.260+0000 7fce4afbc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce440cb900 0x7fce4406f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:30.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.260+0000 7fce4afbc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce4406fa40 0x7fce44151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:30.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.260+0000 7fce4afbc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce44151980 con 0x7fce4406fa40 2023-11-18T20:58:30.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.260+0000 7fce4afbc640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce44150d00 con 0x7fce440cb900 2023-11-18T20:58:30.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.260+0000 7fce4afbc640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce44150fe0 con 0x7fce440cb520 2023-11-18T20:58:30.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.260+0000 7fce48d58640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce440cb520 0x7fce44155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:30.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.260+0000 7fce43fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce440cb900 0x7fce4406f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:30.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.260+0000 7fce43fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce440cb900 0x7fce4406f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40020/0 (socket says 172.21.15.106:40020) 2023-11-18T20:58:30.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.260+0000 7fce43fff640 1 -- 172.21.15.106:0/3163191840 learned_addr learned my addr 172.21.15.106:0/3163191840 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-18T20:58:30.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.264+0000 7fce43fff640 1 -- 172.21.15.106:0/3163191840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce440cb520 msgr2=0x7fce44155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:30.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.264+0000 7fce43fff640 1 --2- 172.21.15.106:0/3163191840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce440cb520 0x7fce44155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:30.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.264+0000 7fce43fff640 1 -- 172.21.15.106:0/3163191840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce4406fa40 msgr2=0x7fce44151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:30.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.264+0000 7fce43fff640 1 --2- 172.21.15.106:0/3163191840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce4406fa40 0x7fce44151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:30.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.264+0000 7fce43fff640 1 -- 172.21.15.106:0/3163191840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce30009420 con 0x7fce440cb900 2023-11-18T20:58:30.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.268+0000 7fce43fff640 1 --2- 172.21.15.106:0/3163191840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce440cb900 0x7fce4406f030 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fce3001c8a0 tx=0x7fce3001ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:30.276 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.272+0000 7fce417fa640 1 -- 172.21.15.106:0/3163191840 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce300a8970 con 0x7fce440cb900 2023-11-18T20:58:30.276 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.272+0000 7fce4afbc640 1 -- 172.21.15.106:0/3163191840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce441512c0 con 0x7fce440cb900 2023-11-18T20:58:30.276 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.272+0000 7fce4afbc640 1 -- 172.21.15.106:0/3163191840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4415a360 con 0x7fce440cb900 2023-11-18T20:58:30.277 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.272+0000 7fce417fa640 1 -- 172.21.15.106:0/3163191840 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce300c6460 con 0x7fce440cb900 2023-11-18T20:58:30.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.272+0000 7fce417fa640 1 -- 172.21.15.106:0/3163191840 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce300c67d0 con 0x7fce440cb900 2023-11-18T20:58:30.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.272+0000 7fce4afbc640 1 -- 172.21.15.106:0/3163191840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce44151ac0 con 0x7fce440cb900 2023-11-18T20:58:30.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.548+0000 7fce417fa640 1 -- 172.21.15.106:0/3163191840 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7fce300b7040 con 0x7fce440cb900 2023-11-18T20:58:30.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.548+0000 7fce417fa640 1 --2- 172.21.15.106:0/3163191840 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fce280663e0 0x7fce280688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:30.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.548+0000 7fce48d58640 1 --2- 172.21.15.106:0/3163191840 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fce280663e0 0x7fce280688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:30.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.552+0000 7fce48d58640 1 --2- 172.21.15.106:0/3163191840 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fce280663e0 0x7fce280688a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce38009990 tx=0x7fce38009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:30.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.576+0000 7fce417fa640 1 -- 172.21.15.106:0/3163191840 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fce300f3cc0 con 0x7fce440cb900 2023-11-18T20:58:30.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.576+0000 7fce417fa640 1 -- 172.21.15.106:0/3163191840 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce300ef900 con 0x7fce440cb900 2023-11-18T20:58:30.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:30.748+0000 7fce4afbc640 1 -- 172.21.15.106:0/3163191840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5031f219-8897-4960-870b-9946c5ab2901", "id": 7} v 0) v1 -- 0x7fce44151ac0 con 0x7fce440cb900 2023-11-18T20:58:31.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:31.152+0000 7fce417fa640 1 -- 172.21.15.106:0/3163191840 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5031f219-8897-4960-870b-9946c5ab2901", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fce44151ac0 con 0x7fce440cb900 2023-11-18T20:58:31.158 INFO:teuthology.orchestra.run.smithi106.stdout:7 2023-11-18T20:58:31.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:31.156+0000 7fce4afbc640 1 -- 172.21.15.106:0/3163191840 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fce280663e0 msgr2=0x7fce280688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:31.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:31.156+0000 7fce4afbc640 1 --2- 172.21.15.106:0/3163191840 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fce280663e0 0x7fce280688a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce38009990 tx=0x7fce38009110 comp rx=0 tx=0).stop 2023-11-18T20:58:31.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:31.156+0000 7fce4afbc640 1 -- 172.21.15.106:0/3163191840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce440cb900 msgr2=0x7fce4406f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:31.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:31.156+0000 7fce4afbc640 1 --2- 172.21.15.106:0/3163191840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce440cb900 0x7fce4406f030 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fce3001c8a0 tx=0x7fce3001ba10 comp rx=0 tx=0).stop 2023-11-18T20:58:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:31.156+0000 7fce4afbc640 1 -- 172.21.15.106:0/3163191840 shutdown_connections 2023-11-18T20:58:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:31.156+0000 7fce4afbc640 1 --2- 172.21.15.106:0/3163191840 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fce280663e0 0x7fce280688a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:31.156+0000 7fce4afbc640 1 --2- 172.21.15.106:0/3163191840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce4406fa40 0x7fce44151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:31.156+0000 7fce4afbc640 1 --2- 172.21.15.106:0/3163191840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce440cb900 0x7fce4406f030 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:31.156+0000 7fce4afbc640 1 --2- 172.21.15.106:0/3163191840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce440cb520 0x7fce44155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:31.156+0000 7fce4afbc640 1 -- 172.21.15.106:0/3163191840 >> 172.21.15.106:0/3163191840 conn(0x7fce4406d220 msgr2=0x7fce440c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:31.156+0000 7fce4afbc640 1 -- 172.21.15.106:0/3163191840 shutdown_connections 2023-11-18T20:58:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-18T20:58:31.156+0000 7fce4afbc640 1 -- 172.21.15.106:0/3163191840 wait complete. 2023-11-18T20:58:31.179 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-18T20:58:31.179 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2023-11-18T20:58:31.181 INFO:tasks.ceph.osd.0:Started 2023-11-18T20:58:31.182 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-18T20:58:31.182 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2023-11-18T20:58:31.184 INFO:tasks.ceph.osd.1:Started 2023-11-18T20:58:31.184 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-18T20:58:31.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2023-11-18T20:58:31.187 INFO:tasks.ceph.osd.2:Started 2023-11-18T20:58:31.187 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-18T20:58:31.187 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2023-11-18T20:58:31.189 INFO:tasks.ceph.osd.3:Started 2023-11-18T20:58:31.190 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-18T20:58:31.190 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2023-11-18T20:58:31.192 INFO:tasks.ceph.osd.4:Started 2023-11-18T20:58:31.192 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-18T20:58:31.192 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2023-11-18T20:58:31.194 INFO:tasks.ceph.osd.5:Started 2023-11-18T20:58:31.194 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-18T20:58:31.194 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2023-11-18T20:58:31.196 INFO:tasks.ceph.osd.6:Started 2023-11-18T20:58:31.196 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-18T20:58:31.196 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2023-11-18T20:58:31.198 INFO:tasks.ceph.osd.7:Started 2023-11-18T20:58:31.199 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:58:31.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.334+0000 7f63c96c4640 1 Processor -- start 2023-11-18T20:58:31.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.334+0000 7f63c96c4640 1 -- start start 2023-11-18T20:58:31.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.334+0000 7f63c96c4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f63c413d010 0x7f63c4157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:31.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.334+0000 7f63c96c4640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63c406eed0 0x7f63c40c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:31.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.334+0000 7f63c96c4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c40c6920 con 0x7f63c40c4f80 2023-11-18T20:58:31.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.334+0000 7f63c96c4640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c41580e0 con 0x7f63c413d010 2023-11-18T20:58:31.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.334+0000 7f63c96c4640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40c5d30 con 0x7f63c406eed0 2023-11-18T20:58:31.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.342+0000 7f63c27fc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63c406eed0 0x7f63c40c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:31.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.342+0000 7f63c27fc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63c406eed0 0x7f63c40c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:49930/0 (socket says 172.21.15.49:49930) 2023-11-18T20:58:31.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.342+0000 7f63c27fc640 1 -- 172.21.15.49:0/2195819696 learned_addr learned my addr 172.21.15.49:0/2195819696 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:58:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.346+0000 7f63c27fc640 1 -- 172.21.15.49:0/2195819696 >> v2:172.21.15.106:3300/0 conn(0x7f63c413d010 msgr2=0x7f63c4157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.346+0000 7f63c27fc640 1 --2- 172.21.15.49:0/2195819696 >> v2:172.21.15.106:3300/0 conn(0x7f63c413d010 0x7f63c4157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.346+0000 7f63c27fc640 1 -- 172.21.15.49:0/2195819696 >> v1:172.21.15.49:6789/0 conn(0x7f63c40c4f80 legacy=0x7f63c40c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:31.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.346+0000 7f63c27fc640 1 -- 172.21.15.49:0/2195819696 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c406f710 con 0x7f63c406eed0 2023-11-18T20:58:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.350+0000 7f63c27fc640 1 --2- 172.21.15.49:0/2195819696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63c406eed0 0x7f63c40c4a40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009870 tx=0x7f63ac01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aea1a16bb0556be4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:31.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.354+0000 7f63c1ffb640 1 -- 172.21.15.49:0/2195819696 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0aa610 con 0x7f63c406eed0 2023-11-18T20:58:31.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.354+0000 7f63c1ffb640 1 -- 172.21.15.49:0/2195819696 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac0a6040 con 0x7f63c406eed0 2023-11-18T20:58:31.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.354+0000 7f63c1ffb640 1 -- 172.21.15.49:0/2195819696 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0aa990 con 0x7f63c406eed0 2023-11-18T20:58:31.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.354+0000 7f63c96c4640 1 -- 172.21.15.49:0/2195819696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63c406eed0 msgr2=0x7f63c40c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:31.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.354+0000 7f63c96c4640 1 --2- 172.21.15.49:0/2195819696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63c406eed0 0x7f63c40c4a40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009870 tx=0x7f63ac01c4d0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.354+0000 7f63c96c4640 1 -- 172.21.15.49:0/2195819696 shutdown_connections 2023-11-18T20:58:31.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.354+0000 7f63c96c4640 1 --2- 172.21.15.49:0/2195819696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63c406eed0 0x7f63c40c4a40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.354+0000 7f63c96c4640 1 --2- 172.21.15.49:0/2195819696 >> v2:172.21.15.106:3300/0 conn(0x7f63c413d010 0x7f63c4157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.354+0000 7f63c96c4640 1 -- 172.21.15.49:0/2195819696 >> 172.21.15.49:0/2195819696 conn(0x7f63c40713a0 msgr2=0x7f63c40717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:31.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.354+0000 7f63c96c4640 1 -- 172.21.15.49:0/2195819696 shutdown_connections 2023-11-18T20:58:31.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.354+0000 7f63c96c4640 1 -- 172.21.15.49:0/2195819696 wait complete. 2023-11-18T20:58:31.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.358+0000 7f63c96c4640 1 Processor -- start 2023-11-18T20:58:31.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.358+0000 7f63c96c4640 1 -- start start 2023-11-18T20:58:31.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.358+0000 7f63c96c4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63c406eed0 0x7f63c4136a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:31.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.358+0000 7f63c96c4640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63c40c4f80 0x7f63c41f07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:31.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.358+0000 7f63c96c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63c413d010 0x7f63c40ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:31.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.358+0000 7f63c96c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c41f0040 con 0x7f63c413d010 2023-11-18T20:58:31.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.358+0000 7f63c96c4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c41530d0 con 0x7f63c406eed0 2023-11-18T20:58:31.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.358+0000 7f63c96c4640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c41f4140 con 0x7f63c40c4f80 2023-11-18T20:58:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.358+0000 7f63c27fc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63c40c4f80 0x7f63c41f07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.358+0000 7f63c27fc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63c40c4f80 0x7f63c41f07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:49934/0 (socket says 172.21.15.49:49934) 2023-11-18T20:58:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.358+0000 7f63c27fc640 1 -- 172.21.15.49:0/2935758902 learned_addr learned my addr 172.21.15.49:0/2935758902 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:58:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.362+0000 7f63c27fc640 1 -- 172.21.15.49:0/2935758902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63c406eed0 msgr2=0x7f63c4136a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.362+0000 7f63c27fc640 1 --2- 172.21.15.49:0/2935758902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63c406eed0 0x7f63c4136a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.362+0000 7f63c27fc640 1 -- 172.21.15.49:0/2935758902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63c413d010 msgr2=0x7f63c40ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.362+0000 7f63c27fc640 1 --2- 172.21.15.49:0/2935758902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63c413d010 0x7f63c40ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.362+0000 7f63c27fc640 1 -- 172.21.15.49:0/2935758902 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac0094d0 con 0x7f63c40c4f80 2023-11-18T20:58:31.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.366+0000 7f63c27fc640 1 --2- 172.21.15.49:0/2935758902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63c40c4f80 0x7f63c41f07e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0ac040 tx=0x7f63ac01ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:31.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.366+0000 7f63bb7fe640 1 -- 172.21.15.49:0/2935758902 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0b3800 con 0x7f63c40c4f80 2023-11-18T20:58:31.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.366+0000 7f63c96c4640 1 -- 172.21.15.49:0/2935758902 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c41f4400 con 0x7f63c40c4f80 2023-11-18T20:58:31.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.366+0000 7f63c96c4640 1 -- 172.21.15.49:0/2935758902 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c40cbd80 con 0x7f63c40c4f80 2023-11-18T20:58:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.370+0000 7f63c96c4640 1 -- 172.21.15.49:0/2935758902 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c40cbf70 con 0x7f63c40c4f80 2023-11-18T20:58:31.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.630+0000 7f63bb7fe640 1 -- 172.21.15.49:0/2935758902 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac0aae20 con 0x7f63c40c4f80 2023-11-18T20:58:31.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.630+0000 7f63bb7fe640 1 -- 172.21.15.49:0/2935758902 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0b3b60 con 0x7f63c40c4f80 2023-11-18T20:58:31.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.634+0000 7f63bb7fe640 1 -- 172.21.15.49:0/2935758902 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f63ac0c6390 con 0x7f63c40c4f80 2023-11-18T20:58:31.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.634+0000 7f63bb7fe640 1 --2- 172.21.15.49:0/2935758902 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f63a40663e0 0x7f63a40688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:31.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.634+0000 7f63c2ffd640 1 --2- 172.21.15.49:0/2935758902 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f63a40663e0 0x7f63a40688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:31.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.634+0000 7f63c2ffd640 1 --2- 172.21.15.49:0/2935758902 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f63a40663e0 0x7f63a40688a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009730 tx=0x7f63bc006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:31.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.642+0000 7f63bb7fe640 1 -- 172.21.15.49:0/2935758902 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f63ac0f00b0 con 0x7f63c40c4f80 2023-11-18T20:58:31.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.662+0000 7f63bb7fe640 1 -- 172.21.15.49:0/2935758902 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63ac0ebcf0 con 0x7f63c40c4f80 2023-11-18T20:58:31.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.826+0000 7f63c96c4640 1 -- 172.21.15.49:0/2935758902 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63c4161880 con 0x7f63c40c4f80 2023-11-18T20:58:31.877 INFO:tasks.ceph.osd.5.smithi106.stderr:2023-11-18T20:58:31.872+0000 7f3174f27640 -1 Falling back to public interface 2023-11-18T20:58:31.893 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-11-18T20:58:31.890+0000 7fc1fb0d3640 -1 Falling back to public interface 2023-11-18T20:58:31.909 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-11-18T20:58:31.906+0000 7f782465d640 -1 Falling back to public interface 2023-11-18T20:58:31.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.906+0000 7f63bb7fe640 1 -- 172.21.15.49:0/2935758902 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f63ac0ef310 con 0x7f63c40c4f80 2023-11-18T20:58:31.911 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:58:31.912 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":10,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:58:30.808766+0000","last_up_change":"0.000000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:58:31.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.910+0000 7f63c96c4640 1 -- 172.21.15.49:0/2935758902 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f63a40663e0 msgr2=0x7f63a40688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.910+0000 7f63c96c4640 1 --2- 172.21.15.49:0/2935758902 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f63a40663e0 0x7f63a40688a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009730 tx=0x7f63bc006ca0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.910+0000 7f63c96c4640 1 -- 172.21.15.49:0/2935758902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63c40c4f80 msgr2=0x7f63c41f07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.910+0000 7f63c96c4640 1 --2- 172.21.15.49:0/2935758902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63c40c4f80 0x7f63c41f07e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0ac040 tx=0x7f63ac01ad10 comp rx=0 tx=0).stop 2023-11-18T20:58:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.910+0000 7f63c96c4640 1 -- 172.21.15.49:0/2935758902 shutdown_connections 2023-11-18T20:58:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.910+0000 7f63c96c4640 1 --2- 172.21.15.49:0/2935758902 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f63a40663e0 0x7f63a40688a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.910+0000 7f63c96c4640 1 --2- 172.21.15.49:0/2935758902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63c413d010 0x7f63c40ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.910+0000 7f63c96c4640 1 --2- 172.21.15.49:0/2935758902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63c40c4f80 0x7f63c41f07e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.910+0000 7f63c96c4640 1 --2- 172.21.15.49:0/2935758902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63c406eed0 0x7f63c4136a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.910+0000 7f63c96c4640 1 -- 172.21.15.49:0/2935758902 >> 172.21.15.49:0/2935758902 conn(0x7f63c40713a0 msgr2=0x7f63c4154e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:31.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.910+0000 7f63c96c4640 1 -- 172.21.15.49:0/2935758902 shutdown_connections 2023-11-18T20:58:31.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:31.910+0000 7f63c96c4640 1 -- 172.21.15.49:0/2935758902 wait complete. 2023-11-18T20:58:31.920 INFO:tasks.ceph.osd.7.smithi106.stderr:2023-11-18T20:58:31.916+0000 7f070f48a640 -1 Falling back to public interface 2023-11-18T20:58:31.928 INFO:tasks.ceph.osd.4.smithi106.stderr:2023-11-18T20:58:31.924+0000 7f09e1842640 -1 Falling back to public interface 2023-11-18T20:58:31.932 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-18T20:58:31.933 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-18T20:58:31.936 INFO:tasks.ceph.osd.6.smithi106.stderr:2023-11-18T20:58:31.932+0000 7f470ce4b640 -1 Falling back to public interface 2023-11-18T20:58:31.985 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-11-18T20:58:31.982+0000 7f7b6a9db640 -1 Falling back to public interface 2023-11-18T20:58:32.005 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-11-18T20:58:32.002+0000 7f5c73538640 -1 Falling back to public interface 2023-11-18T20:58:32.739 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-18T20:58:32.864 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.858+0000 7f2c3e9f9640 1 Processor -- start 2023-11-18T20:58:32.864 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.862+0000 7f2c3e9f9640 1 -- start start 2023-11-18T20:58:32.865 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.862+0000 7f2c3e9f9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2c380c4fa0 0x7f2c380c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:32.865 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.862+0000 7f2c3e9f9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2c380bfc00 0x7f2c380c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:32.865 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.862+0000 7f2c3e9f9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c38150140 con 0x7f2c3814fd60 2023-11-18T20:58:32.866 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.862+0000 7f2c3e9f9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c380c4b10 con 0x7f2c380c4fa0 2023-11-18T20:58:32.866 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.862+0000 7f2c3e9f9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c380b0f70 con 0x7f2c380bfc00 2023-11-18T20:58:32.867 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.862+0000 7f2c2f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2c380c4fa0 0x7f2c380c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:32.867 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.862+0000 7f2c2f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2c380c4fa0 0x7f2c380c6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38800/0 (socket says 172.21.15.49:38800) 2023-11-18T20:58:32.867 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.862+0000 7f2c2f7fe640 1 -- 172.21.15.49:0/1289697998 learned_addr learned my addr 172.21.15.49:0/1289697998 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:58:32.867 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.862+0000 7f2c3cf96640 1 --2- 172.21.15.49:0/1289697998 >> v2:172.21.15.106:3300/0 conn(0x7f2c380bfc00 0x7f2c380c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:32.869 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.866+0000 7f2c2f7fe640 1 -- 172.21.15.49:0/1289697998 >> v2:172.21.15.106:3300/0 conn(0x7f2c380bfc00 msgr2=0x7f2c380c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:32.869 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.866+0000 7f2c2f7fe640 1 --2- 172.21.15.49:0/1289697998 >> v2:172.21.15.106:3300/0 conn(0x7f2c380bfc00 0x7f2c380c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:32.870 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.866+0000 7f2c2f7fe640 1 -- 172.21.15.49:0/1289697998 >> v1:172.21.15.106:6789/0 conn(0x7f2c3814fd60 legacy=0x7f2c380c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:32.870 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.866+0000 7f2c2f7fe640 1 -- 172.21.15.49:0/1289697998 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c380c0140 con 0x7f2c380c4fa0 2023-11-18T20:58:32.873 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.870+0000 7f2c2f7fe640 1 --2- 172.21.15.49:0/1289697998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c380c4fa0 0x7f2c380c6bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2c38159f90 tx=0x7f2c2001e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d231fc2256877bc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:32.878 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.874+0000 7f2c377fe640 1 -- 172.21.15.49:0/1289697998 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20004230 con 0x7f2c380c4fa0 2023-11-18T20:58:32.879 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.874+0000 7f2c377fe640 1 -- 172.21.15.49:0/1289697998 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c200ab070 con 0x7f2c380c4fa0 2023-11-18T20:58:32.879 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.874+0000 7f2c377fe640 1 -- 172.21.15.49:0/1289697998 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c200a7770 con 0x7f2c380c4fa0 2023-11-18T20:58:32.879 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.874+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/1289697998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c380c4fa0 msgr2=0x7f2c380c6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:32.880 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.874+0000 7f2c3e9f9640 1 --2- 172.21.15.49:0/1289697998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c380c4fa0 0x7f2c380c6bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2c38159f90 tx=0x7f2c2001e9b0 comp rx=0 tx=0).stop 2023-11-18T20:58:32.880 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.874+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/1289697998 shutdown_connections 2023-11-18T20:58:32.880 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.874+0000 7f2c3e9f9640 1 --2- 172.21.15.49:0/1289697998 >> v2:172.21.15.106:3300/0 conn(0x7f2c380bfc00 0x7f2c380c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:32.880 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.874+0000 7f2c3e9f9640 1 --2- 172.21.15.49:0/1289697998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c380c4fa0 0x7f2c380c6bd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:32.880 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.874+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/1289697998 >> 172.21.15.49:0/1289697998 conn(0x7f2c380c77a0 msgr2=0x7f2c380c7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:32.880 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.874+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/1289697998 shutdown_connections 2023-11-18T20:58:32.880 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.874+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/1289697998 wait complete. 2023-11-18T20:58:32.880 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.878+0000 7f2c3e9f9640 1 Processor -- start 2023-11-18T20:58:32.881 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.878+0000 7f2c3e9f9640 1 -- start start 2023-11-18T20:58:32.881 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.878+0000 7f2c3e9f9640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c380bfc00 0x7f2c3814c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:32.881 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.878+0000 7f2c3e9f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c3814fd60 0x7f2c3814c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:32.882 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.878+0000 7f2c3e9f9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c381446b0 0x7f2c381f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:32.882 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.878+0000 7f2c3e9f9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c38142570 con 0x7f2c3814fd60 2023-11-18T20:58:32.882 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.878+0000 7f2c3e9f9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c380ca200 con 0x7f2c381446b0 2023-11-18T20:58:32.882 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.878+0000 7f2c3e9f9640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c381427a0 con 0x7f2c380bfc00 2023-11-18T20:58:32.882 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.878+0000 7f2c2f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c3814fd60 0x7f2c3814c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:32.883 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.878+0000 7f2c2f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c3814fd60 0x7f2c3814c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38806/0 (socket says 172.21.15.49:38806) 2023-11-18T20:58:32.883 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.878+0000 7f2c2f7fe640 1 -- 172.21.15.49:0/3725035467 learned_addr learned my addr 172.21.15.49:0/3725035467 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:58:32.883 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.878+0000 7f2c37fff640 1 --2- 172.21.15.49:0/3725035467 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c380bfc00 0x7f2c3814c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:32.885 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.882+0000 7f2c3cf96640 1 --2- 172.21.15.49:0/3725035467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c381446b0 0x7f2c381f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:32.886 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.882+0000 7f2c2f7fe640 1 -- 172.21.15.49:0/3725035467 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c380bfc00 msgr2=0x7f2c3814c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:32.886 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.882+0000 7f2c2f7fe640 1 --2- 172.21.15.49:0/3725035467 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c380bfc00 0x7f2c3814c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:32.886 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.882+0000 7f2c2f7fe640 1 -- 172.21.15.49:0/3725035467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c381446b0 msgr2=0x7f2c381f5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:32.886 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.882+0000 7f2c2f7fe640 1 --2- 172.21.15.49:0/3725035467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c381446b0 0x7f2c381f5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:32.886 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.882+0000 7f2c2f7fe640 1 -- 172.21.15.49:0/3725035467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2000b780 con 0x7f2c3814fd60 2023-11-18T20:58:32.888 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.886+0000 7f2c2f7fe640 1 --2- 172.21.15.49:0/3725035467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c3814fd60 0x7f2c3814c5e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2c20000c10 tx=0x7f2c2001b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:32.893 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.890+0000 7f2c357fa640 1 -- 172.21.15.49:0/3725035467 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c200a7a40 con 0x7f2c3814fd60 2023-11-18T20:58:32.893 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.890+0000 7f2c357fa640 1 -- 172.21.15.49:0/3725035467 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c200a7bc0 con 0x7f2c3814fd60 2023-11-18T20:58:32.893 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.890+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/3725035467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c38142a60 con 0x7f2c3814fd60 2023-11-18T20:58:32.893 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.890+0000 7f2c357fa640 1 -- 172.21.15.49:0/3725035467 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c200a7d70 con 0x7f2c3814fd60 2023-11-18T20:58:32.893 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.890+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/3725035467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c380c41e0 con 0x7f2c3814fd60 2023-11-18T20:58:32.894 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.890+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/3725035467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c38067520 con 0x7f2c3814fd60 2023-11-18T20:58:32.918 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.914+0000 7f2c357fa640 1 -- 172.21.15.49:0/3725035467 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f2c20003620 con 0x7f2c3814fd60 2023-11-18T20:58:32.918 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.914+0000 7f2c357fa640 1 --2- 172.21.15.49:0/3725035467 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2c18066430 0x7f2c180688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:32.919 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.914+0000 7f2c37fff640 1 --2- 172.21.15.49:0/3725035467 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2c18066430 0x7f2c180688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:32.920 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:32.918+0000 7f2c37fff640 1 --2- 172.21.15.49:0/3725035467 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2c18066430 0x7f2c180688f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2c28007fd0 tx=0x7f2c28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:33.233 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.230+0000 7f2c357fa640 1 -- 172.21.15.49:0/3725035467 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2c200ef4a0 con 0x7f2c3814fd60 2023-11-18T20:58:33.233 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.230+0000 7f2c357fa640 1 -- 172.21.15.49:0/3725035467 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2c200eb7e0 con 0x7f2c3814fd60 2023-11-18T20:58:33.406 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.402+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/3725035467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c38147c40 con 0x7f2c3814fd60 2023-11-18T20:58:33.464 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.458+0000 7f2c357fa640 1 -- 172.21.15.49:0/3725035467 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f2c200be090 con 0x7f2c3814fd60 2023-11-18T20:58:33.464 INFO:teuthology.misc.health.smithi049.stdout: 2023-11-18T20:58:33.464 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":10,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:58:30.808766+0000","last_up_change":"0.000000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:58:33.466 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.462+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/3725035467 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2c18066430 msgr2=0x7f2c180688f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:33.466 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.462+0000 7f2c3e9f9640 1 --2- 172.21.15.49:0/3725035467 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2c18066430 0x7f2c180688f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2c28007fd0 tx=0x7f2c28009040 comp rx=0 tx=0).stop 2023-11-18T20:58:33.466 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.462+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/3725035467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c3814fd60 msgr2=0x7f2c3814c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:33.466 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.462+0000 7f2c3e9f9640 1 --2- 172.21.15.49:0/3725035467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c3814fd60 0x7f2c3814c5e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2c20000c10 tx=0x7f2c2001b750 comp rx=0 tx=0).stop 2023-11-18T20:58:33.467 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.462+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/3725035467 shutdown_connections 2023-11-18T20:58:33.467 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.462+0000 7f2c3e9f9640 1 --2- 172.21.15.49:0/3725035467 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2c18066430 0x7f2c180688f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:33.467 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.462+0000 7f2c3e9f9640 1 --2- 172.21.15.49:0/3725035467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c381446b0 0x7f2c381f5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:33.467 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.462+0000 7f2c3e9f9640 1 --2- 172.21.15.49:0/3725035467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c3814fd60 0x7f2c3814c5e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:33.467 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.462+0000 7f2c3e9f9640 1 --2- 172.21.15.49:0/3725035467 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c380bfc00 0x7f2c3814c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:33.467 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.462+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/3725035467 >> 172.21.15.49:0/3725035467 conn(0x7f2c380c77a0 msgr2=0x7f2c3806d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:33.468 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.462+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/3725035467 shutdown_connections 2023-11-18T20:58:33.468 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:33.462+0000 7f2c3e9f9640 1 -- 172.21.15.49:0/3725035467 wait complete. 2023-11-18T20:58:33.484 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-18T20:58:35.025 INFO:tasks.ceph.osd.4.smithi106.stderr:2023-11-18T20:58:35.020+0000 7f09e1842640 -1 osd.4 0 log_to_monitors true 2023-11-18T20:58:35.613 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-11-18T20:58:35.609+0000 7fc1fb0d3640 -1 osd.0 0 log_to_monitors true 2023-11-18T20:58:35.690 INFO:tasks.ceph.osd.5.smithi106.stderr:2023-11-18T20:58:35.684+0000 7f3174f27640 -1 osd.5 0 log_to_monitors true 2023-11-18T20:58:35.756 INFO:tasks.ceph.osd.7.smithi106.stderr:2023-11-18T20:58:35.752+0000 7f070f48a640 -1 osd.7 0 log_to_monitors true 2023-11-18T20:58:35.757 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-11-18T20:58:35.753+0000 7f782465d640 -1 osd.1 0 log_to_monitors true 2023-11-18T20:58:35.828 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-11-18T20:58:35.821+0000 7f7b6a9db640 -1 osd.2 0 log_to_monitors true 2023-11-18T20:58:35.828 INFO:tasks.ceph.osd.6.smithi106.stderr:2023-11-18T20:58:35.824+0000 7f470ce4b640 -1 osd.6 0 log_to_monitors true 2023-11-18T20:58:35.890 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-11-18T20:58:35.885+0000 7f5c73538640 -1 osd.3 0 log_to_monitors true 2023-11-18T20:58:38.036 INFO:tasks.ceph.osd.4.smithi106.stderr:2023-11-18T20:58:38.032+0000 7f09ddffe640 -1 osd.4 0 waiting for initial osdmap 2023-11-18T20:58:38.101 INFO:tasks.ceph.osd.4.smithi106.stderr:2023-11-18T20:58:38.096+0000 7f09d5627640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:58:39.920 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-11-18T20:58:39.913+0000 7f7820607640 -1 osd.1 0 waiting for initial osdmap 2023-11-18T20:58:39.987 INFO:tasks.ceph.osd.7.smithi106.stderr:2023-11-18T20:58:39.980+0000 7f070bc46640 -1 osd.7 0 waiting for initial osdmap 2023-11-18T20:58:39.989 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-11-18T20:58:39.985+0000 7f5c6fcf4640 -1 osd.3 0 waiting for initial osdmap 2023-11-18T20:58:39.993 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-11-18T20:58:39.989+0000 7f7818442640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:58:40.045 INFO:tasks.ceph.osd.5.smithi106.stderr:2023-11-18T20:58:40.040+0000 7f3170ed1640 -1 osd.5 0 waiting for initial osdmap 2023-11-18T20:58:40.046 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-11-18T20:58:40.041+0000 7f7b66985640 -1 osd.2 0 waiting for initial osdmap 2023-11-18T20:58:40.060 INFO:tasks.ceph.osd.6.smithi106.stderr:2023-11-18T20:58:40.056+0000 7f4708df5640 -1 osd.6 0 waiting for initial osdmap 2023-11-18T20:58:40.068 INFO:tasks.ceph.osd.7.smithi106.stderr:2023-11-18T20:58:40.064+0000 7f070326f640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:58:40.073 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-11-18T20:58:40.069+0000 7f7b5e7c0640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:58:40.075 INFO:tasks.ceph.osd.5.smithi106.stderr:2023-11-18T20:58:40.072+0000 7f3168d0c640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:58:40.087 INFO:tasks.ceph.osd.6.smithi106.stderr:2023-11-18T20:58:40.084+0000 7f4700c30640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:58:40.101 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-11-18T20:58:40.097+0000 7f5c6731d640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:58:40.116 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-11-18T20:58:40.113+0000 7fc1f707d640 -1 osd.0 0 waiting for initial osdmap 2023-11-18T20:58:40.149 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-11-18T20:58:40.145+0000 7fc1eeeb8640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T20:58:40.291 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-18T20:58:40.412 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.409+0000 7f1ecdc28640 1 Processor -- start 2023-11-18T20:58:40.412 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.409+0000 7f1ecdc28640 1 -- start start 2023-11-18T20:58:40.413 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.409+0000 7f1ecdc28640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ec8151220 0x7f1ec8157920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:40.413 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.409+0000 7f1ecdc28640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1ec8151600 0x7f1ec80c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:40.413 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.409+0000 7f1ecdc28640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec80c0ee0 con 0x7f1ec8157e60 2023-11-18T20:58:40.413 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.409+0000 7f1ecdc28640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec8157500 con 0x7f1ec8151600 2023-11-18T20:58:40.413 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.409+0000 7f1ecdc28640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec80c2600 con 0x7f1ec8151220 2023-11-18T20:58:40.415 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.409+0000 7f1ec77fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ec8151220 0x7f1ec8157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:40.416 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.409+0000 7f1ec77fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ec8151220 0x7f1ec8157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:47716/0 (socket says 172.21.15.49:47716) 2023-11-18T20:58:40.416 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.409+0000 7f1ec77fe640 1 -- 172.21.15.49:0/2951008096 learned_addr learned my addr 172.21.15.49:0/2951008096 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:58:40.422 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.417+0000 7f1ec77fe640 1 -- 172.21.15.49:0/2951008096 >> v2:172.21.15.49:3300/0 conn(0x7f1ec8151600 msgr2=0x7f1ec80c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:40.422 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.417+0000 7f1ec77fe640 1 --2- 172.21.15.49:0/2951008096 >> v2:172.21.15.49:3300/0 conn(0x7f1ec8151600 0x7f1ec80c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:40.422 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.417+0000 7f1ec77fe640 1 -- 172.21.15.49:0/2951008096 >> v1:172.21.15.49:6789/0 conn(0x7f1ec8157e60 legacy=0x7f1ec80c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:40.422 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.417+0000 7f1ec77fe640 1 -- 172.21.15.49:0/2951008096 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec8157140 con 0x7f1ec8151220 2023-11-18T20:58:40.427 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.421+0000 7f1ec77fe640 1 --2- 172.21.15.49:0/2951008096 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ec8151220 0x7f1ec8157920 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009870 tx=0x7f1eb801c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fe3b74d3ea10ddc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:40.438 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.433+0000 7f1ec67fc640 1 -- 172.21.15.49:0/2951008096 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb80ab5f0 con 0x7f1ec8151220 2023-11-18T20:58:40.438 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.433+0000 7f1ec67fc640 1 -- 172.21.15.49:0/2951008096 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb80ab750 con 0x7f1ec8151220 2023-11-18T20:58:40.438 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.433+0000 7f1ec67fc640 1 -- 172.21.15.49:0/2951008096 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb80abae0 con 0x7f1ec8151220 2023-11-18T20:58:40.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.433+0000 7f1ecdc28640 1 -- 172.21.15.49:0/2951008096 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ec8151220 msgr2=0x7f1ec8157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:40.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.433+0000 7f1ecdc28640 1 --2- 172.21.15.49:0/2951008096 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ec8151220 0x7f1ec8157920 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009870 tx=0x7f1eb801c520 comp rx=0 tx=0).stop 2023-11-18T20:58:40.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.433+0000 7f1ecdc28640 1 -- 172.21.15.49:0/2951008096 shutdown_connections 2023-11-18T20:58:40.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.433+0000 7f1ecdc28640 1 --2- 172.21.15.49:0/2951008096 >> v2:172.21.15.49:3300/0 conn(0x7f1ec8151600 0x7f1ec80c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:40.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.433+0000 7f1ecdc28640 1 --2- 172.21.15.49:0/2951008096 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ec8151220 0x7f1ec8157920 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:40.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.433+0000 7f1ecdc28640 1 -- 172.21.15.49:0/2951008096 >> 172.21.15.49:0/2951008096 conn(0x7f1ec8072510 msgr2=0x7f1ec806e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:40.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.433+0000 7f1ecdc28640 1 -- 172.21.15.49:0/2951008096 shutdown_connections 2023-11-18T20:58:40.439 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.433+0000 7f1ecdc28640 1 -- 172.21.15.49:0/2951008096 wait complete. 2023-11-18T20:58:40.440 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.437+0000 7f1ecdc28640 1 Processor -- start 2023-11-18T20:58:40.440 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.437+0000 7f1ecdc28640 1 -- start start 2023-11-18T20:58:40.440 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.437+0000 7f1ecdc28640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ec8151220 0x7f1ec814cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:40.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.437+0000 7f1ecdc28640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ec8151600 0x7f1ec81598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:40.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.437+0000 7f1ecdc28640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ec8157e60 0x7f1ec814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:40.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.437+0000 7f1ecdc28640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec815a2b0 con 0x7f1ec8151220 2023-11-18T20:58:40.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.437+0000 7f1ecdc28640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec81527f0 con 0x7f1ec8151600 2023-11-18T20:58:40.441 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.437+0000 7f1ecdc28640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec81435f0 con 0x7f1ec8157e60 2023-11-18T20:58:40.442 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.437+0000 7f1ec6ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ec8151600 0x7f1ec81598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:40.443 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.437+0000 7f1ec6ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ec8151600 0x7f1ec81598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:59046/0 (socket says 172.21.15.49:59046) 2023-11-18T20:58:40.443 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.437+0000 7f1ec6ffd640 1 -- 172.21.15.49:0/1922764302 learned_addr learned my addr 172.21.15.49:0/1922764302 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:58:40.443 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.437+0000 7f1ec7fff640 1 --2- 172.21.15.49:0/1922764302 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ec8157e60 0x7f1ec814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:40.453 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.449+0000 7f1ec6ffd640 1 -- 172.21.15.49:0/1922764302 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ec8157e60 msgr2=0x7f1ec814bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:40.453 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.449+0000 7f1ec6ffd640 1 --2- 172.21.15.49:0/1922764302 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ec8157e60 0x7f1ec814bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:40.454 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.449+0000 7f1ec6ffd640 1 -- 172.21.15.49:0/1922764302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ec8151220 msgr2=0x7f1ec814cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:40.454 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.449+0000 7f1ec6ffd640 1 --2- 172.21.15.49:0/1922764302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ec8151220 0x7f1ec814cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:40.454 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.449+0000 7f1ec6ffd640 1 -- 172.21.15.49:0/1922764302 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb80094d0 con 0x7f1ec8151600 2023-11-18T20:58:40.459 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.453+0000 7f1ec6ffd640 1 --2- 172.21.15.49:0/1922764302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ec8151600 0x7f1ec81598f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c410 tx=0x7f1ebc00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:40.469 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.465+0000 7f1eaffff640 1 -- 172.21.15.49:0/1922764302 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc003600 con 0x7f1ec8151600 2023-11-18T20:58:40.469 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.465+0000 7f1eaffff640 1 -- 172.21.15.49:0/1922764302 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc003780 con 0x7f1ec8151600 2023-11-18T20:58:40.470 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.465+0000 7f1eaffff640 1 -- 172.21.15.49:0/1922764302 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc003b30 con 0x7f1ec8151600 2023-11-18T20:58:40.470 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.465+0000 7f1ecdc28640 1 -- 172.21.15.49:0/1922764302 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec814d050 con 0x7f1ec8151600 2023-11-18T20:58:40.470 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.465+0000 7f1ecdc28640 1 -- 172.21.15.49:0/1922764302 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec814b000 con 0x7f1ec8151600 2023-11-18T20:58:40.470 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.465+0000 7f1ecdc28640 1 -- 172.21.15.49:0/1922764302 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec8073e70 con 0x7f1ec8151600 2023-11-18T20:58:40.785 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.781+0000 7f1eaffff640 1 -- 172.21.15.49:0/1922764302 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f1ebc003c90 con 0x7f1ec8151600 2023-11-18T20:58:40.786 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.781+0000 7f1eaffff640 1 --2- 172.21.15.49:0/1922764302 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1eb406a840 0x7f1eb406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:40.786 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.781+0000 7f1ec77fe640 1 --2- 172.21.15.49:0/1922764302 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1eb406a840 0x7f1eb406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:40.788 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.781+0000 7f1ec77fe640 1 --2- 172.21.15.49:0/1922764302 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1eb406a840 0x7f1eb406cd00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80af000 tx=0x7f1eb8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:40.819 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.813+0000 7f1eaffff640 1 -- 172.21.15.49:0/1922764302 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f1ebc0010f0 con 0x7f1ec8151600 2023-11-18T20:58:40.820 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.817+0000 7f1eaffff640 1 -- 172.21.15.49:0/1922764302 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ebc0511c0 con 0x7f1ec8151600 2023-11-18T20:58:41.001 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:40.997+0000 7f1ecdc28640 1 -- 172.21.15.49:0/1922764302 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ec8154a60 con 0x7f1ec8151600 2023-11-18T20:58:41.342 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:41.337+0000 7f1eaffff640 1 -- 172.21.15.49:0/1922764302 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7566 (secure 0 0 0) 0x7f1ebc021020 con 0x7f1ec8151600 2023-11-18T20:58:41.342 INFO:teuthology.misc.health.smithi049.stdout: 2023-11-18T20:58:41.343 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":14,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:58:39.420355+0000","last_up_change":"2023-11-18T20:58:39.420355+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:58:41.345 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:41.341+0000 7f1ecdc28640 1 -- 172.21.15.49:0/1922764302 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1eb406a840 msgr2=0x7f1eb406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:41.345 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:41.341+0000 7f1ecdc28640 1 --2- 172.21.15.49:0/1922764302 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1eb406a840 0x7f1eb406cd00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80af000 tx=0x7f1eb8008040 comp rx=0 tx=0).stop 2023-11-18T20:58:41.345 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:41.341+0000 7f1ecdc28640 1 -- 172.21.15.49:0/1922764302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ec8151600 msgr2=0x7f1ec81598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:41.345 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:41.341+0000 7f1ecdc28640 1 --2- 172.21.15.49:0/1922764302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ec8151600 0x7f1ec81598f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c410 tx=0x7f1ebc00c8d0 comp rx=0 tx=0).stop 2023-11-18T20:58:41.346 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:41.341+0000 7f1ecdc28640 1 -- 172.21.15.49:0/1922764302 shutdown_connections 2023-11-18T20:58:41.346 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:41.341+0000 7f1ecdc28640 1 --2- 172.21.15.49:0/1922764302 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1eb406a840 0x7f1eb406cd00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:41.346 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:41.341+0000 7f1ecdc28640 1 --2- 172.21.15.49:0/1922764302 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ec8157e60 0x7f1ec814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:41.346 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:41.341+0000 7f1ecdc28640 1 --2- 172.21.15.49:0/1922764302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ec8151600 0x7f1ec81598f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:41.346 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:41.341+0000 7f1ecdc28640 1 --2- 172.21.15.49:0/1922764302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ec8151220 0x7f1ec814cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:41.346 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:41.341+0000 7f1ecdc28640 1 -- 172.21.15.49:0/1922764302 >> 172.21.15.49:0/1922764302 conn(0x7f1ec8072510 msgr2=0x7f1ec81566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:41.346 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:41.341+0000 7f1ecdc28640 1 -- 172.21.15.49:0/1922764302 shutdown_connections 2023-11-18T20:58:41.346 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:41.341+0000 7f1ecdc28640 1 -- 172.21.15.49:0/1922764302 wait complete. 2023-11-18T20:58:41.364 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-11-18T20:58:48.171 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-18T20:58:48.284 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.281+0000 7f3088de8640 1 Processor -- start 2023-11-18T20:58:48.284 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.281+0000 7f3088de8640 1 -- start start 2023-11-18T20:58:48.285 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.281+0000 7f3088de8640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30840c4e10 0x7f30840666c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:48.285 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.281+0000 7f3088de8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f30840c51f0 0x7f30840c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:48.285 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.281+0000 7f3088de8640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30840c5ea0 con 0x7f30841572b0 2023-11-18T20:58:48.285 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.281+0000 7f3088de8640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3084071530 con 0x7f30840c51f0 2023-11-18T20:58:48.285 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.281+0000 7f3088de8640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30841578d0 con 0x7f30840c4e10 2023-11-18T20:58:48.287 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.281+0000 7f3081d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f30840c51f0 0x7f30840c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:48.287 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.281+0000 7f3082d9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f30841572b0 0x7f3084071ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47566/0 (socket says 172.21.15.49:47566) 2023-11-18T20:58:48.287 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.281+0000 7f3082d9d640 1 -- 172.21.15.49:0/978997092 learned_addr learned my addr 172.21.15.49:0/978997092 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:58:48.287 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.281+0000 7f308259c640 1 --2- 172.21.15.49:0/978997092 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30840c4e10 0x7f30840666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:48.291 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.285+0000 7f3081d9b640 1 -- 172.21.15.49:0/978997092 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30840c4e10 msgr2=0x7f30840666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:48.291 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.285+0000 7f3081d9b640 1 --2- 172.21.15.49:0/978997092 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30840c4e10 0x7f30840666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:48.291 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.285+0000 7f3081d9b640 1 -- 172.21.15.49:0/978997092 >> v1:172.21.15.49:6789/0 conn(0x7f30841572b0 legacy=0x7f3084071ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:48.291 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.285+0000 7f3081d9b640 1 -- 172.21.15.49:0/978997092 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3084157b70 con 0x7f30840c51f0 2023-11-18T20:58:48.296 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:48.289+0000 7f3081d9b640 1 --2- 172.21.15.49:0/978997092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30840c51f0 0x7f30840c86b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f30780097c0 tx=0x7f307801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566d46f4e6e74112 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:52.572 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.565+0000 7f308159a640 1 -- 172.21.15.49:0/978997092 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780ab600 con 0x7f30840c51f0 2023-11-18T20:58:52.572 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.565+0000 7f308159a640 1 -- 172.21.15.49:0/978997092 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30780a7050 con 0x7f30840c51f0 2023-11-18T20:58:52.572 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.565+0000 7f308159a640 1 -- 172.21.15.49:0/978997092 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780aba00 con 0x7f30840c51f0 2023-11-18T20:58:52.573 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.569+0000 7f3088de8640 1 -- 172.21.15.49:0/978997092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30840c51f0 msgr2=0x7f30840c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:52.573 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.569+0000 7f3088de8640 1 --2- 172.21.15.49:0/978997092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30840c51f0 0x7f30840c86b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f30780097c0 tx=0x7f307801c480 comp rx=0 tx=0).stop 2023-11-18T20:58:52.573 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.569+0000 7f3088de8640 1 -- 172.21.15.49:0/978997092 shutdown_connections 2023-11-18T20:58:52.573 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.569+0000 7f3088de8640 1 --2- 172.21.15.49:0/978997092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30840c51f0 0x7f30840c86b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:52.573 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.569+0000 7f3088de8640 1 --2- 172.21.15.49:0/978997092 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30840c4e10 0x7f30840666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:52.573 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.569+0000 7f3088de8640 1 -- 172.21.15.49:0/978997092 >> 172.21.15.49:0/978997092 conn(0x7f30840cbaa0 msgr2=0x7f30840c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:52.574 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.569+0000 7f3088de8640 1 -- 172.21.15.49:0/978997092 shutdown_connections 2023-11-18T20:58:52.574 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.569+0000 7f3088de8640 1 -- 172.21.15.49:0/978997092 wait complete. 2023-11-18T20:58:52.575 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.569+0000 7f3088de8640 1 Processor -- start 2023-11-18T20:58:52.575 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.569+0000 7f3088de8640 1 -- start start 2023-11-18T20:58:52.576 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.573+0000 7f3088de8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30840c4e10 0x7f3084137a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:52.576 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.573+0000 7f3088de8640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30840c51f0 0x7f30841f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:52.576 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.573+0000 7f3088de8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30841572b0 0x7f3084134bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:52.577 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.573+0000 7f3088de8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3084153b40 con 0x7f30841572b0 2023-11-18T20:58:52.577 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.573+0000 7f3088de8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3084152e30 con 0x7f30840c4e10 2023-11-18T20:58:52.577 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.573+0000 7f3088de8640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3084151fd0 con 0x7f30840c51f0 2023-11-18T20:58:52.577 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.573+0000 7f3081d9b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30840c51f0 0x7f30841f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:52.578 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.573+0000 7f308259c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30840c4e10 0x7f3084137a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:52.579 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.573+0000 7f3081d9b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30840c51f0 0x7f30841f0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:40128/0 (socket says 172.21.15.49:40128) 2023-11-18T20:58:52.579 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.573+0000 7f3081d9b640 1 -- 172.21.15.49:0/1325963666 learned_addr learned my addr 172.21.15.49:0/1325963666 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:58:52.588 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.585+0000 7f3081d9b640 1 -- 172.21.15.49:0/1325963666 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30840c4e10 msgr2=0x7f3084137a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:52.588 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.585+0000 7f3081d9b640 1 --2- 172.21.15.49:0/1325963666 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30840c4e10 0x7f3084137a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:52.588 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.585+0000 7f3081d9b640 1 -- 172.21.15.49:0/1325963666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30841572b0 msgr2=0x7f3084134bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:52.588 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.585+0000 7f3081d9b640 1 --2- 172.21.15.49:0/1325963666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30841572b0 0x7f3084134bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:52.588 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.585+0000 7f3081d9b640 1 -- 172.21.15.49:0/1325963666 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3078009420 con 0x7f30840c51f0 2023-11-18T20:58:52.596 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.593+0000 7f3081d9b640 1 --2- 172.21.15.49:0/1325963666 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30840c51f0 0x7f30841f0940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f307801ab30 tx=0x7f3078019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:52.612 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.605+0000 7f3072ffd640 1 -- 172.21.15.49:0/1325963666 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780ba070 con 0x7f30840c51f0 2023-11-18T20:58:52.612 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.609+0000 7f3072ffd640 1 -- 172.21.15.49:0/1325963666 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3078003970 con 0x7f30840c51f0 2023-11-18T20:58:52.612 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.609+0000 7f3072ffd640 1 -- 172.21.15.49:0/1325963666 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078003ce0 con 0x7f30840c51f0 2023-11-18T20:58:52.612 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.609+0000 7f3088de8640 1 -- 172.21.15.49:0/1325963666 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3084152220 con 0x7f30840c51f0 2023-11-18T20:58:52.612 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.609+0000 7f3088de8640 1 -- 172.21.15.49:0/1325963666 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30841527e0 con 0x7f30840c51f0 2023-11-18T20:58:52.613 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.609+0000 7f3088de8640 1 -- 172.21.15.49:0/1325963666 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3084152fe0 con 0x7f30840c51f0 2023-11-18T20:58:52.941 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.937+0000 7f3072ffd640 1 -- 172.21.15.49:0/1325963666 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f30780bf410 con 0x7f30840c51f0 2023-11-18T20:58:52.941 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.937+0000 7f3072ffd640 1 --2- 172.21.15.49:0/1325963666 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3064066430 0x7f30640688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:52.942 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.937+0000 7f308259c640 1 --2- 172.21.15.49:0/1325963666 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3064066430 0x7f30640688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:52.943 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.937+0000 7f308259c640 1 --2- 172.21.15.49:0/1325963666 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3064066430 0x7f30640688f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3074009b60 tx=0x7f3074009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:58:52.947 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.941+0000 7f3072ffd640 1 -- 172.21.15.49:0/1325963666 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3078003e40 con 0x7f30840c51f0 2023-11-18T20:58:52.971 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:52.965+0000 7f3072ffd640 1 -- 172.21.15.49:0/1325963666 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30780ebca0 con 0x7f30840c51f0 2023-11-18T20:58:53.221 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:53.217+0000 7f3088de8640 1 -- 172.21.15.49:0/1325963666 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3084073e70 con 0x7f30840c51f0 2023-11-18T20:58:55.276 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:58:55.279 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:58:59.469 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:59.469+0000 7f3072ffd640 1 -- 172.21.15.49:0/1325963666 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12814 (secure 0 0 0) 0x7f30780b0070 con 0x7f30840c51f0 2023-11-18T20:58:59.469 INFO:teuthology.misc.health.smithi049.stdout: 2023-11-18T20:58:59.469 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":18,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:58:45.750504+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:58:59.473 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:59.469+0000 7f3088de8640 1 -- 172.21.15.49:0/1325963666 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3064066430 msgr2=0x7f30640688f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:59.473 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:59.469+0000 7f3088de8640 1 --2- 172.21.15.49:0/1325963666 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3064066430 0x7f30640688f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3074009b60 tx=0x7f3074009190 comp rx=0 tx=0).stop 2023-11-18T20:58:59.474 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:59.469+0000 7f3088de8640 1 -- 172.21.15.49:0/1325963666 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30840c51f0 msgr2=0x7f30841f0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:59.474 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:59.469+0000 7f3088de8640 1 --2- 172.21.15.49:0/1325963666 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30840c51f0 0x7f30841f0940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f307801ab30 tx=0x7f3078019220 comp rx=0 tx=0).stop 2023-11-18T20:58:59.474 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:59.469+0000 7f3088de8640 1 -- 172.21.15.49:0/1325963666 shutdown_connections 2023-11-18T20:58:59.474 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:59.469+0000 7f3088de8640 1 --2- 172.21.15.49:0/1325963666 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3064066430 0x7f30640688f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:59.474 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:59.469+0000 7f3088de8640 1 --2- 172.21.15.49:0/1325963666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30841572b0 0x7f3084134bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:59.474 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:59.469+0000 7f3088de8640 1 --2- 172.21.15.49:0/1325963666 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30840c51f0 0x7f30841f0940 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:59.474 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:59.469+0000 7f3088de8640 1 --2- 172.21.15.49:0/1325963666 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30840c4e10 0x7f3084137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:58:59.475 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:59.469+0000 7f3088de8640 1 -- 172.21.15.49:0/1325963666 >> 172.21.15.49:0/1325963666 conn(0x7f30840cbaa0 msgr2=0x7f3084156b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:58:59.475 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:59.469+0000 7f3088de8640 1 -- 172.21.15.49:0/1325963666 shutdown_connections 2023-11-18T20:58:59.475 INFO:teuthology.misc.health.smithi049.stderr:2023-11-18T20:58:59.469+0000 7f3088de8640 1 -- 172.21.15.49:0/1325963666 wait complete. 2023-11-18T20:58:59.493 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-18T20:58:59.494 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-18T20:58:59.494 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-11-18T20:58:59.494 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-18T20:58:59.495 DEBUG:teuthology.orchestra.run.smithi049:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a 2023-11-18T20:58:59.497 INFO:tasks.ceph.mds.a:Started 2023-11-18T20:58:59.497 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-11-18T20:58:59.498 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-18T20:58:59.498 DEBUG:teuthology.orchestra.run.smithi049:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c 2023-11-18T20:58:59.501 INFO:tasks.ceph.mds.c:Started 2023-11-18T20:58:59.501 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-11-18T20:58:59.501 INFO:tasks.ceph.mds.e:Restarting daemon 2023-11-18T20:58:59.501 DEBUG:teuthology.orchestra.run.smithi049:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e 2023-11-18T20:58:59.504 INFO:tasks.ceph.mds.e:Started 2023-11-18T20:58:59.504 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-11-18T20:58:59.504 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-18T20:58:59.505 DEBUG:teuthology.orchestra.run.smithi106:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b 2023-11-18T20:58:59.507 INFO:tasks.ceph.mds.b:Started 2023-11-18T20:58:59.507 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-11-18T20:58:59.507 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-18T20:58:59.507 DEBUG:teuthology.orchestra.run.smithi106:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d 2023-11-18T20:58:59.509 INFO:tasks.ceph.mds.d:Started 2023-11-18T20:58:59.510 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-11-18T20:58:59.510 INFO:tasks.ceph.mds.f:Restarting daemon 2023-11-18T20:58:59.511 DEBUG:teuthology.orchestra.run.smithi106:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f 2023-11-18T20:58:59.513 INFO:tasks.ceph.mds.f:Started 2023-11-18T20:58:59.513 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-18T20:58:59.513 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:58:59.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:59.637+0000 7f13d57e1640 1 Processor -- start 2023-11-18T20:58:59.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:59.637+0000 7f13d57e1640 1 -- start start 2023-11-18T20:58:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:59.637+0000 7f13d57e1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f13d00c5180 0x7f13d0156f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:58:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:59.637+0000 7f13d57e1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d00c6820 con 0x7f13d00c7440 2023-11-18T20:58:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:59.637+0000 7f13d57e1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d0156af0 con 0x7f13d00c5560 2023-11-18T20:58:59.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:59.637+0000 7f13d57e1640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d00c4370 con 0x7f13d00c5180 2023-11-18T20:58:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:59.641+0000 7f13ceffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f13d00c5180 0x7f13d0156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:58:59.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:59.641+0000 7f13ce7fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f13d00c5560 0x7f13d006b800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:36464/0 (socket says 172.21.15.49:36464) 2023-11-18T20:58:59.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:59.641+0000 7f13ce7fc640 1 -- 172.21.15.49:0/2330589390 learned_addr learned my addr 172.21.15.49:0/2330589390 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:58:59.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:59.649+0000 7f13ceffd640 1 -- 172.21.15.49:0/2330589390 >> v1:172.21.15.106:6789/0 conn(0x7f13d00c5560 legacy=0x7f13d006b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:58:59.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:59.649+0000 7f13ceffd640 1 -- 172.21.15.49:0/2330589390 >> v1:172.21.15.49:6789/0 conn(0x7f13d00c7440 legacy=0x7f13d014ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:58:59.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:59.649+0000 7f13ceffd640 1 -- 172.21.15.49:0/2330589390 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d00c6260 con 0x7f13d00c5180 2023-11-18T20:58:59.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:58:59.657+0000 7f13ceffd640 1 --2- 172.21.15.49:0/2330589390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13d00c5180 0x7f13d0156f80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f13c00097f0 tx=0x7f13c001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3e39154132957b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:04.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.265+0000 7f13cdffb640 1 -- 172.21.15.49:0/2330589390 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c00ab600 con 0x7f13d00c5180 2023-11-18T20:59:04.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.265+0000 7f13cdffb640 1 -- 172.21.15.49:0/2330589390 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c00a7050 con 0x7f13d00c5180 2023-11-18T20:59:04.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.265+0000 7f13cdffb640 1 -- 172.21.15.49:0/2330589390 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c00aba00 con 0x7f13d00c5180 2023-11-18T20:59:04.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.265+0000 7f13d57e1640 1 -- 172.21.15.49:0/2330589390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13d00c5180 msgr2=0x7f13d0156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:04.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.265+0000 7f13d57e1640 1 --2- 172.21.15.49:0/2330589390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13d00c5180 0x7f13d0156f80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f13c00097f0 tx=0x7f13c001c410 comp rx=0 tx=0).stop 2023-11-18T20:59:04.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.265+0000 7f13d57e1640 1 -- 172.21.15.49:0/2330589390 shutdown_connections 2023-11-18T20:59:04.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.265+0000 7f13d57e1640 1 --2- 172.21.15.49:0/2330589390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13d00c5180 0x7f13d0156f80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:04.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.265+0000 7f13d57e1640 1 -- 172.21.15.49:0/2330589390 >> 172.21.15.49:0/2330589390 conn(0x7f13d006d220 msgr2=0x7f13d006d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:04.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.265+0000 7f13d57e1640 1 -- 172.21.15.49:0/2330589390 shutdown_connections 2023-11-18T20:59:04.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.265+0000 7f13d57e1640 1 -- 172.21.15.49:0/2330589390 wait complete. 2023-11-18T20:59:04.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.269+0000 7f13d57e1640 1 Processor -- start 2023-11-18T20:59:04.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.269+0000 7f13d57e1640 1 -- start start 2023-11-18T20:59:04.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.269+0000 7f13d57e1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00c5180 0x7f13d0144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:04.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.269+0000 7f13d57e1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13d00c5560 0x7f13d01522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:04.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.269+0000 7f13d57e1640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13d00c7440 0x7f13d0152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:04.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.269+0000 7f13d57e1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0151e30 con 0x7f13d00c5180 2023-11-18T20:59:04.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.269+0000 7f13d57e1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0151b30 con 0x7f13d00c5560 2023-11-18T20:59:04.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.269+0000 7f13d57e1640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d01f4210 con 0x7f13d00c7440 2023-11-18T20:59:04.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.269+0000 7f13cf7fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13d00c7440 0x7f13d0152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:04.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.269+0000 7f13cf7fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13d00c7440 0x7f13d0152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:56620/0 (socket says 172.21.15.49:56620) 2023-11-18T20:59:04.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.269+0000 7f13cf7fe640 1 -- 172.21.15.49:0/3274354803 learned_addr learned my addr 172.21.15.49:0/3274354803 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:04.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.277+0000 7f13cf7fe640 1 -- 172.21.15.49:0/3274354803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13d00c5560 msgr2=0x7f13d01522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:04.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.277+0000 7f13cf7fe640 1 --2- 172.21.15.49:0/3274354803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13d00c5560 0x7f13d01522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:04.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.277+0000 7f13cf7fe640 1 -- 172.21.15.49:0/3274354803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00c5180 msgr2=0x7f13d0144be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:04.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.277+0000 7f13cf7fe640 1 --2- 172.21.15.49:0/3274354803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00c5180 0x7f13d0144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:04.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.277+0000 7f13cf7fe640 1 -- 172.21.15.49:0/3274354803 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c0009420 con 0x7f13d00c7440 2023-11-18T20:59:04.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.277+0000 7f13cf7fe640 1 --2- 172.21.15.49:0/3274354803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13d00c7440 0x7f13d0152800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f13c800b9c0 tx=0x7f13c800be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:04.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.285+0000 7f13b77fe640 1 -- 172.21.15.49:0/3274354803 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800cba0 con 0x7f13d00c7440 2023-11-18T20:59:04.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.285+0000 7f13b77fe640 1 -- 172.21.15.49:0/3274354803 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c800cd00 con 0x7f13d00c7440 2023-11-18T20:59:04.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.285+0000 7f13b77fe640 1 -- 172.21.15.49:0/3274354803 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8014680 con 0x7f13d00c7440 2023-11-18T20:59:04.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.285+0000 7f13d57e1640 1 -- 172.21.15.49:0/3274354803 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d01f44f0 con 0x7f13d00c7440 2023-11-18T20:59:04.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.285+0000 7f13d57e1640 1 -- 172.21.15.49:0/3274354803 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d01f4ab0 con 0x7f13d00c7440 2023-11-18T20:59:04.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.289+0000 7f13d57e1640 1 -- 172.21.15.49:0/3274354803 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d01f4c40 con 0x7f13d00c7440 2023-11-18T20:59:04.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.321+0000 7f13b77fe640 1 -- 172.21.15.49:0/3274354803 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f13c8003980 con 0x7f13d00c7440 2023-11-18T20:59:04.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.321+0000 7f13b77fe640 1 --2- 172.21.15.49:0/3274354803 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f13bc066460 0x7f13bc068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:04.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.321+0000 7f13ceffd640 1 --2- 172.21.15.49:0/3274354803 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f13bc066460 0x7f13bc068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.321+0000 7f13ceffd640 1 --2- 172.21.15.49:0/3274354803 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f13bc066460 0x7f13bc068920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f13c00ad000 tx=0x7f13c0004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:04.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.341+0000 7f13b77fe640 1 -- 172.21.15.49:0/3274354803 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f13c8055320 con 0x7f13d00c7440 2023-11-18T20:59:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:04.757+0000 7f13b77fe640 1 -- 172.21.15.49:0/3274354803 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f13c8050f60 con 0x7f13d00c7440 2023-11-18T20:59:05.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:05.081+0000 7f13d57e1640 1 -- 172.21.15.49:0/3274354803 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13d0151c70 con 0x7f13d00c7440 2023-11-18T20:59:07.182 INFO:tasks.ceph.mds.e.smithi049.stdout:starting mds.e at 2023-11-18T20:59:07.273 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2023-11-18T20:59:07.312 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2023-11-18T20:59:09.300 INFO:tasks.ceph.mds.f.smithi106.stdout:starting mds.f at 2023-11-18T20:59:09.344 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2023-11-18T20:59:11.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.193+0000 7f13b77fe640 1 -- 172.21.15.49:0/3274354803 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13c8051330 con 0x7f13d00c7440 2023-11-18T20:59:11.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.197+0000 7f13b77fe640 1 -- 172.21.15.49:0/3274354803 <== mon.2 v2:172.21.15.106:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12814 (secure 0 0 0) 0x7f13c80781f0 con 0x7f13d00c7440 2023-11-18T20:59:11.200 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:59:11.200 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":18,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:58:45.750504+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:59:11.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.201+0000 7f13d57e1640 1 -- 172.21.15.49:0/3274354803 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f13bc066460 msgr2=0x7f13bc068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:11.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.201+0000 7f13d57e1640 1 --2- 172.21.15.49:0/3274354803 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f13bc066460 0x7f13bc068920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f13c00ad000 tx=0x7f13c0004740 comp rx=0 tx=0).stop 2023-11-18T20:59:11.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.201+0000 7f13d57e1640 1 -- 172.21.15.49:0/3274354803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13d00c7440 msgr2=0x7f13d0152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:11.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.201+0000 7f13d57e1640 1 --2- 172.21.15.49:0/3274354803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13d00c7440 0x7f13d0152800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f13c800b9c0 tx=0x7f13c800be80 comp rx=0 tx=0).stop 2023-11-18T20:59:11.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.201+0000 7f13d57e1640 1 -- 172.21.15.49:0/3274354803 shutdown_connections 2023-11-18T20:59:11.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.201+0000 7f13d57e1640 1 --2- 172.21.15.49:0/3274354803 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f13bc066460 0x7f13bc068920 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:11.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.201+0000 7f13d57e1640 1 --2- 172.21.15.49:0/3274354803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13d00c7440 0x7f13d0152800 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:11.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.201+0000 7f13d57e1640 1 --2- 172.21.15.49:0/3274354803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13d00c5560 0x7f13d01522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:11.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.201+0000 7f13d57e1640 1 --2- 172.21.15.49:0/3274354803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d00c5180 0x7f13d0144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:11.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.201+0000 7f13d57e1640 1 -- 172.21.15.49:0/3274354803 >> 172.21.15.49:0/3274354803 conn(0x7f13d006d220 msgr2=0x7f13d006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:11.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.201+0000 7f13d57e1640 1 -- 172.21.15.49:0/3274354803 shutdown_connections 2023-11-18T20:59:11.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.201+0000 7f13d57e1640 1 -- 172.21.15.49:0/3274354803 wait complete. 2023-11-18T20:59:11.227 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:58:42.362631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:59:11.227 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:59:11.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.357+0000 7f002fc07640 1 Processor -- start 2023-11-18T20:59:11.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.357+0000 7f002fc07640 1 -- start start 2023-11-18T20:59:11.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.357+0000 7f002fc07640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f00281513c0 0x7f00280cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:11.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.357+0000 7f002fc07640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f002806ad60 0x7f00281571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:11.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.357+0000 7f002fc07640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0028072400 con 0x7f0028072890 2023-11-18T20:59:11.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.357+0000 7f002fc07640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0028157cc0 con 0x7f002806ad60 2023-11-18T20:59:11.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.357+0000 7f002fc07640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0028157fa0 con 0x7f00281513c0 2023-11-18T20:59:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.357+0000 7f002d9a3640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f00281513c0 0x7f00280cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:11.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.361+0000 7f002d9a3640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f00281513c0 0x7f00280cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:55366/0 (socket says 172.21.15.49:55366) 2023-11-18T20:59:11.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.361+0000 7f002d9a3640 1 -- 172.21.15.49:0/2999410363 learned_addr learned my addr 172.21.15.49:0/2999410363 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.365+0000 7f002d9a3640 1 -- 172.21.15.49:0/2999410363 >> v2:172.21.15.49:3300/0 conn(0x7f002806ad60 msgr2=0x7f00281571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.365+0000 7f002d9a3640 1 --2- 172.21.15.49:0/2999410363 >> v2:172.21.15.49:3300/0 conn(0x7f002806ad60 0x7f00281571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.365+0000 7f002d9a3640 1 -- 172.21.15.49:0/2999410363 >> v1:172.21.15.49:6789/0 conn(0x7f0028072890 legacy=0x7f00280c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.365+0000 7f002d9a3640 1 -- 172.21.15.49:0/2999410363 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0028071db0 con 0x7f00281513c0 2023-11-18T20:59:11.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.373+0000 7f002d9a3640 1 --2- 172.21.15.49:0/2999410363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00281513c0 0x7f00280cb8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f002806b640 tx=0x7f002401ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=671ecbfc114a9cdd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:11.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.377+0000 7f002c9a1640 1 -- 172.21.15.49:0/2999410363 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00240a89b0 con 0x7f00281513c0 2023-11-18T20:59:11.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.377+0000 7f002c9a1640 1 -- 172.21.15.49:0/2999410363 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00240a8b10 con 0x7f00281513c0 2023-11-18T20:59:11.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.377+0000 7f002c9a1640 1 -- 172.21.15.49:0/2999410363 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00240a8ea0 con 0x7f00281513c0 2023-11-18T20:59:11.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.377+0000 7f002fc07640 1 -- 172.21.15.49:0/2999410363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00281513c0 msgr2=0x7f00280cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:11.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.377+0000 7f002fc07640 1 --2- 172.21.15.49:0/2999410363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00281513c0 0x7f00280cb8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f002806b640 tx=0x7f002401ecb0 comp rx=0 tx=0).stop 2023-11-18T20:59:11.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.377+0000 7f002fc07640 1 -- 172.21.15.49:0/2999410363 shutdown_connections 2023-11-18T20:59:11.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.377+0000 7f002fc07640 1 --2- 172.21.15.49:0/2999410363 >> v2:172.21.15.49:3300/0 conn(0x7f002806ad60 0x7f00281571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:11.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.377+0000 7f002fc07640 1 --2- 172.21.15.49:0/2999410363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00281513c0 0x7f00280cb8f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:11.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.377+0000 7f002fc07640 1 -- 172.21.15.49:0/2999410363 >> 172.21.15.49:0/2999410363 conn(0x7f002806b670 msgr2=0x7f002806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:11.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.377+0000 7f002fc07640 1 -- 172.21.15.49:0/2999410363 shutdown_connections 2023-11-18T20:59:11.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.377+0000 7f002fc07640 1 -- 172.21.15.49:0/2999410363 wait complete. 2023-11-18T20:59:11.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.381+0000 7f002fc07640 1 Processor -- start 2023-11-18T20:59:11.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.381+0000 7f002fc07640 1 -- start start 2023-11-18T20:59:11.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.381+0000 7f002fc07640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f002806ad60 0x7f0028154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:11.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.381+0000 7f002fc07640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0028072890 0x7f00280ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:11.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.381+0000 7f002fc07640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00281513c0 0x7f002814c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:11.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.381+0000 7f002fc07640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0028154230 con 0x7f0028072890 2023-11-18T20:59:11.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.381+0000 7f002fc07640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0028152e50 con 0x7f00281513c0 2023-11-18T20:59:11.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.381+0000 7f002fc07640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0028154b90 con 0x7f002806ad60 2023-11-18T20:59:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.385+0000 7f002e1a4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00281513c0 0x7f002814c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:11.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.385+0000 7f002d9a3640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f002806ad60 0x7f0028154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.385+0000 7f002e1a4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00281513c0 0x7f002814c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:55380/0 (socket says 172.21.15.49:55380) 2023-11-18T20:59:11.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.385+0000 7f002e1a4640 1 -- 172.21.15.49:0/3141598084 learned_addr learned my addr 172.21.15.49:0/3141598084 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.397+0000 7f002e1a4640 1 -- 172.21.15.49:0/3141598084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f002806ad60 msgr2=0x7f0028154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.397+0000 7f002e1a4640 1 --2- 172.21.15.49:0/3141598084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f002806ad60 0x7f0028154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.397+0000 7f002e1a4640 1 -- 172.21.15.49:0/3141598084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0028072890 msgr2=0x7f00280ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.397+0000 7f002e1a4640 1 --2- 172.21.15.49:0/3141598084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0028072890 0x7f00280ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:11.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.397+0000 7f002e1a4640 1 -- 172.21.15.49:0/3141598084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00240094d0 con 0x7f00281513c0 2023-11-18T20:59:11.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.401+0000 7f002e1a4640 1 --2- 172.21.15.49:0/3141598084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00281513c0 0x7f002814c330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f002000c7b0 tx=0x7f002000cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:11.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.409+0000 7f001e7fc640 1 -- 172.21.15.49:0/3141598084 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020003d90 con 0x7f00281513c0 2023-11-18T20:59:11.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.409+0000 7f001e7fc640 1 -- 172.21.15.49:0/3141598084 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002000ce60 con 0x7f00281513c0 2023-11-18T20:59:11.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.409+0000 7f002fc07640 1 -- 172.21.15.49:0/3141598084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00281e1c20 con 0x7f00281513c0 2023-11-18T20:59:11.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.409+0000 7f001e7fc640 1 -- 172.21.15.49:0/3141598084 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00200052b0 con 0x7f00281513c0 2023-11-18T20:59:11.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.409+0000 7f002fc07640 1 -- 172.21.15.49:0/3141598084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0028156a30 con 0x7f00281513c0 2023-11-18T20:59:11.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.413+0000 7f002fc07640 1 -- 172.21.15.49:0/3141598084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0028154370 con 0x7f00281513c0 2023-11-18T20:59:11.544 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2023-11-18T20:59:11.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.693+0000 7f001e7fc640 1 -- 172.21.15.49:0/3141598084 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0020005410 con 0x7f00281513c0 2023-11-18T20:59:11.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.693+0000 7f001e7fc640 1 --2- 172.21.15.49:0/3141598084 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f000c0664c0 0x7f000c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:11.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.693+0000 7f002d9a3640 1 --2- 172.21.15.49:0/3141598084 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f000c0664c0 0x7f000c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:11.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.697+0000 7f002d9a3640 1 --2- 172.21.15.49:0/3141598084 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f000c0664c0 0x7f000c068980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f00240b2000 tx=0x7f00240aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:11.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.701+0000 7f001e7fc640 1 -- 172.21.15.49:0/3141598084 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0020054b70 con 0x7f00281513c0 2023-11-18T20:59:11.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.729+0000 7f001e7fc640 1 -- 172.21.15.49:0/3141598084 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0020050eb0 con 0x7f00281513c0 2023-11-18T20:59:11.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:11.933+0000 7f002fc07640 1 -- 172.21.15.49:0/3141598084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0028154370 con 0x7f00281513c0 2023-11-18T20:59:15.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:15.980+0000 7f001e7fc640 1 -- 172.21.15.49:0/3141598084 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0028154370 con 0x7f00281513c0 2023-11-18T20:59:15.982 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-18T20:59:15.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:15.984+0000 7f002fc07640 1 -- 172.21.15.49:0/3141598084 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f000c0664c0 msgr2=0x7f000c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:15.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:15.984+0000 7f002fc07640 1 --2- 172.21.15.49:0/3141598084 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f000c0664c0 0x7f000c068980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f00240b2000 tx=0x7f00240aa070 comp rx=0 tx=0).stop 2023-11-18T20:59:15.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:15.984+0000 7f002fc07640 1 -- 172.21.15.49:0/3141598084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00281513c0 msgr2=0x7f002814c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:15.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:15.984+0000 7f002fc07640 1 --2- 172.21.15.49:0/3141598084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00281513c0 0x7f002814c330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f002000c7b0 tx=0x7f002000cc70 comp rx=0 tx=0).stop 2023-11-18T20:59:15.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:15.984+0000 7f002fc07640 1 -- 172.21.15.49:0/3141598084 shutdown_connections 2023-11-18T20:59:15.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:15.984+0000 7f002fc07640 1 --2- 172.21.15.49:0/3141598084 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f000c0664c0 0x7f000c068980 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:15.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:15.984+0000 7f002fc07640 1 --2- 172.21.15.49:0/3141598084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00281513c0 0x7f002814c330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:15.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:15.984+0000 7f002fc07640 1 --2- 172.21.15.49:0/3141598084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0028072890 0x7f00280ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:15.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:15.984+0000 7f002fc07640 1 --2- 172.21.15.49:0/3141598084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f002806ad60 0x7f0028154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:15.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:15.984+0000 7f002fc07640 1 -- 172.21.15.49:0/3141598084 >> 172.21.15.49:0/3141598084 conn(0x7f002806b670 msgr2=0x7f00280c1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:15.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:15.984+0000 7f002fc07640 1 -- 172.21.15.49:0/3141598084 shutdown_connections 2023-11-18T20:59:15.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:15.984+0000 7f002fc07640 1 -- 172.21.15.49:0/3141598084 wait complete. 2023-11-18T20:59:16.010 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:59:16.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.128+0000 7f6e608e3640 1 Processor -- start 2023-11-18T20:59:16.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.128+0000 7f6e608e3640 1 -- start start 2023-11-18T20:59:16.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.132+0000 7f6e608e3640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6e5c0ce0c0 0x7f6e5c0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:16.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.132+0000 7f6e608e3640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e5c15a280 0x7f6e5c163e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:16.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.132+0000 7f6e608e3640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c0cd9a0 con 0x7f6e5c0cc3c0 2023-11-18T20:59:16.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.132+0000 7f6e608e3640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5c0ca550 con 0x7f6e5c0ce0c0 2023-11-18T20:59:16.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.132+0000 7f6e608e3640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0ce9e0 con 0x7f6e5c15a280 2023-11-18T20:59:16.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.164+0000 7f6e5ad9d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e5c15a280 0x7f6e5c163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:16.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.164+0000 7f6e5ad9d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e5c15a280 0x7f6e5c163e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:40926/0 (socket says 172.21.15.49:40926) 2023-11-18T20:59:16.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.164+0000 7f6e5ad9d640 1 -- 172.21.15.49:0/2080265086 learned_addr learned my addr 172.21.15.49:0/2080265086 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:16.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.172+0000 7f6e5ad9d640 1 -- 172.21.15.49:0/2080265086 >> v2:172.21.15.49:3300/0 conn(0x7f6e5c0ce0c0 msgr2=0x7f6e5c0ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:16.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.172+0000 7f6e5ad9d640 1 --2- 172.21.15.49:0/2080265086 >> v2:172.21.15.49:3300/0 conn(0x7f6e5c0ce0c0 0x7f6e5c0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:16.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.172+0000 7f6e5ad9d640 1 -- 172.21.15.49:0/2080265086 >> v1:172.21.15.49:6789/0 conn(0x7f6e5c0cc3c0 legacy=0x7f6e5c159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:16.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.172+0000 7f6e5ad9d640 1 -- 172.21.15.49:0/2080265086 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c1596c0 con 0x7f6e5c15a280 2023-11-18T20:59:16.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.176+0000 7f6e5ad9d640 1 --2- 172.21.15.49:0/2080265086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e5c15a280 0x7f6e5c163e50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009e50 tx=0x7f6e5401c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f89bfd862fd6ed87 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:16.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.180+0000 7f6e5959a640 1 -- 172.21.15.49:0/2080265086 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e540a5850 con 0x7f6e5c15a280 2023-11-18T20:59:16.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.180+0000 7f6e5959a640 1 -- 172.21.15.49:0/2080265086 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e540a59b0 con 0x7f6e5c15a280 2023-11-18T20:59:16.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.180+0000 7f6e5959a640 1 -- 172.21.15.49:0/2080265086 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e540a5d40 con 0x7f6e5c15a280 2023-11-18T20:59:16.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.180+0000 7f6e608e3640 1 -- 172.21.15.49:0/2080265086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e5c15a280 msgr2=0x7f6e5c163e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:16.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.180+0000 7f6e608e3640 1 --2- 172.21.15.49:0/2080265086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e5c15a280 0x7f6e5c163e50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009e50 tx=0x7f6e5401c9d0 comp rx=0 tx=0).stop 2023-11-18T20:59:16.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e608e3640 1 -- 172.21.15.49:0/2080265086 shutdown_connections 2023-11-18T20:59:16.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e608e3640 1 --2- 172.21.15.49:0/2080265086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e5c15a280 0x7f6e5c163e50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:16.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e608e3640 1 --2- 172.21.15.49:0/2080265086 >> v2:172.21.15.49:3300/0 conn(0x7f6e5c0ce0c0 0x7f6e5c0ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:16.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e608e3640 1 -- 172.21.15.49:0/2080265086 >> 172.21.15.49:0/2080265086 conn(0x7f6e5c0b07c0 msgr2=0x7f6e5c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:16.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e608e3640 1 -- 172.21.15.49:0/2080265086 shutdown_connections 2023-11-18T20:59:16.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e608e3640 1 -- 172.21.15.49:0/2080265086 wait complete. 2023-11-18T20:59:16.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e608e3640 1 Processor -- start 2023-11-18T20:59:16.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e608e3640 1 -- start start 2023-11-18T20:59:16.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e608e3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e5c0cc3c0 0x7f6e5c0b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:16.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e608e3640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e5c0ce0c0 0x7f6e5c157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:16.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e608e3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e5c15a280 0x7f6e5c1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:16.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e608e3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c156c00 con 0x7f6e5c15a280 2023-11-18T20:59:16.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e608e3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c1f6dc0 con 0x7f6e5c0cc3c0 2023-11-18T20:59:16.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e608e3640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0b1870 con 0x7f6e5c0ce0c0 2023-11-18T20:59:16.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.184+0000 7f6e59d9b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e5c0ce0c0 0x7f6e5c157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:16.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.188+0000 7f6e59d9b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e5c0ce0c0 0x7f6e5c157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:40936/0 (socket says 172.21.15.49:40936) 2023-11-18T20:59:16.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.188+0000 7f6e59d9b640 1 -- 172.21.15.49:0/625545965 learned_addr learned my addr 172.21.15.49:0/625545965 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:16.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.192+0000 7f6e59d9b640 1 -- 172.21.15.49:0/625545965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e5c0cc3c0 msgr2=0x7f6e5c0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:16.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.192+0000 7f6e59d9b640 1 --2- 172.21.15.49:0/625545965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e5c0cc3c0 0x7f6e5c0b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:16.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.192+0000 7f6e59d9b640 1 -- 172.21.15.49:0/625545965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e5c15a280 msgr2=0x7f6e5c1586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:16.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.192+0000 7f6e59d9b640 1 --2- 172.21.15.49:0/625545965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e5c15a280 0x7f6e5c1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:16.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.192+0000 7f6e59d9b640 1 -- 172.21.15.49:0/625545965 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e54009b30 con 0x7f6e5c0ce0c0 2023-11-18T20:59:16.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.192+0000 7f6e59d9b640 1 --2- 172.21.15.49:0/625545965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e5c0ce0c0 0x7f6e5c157420 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c490 tx=0x7f6e50001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:16.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.200+0000 7f6e4affd640 1 -- 172.21.15.49:0/625545965 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50003600 con 0x7f6e5c0ce0c0 2023-11-18T20:59:16.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.200+0000 7f6e4affd640 1 -- 172.21.15.49:0/625545965 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e50003780 con 0x7f6e5c0ce0c0 2023-11-18T20:59:16.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.200+0000 7f6e608e3640 1 -- 172.21.15.49:0/625545965 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5c0b4850 con 0x7f6e5c0ce0c0 2023-11-18T20:59:16.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.200+0000 7f6e4affd640 1 -- 172.21.15.49:0/625545965 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50003b70 con 0x7f6e5c0ce0c0 2023-11-18T20:59:16.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.200+0000 7f6e608e3640 1 -- 172.21.15.49:0/625545965 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c154f90 con 0x7f6e5c0ce0c0 2023-11-18T20:59:16.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.204+0000 7f6e608e3640 1 -- 172.21.15.49:0/625545965 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5c067520 con 0x7f6e5c0ce0c0 2023-11-18T20:59:16.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.292+0000 7f6e4affd640 1 -- 172.21.15.49:0/625545965 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6e50003cd0 con 0x7f6e5c0ce0c0 2023-11-18T20:59:16.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.292+0000 7f6e4affd640 1 --2- 172.21.15.49:0/625545965 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6e3c0664f0 0x7f6e3c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:16.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.292+0000 7f6e5a59c640 1 --2- 172.21.15.49:0/625545965 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6e3c0664f0 0x7f6e3c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:16.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.292+0000 7f6e5a59c640 1 --2- 172.21.15.49:0/625545965 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6e3c0664f0 0x7f6e3c0689b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c009730 tx=0x7f6e4c006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:16.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.296+0000 7f6e4affd640 1 -- 172.21.15.49:0/625545965 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e50055130 con 0x7f6e5c0ce0c0 2023-11-18T20:59:16.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.552+0000 7f6e4affd640 1 -- 172.21.15.49:0/625545965 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e50050d70 con 0x7f6e5c0ce0c0 2023-11-18T20:59:16.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.744+0000 7f6e608e3640 1 -- 172.21.15.49:0/625545965 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e5c0c9070 con 0x7f6e5c0ce0c0 2023-11-18T20:59:16.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.792+0000 7f6e4affd640 1 -- 172.21.15.49:0/625545965 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2907 (secure 0 0 0) 0x7f6e50017030 con 0x7f6e5c0ce0c0 2023-11-18T20:59:16.796 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:59:16.796 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1013296856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1013296856},{"type":"v1","addr":"172.21.15.49:6833","nonce":1013296856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3397458527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3397458527},{"type":"v1","addr":"172.21.15.49:6835","nonce":3397458527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2795994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2795994685},{"type":"v1","addr":"172.21.15.106:6835","nonce":2795994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-18T20:59:16.796 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 3 2023-11-18T20:59:16.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.796+0000 7f6e608e3640 1 -- 172.21.15.49:0/625545965 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6e3c0664f0 msgr2=0x7f6e3c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:16.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.796+0000 7f6e608e3640 1 --2- 172.21.15.49:0/625545965 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6e3c0664f0 0x7f6e3c0689b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c009730 tx=0x7f6e4c006ca0 comp rx=0 tx=0).stop 2023-11-18T20:59:16.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.796+0000 7f6e608e3640 1 -- 172.21.15.49:0/625545965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e5c0ce0c0 msgr2=0x7f6e5c157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:16.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.796+0000 7f6e608e3640 1 --2- 172.21.15.49:0/625545965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e5c0ce0c0 0x7f6e5c157420 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c490 tx=0x7f6e50001e80 comp rx=0 tx=0).stop 2023-11-18T20:59:16.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.796+0000 7f6e608e3640 1 -- 172.21.15.49:0/625545965 shutdown_connections 2023-11-18T20:59:16.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.796+0000 7f6e608e3640 1 --2- 172.21.15.49:0/625545965 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6e3c0664f0 0x7f6e3c0689b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:16.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.796+0000 7f6e608e3640 1 --2- 172.21.15.49:0/625545965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e5c15a280 0x7f6e5c1586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:16.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.796+0000 7f6e608e3640 1 --2- 172.21.15.49:0/625545965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e5c0ce0c0 0x7f6e5c157420 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:16.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.796+0000 7f6e608e3640 1 --2- 172.21.15.49:0/625545965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e5c0cc3c0 0x7f6e5c0b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:16.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.796+0000 7f6e608e3640 1 -- 172.21.15.49:0/625545965 >> 172.21.15.49:0/625545965 conn(0x7f6e5c0b07c0 msgr2=0x7f6e5c152010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:16.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.796+0000 7f6e608e3640 1 -- 172.21.15.49:0/625545965 shutdown_connections 2023-11-18T20:59:16.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:16.796+0000 7f6e608e3640 1 -- 172.21.15.49:0/625545965 wait complete. 2023-11-18T20:59:18.817 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:59:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.948+0000 7f2d03dd6640 1 Processor -- start 2023-11-18T20:59:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.948+0000 7f2d03dd6640 1 -- start start 2023-11-18T20:59:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.948+0000 7f2d03dd6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2cfc0ce0c0 0x7f2cfc0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:18.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.948+0000 7f2d03dd6640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cfc0cc3c0 0x7f2cfc159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:18.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.948+0000 7f2d03dd6640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2cfc0cdb70 0x7f2cfc15a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:18.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.948+0000 7f2d03dd6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cfc0ca550 con 0x7f2cfc0ce0c0 2023-11-18T20:59:18.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.948+0000 7f2d03dd6640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cfc0ce9e0 con 0x7f2cfc0cdb70 2023-11-18T20:59:18.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.948+0000 7f2d03dd6640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc0cd9a0 con 0x7f2cfc0cc3c0 2023-11-18T20:59:18.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.948+0000 7f2d01b72640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2cfc0ce0c0 0x7f2cfc0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:18.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.948+0000 7f2d01b72640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2cfc0ce0c0 0x7f2cfc0ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52028/0 (socket says 172.21.15.49:52028) 2023-11-18T20:59:18.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.948+0000 7f2d01b72640 1 -- 172.21.15.49:0/3593923763 learned_addr learned my addr 172.21.15.49:0/3593923763 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:18.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.948+0000 7f2d01371640 1 --2- 172.21.15.49:0/3593923763 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cfc0cc3c0 0x7f2cfc159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:18.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.948+0000 7f2d02373640 1 --2- 172.21.15.49:0/3593923763 >> v2:172.21.15.106:3300/0 conn(0x7f2cfc0cdb70 0x7f2cfc15a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:18.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.952+0000 7f2d01b72640 1 -- 172.21.15.49:0/3593923763 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cfc0cc3c0 msgr2=0x7f2cfc159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:18.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.952+0000 7f2d01b72640 1 --2- 172.21.15.49:0/3593923763 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cfc0cc3c0 0x7f2cfc159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:18.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.952+0000 7f2d01b72640 1 -- 172.21.15.49:0/3593923763 >> v2:172.21.15.106:3300/0 conn(0x7f2cfc0cdb70 msgr2=0x7f2cfc15a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:18.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.952+0000 7f2d01b72640 1 --2- 172.21.15.49:0/3593923763 >> v2:172.21.15.106:3300/0 conn(0x7f2cfc0cdb70 0x7f2cfc15a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:18.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.952+0000 7f2d01b72640 1 -- 172.21.15.49:0/3593923763 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc1596c0 con 0x7f2cfc0ce0c0 2023-11-18T20:59:18.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.956+0000 7f2d01b72640 1 --2- 172.21.15.49:0/3593923763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cfc0ce0c0 0x7f2cfc0ce4a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc06cf50 tx=0x7f2cf801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b271a67dc0dfe4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:18.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.960+0000 7f2d00b70640 1 -- 172.21.15.49:0/3593923763 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80aa640 con 0x7f2cfc0ce0c0 2023-11-18T20:59:18.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.960+0000 7f2d00b70640 1 -- 172.21.15.49:0/3593923763 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf80aa7a0 con 0x7f2cfc0ce0c0 2023-11-18T20:59:18.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.960+0000 7f2d00b70640 1 -- 172.21.15.49:0/3593923763 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80aab30 con 0x7f2cfc0ce0c0 2023-11-18T20:59:18.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3593923763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cfc0ce0c0 msgr2=0x7f2cfc0ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:18.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 --2- 172.21.15.49:0/3593923763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cfc0ce0c0 0x7f2cfc0ce4a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc06cf50 tx=0x7f2cf801c500 comp rx=0 tx=0).stop 2023-11-18T20:59:18.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3593923763 shutdown_connections 2023-11-18T20:59:18.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 --2- 172.21.15.49:0/3593923763 >> v2:172.21.15.106:3300/0 conn(0x7f2cfc0cdb70 0x7f2cfc15a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 --2- 172.21.15.49:0/3593923763 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cfc0cc3c0 0x7f2cfc159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 --2- 172.21.15.49:0/3593923763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cfc0ce0c0 0x7f2cfc0ce4a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3593923763 >> 172.21.15.49:0/3593923763 conn(0x7f2cfc0b07c0 msgr2=0x7f2cfc0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3593923763 shutdown_connections 2023-11-18T20:59:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3593923763 wait complete. 2023-11-18T20:59:18.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 Processor -- start 2023-11-18T20:59:18.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 -- start start 2023-11-18T20:59:18.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cfc0cc3c0 0x7f2cfc146a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:18.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cfc0cdb70 0x7f2cfc157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:18.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cfc0ce0c0 0x7f2cfc15ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:18.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc1593c0 con 0x7f2cfc0cdb70 2023-11-18T20:59:18.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc14d630 con 0x7f2cfc0ce0c0 2023-11-18T20:59:18.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d03dd6640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc14c780 con 0x7f2cfc0cc3c0 2023-11-18T20:59:18.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.964+0000 7f2d01371640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cfc0cdb70 0x7f2cfc157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:18.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.968+0000 7f2d01371640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cfc0cdb70 0x7f2cfc157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52032/0 (socket says 172.21.15.49:52032) 2023-11-18T20:59:18.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.968+0000 7f2d01371640 1 -- 172.21.15.49:0/3380875188 learned_addr learned my addr 172.21.15.49:0/3380875188 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:18.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.968+0000 7f2d02373640 1 --2- 172.21.15.49:0/3380875188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cfc0ce0c0 0x7f2cfc15ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:18.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.968+0000 7f2d01b72640 1 --2- 172.21.15.49:0/3380875188 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cfc0cc3c0 0x7f2cfc146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:18.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.968+0000 7f2d01371640 1 -- 172.21.15.49:0/3380875188 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cfc0cc3c0 msgr2=0x7f2cfc146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:18.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.968+0000 7f2d01371640 1 --2- 172.21.15.49:0/3380875188 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cfc0cc3c0 0x7f2cfc146a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:18.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.968+0000 7f2d01371640 1 -- 172.21.15.49:0/3380875188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cfc0ce0c0 msgr2=0x7f2cfc15ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:18.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.968+0000 7f2d01371640 1 --2- 172.21.15.49:0/3380875188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cfc0ce0c0 0x7f2cfc15ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:18.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.968+0000 7f2d01371640 1 -- 172.21.15.49:0/3380875188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf80094d0 con 0x7f2cfc0cdb70 2023-11-18T20:59:18.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.972+0000 7f2d01371640 1 --2- 172.21.15.49:0/3380875188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cfc0cdb70 0x7f2cfc157680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00e8b0 tx=0x7f2cec00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.976+0000 7f2cf27fc640 1 -- 172.21.15.49:0/3380875188 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec00c940 con 0x7f2cfc0cdb70 2023-11-18T20:59:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.976+0000 7f2cf27fc640 1 -- 172.21.15.49:0/3380875188 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec00caa0 con 0x7f2cfc0cdb70 2023-11-18T20:59:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.976+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3380875188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cfc14ca20 con 0x7f2cfc0cdb70 2023-11-18T20:59:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.976+0000 7f2cf27fc640 1 -- 172.21.15.49:0/3380875188 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec00ce30 con 0x7f2cfc0cdb70 2023-11-18T20:59:18.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.976+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3380875188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cfc14cfe0 con 0x7f2cfc0cdb70 2023-11-18T20:59:18.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.980+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3380875188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cfc0c2240 con 0x7f2cfc0cdb70 2023-11-18T20:59:18.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:18.996+0000 7f2cf27fc640 1 -- 172.21.15.49:0/3380875188 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2cec013470 con 0x7f2cfc0cdb70 2023-11-18T20:59:19.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.000+0000 7f2cf27fc640 1 --2- 172.21.15.49:0/3380875188 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2ce00664c0 0x7f2ce0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:19.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.000+0000 7f2d01b72640 1 --2- 172.21.15.49:0/3380875188 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2ce00664c0 0x7f2ce0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:19.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.000+0000 7f2d01b72640 1 --2- 172.21.15.49:0/3380875188 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2ce00664c0 0x7f2ce0068980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80ae000 tx=0x7f2cf80b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:19.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.004+0000 7f2cf27fc640 1 -- 172.21.15.49:0/3380875188 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2cec0559f0 con 0x7f2cfc0cdb70 2023-11-18T20:59:19.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.344+0000 7f2cf27fc640 1 -- 172.21.15.49:0/3380875188 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2cec051d30 con 0x7f2cfc0cdb70 2023-11-18T20:59:19.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.548+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3380875188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2cfc067520 con 0x7f2cfc0cdb70 2023-11-18T20:59:19.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.592+0000 7f2cf27fc640 1 -- 172.21.15.49:0/3380875188 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+5277 (secure 0 0 0) 0x7f2cec021020 con 0x7f2cfc0cdb70 2023-11-18T20:59:19.593 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:59:19.593 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1013296856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1013296856},{"type":"v1","addr":"172.21.15.49:6833","nonce":1013296856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3397458527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3397458527},{"type":"v1","addr":"172.21.15.49:6835","nonce":3397458527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2795994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2795994685},{"type":"v1","addr":"172.21.15.106:6835","nonce":2795994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2839781261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":2839781261},{"type":"v1","addr":"172.21.15.106:6837","nonce":2839781261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6839/957974967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":957974967},{"type":"v1","addr":"172.21.15.106:6839","nonce":957974967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":4252,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/321839377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":321839377},{"type":"v1","addr":"172.21.15.49:6837","nonce":321839377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[]} 2023-11-18T20:59:19.593 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 4 2023-11-18T20:59:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.596+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3380875188 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2ce00664c0 msgr2=0x7f2ce0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.596+0000 7f2d03dd6640 1 --2- 172.21.15.49:0/3380875188 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2ce00664c0 0x7f2ce0068980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80ae000 tx=0x7f2cf80b5040 comp rx=0 tx=0).stop 2023-11-18T20:59:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.596+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3380875188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cfc0cdb70 msgr2=0x7f2cfc157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.596+0000 7f2d03dd6640 1 --2- 172.21.15.49:0/3380875188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cfc0cdb70 0x7f2cfc157680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00e8b0 tx=0x7f2cec00ed70 comp rx=0 tx=0).stop 2023-11-18T20:59:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.596+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3380875188 shutdown_connections 2023-11-18T20:59:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.596+0000 7f2d03dd6640 1 --2- 172.21.15.49:0/3380875188 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2ce00664c0 0x7f2ce0068980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.596+0000 7f2d03dd6640 1 --2- 172.21.15.49:0/3380875188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cfc0ce0c0 0x7f2cfc15ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.596+0000 7f2d03dd6640 1 --2- 172.21.15.49:0/3380875188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2cfc0cdb70 0x7f2cfc157680 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.596+0000 7f2d03dd6640 1 --2- 172.21.15.49:0/3380875188 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cfc0cc3c0 0x7f2cfc146a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.596+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3380875188 >> 172.21.15.49:0/3380875188 conn(0x7f2cfc0b07c0 msgr2=0x7f2cfc0ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.596+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3380875188 shutdown_connections 2023-11-18T20:59:19.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.596+0000 7f2d03dd6640 1 -- 172.21.15.49:0/3380875188 wait complete. 2023-11-18T20:59:19.615 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:59:19.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.744+0000 7fa07eb65640 1 Processor -- start 2023-11-18T20:59:19.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.744+0000 7fa07eb65640 1 -- start start 2023-11-18T20:59:19.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.744+0000 7fa07eb65640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa0781594f0 0x7fa0780cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:19.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.744+0000 7fa07eb65640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa078159930 con 0x7fa0780cb800 2023-11-18T20:59:19.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.744+0000 7fa07eb65640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0780c3930 con 0x7fa07814fea0 2023-11-18T20:59:19.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.744+0000 7fa07eb65640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa078159b80 con 0x7fa0781594f0 2023-11-18T20:59:19.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.744+0000 7fa07d102640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa0780cb800 0x7fa0780c45d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57164/0 (socket says 172.21.15.49:57164) 2023-11-18T20:59:19.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.744+0000 7fa07d102640 1 -- 172.21.15.49:0/3447779225 learned_addr learned my addr 172.21.15.49:0/3447779225 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:59:19.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.744+0000 7fa06ffff640 1 --2- 172.21.15.49:0/3447779225 >> v2:172.21.15.49:3300/0 conn(0x7fa0781594f0 0x7fa0780cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:19.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.748+0000 7fa06f7fe640 1 -- 172.21.15.49:0/3447779225 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503766395 0 0) 0x7fa078159930 con 0x7fa0780cb800 2023-11-18T20:59:19.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.748+0000 7fa06f7fe640 1 -- 172.21.15.49:0/3447779225 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa060003530 con 0x7fa0780cb800 2023-11-18T20:59:19.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.752+0000 7fa06ffff640 1 -- 172.21.15.49:0/3447779225 >> v1:172.21.15.106:6789/0 conn(0x7fa07814fea0 legacy=0x7fa07806b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.752+0000 7fa06ffff640 1 -- 172.21.15.49:0/3447779225 >> v1:172.21.15.49:6789/0 conn(0x7fa0780cb800 legacy=0x7fa0780c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.752+0000 7fa06ffff640 1 -- 172.21.15.49:0/3447779225 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa078159e20 con 0x7fa0781594f0 2023-11-18T20:59:19.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.760+0000 7fa06ffff640 1 --2- 172.21.15.49:0/3447779225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0781594f0 0x7fa0780cb2c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa0680097c0 tx=0x7fa06801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaeeded42515e38 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:19.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.768+0000 7fa06f7fe640 1 -- 172.21.15.49:0/3447779225 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680a8930 con 0x7fa0781594f0 2023-11-18T20:59:19.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.768+0000 7fa06f7fe640 1 -- 172.21.15.49:0/3447779225 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0680a8a90 con 0x7fa0781594f0 2023-11-18T20:59:19.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.768+0000 7fa06f7fe640 1 -- 172.21.15.49:0/3447779225 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680a8e20 con 0x7fa0781594f0 2023-11-18T20:59:19.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.768+0000 7fa07eb65640 1 -- 172.21.15.49:0/3447779225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0781594f0 msgr2=0x7fa0780cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:19.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.768+0000 7fa07eb65640 1 --2- 172.21.15.49:0/3447779225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0781594f0 0x7fa0780cb2c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa0680097c0 tx=0x7fa06801ec30 comp rx=0 tx=0).stop 2023-11-18T20:59:19.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.768+0000 7fa07eb65640 1 -- 172.21.15.49:0/3447779225 shutdown_connections 2023-11-18T20:59:19.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.768+0000 7fa07eb65640 1 --2- 172.21.15.49:0/3447779225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0781594f0 0x7fa0780cb2c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:19.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.768+0000 7fa07eb65640 1 -- 172.21.15.49:0/3447779225 >> 172.21.15.49:0/3447779225 conn(0x7fa07806d200 msgr2=0x7fa07806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:19.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.768+0000 7fa07eb65640 1 -- 172.21.15.49:0/3447779225 shutdown_connections 2023-11-18T20:59:19.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.768+0000 7fa07eb65640 1 -- 172.21.15.49:0/3447779225 wait complete. 2023-11-18T20:59:19.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.768+0000 7fa07eb65640 1 Processor -- start 2023-11-18T20:59:19.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.768+0000 7fa07eb65640 1 -- start start 2023-11-18T20:59:19.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.772+0000 7fa07eb65640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0780cb800 0x7fa07815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:19.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.772+0000 7fa07eb65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa07814fea0 0x7fa078148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:19.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.772+0000 7fa07eb65640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0781594f0 0x7fa07815a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:19.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.772+0000 7fa07eb65640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07814c500 con 0x7fa07814fea0 2023-11-18T20:59:19.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.772+0000 7fa07eb65640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780ca120 con 0x7fa0781594f0 2023-11-18T20:59:19.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.772+0000 7fa07eb65640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa078147110 con 0x7fa0780cb800 2023-11-18T20:59:19.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.772+0000 7fa06ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa07814fea0 0x7fa078148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:19.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.772+0000 7fa06ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa07814fea0 0x7fa078148600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52048/0 (socket says 172.21.15.49:52048) 2023-11-18T20:59:19.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.772+0000 7fa06ffff640 1 -- 172.21.15.49:0/1925543350 learned_addr learned my addr 172.21.15.49:0/1925543350 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:19.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.776+0000 7fa06ffff640 1 -- 172.21.15.49:0/1925543350 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0780cb800 msgr2=0x7fa07815b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:19.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.776+0000 7fa06ffff640 1 --2- 172.21.15.49:0/1925543350 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0780cb800 0x7fa07815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:19.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.776+0000 7fa06ffff640 1 -- 172.21.15.49:0/1925543350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0781594f0 msgr2=0x7fa07815a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:19.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.776+0000 7fa06ffff640 1 --2- 172.21.15.49:0/1925543350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0781594f0 0x7fa07815a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:19.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.776+0000 7fa06ffff640 1 -- 172.21.15.49:0/1925543350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa068009420 con 0x7fa07814fea0 2023-11-18T20:59:19.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.788+0000 7fa06ffff640 1 --2- 172.21.15.49:0/1925543350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa07814fea0 0x7fa078148600 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa0680097c0 tx=0x7fa06801b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.800+0000 7fa06d7fa640 1 -- 172.21.15.49:0/1925543350 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680b0d50 con 0x7fa07814fea0 2023-11-18T20:59:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.800+0000 7fa06d7fa640 1 -- 172.21.15.49:0/1925543350 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0680ba410 con 0x7fa07814fea0 2023-11-18T20:59:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.800+0000 7fa06d7fa640 1 -- 172.21.15.49:0/1925543350 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680ba7c0 con 0x7fa07814fea0 2023-11-18T20:59:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.800+0000 7fa07eb65640 1 -- 172.21.15.49:0/1925543350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07815bf00 con 0x7fa07814fea0 2023-11-18T20:59:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.800+0000 7fa07eb65640 1 -- 172.21.15.49:0/1925543350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07814bf40 con 0x7fa07814fea0 2023-11-18T20:59:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.800+0000 7fa07eb65640 1 -- 172.21.15.49:0/1925543350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa078073e70 con 0x7fa07814fea0 2023-11-18T20:59:19.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.820+0000 7fa06d7fa640 1 -- 172.21.15.49:0/1925543350 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0680b7050 con 0x7fa07814fea0 2023-11-18T20:59:19.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.820+0000 7fa06d7fa640 1 --2- 172.21.15.49:0/1925543350 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fa0640664c0 0x7fa064068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:19.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.824+0000 7fa07c901640 1 --2- 172.21.15.49:0/1925543350 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fa0640664c0 0x7fa064068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:19.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.824+0000 7fa07c901640 1 --2- 172.21.15.49:0/1925543350 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fa0640664c0 0x7fa064068980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa074007fd0 tx=0x7fa0740079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:19.828+0000 7fa06d7fa640 1 -- 172.21.15.49:0/1925543350 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa0680aee20 con 0x7fa07814fea0 2023-11-18T20:59:20.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.120+0000 7fa06d7fa640 1 -- 172.21.15.49:0/1925543350 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0680ef970 con 0x7fa07814fea0 2023-11-18T20:59:20.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.292+0000 7fa07eb65640 1 -- 172.21.15.49:0/1925543350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa078073e70 con 0x7fa07814fea0 2023-11-18T20:59:20.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.440+0000 7fa06d7fa640 1 -- 172.21.15.49:0/1925543350 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12814 (secure 0 0 0) 0x7fa0680b5070 con 0x7fa07814fea0 2023-11-18T20:59:20.442 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:59:20.442 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":18,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:58:45.750504+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:59:20.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.444+0000 7fa07eb65640 1 -- 172.21.15.49:0/1925543350 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fa0640664c0 msgr2=0x7fa064068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.444+0000 7fa07eb65640 1 --2- 172.21.15.49:0/1925543350 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fa0640664c0 0x7fa064068980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa074007fd0 tx=0x7fa0740079a0 comp rx=0 tx=0).stop 2023-11-18T20:59:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.444+0000 7fa07eb65640 1 -- 172.21.15.49:0/1925543350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa07814fea0 msgr2=0x7fa078148600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.444+0000 7fa07eb65640 1 --2- 172.21.15.49:0/1925543350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa07814fea0 0x7fa078148600 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa0680097c0 tx=0x7fa06801b9d0 comp rx=0 tx=0).stop 2023-11-18T20:59:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.444+0000 7fa07eb65640 1 -- 172.21.15.49:0/1925543350 shutdown_connections 2023-11-18T20:59:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.444+0000 7fa07eb65640 1 --2- 172.21.15.49:0/1925543350 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fa0640664c0 0x7fa064068980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.444+0000 7fa07eb65640 1 --2- 172.21.15.49:0/1925543350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0781594f0 0x7fa07815a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.444+0000 7fa07eb65640 1 --2- 172.21.15.49:0/1925543350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa07814fea0 0x7fa078148600 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.444+0000 7fa07eb65640 1 --2- 172.21.15.49:0/1925543350 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0780cb800 0x7fa07815b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.444+0000 7fa07eb65640 1 -- 172.21.15.49:0/1925543350 >> 172.21.15.49:0/1925543350 conn(0x7fa07806d200 msgr2=0x7fa07814ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.444+0000 7fa07eb65640 1 -- 172.21.15.49:0/1925543350 shutdown_connections 2023-11-18T20:59:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.444+0000 7fa07eb65640 1 -- 172.21.15.49:0/1925543350 wait complete. 2023-11-18T20:59:20.466 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:58:42.362631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T20:59:20.467 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:59:20.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.596+0000 7fab6fcb1640 1 Processor -- start 2023-11-18T20:59:20.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.596+0000 7fab6fcb1640 1 -- start start 2023-11-18T20:59:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.596+0000 7fab6fcb1640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fab680ccf70 0x7fab68159560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.596+0000 7fab6fcb1640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fab680c9650 0x7fab68159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.596+0000 7fab6fcb1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab680cb3b0 con 0x7fab680cd350 2023-11-18T20:59:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.596+0000 7fab6fcb1640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab680c9f00 con 0x7fab680c9650 2023-11-18T20:59:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.596+0000 7fab6fcb1640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab680cbf10 con 0x7fab680ccf70 2023-11-18T20:59:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.596+0000 7fab6d24c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fab680c9650 0x7fab68159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.596+0000 7fab6d24c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fab680c9650 0x7fab68159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52058/0 (socket says 172.21.15.49:52058) 2023-11-18T20:59:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.596+0000 7fab6d24c640 1 -- 172.21.15.49:0/2197870181 learned_addr learned my addr 172.21.15.49:0/2197870181 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.600+0000 7fab6da4d640 1 --2- 172.21.15.49:0/2197870181 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fab680ccf70 0x7fab68159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:20.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.600+0000 7fab6d24c640 1 -- 172.21.15.49:0/2197870181 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fab680ccf70 msgr2=0x7fab68159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:20.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.600+0000 7fab6d24c640 1 --2- 172.21.15.49:0/2197870181 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fab680ccf70 0x7fab68159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:20.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.600+0000 7fab6d24c640 1 -- 172.21.15.49:0/2197870181 >> v1:172.21.15.106:6789/0 conn(0x7fab680cd350 legacy=0x7fab680cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:20.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.600+0000 7fab6d24c640 1 -- 172.21.15.49:0/2197870181 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab680c9c20 con 0x7fab680c9650 2023-11-18T20:59:20.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.604+0000 7fab6d24c640 1 --2- 172.21.15.49:0/2197870181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab680c9650 0x7fab68159aa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fab58009870 tx=0x7fab5801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6250fd3bdd0052ca server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:20.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.608+0000 7fab6ca4b640 1 -- 172.21.15.49:0/2197870181 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580a8a30 con 0x7fab680c9650 2023-11-18T20:59:20.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.608+0000 7fab6ca4b640 1 -- 172.21.15.49:0/2197870181 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab580a8b90 con 0x7fab680c9650 2023-11-18T20:59:20.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.608+0000 7fab6ca4b640 1 -- 172.21.15.49:0/2197870181 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580b0440 con 0x7fab680c9650 2023-11-18T20:59:20.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.608+0000 7fab6fcb1640 1 -- 172.21.15.49:0/2197870181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab680c9650 msgr2=0x7fab68159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:20.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.608+0000 7fab6fcb1640 1 --2- 172.21.15.49:0/2197870181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab680c9650 0x7fab68159aa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fab58009870 tx=0x7fab5801ed30 comp rx=0 tx=0).stop 2023-11-18T20:59:20.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.608+0000 7fab6fcb1640 1 -- 172.21.15.49:0/2197870181 shutdown_connections 2023-11-18T20:59:20.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.608+0000 7fab6fcb1640 1 --2- 172.21.15.49:0/2197870181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab680c9650 0x7fab68159aa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:20.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.608+0000 7fab6fcb1640 1 --2- 172.21.15.49:0/2197870181 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fab680ccf70 0x7fab68159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:20.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.608+0000 7fab6fcb1640 1 -- 172.21.15.49:0/2197870181 >> 172.21.15.49:0/2197870181 conn(0x7fab680b07e0 msgr2=0x7fab680b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:20.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.608+0000 7fab6fcb1640 1 -- 172.21.15.49:0/2197870181 shutdown_connections 2023-11-18T20:59:20.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.608+0000 7fab6fcb1640 1 -- 172.21.15.49:0/2197870181 wait complete. 2023-11-18T20:59:20.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.612+0000 7fab6fcb1640 1 Processor -- start 2023-11-18T20:59:20.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.612+0000 7fab6fcb1640 1 -- start start 2023-11-18T20:59:20.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.612+0000 7fab6fcb1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab680c9650 0x7fab680c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:20.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.612+0000 7fab6fcb1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab680ccf70 0x7fab6814bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:20.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.612+0000 7fab6fcb1640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fab680cd350 0x7fab680c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:20.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.612+0000 7fab6fcb1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab680c6590 con 0x7fab680ccf70 2023-11-18T20:59:20.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.612+0000 7fab6fcb1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab680b1eb0 con 0x7fab680c9650 2023-11-18T20:59:20.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.612+0000 7fab6fcb1640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab680c5fd0 con 0x7fab680cd350 2023-11-18T20:59:20.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.612+0000 7fab6d24c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab680ccf70 0x7fab6814bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:20.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.612+0000 7fab6d24c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab680ccf70 0x7fab6814bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52060/0 (socket says 172.21.15.49:52060) 2023-11-18T20:59:20.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.612+0000 7fab6d24c640 1 -- 172.21.15.49:0/4226513552 learned_addr learned my addr 172.21.15.49:0/4226513552 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:20.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.612+0000 7fab6e24e640 1 --2- 172.21.15.49:0/4226513552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fab680cd350 0x7fab680c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:20.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.612+0000 7fab6da4d640 1 --2- 172.21.15.49:0/4226513552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab680c9650 0x7fab680c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:20.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.616+0000 7fab6d24c640 1 -- 172.21.15.49:0/4226513552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fab680cd350 msgr2=0x7fab680c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:20.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.616+0000 7fab6d24c640 1 --2- 172.21.15.49:0/4226513552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fab680cd350 0x7fab680c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:20.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.616+0000 7fab6d24c640 1 -- 172.21.15.49:0/4226513552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab680c9650 msgr2=0x7fab680c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:20.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.616+0000 7fab6d24c640 1 --2- 172.21.15.49:0/4226513552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab680c9650 0x7fab680c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:20.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.616+0000 7fab6d24c640 1 -- 172.21.15.49:0/4226513552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab580094d0 con 0x7fab680ccf70 2023-11-18T20:59:20.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.620+0000 7fab6d24c640 1 --2- 172.21.15.49:0/4226513552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab680ccf70 0x7fab6814bde0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab5801b940 tx=0x7fab5801bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.624+0000 7fab5e7fc640 1 -- 172.21.15.49:0/4226513552 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580b1ce0 con 0x7fab680ccf70 2023-11-18T20:59:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.624+0000 7fab5e7fc640 1 -- 172.21.15.49:0/4226513552 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab580b1e60 con 0x7fab680ccf70 2023-11-18T20:59:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.624+0000 7fab5e7fc640 1 -- 172.21.15.49:0/4226513552 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580b9680 con 0x7fab680ccf70 2023-11-18T20:59:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.624+0000 7fab6fcb1640 1 -- 172.21.15.49:0/4226513552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6814a6f0 con 0x7fab680ccf70 2023-11-18T20:59:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.624+0000 7fab6fcb1640 1 -- 172.21.15.49:0/4226513552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6814acb0 con 0x7fab680ccf70 2023-11-18T20:59:20.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.624+0000 7fab6fcb1640 1 -- 172.21.15.49:0/4226513552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab68067520 con 0x7fab680ccf70 2023-11-18T20:59:20.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.892+0000 7fab5e7fc640 1 -- 172.21.15.49:0/4226513552 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fab580b7070 con 0x7fab680ccf70 2023-11-18T20:59:20.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.896+0000 7fab5e7fc640 1 --2- 172.21.15.49:0/4226513552 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fab4c0664c0 0x7fab4c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:20.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.896+0000 7fab6da4d640 1 --2- 172.21.15.49:0/4226513552 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fab4c0664c0 0x7fab4c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:20.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.896+0000 7fab6da4d640 1 --2- 172.21.15.49:0/4226513552 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fab4c0664c0 0x7fab4c068980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fab64009b60 tx=0x7fab64009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:20.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.912+0000 7fab5e7fc640 1 -- 172.21.15.49:0/4226513552 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fab580f32d0 con 0x7fab680ccf70 2023-11-18T20:59:20.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:20.912+0000 7fab5e7fc640 1 -- 172.21.15.49:0/4226513552 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fab580ef610 con 0x7fab680ccf70 2023-11-18T20:59:21.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.088+0000 7fab6fcb1640 1 -- 172.21.15.49:0/4226513552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab6806d140 con 0x7fab680ccf70 2023-11-18T20:59:21.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.132+0000 7fab5e7fc640 1 -- 172.21.15.49:0/4226513552 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab580b5070 con 0x7fab680ccf70 2023-11-18T20:59:21.136 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-18T20:59:21.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.136+0000 7fab6fcb1640 1 -- 172.21.15.49:0/4226513552 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fab4c0664c0 msgr2=0x7fab4c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:21.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.136+0000 7fab6fcb1640 1 --2- 172.21.15.49:0/4226513552 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fab4c0664c0 0x7fab4c068980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fab64009b60 tx=0x7fab64009190 comp rx=0 tx=0).stop 2023-11-18T20:59:21.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.136+0000 7fab6fcb1640 1 -- 172.21.15.49:0/4226513552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab680ccf70 msgr2=0x7fab6814bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:21.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.136+0000 7fab6fcb1640 1 --2- 172.21.15.49:0/4226513552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab680ccf70 0x7fab6814bde0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab5801b940 tx=0x7fab5801bad0 comp rx=0 tx=0).stop 2023-11-18T20:59:21.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.136+0000 7fab6fcb1640 1 -- 172.21.15.49:0/4226513552 shutdown_connections 2023-11-18T20:59:21.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.136+0000 7fab6fcb1640 1 --2- 172.21.15.49:0/4226513552 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fab4c0664c0 0x7fab4c068980 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:21.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.136+0000 7fab6fcb1640 1 --2- 172.21.15.49:0/4226513552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fab680cd350 0x7fab680c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:21.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.136+0000 7fab6fcb1640 1 --2- 172.21.15.49:0/4226513552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab680ccf70 0x7fab6814bde0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:21.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.136+0000 7fab6fcb1640 1 --2- 172.21.15.49:0/4226513552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab680c9650 0x7fab680c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:21.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.136+0000 7fab6fcb1640 1 -- 172.21.15.49:0/4226513552 >> 172.21.15.49:0/4226513552 conn(0x7fab680b07e0 msgr2=0x7fab6806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:21.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.136+0000 7fab6fcb1640 1 -- 172.21.15.49:0/4226513552 shutdown_connections 2023-11-18T20:59:21.140 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.136+0000 7fab6fcb1640 1 -- 172.21.15.49:0/4226513552 wait complete. 2023-11-18T20:59:21.156 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-18T20:59:21.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.284+0000 7faefac74640 1 Processor -- start 2023-11-18T20:59:21.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.284+0000 7faefac74640 1 -- start start 2023-11-18T20:59:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.288+0000 7faefac74640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faef40c5590 0x7faef40c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.288+0000 7faefac74640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef4158200 con 0x7faef40c5970 2023-11-18T20:59:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.288+0000 7faefac74640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef41575f0 con 0x7faef406b130 2023-11-18T20:59:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.288+0000 7faefac74640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef41578d0 con 0x7faef40c5590 2023-11-18T20:59:21.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.300+0000 7faef8a10640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faef40c5590 0x7faef40c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:21.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.300+0000 7faef8a10640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faef40c5590 0x7faef40c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:44422/0 (socket says 172.21.15.49:44422) 2023-11-18T20:59:21.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.300+0000 7faef8a10640 1 -- 172.21.15.49:0/599605494 learned_addr learned my addr 172.21.15.49:0/599605494 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.312+0000 7faef8a10640 1 -- 172.21.15.49:0/599605494 >> v1:172.21.15.106:6789/0 conn(0x7faef406b130 legacy=0x7faef4151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.312+0000 7faef8a10640 1 -- 172.21.15.49:0/599605494 >> v1:172.21.15.49:6789/0 conn(0x7faef40c5970 legacy=0x7faef415ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.312+0000 7faef8a10640 1 -- 172.21.15.49:0/599605494 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4157bb0 con 0x7faef40c5590 2023-11-18T20:59:21.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.408+0000 7faef8a10640 1 --2- 172.21.15.49:0/599605494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef40c5590 0x7faef40c90d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faee8009870 tx=0x7faee801ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d8c2b7544c2106d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.460+0000 7faef37fe640 1 -- 172.21.15.49:0/599605494 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80a89b0 con 0x7faef40c5590 2023-11-18T20:59:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.464+0000 7faef37fe640 1 -- 172.21.15.49:0/599605494 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee80a8b10 con 0x7faef40c5590 2023-11-18T20:59:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.464+0000 7faef37fe640 1 -- 172.21.15.49:0/599605494 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80a8ea0 con 0x7faef40c5590 2023-11-18T20:59:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.464+0000 7faefac74640 1 -- 172.21.15.49:0/599605494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef40c5590 msgr2=0x7faef40c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.464+0000 7faefac74640 1 --2- 172.21.15.49:0/599605494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef40c5590 0x7faef40c90d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faee8009870 tx=0x7faee801ecb0 comp rx=0 tx=0).stop 2023-11-18T20:59:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.464+0000 7faefac74640 1 -- 172.21.15.49:0/599605494 shutdown_connections 2023-11-18T20:59:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.464+0000 7faefac74640 1 --2- 172.21.15.49:0/599605494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef40c5590 0x7faef40c90d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.464+0000 7faefac74640 1 -- 172.21.15.49:0/599605494 >> 172.21.15.49:0/599605494 conn(0x7faef406d7d0 msgr2=0x7faef406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.464+0000 7faefac74640 1 -- 172.21.15.49:0/599605494 shutdown_connections 2023-11-18T20:59:21.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.464+0000 7faefac74640 1 -- 172.21.15.49:0/599605494 wait complete. 2023-11-18T20:59:21.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.464+0000 7faefac74640 1 Processor -- start 2023-11-18T20:59:21.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.464+0000 7faefac74640 1 -- start start 2023-11-18T20:59:21.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.468+0000 7faefac74640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faef406b130 0x7faef41efa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:21.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.468+0000 7faefac74640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef40c5590 0x7faef40c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:21.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.468+0000 7faefac74640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faef40c5970 0x7faef4142270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:21.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.468+0000 7faefac74640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef41effd0 con 0x7faef406b130 2023-11-18T20:59:21.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.468+0000 7faefac74640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef4141540 con 0x7faef40c5590 2023-11-18T20:59:21.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.468+0000 7faefac74640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef4141de0 con 0x7faef40c5970 2023-11-18T20:59:21.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.468+0000 7faef8a10640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faef406b130 0x7faef41efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:21.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.468+0000 7faef8a10640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faef406b130 0x7faef41efa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52062/0 (socket says 172.21.15.49:52062) 2023-11-18T20:59:21.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.468+0000 7faef8a10640 1 -- 172.21.15.49:0/4236064871 learned_addr learned my addr 172.21.15.49:0/4236064871 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.468+0000 7faef9211640 1 --2- 172.21.15.49:0/4236064871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faef40c5970 0x7faef4142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:21.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.472+0000 7faef8a10640 1 -- 172.21.15.49:0/4236064871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faef40c5970 msgr2=0x7faef4142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:21.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.472+0000 7faef8a10640 1 --2- 172.21.15.49:0/4236064871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faef40c5970 0x7faef4142270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:21.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.472+0000 7faef8a10640 1 -- 172.21.15.49:0/4236064871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef40c5590 msgr2=0x7faef40c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:21.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.472+0000 7faef8a10640 1 --2- 172.21.15.49:0/4236064871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef40c5590 0x7faef40c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:21.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.472+0000 7faef8a10640 1 -- 172.21.15.49:0/4236064871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee80094d0 con 0x7faef406b130 2023-11-18T20:59:21.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.476+0000 7faef8a10640 1 --2- 172.21.15.49:0/4236064871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faef406b130 0x7faef41efa90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faee80b3040 tx=0x7faee801ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:21.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.504+0000 7faef17fa640 1 -- 172.21.15.49:0/4236064871 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80b0e40 con 0x7faef406b130 2023-11-18T20:59:21.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.504+0000 7faef17fa640 1 -- 172.21.15.49:0/4236064871 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee80b9440 con 0x7faef406b130 2023-11-18T20:59:21.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.504+0000 7faef17fa640 1 -- 172.21.15.49:0/4236064871 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80b97f0 con 0x7faef406b130 2023-11-18T20:59:21.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.504+0000 7faefac74640 1 -- 172.21.15.49:0/4236064871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef4158490 con 0x7faef406b130 2023-11-18T20:59:21.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.504+0000 7faefac74640 1 -- 172.21.15.49:0/4236064871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef4142ef0 con 0x7faef406b130 2023-11-18T20:59:21.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.504+0000 7faefac74640 1 -- 172.21.15.49:0/4236064871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef4142ef0 con 0x7faef406b130 2023-11-18T20:59:21.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.816+0000 7faef17fa640 1 -- 172.21.15.49:0/4236064871 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faee80b7070 con 0x7faef406b130 2023-11-18T20:59:21.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.816+0000 7faef17fa640 1 --2- 172.21.15.49:0/4236064871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7faee00664c0 0x7faee0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:21.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.816+0000 7faef3fff640 1 --2- 172.21.15.49:0/4236064871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7faee00664c0 0x7faee0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:21.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.820+0000 7faef3fff640 1 --2- 172.21.15.49:0/4236064871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7faee00664c0 0x7faee0068980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faef4155640 tx=0x7faee40079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:21.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.852+0000 7faef17fa640 1 -- 172.21.15.49:0/4236064871 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faee80f3d90 con 0x7faef406b130 2023-11-18T20:59:21.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:21.852+0000 7faef17fa640 1 -- 172.21.15.49:0/4236064871 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faee80ef9d0 con 0x7faef406b130 2023-11-18T20:59:22.035 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.032+0000 7faefac74640 1 -- 172.21.15.49:0/4236064871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7faef4142ef0 con 0x7faef406b130 2023-11-18T20:59:22.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.044+0000 7faef17fa640 1 -- 172.21.15.49:0/4236064871 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7faee80b5020 con 0x7faef406b130 2023-11-18T20:59:22.048 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:59:22.048 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2023-11-18T20:59:22.048 INFO:teuthology.orchestra.run.smithi049.stdout: { 2023-11-18T20:59:22.048 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2023-11-18T20:59:22.048 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2023-11-18T20:59:22.048 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-18T20:59:22.048 INFO:teuthology.orchestra.run.smithi049.stdout:] 2023-11-18T20:59:22.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.048+0000 7faefac74640 1 -- 172.21.15.49:0/4236064871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7faee00664c0 msgr2=0x7faee0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:22.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.048+0000 7faefac74640 1 --2- 172.21.15.49:0/4236064871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7faee00664c0 0x7faee0068980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faef4155640 tx=0x7faee40079c0 comp rx=0 tx=0).stop 2023-11-18T20:59:22.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.048+0000 7faefac74640 1 -- 172.21.15.49:0/4236064871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faef406b130 msgr2=0x7faef41efa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:22.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.048+0000 7faefac74640 1 --2- 172.21.15.49:0/4236064871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faef406b130 0x7faef41efa90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faee80b3040 tx=0x7faee801ba50 comp rx=0 tx=0).stop 2023-11-18T20:59:22.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.048+0000 7faefac74640 1 -- 172.21.15.49:0/4236064871 shutdown_connections 2023-11-18T20:59:22.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.048+0000 7faefac74640 1 --2- 172.21.15.49:0/4236064871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7faee00664c0 0x7faee0068980 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:22.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.048+0000 7faefac74640 1 --2- 172.21.15.49:0/4236064871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faef40c5970 0x7faef4142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:22.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.048+0000 7faefac74640 1 --2- 172.21.15.49:0/4236064871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef40c5590 0x7faef40c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:22.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.048+0000 7faefac74640 1 --2- 172.21.15.49:0/4236064871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faef406b130 0x7faef41efa90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:22.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.048+0000 7faefac74640 1 -- 172.21.15.49:0/4236064871 >> 172.21.15.49:0/4236064871 conn(0x7faef406d7d0 msgr2=0x7faef406dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:22.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.048+0000 7faefac74640 1 -- 172.21.15.49:0/4236064871 shutdown_connections 2023-11-18T20:59:22.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.048+0000 7faefac74640 1 -- 172.21.15.49:0/4236064871 wait complete. 2023-11-18T20:59:22.068 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-18T20:59:22.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-18T20:59:22.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.196+0000 7f20bb44b640 1 Processor -- start 2023-11-18T20:59:22.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.200+0000 7f20bb44b640 1 -- start start 2023-11-18T20:59:22.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.200+0000 7f20bb44b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f20b40ce0c0 0x7f20b40ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:22.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.200+0000 7f20bb44b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20b415a280 0x7f20b4163e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:22.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.200+0000 7f20bb44b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b40cd9a0 con 0x7f20b40cc3c0 2023-11-18T20:59:22.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.200+0000 7f20bb44b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b40ca550 con 0x7f20b40ce0c0 2023-11-18T20:59:22.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.200+0000 7f20bb44b640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b40ce9e0 con 0x7f20b415a280 2023-11-18T20:59:22.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.200+0000 7f20b91e7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f20b40ce0c0 0x7f20b40ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:22.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.200+0000 7f20b91e7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f20b40ce0c0 0x7f20b40ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52066/0 (socket says 172.21.15.49:52066) 2023-11-18T20:59:22.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.200+0000 7f20b91e7640 1 -- 172.21.15.49:0/884258440 learned_addr learned my addr 172.21.15.49:0/884258440 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:22.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.200+0000 7f20b99e8640 1 --2- 172.21.15.49:0/884258440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20b415a280 0x7f20b4163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:22.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.204+0000 7f20b91e7640 1 -- 172.21.15.49:0/884258440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20b415a280 msgr2=0x7f20b4163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:22.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.204+0000 7f20b91e7640 1 --2- 172.21.15.49:0/884258440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20b415a280 0x7f20b4163e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:22.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.204+0000 7f20b91e7640 1 -- 172.21.15.49:0/884258440 >> v1:172.21.15.106:6789/0 conn(0x7f20b40cc3c0 legacy=0x7f20b4159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:22.205 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.204+0000 7f20b91e7640 1 -- 172.21.15.49:0/884258440 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b41596c0 con 0x7f20b40ce0c0 2023-11-18T20:59:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.208+0000 7f20b91e7640 1 --2- 172.21.15.49:0/884258440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b40ce0c0 0x7f20b40ce4a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009870 tx=0x7f20ac01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee642436a77e21eb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:22.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.212+0000 7f20b3fff640 1 -- 172.21.15.49:0/884258440 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0a9400 con 0x7f20b40ce0c0 2023-11-18T20:59:22.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.212+0000 7f20b3fff640 1 -- 172.21.15.49:0/884258440 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac0a9560 con 0x7f20b40ce0c0 2023-11-18T20:59:22.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.212+0000 7f20b3fff640 1 -- 172.21.15.49:0/884258440 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0a98f0 con 0x7f20b40ce0c0 2023-11-18T20:59:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 -- 172.21.15.49:0/884258440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b40ce0c0 msgr2=0x7f20b40ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 --2- 172.21.15.49:0/884258440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b40ce0c0 0x7f20b40ce4a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009870 tx=0x7f20ac01c540 comp rx=0 tx=0).stop 2023-11-18T20:59:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 -- 172.21.15.49:0/884258440 shutdown_connections 2023-11-18T20:59:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 --2- 172.21.15.49:0/884258440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20b415a280 0x7f20b4163e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 --2- 172.21.15.49:0/884258440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b40ce0c0 0x7f20b40ce4a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 -- 172.21.15.49:0/884258440 >> 172.21.15.49:0/884258440 conn(0x7f20b40b07c0 msgr2=0x7f20b40b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 -- 172.21.15.49:0/884258440 shutdown_connections 2023-11-18T20:59:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 -- 172.21.15.49:0/884258440 wait complete. 2023-11-18T20:59:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 Processor -- start 2023-11-18T20:59:22.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 -- start start 2023-11-18T20:59:22.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20b40cc3c0 0x7f20b4156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:22.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b40ce0c0 0x7f20b40c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20b415a280 0x7f20b40c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b40c6310 con 0x7f20b40ce0c0 2023-11-18T20:59:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b4156bb0 con 0x7f20b40cc3c0 2023-11-18T20:59:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.216+0000 7f20bb44b640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b4156e90 con 0x7f20b415a280 2023-11-18T20:59:22.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.220+0000 7f20b89e6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b40ce0c0 0x7f20b40c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:22.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.220+0000 7f20b99e8640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20b415a280 0x7f20b40c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:22.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.220+0000 7f20b89e6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b40ce0c0 0x7f20b40c6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52070/0 (socket says 172.21.15.49:52070) 2023-11-18T20:59:22.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.220+0000 7f20b89e6640 1 -- 172.21.15.49:0/3515448491 learned_addr learned my addr 172.21.15.49:0/3515448491 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.220+0000 7f20b91e7640 1 --2- 172.21.15.49:0/3515448491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20b40cc3c0 0x7f20b4156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.224+0000 7f20b89e6640 1 -- 172.21.15.49:0/3515448491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20b415a280 msgr2=0x7f20b40c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.224+0000 7f20b89e6640 1 --2- 172.21.15.49:0/3515448491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20b415a280 0x7f20b40c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.224+0000 7f20b89e6640 1 -- 172.21.15.49:0/3515448491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20b40cc3c0 msgr2=0x7f20b4156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.224+0000 7f20b89e6640 1 --2- 172.21.15.49:0/3515448491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20b40cc3c0 0x7f20b4156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.224+0000 7f20b89e6640 1 -- 172.21.15.49:0/3515448491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac0094d0 con 0x7f20b40ce0c0 2023-11-18T20:59:22.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.224+0000 7f20b89e6640 1 --2- 172.21.15.49:0/3515448491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b40ce0c0 0x7f20b40c6ce0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f20a800c420 tx=0x7f20a800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:22.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.228+0000 7f20b1ffb640 1 -- 172.21.15.49:0/3515448491 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a80052d0 con 0x7f20b40ce0c0 2023-11-18T20:59:22.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.228+0000 7f20b1ffb640 1 -- 172.21.15.49:0/3515448491 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a8005430 con 0x7f20b40ce0c0 2023-11-18T20:59:22.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.228+0000 7f20bb44b640 1 -- 172.21.15.49:0/3515448491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b40c8c50 con 0x7f20b40ce0c0 2023-11-18T20:59:22.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.228+0000 7f20b1ffb640 1 -- 172.21.15.49:0/3515448491 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a8007260 con 0x7f20b40ce0c0 2023-11-18T20:59:22.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.228+0000 7f20bb44b640 1 -- 172.21.15.49:0/3515448491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b40b3960 con 0x7f20b40ce0c0 2023-11-18T20:59:22.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.228+0000 7f20bb44b640 1 -- 172.21.15.49:0/3515448491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b4067520 con 0x7f20b40ce0c0 2023-11-18T20:59:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.252+0000 7f20b1ffb640 1 -- 172.21.15.49:0/3515448491 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20a80073c0 con 0x7f20b40ce0c0 2023-11-18T20:59:22.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.252+0000 7f20b1ffb640 1 --2- 172.21.15.49:0/3515448491 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f20a00664c0 0x7f20a0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:22.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.256+0000 7f20b91e7640 1 --2- 172.21.15.49:0/3515448491 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f20a00664c0 0x7f20a0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.256+0000 7f20b91e7640 1 --2- 172.21.15.49:0/3515448491 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f20a00664c0 0x7f20a0068980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0ae000 tx=0x7f20ac0b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:22.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.552+0000 7f20b1ffb640 1 -- 172.21.15.49:0/3515448491 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f20a8007670 con 0x7f20b40ce0c0 2023-11-18T20:59:22.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.556+0000 7f20b1ffb640 1 -- 172.21.15.49:0/3515448491 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20a8050fe0 con 0x7f20b40ce0c0 2023-11-18T20:59:22.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:22.732+0000 7f20bb44b640 1 -- 172.21.15.49:0/3515448491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f20b40b1570 con 0x7f20b40ce0c0 2023-11-18T20:59:23.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:23.908+0000 7f20b1ffb640 1 -- 172.21.15.49:0/3515448491 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f20a8020020 con 0x7f20b40ce0c0 2023-11-18T20:59:23.913 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2023-11-18T20:59:23.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:23.912+0000 7f20bb44b640 1 -- 172.21.15.49:0/3515448491 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f20a00664c0 msgr2=0x7f20a0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:23.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:23.912+0000 7f20bb44b640 1 --2- 172.21.15.49:0/3515448491 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f20a00664c0 0x7f20a0068980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0ae000 tx=0x7f20ac0b3040 comp rx=0 tx=0).stop 2023-11-18T20:59:23.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:23.912+0000 7f20bb44b640 1 -- 172.21.15.49:0/3515448491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b40ce0c0 msgr2=0x7f20b40c6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:23.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:23.912+0000 7f20bb44b640 1 --2- 172.21.15.49:0/3515448491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b40ce0c0 0x7f20b40c6ce0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f20a800c420 tx=0x7f20a800c8e0 comp rx=0 tx=0).stop 2023-11-18T20:59:23.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:23.912+0000 7f20bb44b640 1 -- 172.21.15.49:0/3515448491 shutdown_connections 2023-11-18T20:59:23.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:23.912+0000 7f20bb44b640 1 --2- 172.21.15.49:0/3515448491 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f20a00664c0 0x7f20a0068980 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:23.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:23.912+0000 7f20bb44b640 1 --2- 172.21.15.49:0/3515448491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f20b415a280 0x7f20b40c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:23.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:23.912+0000 7f20bb44b640 1 --2- 172.21.15.49:0/3515448491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b40ce0c0 0x7f20b40c6ce0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:23.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:23.912+0000 7f20bb44b640 1 --2- 172.21.15.49:0/3515448491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20b40cc3c0 0x7f20b4156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:23.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:23.912+0000 7f20bb44b640 1 -- 172.21.15.49:0/3515448491 >> 172.21.15.49:0/3515448491 conn(0x7f20b40b07c0 msgr2=0x7f20b4151770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:23.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:23.912+0000 7f20bb44b640 1 -- 172.21.15.49:0/3515448491 shutdown_connections 2023-11-18T20:59:23.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:23.912+0000 7f20bb44b640 1 -- 172.21.15.49:0/3515448491 wait complete. 2023-11-18T20:59:23.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-18T20:59:24.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.088+0000 7f85bf445640 1 Processor -- start 2023-11-18T20:59:24.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.088+0000 7f85bf445640 1 -- start start 2023-11-18T20:59:24.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.092+0000 7f85bf445640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f85b80c1ed0 0x7f85b806e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:24.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.092+0000 7f85bf445640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b8070ab0 0x7f85b806ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:24.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.092+0000 7f85bf445640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b80c3b10 con 0x7f85b814f850 2023-11-18T20:59:24.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.092+0000 7f85bf445640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b80c46b0 con 0x7f85b80c1ed0 2023-11-18T20:59:24.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.092+0000 7f85bf445640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b814fc30 con 0x7f85b8070ab0 2023-11-18T20:59:24.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.164+0000 7f85bd9e2640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b8070ab0 0x7f85b806ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.164+0000 7f85bd1e1640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f85b814f850 0x7f85b80c3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:38442/0 (socket says 172.21.15.49:38442) 2023-11-18T20:59:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.164+0000 7f85bd1e1640 1 -- 172.21.15.49:0/1041650757 learned_addr learned my addr 172.21.15.49:0/1041650757 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:59:24.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.164+0000 7f85bc9e0640 1 --2- 172.21.15.49:0/1041650757 >> v2:172.21.15.106:3300/0 conn(0x7f85b80c1ed0 0x7f85b806e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:24.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.180+0000 7f85bd9e2640 1 -- 172.21.15.49:0/1041650757 >> v2:172.21.15.106:3300/0 conn(0x7f85b80c1ed0 msgr2=0x7f85b806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:24.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.180+0000 7f85bd9e2640 1 --2- 172.21.15.49:0/1041650757 >> v2:172.21.15.106:3300/0 conn(0x7f85b80c1ed0 0x7f85b806e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:24.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.180+0000 7f85bd9e2640 1 -- 172.21.15.49:0/1041650757 >> v1:172.21.15.106:6789/0 conn(0x7f85b814f850 legacy=0x7f85b80c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:24.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.180+0000 7f85bd9e2640 1 -- 172.21.15.49:0/1041650757 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b80c11e0 con 0x7f85b8070ab0 2023-11-18T20:59:24.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.188+0000 7f85bd9e2640 1 --2- 172.21.15.49:0/1041650757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b8070ab0 0x7f85b806ea70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f85b00097c0 tx=0x7f85b001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=645affde933e8100 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.196+0000 7f85affff640 1 -- 172.21.15.49:0/1041650757 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b00ab650 con 0x7f85b8070ab0 2023-11-18T20:59:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.196+0000 7f85affff640 1 -- 172.21.15.49:0/1041650757 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b00ab7b0 con 0x7f85b8070ab0 2023-11-18T20:59:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.196+0000 7f85affff640 1 -- 172.21.15.49:0/1041650757 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b00abb40 con 0x7f85b8070ab0 2023-11-18T20:59:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.196+0000 7f85bf445640 1 -- 172.21.15.49:0/1041650757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b8070ab0 msgr2=0x7f85b806ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.196+0000 7f85bf445640 1 --2- 172.21.15.49:0/1041650757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b8070ab0 0x7f85b806ea70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f85b00097c0 tx=0x7f85b001c450 comp rx=0 tx=0).stop 2023-11-18T20:59:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.196+0000 7f85bf445640 1 -- 172.21.15.49:0/1041650757 shutdown_connections 2023-11-18T20:59:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.196+0000 7f85bf445640 1 --2- 172.21.15.49:0/1041650757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b8070ab0 0x7f85b806ea70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.196+0000 7f85bf445640 1 --2- 172.21.15.49:0/1041650757 >> v2:172.21.15.106:3300/0 conn(0x7f85b80c1ed0 0x7f85b806e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.196+0000 7f85bf445640 1 -- 172.21.15.49:0/1041650757 >> 172.21.15.49:0/1041650757 conn(0x7f85b806c6a0 msgr2=0x7f85b806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.196+0000 7f85bf445640 1 -- 172.21.15.49:0/1041650757 shutdown_connections 2023-11-18T20:59:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.196+0000 7f85bf445640 1 -- 172.21.15.49:0/1041650757 wait complete. 2023-11-18T20:59:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.200+0000 7f85bf445640 1 Processor -- start 2023-11-18T20:59:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.200+0000 7f85bf445640 1 -- start start 2023-11-18T20:59:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.200+0000 7f85bf445640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85b8070ab0 0x7f85b8145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.200+0000 7f85bf445640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b80c1ed0 0x7f85b8144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:24.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.200+0000 7f85bf445640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b814f850 0x7f85b81480e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:24.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.200+0000 7f85bf445640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b8149ef0 con 0x7f85b8070ab0 2023-11-18T20:59:24.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.200+0000 7f85bf445640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b814a190 con 0x7f85b814f850 2023-11-18T20:59:24.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.200+0000 7f85bf445640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b814a470 con 0x7f85b80c1ed0 2023-11-18T20:59:24.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.200+0000 7f85bc9e0640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b80c1ed0 0x7f85b8144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:24.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.200+0000 7f85bd9e2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b814f850 0x7f85b81480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.200+0000 7f85bc9e0640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b80c1ed0 0x7f85b8144c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:41032/0 (socket says 172.21.15.49:41032) 2023-11-18T20:59:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.200+0000 7f85bc9e0640 1 -- 172.21.15.49:0/3924553038 learned_addr learned my addr 172.21.15.49:0/3924553038 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:24.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.212+0000 7f85bd9e2640 1 -- 172.21.15.49:0/3924553038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b80c1ed0 msgr2=0x7f85b8144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:24.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.212+0000 7f85bd9e2640 1 --2- 172.21.15.49:0/3924553038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b80c1ed0 0x7f85b8144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:24.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.212+0000 7f85bd9e2640 1 -- 172.21.15.49:0/3924553038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85b8070ab0 msgr2=0x7f85b8145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:24.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.212+0000 7f85bd9e2640 1 --2- 172.21.15.49:0/3924553038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85b8070ab0 0x7f85b8145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:24.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.212+0000 7f85bd9e2640 1 -- 172.21.15.49:0/3924553038 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b0009420 con 0x7f85b814f850 2023-11-18T20:59:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.216+0000 7f85bd9e2640 1 --2- 172.21.15.49:0/3924553038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b814f850 0x7f85b81480e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f85b00ac000 tx=0x7f85b001ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:24.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.228+0000 7f85adffb640 1 -- 172.21.15.49:0/3924553038 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b00b5810 con 0x7f85b814f850 2023-11-18T20:59:24.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.228+0000 7f85adffb640 1 -- 172.21.15.49:0/3924553038 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b00b5990 con 0x7f85b814f850 2023-11-18T20:59:24.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.228+0000 7f85adffb640 1 -- 172.21.15.49:0/3924553038 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b00b5d40 con 0x7f85b814f850 2023-11-18T20:59:24.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.228+0000 7f85bf445640 1 -- 172.21.15.49:0/3924553038 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b814a750 con 0x7f85b814f850 2023-11-18T20:59:24.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.228+0000 7f85bf445640 1 -- 172.21.15.49:0/3924553038 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b81446e0 con 0x7f85b814f850 2023-11-18T20:59:24.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.228+0000 7f85bf445640 1 -- 172.21.15.49:0/3924553038 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b81448d0 con 0x7f85b814f850 2023-11-18T20:59:24.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.276+0000 7f85adffb640 1 -- 172.21.15.49:0/3924553038 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f85b00bf410 con 0x7f85b814f850 2023-11-18T20:59:24.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.276+0000 7f85adffb640 1 --2- 172.21.15.49:0/3924553038 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f859c0664c0 0x7f859c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:24.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.276+0000 7f85bd1e1640 1 --2- 172.21.15.49:0/3924553038 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f859c0664c0 0x7f859c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:24.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.280+0000 7f85bd1e1640 1 --2- 172.21.15.49:0/3924553038 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f859c0664c0 0x7f859c068980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f85b4002080 tx=0x7f85b4001670 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:24.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.552+0000 7f85adffb640 1 -- 172.21.15.49:0/3924553038 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f85b00f0400 con 0x7f85b814f850 2023-11-18T20:59:24.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.560+0000 7f85adffb640 1 -- 172.21.15.49:0/3924553038 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f85b00ec740 con 0x7f85b814f850 2023-11-18T20:59:24.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:24.744+0000 7f85bf445640 1 -- 172.21.15.49:0/3924553038 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f85b814a5b0 con 0x7f85b814f850 2023-11-18T20:59:25.325 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:59:25.327 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:59:26.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.484+0000 7f85adffb640 1 -- 172.21.15.49:0/3924553038 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f85b814a5b0 con 0x7f85b814f850 2023-11-18T20:59:26.486 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2023-11-18T20:59:26.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.488+0000 7f85bf445640 1 -- 172.21.15.49:0/3924553038 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f859c0664c0 msgr2=0x7f859c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:26.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.488+0000 7f85bf445640 1 --2- 172.21.15.49:0/3924553038 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f859c0664c0 0x7f859c068980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f85b4002080 tx=0x7f85b4001670 comp rx=0 tx=0).stop 2023-11-18T20:59:26.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.488+0000 7f85bf445640 1 -- 172.21.15.49:0/3924553038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b814f850 msgr2=0x7f85b81480e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:26.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.488+0000 7f85bf445640 1 --2- 172.21.15.49:0/3924553038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b814f850 0x7f85b81480e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f85b00ac000 tx=0x7f85b001ac90 comp rx=0 tx=0).stop 2023-11-18T20:59:26.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.488+0000 7f85bf445640 1 -- 172.21.15.49:0/3924553038 shutdown_connections 2023-11-18T20:59:26.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.488+0000 7f85bf445640 1 --2- 172.21.15.49:0/3924553038 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f859c0664c0 0x7f859c068980 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:26.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.488+0000 7f85bf445640 1 --2- 172.21.15.49:0/3924553038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b814f850 0x7f85b81480e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:26.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.488+0000 7f85bf445640 1 --2- 172.21.15.49:0/3924553038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b80c1ed0 0x7f85b8144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:26.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.488+0000 7f85bf445640 1 --2- 172.21.15.49:0/3924553038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85b8070ab0 0x7f85b8145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:26.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.488+0000 7f85bf445640 1 -- 172.21.15.49:0/3924553038 >> 172.21.15.49:0/3924553038 conn(0x7f85b806c6a0 msgr2=0x7f85b814e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:26.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.488+0000 7f85bf445640 1 -- 172.21.15.49:0/3924553038 shutdown_connections 2023-11-18T20:59:26.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.488+0000 7f85bf445640 1 -- 172.21.15.49:0/3924553038 wait complete. 2023-11-18T20:59:26.511 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-18T20:59:26.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.632+0000 7fcf87016640 1 Processor -- start 2023-11-18T20:59:26.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.632+0000 7fcf87016640 1 -- start start 2023-11-18T20:59:26.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.636+0000 7fcf87016640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf80151000 0x7fcf800c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:26.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.636+0000 7fcf87016640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf801513e0 0x7fcf80157120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:26.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.636+0000 7fcf87016640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf8006aeb0 0x7fcf8015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:26.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.636+0000 7fcf87016640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf800b20a0 con 0x7fcf8006aeb0 2023-11-18T20:59:26.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.636+0000 7fcf87016640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8015ab20 con 0x7fcf80151000 2023-11-18T20:59:26.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.636+0000 7fcf87016640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf80157760 con 0x7fcf801513e0 2023-11-18T20:59:26.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.692+0000 7fcf855b3640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf8006aeb0 0x7fcf8015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:26.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.692+0000 7fcf855b3640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf8006aeb0 0x7fcf8015afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55644/0 (socket says 172.21.15.49:55644) 2023-11-18T20:59:26.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.692+0000 7fcf855b3640 1 -- 172.21.15.49:0/1148210658 learned_addr learned my addr 172.21.15.49:0/1148210658 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:26.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.696+0000 7fcf855b3640 1 -- 172.21.15.49:0/1148210658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf801513e0 msgr2=0x7fcf80157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:26.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.696+0000 7fcf855b3640 1 --2- 172.21.15.49:0/1148210658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf801513e0 0x7fcf80157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:26.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.696+0000 7fcf855b3640 1 -- 172.21.15.49:0/1148210658 >> v2:172.21.15.106:3300/0 conn(0x7fcf80151000 msgr2=0x7fcf800c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:26.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.696+0000 7fcf855b3640 1 --2- 172.21.15.49:0/1148210658 >> v2:172.21.15.106:3300/0 conn(0x7fcf80151000 0x7fcf800c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:26.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.696+0000 7fcf855b3640 1 -- 172.21.15.49:0/1148210658 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf80157a40 con 0x7fcf8006aeb0 2023-11-18T20:59:26.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.700+0000 7fcf855b3640 1 --2- 172.21.15.49:0/1148210658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf8006aeb0 0x7fcf8015afb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcf800c96c0 tx=0x7fcf7001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2b74fd35705a09 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:26.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.708+0000 7fcf7f7fe640 1 -- 172.21.15.49:0/1148210658 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf700af400 con 0x7fcf8006aeb0 2023-11-18T20:59:26.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.708+0000 7fcf7f7fe640 1 -- 172.21.15.49:0/1148210658 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf700ab050 con 0x7fcf8006aeb0 2023-11-18T20:59:26.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.708+0000 7fcf7f7fe640 1 -- 172.21.15.49:0/1148210658 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf700af780 con 0x7fcf8006aeb0 2023-11-18T20:59:26.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.712+0000 7fcf87016640 1 -- 172.21.15.49:0/1148210658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf8006aeb0 msgr2=0x7fcf8015afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:26.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.712+0000 7fcf87016640 1 --2- 172.21.15.49:0/1148210658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf8006aeb0 0x7fcf8015afb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcf800c96c0 tx=0x7fcf7001f1c0 comp rx=0 tx=0).stop 2023-11-18T20:59:26.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.712+0000 7fcf87016640 1 -- 172.21.15.49:0/1148210658 shutdown_connections 2023-11-18T20:59:26.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.712+0000 7fcf87016640 1 --2- 172.21.15.49:0/1148210658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf8006aeb0 0x7fcf8015afb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:26.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.712+0000 7fcf87016640 1 --2- 172.21.15.49:0/1148210658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf801513e0 0x7fcf80157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:26.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.712+0000 7fcf87016640 1 --2- 172.21.15.49:0/1148210658 >> v2:172.21.15.106:3300/0 conn(0x7fcf80151000 0x7fcf800c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:26.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.712+0000 7fcf87016640 1 -- 172.21.15.49:0/1148210658 >> 172.21.15.49:0/1148210658 conn(0x7fcf8006b670 msgr2=0x7fcf8006ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:26.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.712+0000 7fcf87016640 1 -- 172.21.15.49:0/1148210658 shutdown_connections 2023-11-18T20:59:26.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.712+0000 7fcf87016640 1 -- 172.21.15.49:0/1148210658 wait complete. 2023-11-18T20:59:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.712+0000 7fcf87016640 1 Processor -- start 2023-11-18T20:59:26.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.712+0000 7fcf87016640 1 -- start start 2023-11-18T20:59:26.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.716+0000 7fcf87016640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf8006aeb0 0x7fcf8014e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:26.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.716+0000 7fcf87016640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf80151000 0x7fcf801468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:26.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.716+0000 7fcf87016640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf801513e0 0x7fcf80072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:26.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.716+0000 7fcf87016640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf801e1a10 con 0x7fcf80151000 2023-11-18T20:59:26.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.716+0000 7fcf87016640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf80146410 con 0x7fcf8006aeb0 2023-11-18T20:59:26.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.716+0000 7fcf87016640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf80145e00 con 0x7fcf801513e0 2023-11-18T20:59:26.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.716+0000 7fcf855b3640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf801513e0 0x7fcf80072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:26.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.716+0000 7fcf855b3640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf801513e0 0x7fcf80072050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:51468/0 (socket says 172.21.15.49:51468) 2023-11-18T20:59:26.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.716+0000 7fcf855b3640 1 -- 172.21.15.49:0/934077871 learned_addr learned my addr 172.21.15.49:0/934077871 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:26.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.716+0000 7fcf84db2640 1 --2- 172.21.15.49:0/934077871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf8006aeb0 0x7fcf8014e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:26.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.720+0000 7fcf7ffff640 1 --2- 172.21.15.49:0/934077871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf80151000 0x7fcf801468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:26.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.720+0000 7fcf855b3640 1 -- 172.21.15.49:0/934077871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf8006aeb0 msgr2=0x7fcf8014e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:26.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.720+0000 7fcf855b3640 1 --2- 172.21.15.49:0/934077871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf8006aeb0 0x7fcf8014e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:26.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.720+0000 7fcf855b3640 1 -- 172.21.15.49:0/934077871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf80151000 msgr2=0x7fcf801468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:26.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.720+0000 7fcf855b3640 1 --2- 172.21.15.49:0/934077871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf80151000 0x7fcf801468a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:26.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.720+0000 7fcf855b3640 1 -- 172.21.15.49:0/934077871 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf70009b30 con 0x7fcf801513e0 2023-11-18T20:59:26.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.724+0000 7fcf855b3640 1 --2- 172.21.15.49:0/934077871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf801513e0 0x7fcf80072050 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcf7001d870 tx=0x7fcf7001bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:26.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.728+0000 7fcf7d7fa640 1 -- 172.21.15.49:0/934077871 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf700c1070 con 0x7fcf801513e0 2023-11-18T20:59:26.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.728+0000 7fcf7d7fa640 1 -- 172.21.15.49:0/934077871 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf700afb40 con 0x7fcf801513e0 2023-11-18T20:59:26.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.728+0000 7fcf7d7fa640 1 -- 172.21.15.49:0/934077871 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf700b9410 con 0x7fcf801513e0 2023-11-18T20:59:26.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.728+0000 7fcf87016640 1 -- 172.21.15.49:0/934077871 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf801f2dd0 con 0x7fcf801513e0 2023-11-18T20:59:26.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.728+0000 7fcf87016640 1 -- 172.21.15.49:0/934077871 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf801f30b0 con 0x7fcf801513e0 2023-11-18T20:59:26.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.728+0000 7fcf87016640 1 -- 172.21.15.49:0/934077871 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf80146580 con 0x7fcf801513e0 2023-11-18T20:59:26.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.748+0000 7fcf7d7fa640 1 -- 172.21.15.49:0/934077871 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf700b6050 con 0x7fcf801513e0 2023-11-18T20:59:26.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.748+0000 7fcf7d7fa640 1 --2- 172.21.15.49:0/934077871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf600664c0 0x7fcf60068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:26.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.748+0000 7fcf84db2640 1 --2- 172.21.15.49:0/934077871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf600664c0 0x7fcf60068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:26.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.748+0000 7fcf84db2640 1 --2- 172.21.15.49:0/934077871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf600664c0 0x7fcf60068980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009990 tx=0x7fcf78009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:26.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:26.752+0000 7fcf7d7fa640 1 -- 172.21.15.49:0/934077871 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fcf700f4140 con 0x7fcf801513e0 2023-11-18T20:59:27.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:27.044+0000 7fcf7d7fa640 1 -- 172.21.15.49:0/934077871 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf700efd80 con 0x7fcf801513e0 2023-11-18T20:59:27.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:27.248+0000 7fcf87016640 1 -- 172.21.15.49:0/934077871 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcf80073e70 con 0x7fcf801513e0 2023-11-18T20:59:29.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.416+0000 7fcf7d7fa640 1 -- 172.21.15.49:0/934077871 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v5) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcf700b4020 con 0x7fcf801513e0 2023-11-18T20:59:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 2 and data pool 3 2023-11-18T20:59:29.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.420+0000 7fcf87016640 1 -- 172.21.15.49:0/934077871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf600664c0 msgr2=0x7fcf60068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:29.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.420+0000 7fcf87016640 1 --2- 172.21.15.49:0/934077871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf600664c0 0x7fcf60068980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009990 tx=0x7fcf78009110 comp rx=0 tx=0).stop 2023-11-18T20:59:29.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.420+0000 7fcf87016640 1 -- 172.21.15.49:0/934077871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf801513e0 msgr2=0x7fcf80072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:29.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.420+0000 7fcf87016640 1 --2- 172.21.15.49:0/934077871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf801513e0 0x7fcf80072050 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcf7001d870 tx=0x7fcf7001bf60 comp rx=0 tx=0).stop 2023-11-18T20:59:29.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.420+0000 7fcf87016640 1 -- 172.21.15.49:0/934077871 shutdown_connections 2023-11-18T20:59:29.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.420+0000 7fcf87016640 1 --2- 172.21.15.49:0/934077871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf600664c0 0x7fcf60068980 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:29.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.420+0000 7fcf87016640 1 --2- 172.21.15.49:0/934077871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf801513e0 0x7fcf80072050 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:29.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.420+0000 7fcf87016640 1 --2- 172.21.15.49:0/934077871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf80151000 0x7fcf801468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:29.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.420+0000 7fcf87016640 1 --2- 172.21.15.49:0/934077871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf8006aeb0 0x7fcf8014e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:29.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.420+0000 7fcf87016640 1 -- 172.21.15.49:0/934077871 >> 172.21.15.49:0/934077871 conn(0x7fcf8006b670 msgr2=0x7fcf8006ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:29.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.420+0000 7fcf87016640 1 -- 172.21.15.49:0/934077871 shutdown_connections 2023-11-18T20:59:29.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.420+0000 7fcf87016640 1 -- 172.21.15.49:0/934077871 wait complete. 2023-11-18T20:59:29.447 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-18T20:59:29.447 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-18T20:59:29.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.580+0000 7f583d122640 1 Processor -- start 2023-11-18T20:59:29.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.580+0000 7f583d122640 1 -- start start 2023-11-18T20:59:29.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.584+0000 7f583d122640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58380ce0c0 0x7f58380ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:29.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.584+0000 7f583d122640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f583815a280 0x7f5838163e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:29.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.584+0000 7f583d122640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58380cd9a0 con 0x7f58380cc3c0 2023-11-18T20:59:29.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.584+0000 7f583d122640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58380ca550 con 0x7f583815a280 2023-11-18T20:59:29.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.584+0000 7f583d122640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58380ce9e0 con 0x7f58380ce0c0 2023-11-18T20:59:29.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.588+0000 7f5836d9d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58380ce0c0 0x7f58380ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:29.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.588+0000 7f5836d9d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58380ce0c0 0x7f58380ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:51484/0 (socket says 172.21.15.49:51484) 2023-11-18T20:59:29.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.588+0000 7f5836d9d640 1 -- 172.21.15.49:0/2646149430 learned_addr learned my addr 172.21.15.49:0/2646149430 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.592+0000 7f5836d9d640 1 -- 172.21.15.49:0/2646149430 >> v2:172.21.15.106:3300/0 conn(0x7f583815a280 msgr2=0x7f5838163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.592+0000 7f5836d9d640 1 --2- 172.21.15.49:0/2646149430 >> v2:172.21.15.106:3300/0 conn(0x7f583815a280 0x7f5838163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.592+0000 7f5836d9d640 1 -- 172.21.15.49:0/2646149430 >> v1:172.21.15.106:6789/0 conn(0x7f58380cc3c0 legacy=0x7f5838159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.592+0000 7f5836d9d640 1 -- 172.21.15.49:0/2646149430 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58381596c0 con 0x7f58380ce0c0 2023-11-18T20:59:29.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.600+0000 7f5836d9d640 1 --2- 172.21.15.49:0/2646149430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58380ce0c0 0x7f58380ce4a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5828009870 tx=0x7f582801c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=809e0b008d52bf1e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:29.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f5835d9b640 1 -- 172.21.15.49:0/2646149430 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280aa620 con 0x7f58380ce0c0 2023-11-18T20:59:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f5835d9b640 1 -- 172.21.15.49:0/2646149430 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58280aa780 con 0x7f58380ce0c0 2023-11-18T20:59:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f5835d9b640 1 -- 172.21.15.49:0/2646149430 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280aab10 con 0x7f58380ce0c0 2023-11-18T20:59:29.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 -- 172.21.15.49:0/2646149430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58380ce0c0 msgr2=0x7f58380ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:29.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 --2- 172.21.15.49:0/2646149430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58380ce0c0 0x7f58380ce4a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5828009870 tx=0x7f582801c500 comp rx=0 tx=0).stop 2023-11-18T20:59:29.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 -- 172.21.15.49:0/2646149430 shutdown_connections 2023-11-18T20:59:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 --2- 172.21.15.49:0/2646149430 >> v2:172.21.15.106:3300/0 conn(0x7f583815a280 0x7f5838163e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 --2- 172.21.15.49:0/2646149430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58380ce0c0 0x7f58380ce4a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 -- 172.21.15.49:0/2646149430 >> 172.21.15.49:0/2646149430 conn(0x7f58380b07c0 msgr2=0x7f58380b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 -- 172.21.15.49:0/2646149430 shutdown_connections 2023-11-18T20:59:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 -- 172.21.15.49:0/2646149430 wait complete. 2023-11-18T20:59:29.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 Processor -- start 2023-11-18T20:59:29.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 -- start start 2023-11-18T20:59:29.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58380cc3c0 0x7f583814d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:29.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58380ce0c0 0x7f58380b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:29.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f583815a280 0x7f58380b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:29.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583814db20 con 0x7f58380cc3c0 2023-11-18T20:59:29.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583814e040 con 0x7f58380ce0c0 2023-11-18T20:59:29.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f583d122640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58380b1d40 con 0x7f583815a280 2023-11-18T20:59:29.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.604+0000 7f5836d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58380cc3c0 0x7f583814d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:29.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.608+0000 7f5836d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58380cc3c0 0x7f583814d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55654/0 (socket says 172.21.15.49:55654) 2023-11-18T20:59:29.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.608+0000 7f5836d9d640 1 -- 172.21.15.49:0/2882172744 learned_addr learned my addr 172.21.15.49:0/2882172744 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:29.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.608+0000 7f583759e640 1 --2- 172.21.15.49:0/2882172744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f583815a280 0x7f58380b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:29.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.612+0000 7f5836d9d640 1 -- 172.21.15.49:0/2882172744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f583815a280 msgr2=0x7f58380b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:29.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.612+0000 7f5836d9d640 1 --2- 172.21.15.49:0/2882172744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f583815a280 0x7f58380b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:29.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.612+0000 7f5836d9d640 1 -- 172.21.15.49:0/2882172744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58380ce0c0 msgr2=0x7f58380b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:29.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.612+0000 7f5836d9d640 1 --2- 172.21.15.49:0/2882172744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58380ce0c0 0x7f58380b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:29.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.612+0000 7f5836d9d640 1 -- 172.21.15.49:0/2882172744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280094d0 con 0x7f58380cc3c0 2023-11-18T20:59:29.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.612+0000 7f5836d9d640 1 --2- 172.21.15.49:0/2882172744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58380cc3c0 0x7f583814d5e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f582801abb0 tx=0x7f582801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:29.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.620+0000 7f581f7fe640 1 -- 172.21.15.49:0/2882172744 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280bd3f0 con 0x7f58380cc3c0 2023-11-18T20:59:29.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.620+0000 7f581f7fe640 1 -- 172.21.15.49:0/2882172744 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58280bd550 con 0x7f58380cc3c0 2023-11-18T20:59:29.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.620+0000 7f583d122640 1 -- 172.21.15.49:0/2882172744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58380b1fd0 con 0x7f58380cc3c0 2023-11-18T20:59:29.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.620+0000 7f581f7fe640 1 -- 172.21.15.49:0/2882172744 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280bd900 con 0x7f58380cc3c0 2023-11-18T20:59:29.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.620+0000 7f583d122640 1 -- 172.21.15.49:0/2882172744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58381f30a0 con 0x7f58380cc3c0 2023-11-18T20:59:29.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.620+0000 7f583d122640 1 -- 172.21.15.49:0/2882172744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5838067520 con 0x7f58380cc3c0 2023-11-18T20:59:29.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.920+0000 7f581f7fe640 1 -- 172.21.15.49:0/2882172744 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f58280c7410 con 0x7f58380cc3c0 2023-11-18T20:59:29.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.920+0000 7f581f7fe640 1 --2- 172.21.15.49:0/2882172744 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58240664c0 0x7f5824068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:29.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.920+0000 7f583659c640 1 --2- 172.21.15.49:0/2882172744 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58240664c0 0x7f5824068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:29.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.924+0000 7f583659c640 1 --2- 172.21.15.49:0/2882172744 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58240664c0 0x7f5824068980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f582c007fd0 tx=0x7f582c0079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:29.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.956+0000 7f581f7fe640 1 -- 172.21.15.49:0/2882172744 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58280ef8d0 con 0x7f58380cc3c0 2023-11-18T20:59:29.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:29.956+0000 7f581f7fe640 1 -- 172.21.15.49:0/2882172744 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58280ebc10 con 0x7f58380cc3c0 2023-11-18T20:59:30.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:30.140+0000 7f583d122640 1 -- 172.21.15.49:0/2882172744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f58380b4c30 con 0x7f58380cc3c0 2023-11-18T20:59:31.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.416+0000 7f581f7fe640 1 -- 172.21.15.49:0/2882172744 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v25) v1 ==== 157+0+0 (secure 0 0 0) 0x7f58280ef230 con 0x7f58380cc3c0 2023-11-18T20:59:31.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.420+0000 7f583d122640 1 -- 172.21.15.49:0/2882172744 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58240664c0 msgr2=0x7f5824068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:31.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.420+0000 7f583d122640 1 --2- 172.21.15.49:0/2882172744 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58240664c0 0x7f5824068980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f582c007fd0 tx=0x7f582c0079a0 comp rx=0 tx=0).stop 2023-11-18T20:59:31.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.420+0000 7f583d122640 1 -- 172.21.15.49:0/2882172744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58380cc3c0 msgr2=0x7f583814d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:31.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.420+0000 7f583d122640 1 --2- 172.21.15.49:0/2882172744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58380cc3c0 0x7f583814d5e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f582801abb0 tx=0x7f582801ad40 comp rx=0 tx=0).stop 2023-11-18T20:59:31.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.420+0000 7f583d122640 1 -- 172.21.15.49:0/2882172744 shutdown_connections 2023-11-18T20:59:31.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.420+0000 7f583d122640 1 --2- 172.21.15.49:0/2882172744 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58240664c0 0x7f5824068980 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:31.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.420+0000 7f583d122640 1 --2- 172.21.15.49:0/2882172744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f583815a280 0x7f58380b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:31.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.420+0000 7f583d122640 1 --2- 172.21.15.49:0/2882172744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58380ce0c0 0x7f58380b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:31.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.420+0000 7f583d122640 1 --2- 172.21.15.49:0/2882172744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58380cc3c0 0x7f583814d5e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:31.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.420+0000 7f583d122640 1 -- 172.21.15.49:0/2882172744 >> 172.21.15.49:0/2882172744 conn(0x7f58380b07c0 msgr2=0x7f5838152ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:31.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.420+0000 7f583d122640 1 -- 172.21.15.49:0/2882172744 shutdown_connections 2023-11-18T20:59:31.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.420+0000 7f583d122640 1 -- 172.21.15.49:0/2882172744 wait complete. 2023-11-18T20:59:31.443 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-18T20:59:31.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.592+0000 7fc97b95e640 1 Processor -- start 2023-11-18T20:59:31.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.592+0000 7fc97b95e640 1 -- start start 2023-11-18T20:59:31.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.592+0000 7fc97b95e640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9740cc290 0x7fc9740727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:31.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.592+0000 7fc97b95e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc9740cc670 0x7fc974153180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:31.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.592+0000 7fc97b95e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc974159420 con 0x7fc9740c6790 2023-11-18T20:59:31.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.592+0000 7fc97b95e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97415c910 con 0x7fc9740cc670 2023-11-18T20:59:31.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.592+0000 7fc97b95e640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97415cbb0 con 0x7fc9740cc290 2023-11-18T20:59:31.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.596+0000 7fc9796fa640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9740cc290 0x7fc9740727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:31.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.596+0000 7fc9796fa640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9740cc290 0x7fc9740727f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:51496/0 (socket says 172.21.15.49:51496) 2023-11-18T20:59:31.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.596+0000 7fc9796fa640 1 -- 172.21.15.49:0/2846583091 learned_addr learned my addr 172.21.15.49:0/2846583091 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:31.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.604+0000 7fc9796fa640 1 -- 172.21.15.49:0/2846583091 >> v2:172.21.15.106:3300/0 conn(0x7fc9740cc670 msgr2=0x7fc974153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:31.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.604+0000 7fc9796fa640 1 --2- 172.21.15.49:0/2846583091 >> v2:172.21.15.106:3300/0 conn(0x7fc9740cc670 0x7fc974153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:31.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.604+0000 7fc9796fa640 1 -- 172.21.15.49:0/2846583091 >> v1:172.21.15.106:6789/0 conn(0x7fc9740c6790 legacy=0x7fc9741598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:31.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.604+0000 7fc9796fa640 1 -- 172.21.15.49:0/2846583091 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97415ce90 con 0x7fc9740cc290 2023-11-18T20:59:31.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.608+0000 7fc9796fa640 1 --2- 172.21.15.49:0/2846583091 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9740cc290 0x7fc9740727f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc970009870 tx=0x7fc97001ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d65da740e3ac082a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:31.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.616+0000 7fc96bfff640 1 -- 172.21.15.49:0/2846583091 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700a89b0 con 0x7fc9740cc290 2023-11-18T20:59:31.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.616+0000 7fc96bfff640 1 -- 172.21.15.49:0/2846583091 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9700a8b10 con 0x7fc9740cc290 2023-11-18T20:59:31.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.616+0000 7fc96bfff640 1 -- 172.21.15.49:0/2846583091 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700a8ea0 con 0x7fc9740cc290 2023-11-18T20:59:31.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 -- 172.21.15.49:0/2846583091 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9740cc290 msgr2=0x7fc9740727f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:31.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 --2- 172.21.15.49:0/2846583091 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9740cc290 0x7fc9740727f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc970009870 tx=0x7fc97001ecf0 comp rx=0 tx=0).stop 2023-11-18T20:59:31.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 -- 172.21.15.49:0/2846583091 shutdown_connections 2023-11-18T20:59:31.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 --2- 172.21.15.49:0/2846583091 >> v2:172.21.15.106:3300/0 conn(0x7fc9740cc670 0x7fc974153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:31.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 --2- 172.21.15.49:0/2846583091 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9740cc290 0x7fc9740727f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:31.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 -- 172.21.15.49:0/2846583091 >> 172.21.15.49:0/2846583091 conn(0x7fc97406b670 msgr2=0x7fc97406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:31.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 -- 172.21.15.49:0/2846583091 shutdown_connections 2023-11-18T20:59:31.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 -- 172.21.15.49:0/2846583091 wait complete. 2023-11-18T20:59:31.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 Processor -- start 2023-11-18T20:59:31.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 -- start start 2023-11-18T20:59:31.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9740c6790 0x7fc9741efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:31.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9740cc290 0x7fc97414da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:31.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9740cc670 0x7fc97415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:31.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9741f0120 con 0x7fc9740c6790 2023-11-18T20:59:31.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740cb1a0 con 0x7fc9740cc670 2023-11-18T20:59:31.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.620+0000 7fc97b95e640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740cb6d0 con 0x7fc9740cc290 2023-11-18T20:59:31.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.624+0000 7fc979efb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9740cc670 0x7fc97415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:31.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.624+0000 7fc978ef9640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9740cc290 0x7fc97414da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:31.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.624+0000 7fc979efb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9740cc670 0x7fc97415a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:52210/0 (socket says 172.21.15.49:52210) 2023-11-18T20:59:31.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.624+0000 7fc979efb640 1 -- 172.21.15.49:0/3165831661 learned_addr learned my addr 172.21.15.49:0/3165831661 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:31.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.632+0000 7fc979efb640 1 -- 172.21.15.49:0/3165831661 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9740cc290 msgr2=0x7fc97414da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:31.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.632+0000 7fc979efb640 1 --2- 172.21.15.49:0/3165831661 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9740cc290 0x7fc97414da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:31.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.632+0000 7fc979efb640 1 -- 172.21.15.49:0/3165831661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9740c6790 msgr2=0x7fc9741efbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:31.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.632+0000 7fc979efb640 1 --2- 172.21.15.49:0/3165831661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9740c6790 0x7fc9741efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:31.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.632+0000 7fc979efb640 1 -- 172.21.15.49:0/3165831661 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9700094d0 con 0x7fc9740cc670 2023-11-18T20:59:31.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.640+0000 7fc979efb640 1 --2- 172.21.15.49:0/3165831661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9740cc670 0x7fc97415a4e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00c780 tx=0x7fc96c00cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.648+0000 7fc969ffb640 1 -- 172.21.15.49:0/3165831661 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c003d90 con 0x7fc9740cc670 2023-11-18T20:59:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.648+0000 7fc969ffb640 1 -- 172.21.15.49:0/3165831661 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c00ce30 con 0x7fc9740cc670 2023-11-18T20:59:31.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.648+0000 7fc969ffb640 1 -- 172.21.15.49:0/3165831661 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c005290 con 0x7fc9740cc670 2023-11-18T20:59:31.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.648+0000 7fc97b95e640 1 -- 172.21.15.49:0/3165831661 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9740ca660 con 0x7fc9740cc670 2023-11-18T20:59:31.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.648+0000 7fc97b95e640 1 -- 172.21.15.49:0/3165831661 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9740c98a0 con 0x7fc9740cc670 2023-11-18T20:59:31.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.648+0000 7fc97b95e640 1 -- 172.21.15.49:0/3165831661 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9740c2d70 con 0x7fc9740cc670 2023-11-18T20:59:31.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.996+0000 7fc969ffb640 1 -- 172.21.15.49:0/3165831661 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc96c0053f0 con 0x7fc9740cc670 2023-11-18T20:59:31.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.996+0000 7fc969ffb640 1 --2- 172.21.15.49:0/3165831661 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc9580664c0 0x7fc958068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:31.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.996+0000 7fc9796fa640 1 --2- 172.21.15.49:0/3165831661 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc9580664c0 0x7fc958068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:31.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:31.996+0000 7fc9796fa640 1 --2- 172.21.15.49:0/3165831661 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc9580664c0 0x7fc958068980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc9700b2000 tx=0x7fc970004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:32.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:32.004+0000 7fc969ffb640 1 -- 172.21.15.49:0/3165831661 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fc96c054cb0 con 0x7fc9740cc670 2023-11-18T20:59:32.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:32.028+0000 7fc969ffb640 1 -- 172.21.15.49:0/3165831661 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc96c050ff0 con 0x7fc9740cc670 2023-11-18T20:59:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:32.284+0000 7fc97b95e640 1 -- 172.21.15.49:0/3165831661 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc9740cb8a0 con 0x7fc9740cc670 2023-11-18T20:59:34.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.668+0000 7fc969ffb640 1 -- 172.21.15.49:0/3165831661 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v27) v1 ==== 228+0+0 (secure 0 0 0) 0x7fc96c017070 con 0x7fc9740cc670 2023-11-18T20:59:34.671 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data_ec' created 2023-11-18T20:59:34.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.676+0000 7fc97b95e640 1 -- 172.21.15.49:0/3165831661 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc9580664c0 msgr2=0x7fc958068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:34.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.676+0000 7fc97b95e640 1 --2- 172.21.15.49:0/3165831661 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc9580664c0 0x7fc958068980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc9700b2000 tx=0x7fc970004740 comp rx=0 tx=0).stop 2023-11-18T20:59:34.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.676+0000 7fc97b95e640 1 -- 172.21.15.49:0/3165831661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9740cc670 msgr2=0x7fc97415a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:34.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.676+0000 7fc97b95e640 1 --2- 172.21.15.49:0/3165831661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9740cc670 0x7fc97415a4e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00c780 tx=0x7fc96c00cc40 comp rx=0 tx=0).stop 2023-11-18T20:59:34.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.676+0000 7fc97b95e640 1 -- 172.21.15.49:0/3165831661 shutdown_connections 2023-11-18T20:59:34.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.676+0000 7fc97b95e640 1 --2- 172.21.15.49:0/3165831661 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc9580664c0 0x7fc958068980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:34.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.676+0000 7fc97b95e640 1 --2- 172.21.15.49:0/3165831661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9740cc670 0x7fc97415a4e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:34.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.676+0000 7fc97b95e640 1 --2- 172.21.15.49:0/3165831661 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9740cc290 0x7fc97414da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:34.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.676+0000 7fc97b95e640 1 --2- 172.21.15.49:0/3165831661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9740c6790 0x7fc9741efbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:34.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.676+0000 7fc97b95e640 1 -- 172.21.15.49:0/3165831661 >> 172.21.15.49:0/3165831661 conn(0x7fc97406b670 msgr2=0x7fc97406f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:34.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.676+0000 7fc97b95e640 1 -- 172.21.15.49:0/3165831661 shutdown_connections 2023-11-18T20:59:34.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.676+0000 7fc97b95e640 1 -- 172.21.15.49:0/3165831661 wait complete. 2023-11-18T20:59:34.701 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-18T20:59:34.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.828+0000 7fd100ff4640 1 Processor -- start 2023-11-18T20:59:34.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.828+0000 7fd100ff4640 1 -- start start 2023-11-18T20:59:34.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.828+0000 7fd100ff4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd0fc0cc470 0x7fd0fc1572c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:34.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.828+0000 7fd100ff4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc0c9aa0 con 0x7fd0fc0ccfb0 2023-11-18T20:59:34.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.828+0000 7fd100ff4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc15adb0 con 0x7fd0fc15a830 2023-11-18T20:59:34.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.828+0000 7fd100ff4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0fc0cc880 con 0x7fd0fc0cc470 2023-11-18T20:59:34.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.832+0000 7fd0fad9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd0fc0cc470 0x7fd0fc1572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:34.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.832+0000 7fd0fa59c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd0fc0ccfb0 0x7fd0fc151160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45416/0 (socket says 172.21.15.49:45416) 2023-11-18T20:59:34.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.832+0000 7fd0fa59c640 1 -- 172.21.15.49:0/3834500122 learned_addr learned my addr 172.21.15.49:0/3834500122 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:59:34.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.836+0000 7fd0fad9d640 1 -- 172.21.15.49:0/3834500122 >> v1:172.21.15.106:6789/0 conn(0x7fd0fc15a830 legacy=0x7fd0fc15fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:34.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.836+0000 7fd0fad9d640 1 -- 172.21.15.49:0/3834500122 >> v1:172.21.15.49:6789/0 conn(0x7fd0fc0ccfb0 legacy=0x7fd0fc151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:34.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.836+0000 7fd0fad9d640 1 -- 172.21.15.49:0/3834500122 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc15b050 con 0x7fd0fc0cc470 2023-11-18T20:59:34.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.840+0000 7fd0fad9d640 1 --2- 172.21.15.49:0/3834500122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0fc0cc470 0x7fd0fc1572c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009d90 tx=0x7fd0f401f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0d7a5e15841b4c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:34.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.844+0000 7fd0f9d9b640 1 -- 172.21.15.49:0/3834500122 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40af600 con 0x7fd0fc0cc470 2023-11-18T20:59:34.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd0f9d9b640 1 -- 172.21.15.49:0/3834500122 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f40ab050 con 0x7fd0fc0cc470 2023-11-18T20:59:34.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd0f9d9b640 1 -- 172.21.15.49:0/3834500122 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40af980 con 0x7fd0fc0cc470 2023-11-18T20:59:34.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 -- 172.21.15.49:0/3834500122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0fc0cc470 msgr2=0x7fd0fc1572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:34.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 --2- 172.21.15.49:0/3834500122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0fc0cc470 0x7fd0fc1572c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009d90 tx=0x7fd0f401f100 comp rx=0 tx=0).stop 2023-11-18T20:59:34.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 -- 172.21.15.49:0/3834500122 shutdown_connections 2023-11-18T20:59:34.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 --2- 172.21.15.49:0/3834500122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0fc0cc470 0x7fd0fc1572c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:34.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 -- 172.21.15.49:0/3834500122 >> 172.21.15.49:0/3834500122 conn(0x7fd0fc061400 msgr2=0x7fd0fc061810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:34.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 -- 172.21.15.49:0/3834500122 shutdown_connections 2023-11-18T20:59:34.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 -- 172.21.15.49:0/3834500122 wait complete. 2023-11-18T20:59:34.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 Processor -- start 2023-11-18T20:59:34.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 -- start start 2023-11-18T20:59:34.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0fc0cc470 0x7fd0fc1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:34.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0fc0ccfb0 0x7fd0fc155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:34.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0fc15a830 0x7fd0fc1efc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:34.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc1ef7e0 con 0x7fd0fc0ccfb0 2023-11-18T20:59:34.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc1557e0 con 0x7fd0fc15a830 2023-11-18T20:59:34.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd100ff4640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc155ac0 con 0x7fd0fc0cc470 2023-11-18T20:59:34.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd0f3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0fc0ccfb0 0x7fd0fc155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:34.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd0f3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0fc0ccfb0 0x7fd0fc155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55672/0 (socket says 172.21.15.49:55672) 2023-11-18T20:59:34.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.848+0000 7fd0f3fff640 1 -- 172.21.15.49:0/850026692 learned_addr learned my addr 172.21.15.49:0/850026692 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:34.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.852+0000 7fd0f3fff640 1 -- 172.21.15.49:0/850026692 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0fc0cc470 msgr2=0x7fd0fc1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:34.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.852+0000 7fd0f3fff640 1 --2- 172.21.15.49:0/850026692 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0fc0cc470 0x7fd0fc1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:34.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.852+0000 7fd0f3fff640 1 -- 172.21.15.49:0/850026692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0fc15a830 msgr2=0x7fd0fc1efc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:34.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.852+0000 7fd0f3fff640 1 --2- 172.21.15.49:0/850026692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0fc15a830 0x7fd0fc1efc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:34.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.852+0000 7fd0f3fff640 1 -- 172.21.15.49:0/850026692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f4009a70 con 0x7fd0fc0ccfb0 2023-11-18T20:59:34.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.856+0000 7fd0f3fff640 1 --2- 172.21.15.49:0/850026692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0fc0ccfb0 0x7fd0fc155130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400c490 tx=0x7fd0e4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:34.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.860+0000 7fd0f2ffd640 1 -- 172.21.15.49:0/850026692 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4003600 con 0x7fd0fc0ccfb0 2023-11-18T20:59:34.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.860+0000 7fd0f2ffd640 1 -- 172.21.15.49:0/850026692 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e4003780 con 0x7fd0fc0ccfb0 2023-11-18T20:59:34.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.860+0000 7fd100ff4640 1 -- 172.21.15.49:0/850026692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0fc155da0 con 0x7fd0fc0ccfb0 2023-11-18T20:59:34.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.860+0000 7fd0f2ffd640 1 -- 172.21.15.49:0/850026692 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4003b70 con 0x7fd0fc0ccfb0 2023-11-18T20:59:34.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.860+0000 7fd100ff4640 1 -- 172.21.15.49:0/850026692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0fc1ef120 con 0x7fd0fc0ccfb0 2023-11-18T20:59:34.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:34.860+0000 7fd100ff4640 1 -- 172.21.15.49:0/850026692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0fc073e70 con 0x7fd0fc0ccfb0 2023-11-18T20:59:35.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.156+0000 7fd0f2ffd640 1 -- 172.21.15.49:0/850026692 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0e4003cd0 con 0x7fd0fc0ccfb0 2023-11-18T20:59:35.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.156+0000 7fd0f2ffd640 1 --2- 172.21.15.49:0/850026692 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd0dc0664c0 0x7fd0dc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:35.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.160+0000 7fd0fa59c640 1 --2- 172.21.15.49:0/850026692 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd0dc0664c0 0x7fd0dc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:35.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.160+0000 7fd0fa59c640 1 --2- 172.21.15.49:0/850026692 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd0dc0664c0 0x7fd0dc068980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec000f70 tx=0x7fd0ec007a90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:35.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.196+0000 7fd0f2ffd640 1 -- 172.21.15.49:0/850026692 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fd0e40551b0 con 0x7fd0fc0ccfb0 2023-11-18T20:59:35.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.196+0000 7fd0f2ffd640 1 -- 172.21.15.49:0/850026692 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd0e4050df0 con 0x7fd0fc0ccfb0 2023-11-18T20:59:35.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.368+0000 7fd100ff4640 1 -- 172.21.15.49:0/850026692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fd0fc1ef920 con 0x7fd0fc0ccfb0 2023-11-18T20:59:35.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.672+0000 7fd0f2ffd640 1 -- 172.21.15.49:0/850026692 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd0fc1ef920 con 0x7fd0fc0ccfb0 2023-11-18T20:59:35.674 INFO:teuthology.orchestra.run.smithi049.stderr:set pool 4 allow_ec_overwrites to true 2023-11-18T20:59:35.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.676+0000 7fd100ff4640 1 -- 172.21.15.49:0/850026692 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd0dc0664c0 msgr2=0x7fd0dc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:35.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.676+0000 7fd100ff4640 1 --2- 172.21.15.49:0/850026692 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd0dc0664c0 0x7fd0dc068980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec000f70 tx=0x7fd0ec007a90 comp rx=0 tx=0).stop 2023-11-18T20:59:35.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.676+0000 7fd100ff4640 1 -- 172.21.15.49:0/850026692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0fc0ccfb0 msgr2=0x7fd0fc155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:35.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.676+0000 7fd100ff4640 1 --2- 172.21.15.49:0/850026692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0fc0ccfb0 0x7fd0fc155130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400c490 tx=0x7fd0e4001e80 comp rx=0 tx=0).stop 2023-11-18T20:59:35.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.676+0000 7fd100ff4640 1 -- 172.21.15.49:0/850026692 shutdown_connections 2023-11-18T20:59:35.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.676+0000 7fd100ff4640 1 --2- 172.21.15.49:0/850026692 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd0dc0664c0 0x7fd0dc068980 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:35.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.676+0000 7fd100ff4640 1 --2- 172.21.15.49:0/850026692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0fc15a830 0x7fd0fc1efc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:35.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.676+0000 7fd100ff4640 1 --2- 172.21.15.49:0/850026692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0fc0ccfb0 0x7fd0fc155130 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:35.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.676+0000 7fd100ff4640 1 --2- 172.21.15.49:0/850026692 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0fc0cc470 0x7fd0fc1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:35.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.676+0000 7fd100ff4640 1 -- 172.21.15.49:0/850026692 >> 172.21.15.49:0/850026692 conn(0x7fd0fc061400 msgr2=0x7fd0fc0c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:35.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.676+0000 7fd100ff4640 1 -- 172.21.15.49:0/850026692 shutdown_connections 2023-11-18T20:59:35.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.676+0000 7fd100ff4640 1 -- 172.21.15.49:0/850026692 wait complete. 2023-11-18T20:59:35.697 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-18T20:59:35.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.840+0000 7f5e5bcf4640 1 Processor -- start 2023-11-18T20:59:35.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.840+0000 7f5e5bcf4640 1 -- start start 2023-11-18T20:59:35.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.844+0000 7f5e5bcf4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5e54070d90 0x7f5e540c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:35.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.844+0000 7f5e5bcf4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e54071a60 con 0x7f5e541537b0 2023-11-18T20:59:35.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.844+0000 7f5e5bcf4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5415da00 con 0x7f5e540c7de0 2023-11-18T20:59:35.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.844+0000 7f5e5bcf4640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5415d720 con 0x7f5e54070d90 2023-11-18T20:59:35.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.844+0000 7f5e5a291640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5e540c7de0 0x7f5e5415cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:43518/0 (socket says 172.21.15.49:43518) 2023-11-18T20:59:35.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.844+0000 7f5e5a291640 1 -- 172.21.15.49:0/1065961487 learned_addr learned my addr 172.21.15.49:0/1065961487 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:59:35.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.848+0000 7f5e5928f640 1 --2- 172.21.15.49:0/1065961487 >> v2:172.21.15.106:3300/0 conn(0x7f5e54070d90 0x7f5e540c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:35.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.856+0000 7f5e5928f640 1 -- 172.21.15.49:0/1065961487 >> v1:172.21.15.106:6789/0 conn(0x7f5e540c7de0 legacy=0x7f5e5415cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:35.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.856+0000 7f5e5928f640 1 -- 172.21.15.49:0/1065961487 >> v1:172.21.15.49:6789/0 conn(0x7f5e541537b0 legacy=0x7f5e54071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:35.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.856+0000 7f5e5928f640 1 -- 172.21.15.49:0/1065961487 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54159600 con 0x7f5e54070d90 2023-11-18T20:59:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.888+0000 7f5e5928f640 1 --2- 172.21.15.49:0/1065961487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e54070d90 0x7f5e540c78a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009d90 tx=0x7f5e4401f100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a79d8a441158c55 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:35.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.896+0000 7f5e58a8e640 1 -- 172.21.15.49:0/1065961487 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e440af600 con 0x7f5e54070d90 2023-11-18T20:59:35.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.896+0000 7f5e58a8e640 1 -- 172.21.15.49:0/1065961487 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e440ab050 con 0x7f5e54070d90 2023-11-18T20:59:35.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.896+0000 7f5e58a8e640 1 -- 172.21.15.49:0/1065961487 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e440af980 con 0x7f5e54070d90 2023-11-18T20:59:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/1065961487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e54070d90 msgr2=0x7f5e540c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 --2- 172.21.15.49:0/1065961487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e54070d90 0x7f5e540c78a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009d90 tx=0x7f5e4401f100 comp rx=0 tx=0).stop 2023-11-18T20:59:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/1065961487 shutdown_connections 2023-11-18T20:59:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 --2- 172.21.15.49:0/1065961487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e54070d90 0x7f5e540c78a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/1065961487 >> 172.21.15.49:0/1065961487 conn(0x7f5e5406c6a0 msgr2=0x7f5e5406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/1065961487 shutdown_connections 2023-11-18T20:59:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/1065961487 wait complete. 2023-11-18T20:59:35.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 Processor -- start 2023-11-18T20:59:35.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 -- start start 2023-11-18T20:59:35.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e54070d90 0x7f5e5415c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:35.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e540c7de0 0x7f5e541f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:35.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e541537b0 0x7f5e541e4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:35.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e541e4100 con 0x7f5e54070d90 2023-11-18T20:59:35.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e541f3440 con 0x7f5e540c7de0 2023-11-18T20:59:35.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.900+0000 7f5e5bcf4640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e541e35f0 con 0x7f5e541537b0 2023-11-18T20:59:35.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.904+0000 7f5e5a291640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e541537b0 0x7f5e541e4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:35.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.908+0000 7f5e5a291640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e541537b0 0x7f5e541e4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:55734/0 (socket says 172.21.15.49:55734) 2023-11-18T20:59:35.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.908+0000 7f5e5a291640 1 -- 172.21.15.49:0/592874076 learned_addr learned my addr 172.21.15.49:0/592874076 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:35.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.908+0000 7f5e5928f640 1 --2- 172.21.15.49:0/592874076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e540c7de0 0x7f5e541f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.916+0000 7f5e5a291640 1 -- 172.21.15.49:0/592874076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e540c7de0 msgr2=0x7f5e541f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.916+0000 7f5e5a291640 1 --2- 172.21.15.49:0/592874076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e540c7de0 0x7f5e541f2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.916+0000 7f5e5a291640 1 -- 172.21.15.49:0/592874076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e54070d90 msgr2=0x7f5e5415c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.916+0000 7f5e5a291640 1 --2- 172.21.15.49:0/592874076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e54070d90 0x7f5e5415c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.916+0000 7f5e5a291640 1 -- 172.21.15.49:0/592874076 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e44009a70 con 0x7f5e541537b0 2023-11-18T20:59:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.928+0000 7f5e5a291640 1 --2- 172.21.15.49:0/592874076 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e541537b0 0x7f5e541e4520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800c430 tx=0x7f5e4800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:35.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.936+0000 7f5e527fc640 1 -- 172.21.15.49:0/592874076 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e48005cf0 con 0x7f5e541537b0 2023-11-18T20:59:35.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.936+0000 7f5e527fc640 1 -- 172.21.15.49:0/592874076 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e48005e50 con 0x7f5e541537b0 2023-11-18T20:59:35.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.936+0000 7f5e527fc640 1 -- 172.21.15.49:0/592874076 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e480072d0 con 0x7f5e541537b0 2023-11-18T20:59:35.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.936+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/592874076 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e541f3160 con 0x7f5e541537b0 2023-11-18T20:59:35.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.936+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/592874076 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e541e3d20 con 0x7f5e541537b0 2023-11-18T20:59:35.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:35.940+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/592874076 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e540c72d0 con 0x7f5e541537b0 2023-11-18T20:59:36.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:36.240+0000 7f5e527fc640 1 -- 172.21.15.49:0/592874076 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5e48007430 con 0x7f5e541537b0 2023-11-18T20:59:36.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:36.240+0000 7f5e527fc640 1 --2- 172.21.15.49:0/592874076 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f5e40066470 0x7f5e40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:36.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:36.240+0000 7f5e59a90640 1 --2- 172.21.15.49:0/592874076 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f5e40066470 0x7f5e40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:36.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:36.240+0000 7f5e527fc640 1 -- 172.21.15.49:0/592874076 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f5e48054a10 con 0x7f5e541537b0 2023-11-18T20:59:36.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:36.240+0000 7f5e59a90640 1 --2- 172.21.15.49:0/592874076 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f5e40066470 0x7f5e40068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5e541f0080 tx=0x7f5e4c006bb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:36.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:36.252+0000 7f5e527fc640 1 -- 172.21.15.49:0/592874076 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5e48081e60 con 0x7f5e541537b0 2023-11-18T20:59:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:36.472+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/592874076 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f5e541e4240 con 0x7f5e541537b0 2023-11-18T20:59:37.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.636+0000 7f5e527fc640 1 -- 172.21.15.49:0/592874076 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v8) v1 ==== 137+0+0 (secure 0 0 0) 0x7f5e541e4240 con 0x7f5e541537b0 2023-11-18T20:59:37.638 INFO:teuthology.orchestra.run.smithi049.stderr:added data pool 4 to fsmap 2023-11-18T20:59:37.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.640+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/592874076 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f5e40066470 msgr2=0x7f5e40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:37.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.640+0000 7f5e5bcf4640 1 --2- 172.21.15.49:0/592874076 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f5e40066470 0x7f5e40068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5e541f0080 tx=0x7f5e4c006bb0 comp rx=0 tx=0).stop 2023-11-18T20:59:37.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.640+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/592874076 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e541537b0 msgr2=0x7f5e541e4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:37.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.640+0000 7f5e5bcf4640 1 --2- 172.21.15.49:0/592874076 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e541537b0 0x7f5e541e4520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800c430 tx=0x7f5e4800c8f0 comp rx=0 tx=0).stop 2023-11-18T20:59:37.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.640+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/592874076 shutdown_connections 2023-11-18T20:59:37.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.640+0000 7f5e5bcf4640 1 --2- 172.21.15.49:0/592874076 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f5e40066470 0x7f5e40068930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:37.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.640+0000 7f5e5bcf4640 1 --2- 172.21.15.49:0/592874076 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e541537b0 0x7f5e541e4520 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:37.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.640+0000 7f5e5bcf4640 1 --2- 172.21.15.49:0/592874076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e540c7de0 0x7f5e541f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:37.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.640+0000 7f5e5bcf4640 1 --2- 172.21.15.49:0/592874076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e54070d90 0x7f5e5415c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:37.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.640+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/592874076 >> 172.21.15.49:0/592874076 conn(0x7f5e5406c6a0 msgr2=0x7f5e54071200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:37.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.640+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/592874076 shutdown_connections 2023-11-18T20:59:37.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.640+0000 7f5e5bcf4640 1 -- 172.21.15.49:0/592874076 wait complete. 2023-11-18T20:59:37.663 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:59:37.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.788+0000 7f07e7c2d640 1 Processor -- start 2023-11-18T20:59:37.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.792+0000 7f07e7c2d640 1 -- start start 2023-11-18T20:59:37.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.792+0000 7f07e7c2d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f07e006b1a0 0x7f07e0159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:37.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.792+0000 7f07e7c2d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07e00c65f0 0x7f07e01532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:37.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.792+0000 7f07e7c2d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e00c2440 con 0x7f07e006adc0 2023-11-18T20:59:37.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.792+0000 7f07e7c2d640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e00c2720 con 0x7f07e00c65f0 2023-11-18T20:59:37.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.792+0000 7f07e7c2d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e00c2a00 con 0x7f07e006b1a0 2023-11-18T20:59:37.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.828+0000 7f07e61ca640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07e00c65f0 0x7f07e01532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:37.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.844+0000 7f07e51c8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f07e006b1a0 0x7f07e0159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:37.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.844+0000 7f07e59c9640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f07e006adc0 0x7f07e0072550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:43526/0 (socket says 172.21.15.49:43526) 2023-11-18T20:59:37.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.844+0000 7f07e59c9640 1 -- 172.21.15.49:0/3277493735 learned_addr learned my addr 172.21.15.49:0/3277493735 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:59:37.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.856+0000 7f07e51c8640 1 -- 172.21.15.49:0/3277493735 >> v2:172.21.15.49:3300/0 conn(0x7f07e00c65f0 msgr2=0x7f07e01532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:37.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.856+0000 7f07e51c8640 1 --2- 172.21.15.49:0/3277493735 >> v2:172.21.15.49:3300/0 conn(0x7f07e00c65f0 0x7f07e01532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:37.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.856+0000 7f07e51c8640 1 -- 172.21.15.49:0/3277493735 >> v1:172.21.15.106:6789/0 conn(0x7f07e006adc0 legacy=0x7f07e0072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:37.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.856+0000 7f07e51c8640 1 -- 172.21.15.49:0/3277493735 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e00c2ce0 con 0x7f07e006b1a0 2023-11-18T20:59:37.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.864+0000 7f07e51c8640 1 --2- 172.21.15.49:0/3277493735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e006b1a0 0x7f07e0159d70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f07e0157030 tx=0x7f07d001ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=238ebdb5d2575ebc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:37.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.872+0000 7f07e49c7640 1 -- 172.21.15.49:0/3277493735 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00a8950 con 0x7f07e006b1a0 2023-11-18T20:59:37.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.872+0000 7f07e49c7640 1 -- 172.21.15.49:0/3277493735 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d00a8ab0 con 0x7f07e006b1a0 2023-11-18T20:59:37.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.872+0000 7f07e49c7640 1 -- 172.21.15.49:0/3277493735 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00a8e40 con 0x7f07e006b1a0 2023-11-18T20:59:37.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.876+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3277493735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e006b1a0 msgr2=0x7f07e0159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:37.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.876+0000 7f07e7c2d640 1 --2- 172.21.15.49:0/3277493735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e006b1a0 0x7f07e0159d70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f07e0157030 tx=0x7f07d001ec50 comp rx=0 tx=0).stop 2023-11-18T20:59:37.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.876+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3277493735 shutdown_connections 2023-11-18T20:59:37.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.876+0000 7f07e7c2d640 1 --2- 172.21.15.49:0/3277493735 >> v2:172.21.15.49:3300/0 conn(0x7f07e00c65f0 0x7f07e01532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:37.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.876+0000 7f07e7c2d640 1 --2- 172.21.15.49:0/3277493735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e006b1a0 0x7f07e0159d70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:37.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.876+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3277493735 >> 172.21.15.49:0/3277493735 conn(0x7f07e0070160 msgr2=0x7f07e006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:37.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.876+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3277493735 shutdown_connections 2023-11-18T20:59:37.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.876+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3277493735 wait complete. 2023-11-18T20:59:37.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.876+0000 7f07e7c2d640 1 Processor -- start 2023-11-18T20:59:37.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.876+0000 7f07e7c2d640 1 -- start start 2023-11-18T20:59:37.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.880+0000 7f07e7c2d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e006adc0 0x7f07e015b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:37.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.880+0000 7f07e7c2d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07e006b1a0 0x7f07e01ef820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:37.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.880+0000 7f07e7c2d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07e00c65f0 0x7f07e0153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:37.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.880+0000 7f07e7c2d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01ef390 con 0x7f07e00c65f0 2023-11-18T20:59:37.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.880+0000 7f07e7c2d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01eed60 con 0x7f07e006adc0 2023-11-18T20:59:37.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.880+0000 7f07e7c2d640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01f2d80 con 0x7f07e006b1a0 2023-11-18T20:59:37.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.880+0000 7f07e51c8640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07e006b1a0 0x7f07e01ef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:37.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.880+0000 7f07e59c9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e006adc0 0x7f07e015b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:37.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.880+0000 7f07e51c8640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07e006b1a0 0x7f07e01ef820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:55748/0 (socket says 172.21.15.49:55748) 2023-11-18T20:59:37.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.880+0000 7f07e51c8640 1 -- 172.21.15.49:0/3349245541 learned_addr learned my addr 172.21.15.49:0/3349245541 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:37.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.888+0000 7f07e61ca640 1 --2- 172.21.15.49:0/3349245541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07e00c65f0 0x7f07e0153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:37.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.888+0000 7f07e51c8640 1 -- 172.21.15.49:0/3349245541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e006adc0 msgr2=0x7f07e015b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:37.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.888+0000 7f07e51c8640 1 --2- 172.21.15.49:0/3349245541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e006adc0 0x7f07e015b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:37.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.888+0000 7f07e51c8640 1 -- 172.21.15.49:0/3349245541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07e00c65f0 msgr2=0x7f07e0153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:37.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.888+0000 7f07e51c8640 1 --2- 172.21.15.49:0/3349245541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07e00c65f0 0x7f07e0153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:37.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.888+0000 7f07e51c8640 1 -- 172.21.15.49:0/3349245541 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d0009420 con 0x7f07e006b1a0 2023-11-18T20:59:37.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.896+0000 7f07e51c8640 1 --2- 172.21.15.49:0/3349245541 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07e006b1a0 0x7f07e01ef820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07d001b860 tx=0x7f07d001b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:37.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.904+0000 7f07d67fc640 1 -- 172.21.15.49:0/3349245541 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00a88f0 con 0x7f07e006b1a0 2023-11-18T20:59:37.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.904+0000 7f07d67fc640 1 -- 172.21.15.49:0/3349245541 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d00b9410 con 0x7f07e006b1a0 2023-11-18T20:59:37.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.904+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3349245541 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e01f3060 con 0x7f07e006b1a0 2023-11-18T20:59:37.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.904+0000 7f07d67fc640 1 -- 172.21.15.49:0/3349245541 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00b97a0 con 0x7f07e006b1a0 2023-11-18T20:59:37.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.904+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3349245541 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e015d790 con 0x7f07e006b1a0 2023-11-18T20:59:37.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.908+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3349245541 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e01ef540 con 0x7f07e006b1a0 2023-11-18T20:59:37.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.964+0000 7f07d67fc640 1 -- 172.21.15.49:0/3349245541 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f07d00b7040 con 0x7f07e006b1a0 2023-11-18T20:59:38.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.964+0000 7f07d67fc640 1 --2- 172.21.15.49:0/3349245541 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f07c40664c0 0x7f07c4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:38.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.968+0000 7f07e59c9640 1 --2- 172.21.15.49:0/3349245541 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f07c40664c0 0x7f07c4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:38.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:37.968+0000 7f07e59c9640 1 --2- 172.21.15.49:0/3349245541 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f07c40664c0 0x7f07c4068980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f07dc000f70 tx=0x7f07dc007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:38.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.252+0000 7f07d67fc640 1 -- 172.21.15.49:0/3349245541 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f07d00f32d0 con 0x7f07e006b1a0 2023-11-18T20:59:38.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.284+0000 7f07d67fc640 1 -- 172.21.15.49:0/3349245541 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f07d00ef610 con 0x7f07e006b1a0 2023-11-18T20:59:38.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.500+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3349245541 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07e01ef500 con 0x7f07e006b1a0 2023-11-18T20:59:38.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.560+0000 7f07d67fc640 1 -- 172.21.15.49:0/3349245541 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6492 (secure 0 0 0) 0x7f07d00b5070 con 0x7f07e006b1a0 2023-11-18T20:59:38.562 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:59:38.563 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1013296856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1013296856},{"type":"v1","addr":"172.21.15.49:6833","nonce":1013296856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3397458527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3397458527},{"type":"v1","addr":"172.21.15.49:6835","nonce":3397458527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2795994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2795994685},{"type":"v1","addr":"172.21.15.106:6835","nonce":2795994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2839781261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":2839781261},{"type":"v1","addr":"172.21.15.106:6837","nonce":2839781261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6839/957974967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":957974967},{"type":"v1","addr":"172.21.15.106:6839","nonce":957974967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:59:27.571192+0000","modified":"2023-11-18T20:59:36.534527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4252},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.49:6837/321839377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":321839377},{"type":"v1","addr":"172.21.15.49:6837","nonce":321839377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-18T20:59:38.563 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-11-18T20:59:38.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.564+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3349245541 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f07c40664c0 msgr2=0x7f07c4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:38.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.564+0000 7f07e7c2d640 1 --2- 172.21.15.49:0/3349245541 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f07c40664c0 0x7f07c4068980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f07dc000f70 tx=0x7f07dc007e90 comp rx=0 tx=0).stop 2023-11-18T20:59:38.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.564+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3349245541 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07e006b1a0 msgr2=0x7f07e01ef820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:38.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.564+0000 7f07e7c2d640 1 --2- 172.21.15.49:0/3349245541 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07e006b1a0 0x7f07e01ef820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07d001b860 tx=0x7f07d001b9f0 comp rx=0 tx=0).stop 2023-11-18T20:59:38.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.564+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3349245541 shutdown_connections 2023-11-18T20:59:38.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.564+0000 7f07e7c2d640 1 --2- 172.21.15.49:0/3349245541 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f07c40664c0 0x7f07c4068980 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:38.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.564+0000 7f07e7c2d640 1 --2- 172.21.15.49:0/3349245541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07e00c65f0 0x7f07e0153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:38.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.564+0000 7f07e7c2d640 1 --2- 172.21.15.49:0/3349245541 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07e006b1a0 0x7f07e01ef820 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:38.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.564+0000 7f07e7c2d640 1 --2- 172.21.15.49:0/3349245541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e006adc0 0x7f07e015b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:38.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.564+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3349245541 >> 172.21.15.49:0/3349245541 conn(0x7f07e0070160 msgr2=0x7f07e00ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:38.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.564+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3349245541 shutdown_connections 2023-11-18T20:59:38.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.564+0000 7f07e7c2d640 1 -- 172.21.15.49:0/3349245541 wait complete. 2023-11-18T20:59:38.585 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:59:38.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.704+0000 7f52b5ccf640 1 Processor -- start 2023-11-18T20:59:38.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.704+0000 7f52b5ccf640 1 -- start start 2023-11-18T20:59:38.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.704+0000 7f52b5ccf640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f52b0151670 0x7f52b00c6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:38.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.704+0000 7f52b5ccf640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f52b00c5290 0x7f52b00c5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:38.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.704+0000 7f52b5ccf640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b015b240 con 0x7f52b00c8dd0 2023-11-18T20:59:38.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.704+0000 7f52b5ccf640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b0157ab0 con 0x7f52b0151670 2023-11-18T20:59:38.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.704+0000 7f52b5ccf640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b00c6ea0 con 0x7f52b00c5290 2023-11-18T20:59:38.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.744+0000 7f52affff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f52b00c5290 0x7f52b00c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:38.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.744+0000 7f52affff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f52b00c5290 0x7f52b00c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:33312/0 (socket says 172.21.15.49:33312) 2023-11-18T20:59:38.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.744+0000 7f52affff640 1 -- 172.21.15.49:0/1316722513 learned_addr learned my addr 172.21.15.49:0/1316722513 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:38.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.756+0000 7f52affff640 1 -- 172.21.15.49:0/1316722513 >> v2:172.21.15.49:3300/0 conn(0x7f52b0151670 msgr2=0x7f52b00c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:38.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.756+0000 7f52affff640 1 --2- 172.21.15.49:0/1316722513 >> v2:172.21.15.49:3300/0 conn(0x7f52b0151670 0x7f52b00c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:38.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.756+0000 7f52affff640 1 -- 172.21.15.49:0/1316722513 >> v1:172.21.15.49:6789/0 conn(0x7f52b00c8dd0 legacy=0x7f52b01573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:38.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.756+0000 7f52affff640 1 -- 172.21.15.49:0/1316722513 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b00c7180 con 0x7f52b00c5290 2023-11-18T20:59:38.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.768+0000 7f52affff640 1 --2- 172.21.15.49:0/1316722513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52b00c5290 0x7f52b00c5700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f52b006ee90 tx=0x7f52a801f180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48e5de7b334c91ed server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.792+0000 7f52ae7fc640 1 -- 172.21.15.49:0/1316722513 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80af400 con 0x7f52b00c5290 2023-11-18T20:59:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.792+0000 7f52ae7fc640 1 -- 172.21.15.49:0/1316722513 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a80ab050 con 0x7f52b00c5290 2023-11-18T20:59:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.792+0000 7f52ae7fc640 1 -- 172.21.15.49:0/1316722513 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80af780 con 0x7f52b00c5290 2023-11-18T20:59:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.792+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1316722513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52b00c5290 msgr2=0x7f52b00c5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.792+0000 7f52b5ccf640 1 --2- 172.21.15.49:0/1316722513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52b00c5290 0x7f52b00c5700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f52b006ee90 tx=0x7f52a801f180 comp rx=0 tx=0).stop 2023-11-18T20:59:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.792+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1316722513 shutdown_connections 2023-11-18T20:59:38.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.792+0000 7f52b5ccf640 1 --2- 172.21.15.49:0/1316722513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52b00c5290 0x7f52b00c5700 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:38.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.792+0000 7f52b5ccf640 1 --2- 172.21.15.49:0/1316722513 >> v2:172.21.15.49:3300/0 conn(0x7f52b0151670 0x7f52b00c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:38.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.792+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1316722513 >> 172.21.15.49:0/1316722513 conn(0x7f52b0070160 msgr2=0x7f52b006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:38.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.792+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1316722513 shutdown_connections 2023-11-18T20:59:38.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.792+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1316722513 wait complete. 2023-11-18T20:59:38.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.796+0000 7f52b5ccf640 1 Processor -- start 2023-11-18T20:59:38.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.796+0000 7f52b5ccf640 1 -- start start 2023-11-18T20:59:38.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.796+0000 7f52b5ccf640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f52b00c5290 0x7f52b01e03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:38.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.796+0000 7f52b5ccf640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52b00c8dd0 0x7f52b00cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:38.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.796+0000 7f52b5ccf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52b0151670 0x7f52b01f0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:38.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.796+0000 7f52b5ccf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b01528a0 con 0x7f52b0151670 2023-11-18T20:59:38.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.796+0000 7f52b5ccf640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b01523e0 con 0x7f52b00c8dd0 2023-11-18T20:59:38.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.796+0000 7f52b5ccf640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b01ed6f0 con 0x7f52b00c5290 2023-11-18T20:59:38.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.796+0000 7f52affff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52b0151670 0x7f52b01f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:38.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.796+0000 7f52affff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52b0151670 0x7f52b01f0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60676/0 (socket says 172.21.15.49:60676) 2023-11-18T20:59:38.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.796+0000 7f52affff640 1 -- 172.21.15.49:0/1881992238 learned_addr learned my addr 172.21.15.49:0/1881992238 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:38.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.796+0000 7f52aeffd640 1 --2- 172.21.15.49:0/1881992238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52b00c8dd0 0x7f52b00cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:38.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.800+0000 7f52affff640 1 -- 172.21.15.49:0/1881992238 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f52b00c5290 msgr2=0x7f52b01e03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:38.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.800+0000 7f52affff640 1 --2- 172.21.15.49:0/1881992238 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f52b00c5290 0x7f52b01e03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:38.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.800+0000 7f52affff640 1 -- 172.21.15.49:0/1881992238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52b00c8dd0 msgr2=0x7f52b00cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:38.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.800+0000 7f52affff640 1 --2- 172.21.15.49:0/1881992238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52b00c8dd0 0x7f52b00cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:38.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.800+0000 7f52affff640 1 -- 172.21.15.49:0/1881992238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a8009b30 con 0x7f52b0151670 2023-11-18T20:59:38.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.804+0000 7f52affff640 1 --2- 172.21.15.49:0/1881992238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52b0151670 0x7f52b01f0470 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009f10 tx=0x7f52a801bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:38.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.808+0000 7f5297fff640 1 -- 172.21.15.49:0/1881992238 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80c1070 con 0x7f52b0151670 2023-11-18T20:59:38.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.808+0000 7f5297fff640 1 -- 172.21.15.49:0/1881992238 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a80afb40 con 0x7f52b0151670 2023-11-18T20:59:38.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.808+0000 7f5297fff640 1 -- 172.21.15.49:0/1881992238 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80b9410 con 0x7f52b0151670 2023-11-18T20:59:38.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.808+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1881992238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b01e0920 con 0x7f52b0151670 2023-11-18T20:59:38.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.808+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1881992238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b0152100 con 0x7f52b0151670 2023-11-18T20:59:38.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.812+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1881992238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b0073e70 con 0x7f52b0151670 2023-11-18T20:59:38.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.832+0000 7f5297fff640 1 -- 172.21.15.49:0/1881992238 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52a80b6050 con 0x7f52b0151670 2023-11-18T20:59:38.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.832+0000 7f5297fff640 1 --2- 172.21.15.49:0/1881992238 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f529c0664a0 0x7f529c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:38.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.832+0000 7f52af7fe640 1 --2- 172.21.15.49:0/1881992238 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f529c0664a0 0x7f529c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:38.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:38.836+0000 7f52af7fe640 1 --2- 172.21.15.49:0/1881992238 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f529c0664a0 0x7f529c068960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f52a0009690 tx=0x7f52a0006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:39.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.132+0000 7f5297fff640 1 -- 172.21.15.49:0/1881992238 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f52a80f4140 con 0x7f52b0151670 2023-11-18T20:59:39.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.132+0000 7f5297fff640 1 -- 172.21.15.49:0/1881992238 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52a80efd80 con 0x7f52b0151670 2023-11-18T20:59:39.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.304+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1881992238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52b006afa0 con 0x7f52b0151670 2023-11-18T20:59:39.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.424+0000 7f5297fff640 1 -- 172.21.15.49:0/1881992238 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18314 (secure 0 0 0) 0x7f52a80b4090 con 0x7f52b0151670 2023-11-18T20:59:39.427 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:59:39.427 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":29,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:59:36.521114+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:59:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.428+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1881992238 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f529c0664a0 msgr2=0x7f529c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.428+0000 7f52b5ccf640 1 --2- 172.21.15.49:0/1881992238 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f529c0664a0 0x7f529c068960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f52a0009690 tx=0x7f52a0006c00 comp rx=0 tx=0).stop 2023-11-18T20:59:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.428+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1881992238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52b0151670 msgr2=0x7f52b01f0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.428+0000 7f52b5ccf640 1 --2- 172.21.15.49:0/1881992238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52b0151670 0x7f52b01f0470 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009f10 tx=0x7f52a801bf20 comp rx=0 tx=0).stop 2023-11-18T20:59:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.428+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1881992238 shutdown_connections 2023-11-18T20:59:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.428+0000 7f52b5ccf640 1 --2- 172.21.15.49:0/1881992238 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f529c0664a0 0x7f529c068960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.428+0000 7f52b5ccf640 1 --2- 172.21.15.49:0/1881992238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52b0151670 0x7f52b01f0470 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.428+0000 7f52b5ccf640 1 --2- 172.21.15.49:0/1881992238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52b00c8dd0 0x7f52b00cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.428+0000 7f52b5ccf640 1 --2- 172.21.15.49:0/1881992238 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f52b00c5290 0x7f52b01e03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.428+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1881992238 >> 172.21.15.49:0/1881992238 conn(0x7f52b0070160 msgr2=0x7f52b006dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.428+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1881992238 shutdown_connections 2023-11-18T20:59:39.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.428+0000 7f52b5ccf640 1 -- 172.21.15.49:0/1881992238 wait complete. 2023-11-18T20:59:39.453 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:59:39.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.576+0000 7f02191f3640 1 Processor -- start 2023-11-18T20:59:39.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.576+0000 7f02191f3640 1 -- start start 2023-11-18T20:59:39.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.576+0000 7f02191f3640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f021415b520 0x7f02140c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:39.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.576+0000 7f02191f3640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021415a7f0 con 0x7f0214151600 2023-11-18T20:59:39.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.576+0000 7f02191f3640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021406ac90 con 0x7f02140c9310 2023-11-18T20:59:39.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.576+0000 7f02191f3640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021406af70 con 0x7f021415b520 2023-11-18T20:59:39.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.576+0000 7f021359e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f02140c9310 0x7f02140c5290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:43528/0 (socket says 172.21.15.49:43528) 2023-11-18T20:59:39.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.576+0000 7f021359e640 1 -- 172.21.15.49:0/2727639612 learned_addr learned my addr 172.21.15.49:0/2727639612 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:59:39.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.588+0000 7f021259c640 1 --2- 172.21.15.49:0/2727639612 >> v2:172.21.15.49:3300/0 conn(0x7f021415b520 0x7f02140c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:39.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.592+0000 7f021259c640 1 -- 172.21.15.49:0/2727639612 >> v1:172.21.15.106:6789/0 conn(0x7f02140c9310 legacy=0x7f02140c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:39.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.592+0000 7f021259c640 1 -- 172.21.15.49:0/2727639612 >> v1:172.21.15.49:6789/0 conn(0x7f0214151600 legacy=0x7f0214157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:39.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.592+0000 7f021259c640 1 -- 172.21.15.49:0/2727639612 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021415aa40 con 0x7f021415b520 2023-11-18T20:59:39.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.604+0000 7f021259c640 1 --2- 172.21.15.49:0/2727639612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021415b520 0x7f02140c8dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0097c0 tx=0x7f01fc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87082e1d37f8816f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:39.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.608+0000 7f0211d9b640 1 -- 172.21.15.49:0/2727639612 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0ab600 con 0x7f021415b520 2023-11-18T20:59:39.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.608+0000 7f0211d9b640 1 -- 172.21.15.49:0/2727639612 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc0a7050 con 0x7f021415b520 2023-11-18T20:59:39.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.608+0000 7f0211d9b640 1 -- 172.21.15.49:0/2727639612 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0ab980 con 0x7f021415b520 2023-11-18T20:59:39.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.608+0000 7f02191f3640 1 -- 172.21.15.49:0/2727639612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021415b520 msgr2=0x7f02140c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:39.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.608+0000 7f02191f3640 1 --2- 172.21.15.49:0/2727639612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021415b520 0x7f02140c8dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0097c0 tx=0x7f01fc01c480 comp rx=0 tx=0).stop 2023-11-18T20:59:39.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.608+0000 7f02191f3640 1 -- 172.21.15.49:0/2727639612 shutdown_connections 2023-11-18T20:59:39.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.608+0000 7f02191f3640 1 --2- 172.21.15.49:0/2727639612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021415b520 0x7f02140c8dd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:39.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.608+0000 7f02191f3640 1 -- 172.21.15.49:0/2727639612 >> 172.21.15.49:0/2727639612 conn(0x7f0214070160 msgr2=0x7f021406b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:39.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.608+0000 7f02191f3640 1 -- 172.21.15.49:0/2727639612 shutdown_connections 2023-11-18T20:59:39.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.608+0000 7f02191f3640 1 -- 172.21.15.49:0/2727639612 wait complete. 2023-11-18T20:59:39.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.608+0000 7f02191f3640 1 Processor -- start 2023-11-18T20:59:39.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.608+0000 7f02191f3640 1 -- start start 2023-11-18T20:59:39.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.612+0000 7f02191f3640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02140c9310 0x7f02141547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:39.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.612+0000 7f02191f3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0214151600 0x7f0214154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:39.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.612+0000 7f02191f3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021415b520 0x7f02141f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:39.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.612+0000 7f02191f3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021415c1f0 con 0x7f021415b520 2023-11-18T20:59:39.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.612+0000 7f02191f3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02141f1bd0 con 0x7f0214151600 2023-11-18T20:59:39.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.612+0000 7f02191f3640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0214152ab0 con 0x7f02140c9310 2023-11-18T20:59:39.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.612+0000 7f021359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021415b520 0x7f02141f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:39.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.612+0000 7f021359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021415b520 0x7f02141f2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60706/0 (socket says 172.21.15.49:60706) 2023-11-18T20:59:39.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.612+0000 7f021359e640 1 -- 172.21.15.49:0/3270865831 learned_addr learned my addr 172.21.15.49:0/3270865831 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.616+0000 7f021359e640 1 -- 172.21.15.49:0/3270865831 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02140c9310 msgr2=0x7f02141547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.616+0000 7f021359e640 1 --2- 172.21.15.49:0/3270865831 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02140c9310 0x7f02141547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.616+0000 7f021359e640 1 -- 172.21.15.49:0/3270865831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0214151600 msgr2=0x7f0214154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.616+0000 7f021359e640 1 --2- 172.21.15.49:0/3270865831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0214151600 0x7f0214154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.616+0000 7f021359e640 1 -- 172.21.15.49:0/3270865831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc009420 con 0x7f021415b520 2023-11-18T20:59:39.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.616+0000 7f021359e640 1 --2- 172.21.15.49:0/3270865831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021415b520 0x7f02141f2060 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f020c00cb10 tx=0x7f020c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:39.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.624+0000 7f020b7fe640 1 -- 172.21.15.49:0/3270865831 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c00ac70 con 0x7f021415b520 2023-11-18T20:59:39.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.624+0000 7f020b7fe640 1 -- 172.21.15.49:0/3270865831 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c00add0 con 0x7f021415b520 2023-11-18T20:59:39.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.624+0000 7f02191f3640 1 -- 172.21.15.49:0/3270865831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0214152d90 con 0x7f021415b520 2023-11-18T20:59:39.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.624+0000 7f020b7fe640 1 -- 172.21.15.49:0/3270865831 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c012600 con 0x7f021415b520 2023-11-18T20:59:39.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.624+0000 7f02191f3640 1 -- 172.21.15.49:0/3270865831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0214153350 con 0x7f021415b520 2023-11-18T20:59:39.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.624+0000 7f02191f3640 1 -- 172.21.15.49:0/3270865831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0214073e70 con 0x7f021415b520 2023-11-18T20:59:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.644+0000 7f020b7fe640 1 -- 172.21.15.49:0/3270865831 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f020c007070 con 0x7f021415b520 2023-11-18T20:59:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.644+0000 7f020b7fe640 1 --2- 172.21.15.49:0/3270865831 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f01f40664f0 0x7f01f40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:39.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.644+0000 7f0212d9d640 1 --2- 172.21.15.49:0/3270865831 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f01f40664f0 0x7f01f40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:39.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.648+0000 7f0212d9d640 1 --2- 172.21.15.49:0/3270865831 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f01f40664f0 0x7f01f40689b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0204000f70 tx=0x7f02040079e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:39.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.648+0000 7f020b7fe640 1 -- 172.21.15.49:0/3270865831 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f020c0553f0 con 0x7f021415b520 2023-11-18T20:59:39.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:39.996+0000 7f020b7fe640 1 -- 172.21.15.49:0/3270865831 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f020c051730 con 0x7f021415b520 2023-11-18T20:59:40.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.172+0000 7f02191f3640 1 -- 172.21.15.49:0/3270865831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f021406a710 con 0x7f021415b520 2023-11-18T20:59:40.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.272+0000 7f020b7fe640 1 -- 172.21.15.49:0/3270865831 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18314 (secure 0 0 0) 0x7f020c054d50 con 0x7f021415b520 2023-11-18T20:59:40.275 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:59:40.276 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":29,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:59:36.521114+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:59:40.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.276+0000 7f02191f3640 1 -- 172.21.15.49:0/3270865831 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f01f40664f0 msgr2=0x7f01f40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:40.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.276+0000 7f02191f3640 1 --2- 172.21.15.49:0/3270865831 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f01f40664f0 0x7f01f40689b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0204000f70 tx=0x7f02040079e0 comp rx=0 tx=0).stop 2023-11-18T20:59:40.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.276+0000 7f02191f3640 1 -- 172.21.15.49:0/3270865831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021415b520 msgr2=0x7f02141f2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:40.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.276+0000 7f02191f3640 1 --2- 172.21.15.49:0/3270865831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021415b520 0x7f02141f2060 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f020c00cb10 tx=0x7f020c00a060 comp rx=0 tx=0).stop 2023-11-18T20:59:40.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.276+0000 7f02191f3640 1 -- 172.21.15.49:0/3270865831 shutdown_connections 2023-11-18T20:59:40.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.276+0000 7f02191f3640 1 --2- 172.21.15.49:0/3270865831 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f01f40664f0 0x7f01f40689b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:40.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.276+0000 7f02191f3640 1 --2- 172.21.15.49:0/3270865831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021415b520 0x7f02141f2060 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:40.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.276+0000 7f02191f3640 1 --2- 172.21.15.49:0/3270865831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0214151600 0x7f0214154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:40.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.276+0000 7f02191f3640 1 --2- 172.21.15.49:0/3270865831 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02140c9310 0x7f02141547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:40.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.276+0000 7f02191f3640 1 -- 172.21.15.49:0/3270865831 >> 172.21.15.49:0/3270865831 conn(0x7f0214070160 msgr2=0x7f02140cb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:40.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.276+0000 7f02191f3640 1 -- 172.21.15.49:0/3270865831 shutdown_connections 2023-11-18T20:59:40.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.276+0000 7f02191f3640 1 -- 172.21.15.49:0/3270865831 wait complete. 2023-11-18T20:59:40.314 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T20:59:40.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.440+0000 7f2c303a4640 1 Processor -- start 2023-11-18T20:59:40.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.440+0000 7f2c303a4640 1 -- start start 2023-11-18T20:59:40.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.444+0000 7f2c303a4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2c28151340 0x7f2c2806ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:40.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.444+0000 7f2c303a4640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c280c40e0 0x7f2c280c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:40.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.444+0000 7f2c303a4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2806f4a0 con 0x7f2c28151720 2023-11-18T20:59:40.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.444+0000 7f2c303a4640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c28072570 con 0x7f2c28151340 2023-11-18T20:59:40.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.444+0000 7f2c303a4640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c28070be0 con 0x7f2c280c40e0 2023-11-18T20:59:40.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.448+0000 7f2c2e140640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2c28151340 0x7f2c2806ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:40.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.448+0000 7f2c2d93f640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2c28151720 0x7f2c28157c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:43542/0 (socket says 172.21.15.49:43542) 2023-11-18T20:59:40.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.448+0000 7f2c2d93f640 1 -- 172.21.15.49:0/7241060 learned_addr learned my addr 172.21.15.49:0/7241060 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:59:40.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.456+0000 7f2c2e941640 1 --2- 172.21.15.49:0/7241060 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c280c40e0 0x7f2c280c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:40.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.460+0000 7f2c2e140640 1 -- 172.21.15.49:0/7241060 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c280c40e0 msgr2=0x7f2c280c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:40.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.460+0000 7f2c2e140640 1 --2- 172.21.15.49:0/7241060 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c280c40e0 0x7f2c280c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:40.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.460+0000 7f2c2e140640 1 -- 172.21.15.49:0/7241060 >> v1:172.21.15.106:6789/0 conn(0x7f2c28151720 legacy=0x7f2c28157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:40.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.460+0000 7f2c2e140640 1 -- 172.21.15.49:0/7241060 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c28070e80 con 0x7f2c28151340 2023-11-18T20:59:40.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.472+0000 7f2c2e140640 1 --2- 172.21.15.49:0/7241060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c28151340 0x7f2c2806ee10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2c240097c0 tx=0x7f2c2401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cac0ba313b1cfe4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:40.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c2d13e640 1 -- 172.21.15.49:0/7241060 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c240ab650 con 0x7f2c28151340 2023-11-18T20:59:40.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c2d13e640 1 -- 172.21.15.49:0/7241060 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c240ab7b0 con 0x7f2c28151340 2023-11-18T20:59:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c2d13e640 1 -- 172.21.15.49:0/7241060 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c240abb40 con 0x7f2c28151340 2023-11-18T20:59:40.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 -- 172.21.15.49:0/7241060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c28151340 msgr2=0x7f2c2806ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 --2- 172.21.15.49:0/7241060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c28151340 0x7f2c2806ee10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2c240097c0 tx=0x7f2c2401c450 comp rx=0 tx=0).stop 2023-11-18T20:59:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 -- 172.21.15.49:0/7241060 shutdown_connections 2023-11-18T20:59:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 --2- 172.21.15.49:0/7241060 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c280c40e0 0x7f2c280c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 --2- 172.21.15.49:0/7241060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c28151340 0x7f2c2806ee10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 -- 172.21.15.49:0/7241060 >> 172.21.15.49:0/7241060 conn(0x7f2c2806c6a0 msgr2=0x7f2c2806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 -- 172.21.15.49:0/7241060 shutdown_connections 2023-11-18T20:59:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 -- 172.21.15.49:0/7241060 wait complete. 2023-11-18T20:59:40.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 Processor -- start 2023-11-18T20:59:40.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 -- start start 2023-11-18T20:59:40.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c280c40e0 0x7f2c2814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:40.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28151340 0x7f2c2814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:40.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c28151720 0x7f2c28149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:40.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c281618d0 con 0x7f2c28151340 2023-11-18T20:59:40.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2814ceb0 con 0x7f2c28151720 2023-11-18T20:59:40.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.488+0000 7f2c303a4640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c281f2a30 con 0x7f2c280c40e0 2023-11-18T20:59:40.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.492+0000 7f2c2e140640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c280c40e0 0x7f2c2814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:40.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.492+0000 7f2c2e140640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c280c40e0 0x7f2c2814c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:55796/0 (socket says 172.21.15.49:55796) 2023-11-18T20:59:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.492+0000 7f2c2e140640 1 -- 172.21.15.49:0/4215774378 learned_addr learned my addr 172.21.15.49:0/4215774378 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:40.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.492+0000 7f2c2e941640 1 --2- 172.21.15.49:0/4215774378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c28151720 0x7f2c28149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:40.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.496+0000 7f2c2d93f640 1 --2- 172.21.15.49:0/4215774378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28151340 0x7f2c2814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:40.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.500+0000 7f2c2e140640 1 -- 172.21.15.49:0/4215774378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c28151720 msgr2=0x7f2c28149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:40.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.500+0000 7f2c2e140640 1 --2- 172.21.15.49:0/4215774378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c28151720 0x7f2c28149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:40.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.500+0000 7f2c2e140640 1 -- 172.21.15.49:0/4215774378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28151340 msgr2=0x7f2c2814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:40.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.500+0000 7f2c2e140640 1 --2- 172.21.15.49:0/4215774378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28151340 0x7f2c2814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:40.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.500+0000 7f2c2e140640 1 -- 172.21.15.49:0/4215774378 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c24009420 con 0x7f2c280c40e0 2023-11-18T20:59:40.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.504+0000 7f2c2e140640 1 --2- 172.21.15.49:0/4215774378 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c280c40e0 0x7f2c2814c740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c240ad040 tx=0x7f2c2401ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:40.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.540+0000 7f2c1effd640 1 -- 172.21.15.49:0/4215774378 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c240bf610 con 0x7f2c280c40e0 2023-11-18T20:59:40.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.540+0000 7f2c1effd640 1 -- 172.21.15.49:0/4215774378 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c240bf790 con 0x7f2c280c40e0 2023-11-18T20:59:40.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.540+0000 7f2c1effd640 1 -- 172.21.15.49:0/4215774378 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c240bfb40 con 0x7f2c280c40e0 2023-11-18T20:59:40.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.540+0000 7f2c303a4640 1 -- 172.21.15.49:0/4215774378 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c281f24b0 con 0x7f2c280c40e0 2023-11-18T20:59:40.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.540+0000 7f2c303a4640 1 -- 172.21.15.49:0/4215774378 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c280c6a20 con 0x7f2c280c40e0 2023-11-18T20:59:40.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.544+0000 7f2c303a4640 1 -- 172.21.15.49:0/4215774378 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c28067520 con 0x7f2c280c40e0 2023-11-18T20:59:40.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.856+0000 7f2c1effd640 1 -- 172.21.15.49:0/4215774378 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2c240b5400 con 0x7f2c280c40e0 2023-11-18T20:59:40.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.860+0000 7f2c1effd640 1 --2- 172.21.15.49:0/4215774378 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2c0c0664a0 0x7f2c0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:40.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.860+0000 7f2c2d93f640 1 --2- 172.21.15.49:0/4215774378 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2c0c0664a0 0x7f2c0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:40.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.860+0000 7f2c2d93f640 1 --2- 172.21.15.49:0/4215774378 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2c0c0664a0 0x7f2c0c068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2c280c63c0 tx=0x7f2c18007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:40.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.868+0000 7f2c1effd640 1 -- 172.21.15.49:0/4215774378 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2c240f0860 con 0x7f2c280c40e0 2023-11-18T20:59:40.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:40.900+0000 7f2c1effd640 1 -- 172.21.15.49:0/4215774378 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2c240ecba0 con 0x7f2c280c40e0 2023-11-18T20:59:41.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.112+0000 7f2c303a4640 1 -- 172.21.15.49:0/4215774378 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c2814d100 con 0x7f2c280c40e0 2023-11-18T20:59:41.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.136+0000 7f2c1effd640 1 -- 172.21.15.49:0/4215774378 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6492 (secure 0 0 0) 0x7f2c240f01c0 con 0x7f2c280c40e0 2023-11-18T20:59:41.139 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:59:41.139 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1013296856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1013296856},{"type":"v1","addr":"172.21.15.49:6833","nonce":1013296856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3397458527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3397458527},{"type":"v1","addr":"172.21.15.49:6835","nonce":3397458527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2795994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2795994685},{"type":"v1","addr":"172.21.15.106:6835","nonce":2795994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2839781261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":2839781261},{"type":"v1","addr":"172.21.15.106:6837","nonce":2839781261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6839/957974967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":957974967},{"type":"v1","addr":"172.21.15.106:6839","nonce":957974967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:59:27.571192+0000","modified":"2023-11-18T20:59:36.534527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4252},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.49:6837/321839377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":321839377},{"type":"v1","addr":"172.21.15.49:6837","nonce":321839377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-18T20:59:41.139 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2023-11-18T20:59:41.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.140+0000 7f2c303a4640 1 -- 172.21.15.49:0/4215774378 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2c0c0664a0 msgr2=0x7f2c0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:41.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.140+0000 7f2c303a4640 1 --2- 172.21.15.49:0/4215774378 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2c0c0664a0 0x7f2c0c068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2c280c63c0 tx=0x7f2c18007e90 comp rx=0 tx=0).stop 2023-11-18T20:59:41.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.140+0000 7f2c303a4640 1 -- 172.21.15.49:0/4215774378 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c280c40e0 msgr2=0x7f2c2814c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:41.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.140+0000 7f2c303a4640 1 --2- 172.21.15.49:0/4215774378 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c280c40e0 0x7f2c2814c740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c240ad040 tx=0x7f2c2401ac90 comp rx=0 tx=0).stop 2023-11-18T20:59:41.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.140+0000 7f2c303a4640 1 -- 172.21.15.49:0/4215774378 shutdown_connections 2023-11-18T20:59:41.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.140+0000 7f2c303a4640 1 --2- 172.21.15.49:0/4215774378 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2c0c0664a0 0x7f2c0c068960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:41.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.140+0000 7f2c303a4640 1 --2- 172.21.15.49:0/4215774378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c28151720 0x7f2c28149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:41.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.140+0000 7f2c303a4640 1 --2- 172.21.15.49:0/4215774378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c28151340 0x7f2c2814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:41.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.140+0000 7f2c303a4640 1 --2- 172.21.15.49:0/4215774378 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c280c40e0 0x7f2c2814c740 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:41.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.140+0000 7f2c303a4640 1 -- 172.21.15.49:0/4215774378 >> 172.21.15.49:0/4215774378 conn(0x7f2c2806c6a0 msgr2=0x7f2c280c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:41.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.140+0000 7f2c303a4640 1 -- 172.21.15.49:0/4215774378 shutdown_connections 2023-11-18T20:59:41.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.140+0000 7f2c303a4640 1 -- 172.21.15.49:0/4215774378 wait complete. 2023-11-18T20:59:41.161 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:59:41.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.288+0000 7fc7b6adb640 1 Processor -- start 2023-11-18T20:59:41.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.288+0000 7fc7b6adb640 1 -- start start 2023-11-18T20:59:41.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.288+0000 7fc7b6adb640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc7b00cd110 0x7fc7b0159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:41.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.288+0000 7fc7b6adb640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b006ec00 con 0x7fc7b015a110 2023-11-18T20:59:41.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.288+0000 7fc7b6adb640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b01593f0 con 0x7fc7b00ccd30 2023-11-18T20:59:41.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.288+0000 7fc7b6adb640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b015cf20 con 0x7fc7b00cd110 2023-11-18T20:59:41.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.288+0000 7fc7b5078640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc7b015a110 0x7fc7b01532b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:43590/0 (socket says 172.21.15.49:43590) 2023-11-18T20:59:41.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.288+0000 7fc7b5078640 1 -- 172.21.15.49:0/4170757736 learned_addr learned my addr 172.21.15.49:0/4170757736 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:59:41.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.288+0000 7fc7affff640 1 --2- 172.21.15.49:0/4170757736 >> v2:172.21.15.106:3300/0 conn(0x7fc7b00cd110 0x7fc7b0159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:41.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.292+0000 7fc7af7fe640 1 -- 172.21.15.49:0/4170757736 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520986171 0 0) 0x7fc7b006ec00 con 0x7fc7b015a110 2023-11-18T20:59:41.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.292+0000 7fc7af7fe640 1 -- 172.21.15.49:0/4170757736 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7a0003530 con 0x7fc7b015a110 2023-11-18T20:59:41.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7af7fe640 1 -- 172.21.15.49:0/4170757736 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 140129374 0 0) 0x7fc7a0003530 con 0x7fc7b015a110 2023-11-18T20:59:41.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7af7fe640 1 -- 172.21.15.49:0/4170757736 >> v2:172.21.15.106:3300/0 conn(0x7fc7b00cd110 msgr2=0x7fc7b0159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:41.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7af7fe640 1 --2- 172.21.15.49:0/4170757736 >> v2:172.21.15.106:3300/0 conn(0x7fc7b00cd110 0x7fc7b0159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:41.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7af7fe640 1 -- 172.21.15.49:0/4170757736 >> v1:172.21.15.106:6789/0 conn(0x7fc7b00ccd30 legacy=0x7fc7b00c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:41.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7af7fe640 1 -- 172.21.15.49:0/4170757736 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b015d200 con 0x7fc7b015a110 2023-11-18T20:59:41.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7af7fe640 1 -- 172.21.15.49:0/4170757736 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7fc7a8001a00 con 0x7fc7b015a110 2023-11-18T20:59:41.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7af7fe640 1 -- 172.21.15.49:0/4170757736 >> v1:172.21.15.49:6789/0 conn(0x7fc7b015a110 legacy=0x7fc7b01532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:41.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7af7fe640 1 --2- 172.21.15.49:0/4170757736 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7a00039f0 0x7fc7a0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:41.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7af7fe640 1 --2- 172.21.15.49:0/4170757736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7a00047d0 0x7fc7a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:41.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7af7fe640 1 --2- 172.21.15.49:0/4170757736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7a0005190 0x7fc7a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:41.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7af7fe640 1 -- 172.21.15.49:0/4170757736 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b015cf20 con 0x7fc7a00047d0 2023-11-18T20:59:41.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7af7fe640 1 -- 172.21.15.49:0/4170757736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a000c0c0 con 0x7fc7a0005190 2023-11-18T20:59:41.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7af7fe640 1 -- 172.21.15.49:0/4170757736 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a000c280 con 0x7fc7a00039f0 2023-11-18T20:59:41.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7affff640 1 --2- 172.21.15.49:0/4170757736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7a00047d0 0x7fc7a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:41.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.296+0000 7fc7b4877640 1 --2- 172.21.15.49:0/4170757736 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7a00039f0 0x7fc7a0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:41.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.304+0000 7fc7b4877640 1 -- 172.21.15.49:0/4170757736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7a0005190 msgr2=0x7fc7a000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:41.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.304+0000 7fc7b4877640 1 --2- 172.21.15.49:0/4170757736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7a0005190 0x7fc7a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:41.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.304+0000 7fc7b4877640 1 -- 172.21.15.49:0/4170757736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7a00047d0 msgr2=0x7fc7a0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:41.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.304+0000 7fc7b4877640 1 --2- 172.21.15.49:0/4170757736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7a00047d0 0x7fc7a0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:41.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.304+0000 7fc7b4877640 1 -- 172.21.15.49:0/4170757736 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a0003530 con 0x7fc7a00039f0 2023-11-18T20:59:41.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.304+0000 7fc7b5078640 1 -- 172.21.15.49:0/4170757736 reap_dead start 2023-11-18T20:59:41.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.312+0000 7fc7b4877640 1 --2- 172.21.15.49:0/4170757736 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7a00039f0 0x7fc7a0003e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4001750 tx=0x7fc7a401c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaae962aad52eaa5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:41.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.324+0000 7fc7af7fe640 1 -- 172.21.15.49:0/4170757736 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40052d0 con 0x7fc7a00039f0 2023-11-18T20:59:41.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.324+0000 7fc7af7fe640 1 -- 172.21.15.49:0/4170757736 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a40a7050 con 0x7fc7a00039f0 2023-11-18T20:59:41.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.324+0000 7fc7af7fe640 1 -- 172.21.15.49:0/4170757736 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4003840 con 0x7fc7a00039f0 2023-11-18T20:59:41.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.324+0000 7fc7b6adb640 1 -- 172.21.15.49:0/4170757736 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7a00039f0 msgr2=0x7fc7a0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:41.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.324+0000 7fc7b6adb640 1 --2- 172.21.15.49:0/4170757736 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7a00039f0 0x7fc7a0003e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4001750 tx=0x7fc7a401c380 comp rx=0 tx=0).stop 2023-11-18T20:59:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.328+0000 7fc7b6adb640 1 -- 172.21.15.49:0/4170757736 shutdown_connections 2023-11-18T20:59:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.328+0000 7fc7b6adb640 1 --2- 172.21.15.49:0/4170757736 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7a00039f0 0x7fc7a0003e30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.328+0000 7fc7b6adb640 1 -- 172.21.15.49:0/4170757736 >> 172.21.15.49:0/4170757736 conn(0x7fc7b00708a0 msgr2=0x7fc7b0070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.328+0000 7fc7b6adb640 1 -- 172.21.15.49:0/4170757736 shutdown_connections 2023-11-18T20:59:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.328+0000 7fc7b6adb640 1 -- 172.21.15.49:0/4170757736 wait complete. 2023-11-18T20:59:41.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.328+0000 7fc7b6adb640 1 Processor -- start 2023-11-18T20:59:41.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.328+0000 7fc7b6adb640 1 -- start start 2023-11-18T20:59:41.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.328+0000 7fc7b6adb640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7a00039f0 0x7fc7b01eed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:41.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.328+0000 7fc7b6adb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7b01e2990 0x7fc7b006cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:41.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.328+0000 7fc7b6adb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b014e6d0 0x7fc7b015ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:41.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.328+0000 7fc7b6adb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b014f510 con 0x7fc7b014e6d0 2023-11-18T20:59:41.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.328+0000 7fc7b6adb640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b014f7f0 con 0x7fc7b01e2990 2023-11-18T20:59:41.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.328+0000 7fc7b6adb640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b014fad0 con 0x7fc7a00039f0 2023-11-18T20:59:41.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.332+0000 7fc7b5078640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b014e6d0 0x7fc7b015ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:41.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.332+0000 7fc7affff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7b01e2990 0x7fc7b006cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:41.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.332+0000 7fc7b5078640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b014e6d0 0x7fc7b015ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60728/0 (socket says 172.21.15.49:60728) 2023-11-18T20:59:41.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.332+0000 7fc7b5078640 1 -- 172.21.15.49:0/1756689260 learned_addr learned my addr 172.21.15.49:0/1756689260 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:41.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.336+0000 7fc7b5078640 1 -- 172.21.15.49:0/1756689260 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7a00039f0 msgr2=0x7fc7b01eed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:41.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.336+0000 7fc7b5078640 1 --2- 172.21.15.49:0/1756689260 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7a00039f0 0x7fc7b01eed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:41.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.336+0000 7fc7b5078640 1 -- 172.21.15.49:0/1756689260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7b01e2990 msgr2=0x7fc7b006cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:41.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.336+0000 7fc7b5078640 1 --2- 172.21.15.49:0/1756689260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7b01e2990 0x7fc7b006cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:41.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.336+0000 7fc7b5078640 1 -- 172.21.15.49:0/1756689260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b014fdb0 con 0x7fc7b014e6d0 2023-11-18T20:59:41.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.340+0000 7fc7b5078640 1 --2- 172.21.15.49:0/1756689260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b014e6d0 0x7fc7b015ad90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8004c00 tx=0x7fc7a800ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:41.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.344+0000 7fc7ad7fa640 1 -- 172.21.15.49:0/1756689260 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800da20 con 0x7fc7b014e6d0 2023-11-18T20:59:41.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.344+0000 7fc7ad7fa640 1 -- 172.21.15.49:0/1756689260 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a800db80 con 0x7fc7b014e6d0 2023-11-18T20:59:41.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.344+0000 7fc7ad7fa640 1 -- 172.21.15.49:0/1756689260 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800a030 con 0x7fc7b014e6d0 2023-11-18T20:59:41.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.344+0000 7fc7b6adb640 1 -- 172.21.15.49:0/1756689260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b0150090 con 0x7fc7b014e6d0 2023-11-18T20:59:41.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.344+0000 7fc7b6adb640 1 -- 172.21.15.49:0/1756689260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b006d110 con 0x7fc7b014e6d0 2023-11-18T20:59:41.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.344+0000 7fc7b6adb640 1 -- 172.21.15.49:0/1756689260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b015a9d0 con 0x7fc7b014e6d0 2023-11-18T20:59:41.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.628+0000 7fc7ad7fa640 1 -- 172.21.15.49:0/1756689260 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc7a800a190 con 0x7fc7b014e6d0 2023-11-18T20:59:41.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.628+0000 7fc7ad7fa640 1 --2- 172.21.15.49:0/1756689260 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc7940664c0 0x7fc794068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:41.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.632+0000 7fc7b4877640 1 --2- 172.21.15.49:0/1756689260 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc7940664c0 0x7fc794068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:41.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.632+0000 7fc7b4877640 1 --2- 172.21.15.49:0/1756689260 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc7940664c0 0x7fc794068980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00057b0 tx=0x7fc7a4001130 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.660+0000 7fc7ad7fa640 1 -- 172.21.15.49:0/1756689260 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc7a8057c00 con 0x7fc7b014e6d0 2023-11-18T20:59:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.660+0000 7fc7ad7fa640 1 -- 172.21.15.49:0/1756689260 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7a8053f40 con 0x7fc7b014e6d0 2023-11-18T20:59:41.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:41.836+0000 7fc7b6adb640 1 -- 172.21.15.49:0/1756689260 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7b0073e70 con 0x7fc7b014e6d0 2023-11-18T20:59:42.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.024+0000 7fc7ad7fa640 1 -- 172.21.15.49:0/1756689260 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18314 (secure 0 0 0) 0x7fc7a807ee60 con 0x7fc7b014e6d0 2023-11-18T20:59:42.024 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:59:42.024 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":29,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:59:36.521114+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:59:42.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.028+0000 7fc7b6adb640 1 -- 172.21.15.49:0/1756689260 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc7940664c0 msgr2=0x7fc794068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:42.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.028+0000 7fc7b6adb640 1 --2- 172.21.15.49:0/1756689260 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc7940664c0 0x7fc794068980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00057b0 tx=0x7fc7a4001130 comp rx=0 tx=0).stop 2023-11-18T20:59:42.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.028+0000 7fc7b6adb640 1 -- 172.21.15.49:0/1756689260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b014e6d0 msgr2=0x7fc7b015ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:42.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.028+0000 7fc7b6adb640 1 --2- 172.21.15.49:0/1756689260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b014e6d0 0x7fc7b015ad90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8004c00 tx=0x7fc7a800ff00 comp rx=0 tx=0).stop 2023-11-18T20:59:42.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.028+0000 7fc7b6adb640 1 -- 172.21.15.49:0/1756689260 shutdown_connections 2023-11-18T20:59:42.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.028+0000 7fc7b6adb640 1 --2- 172.21.15.49:0/1756689260 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc7940664c0 0x7fc794068980 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:42.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.028+0000 7fc7b6adb640 1 --2- 172.21.15.49:0/1756689260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b014e6d0 0x7fc7b015ad90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:42.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.028+0000 7fc7b6adb640 1 --2- 172.21.15.49:0/1756689260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7b01e2990 0x7fc7b006cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:42.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.028+0000 7fc7b6adb640 1 --2- 172.21.15.49:0/1756689260 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7a00039f0 0x7fc7b01eed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:42.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.028+0000 7fc7b6adb640 1 -- 172.21.15.49:0/1756689260 >> 172.21.15.49:0/1756689260 conn(0x7fc7b00708a0 msgr2=0x7fc7b0151590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:42.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.028+0000 7fc7b6adb640 1 -- 172.21.15.49:0/1756689260 shutdown_connections 2023-11-18T20:59:42.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.028+0000 7fc7b6adb640 1 -- 172.21.15.49:0/1756689260 wait complete. 2023-11-18T20:59:42.658 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-18T20:59:27.571192+0000', 'modified': '2023-11-18T20:59:36.534527+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4252}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4252': {'gid': 4252, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.49:6837/321839377', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6836', 'nonce': 321839377}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 321839377}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-18T20:59:42.658 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-18T20:59:42.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-18T20:59:42.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.796+0000 7fed0576b640 1 Processor -- start 2023-11-18T20:59:42.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.796+0000 7fed0576b640 1 -- start start 2023-11-18T20:59:42.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.796+0000 7fed0576b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed000cc470 0x7fed001572c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:42.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.796+0000 7fed0576b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed000c9aa0 con 0x7fed0015a830 2023-11-18T20:59:42.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.796+0000 7fed0576b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0015adb0 con 0x7fed000ccfb0 2023-11-18T20:59:42.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.796+0000 7fed0576b640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed000cc8a0 con 0x7fed000cc470 2023-11-18T20:59:42.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.804+0000 7fecfeffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fed000ccfb0 0x7fed00151160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:43558/0 (socket says 172.21.15.49:43558) 2023-11-18T20:59:42.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.804+0000 7fecfeffd640 1 -- 172.21.15.49:0/1532843504 learned_addr learned my addr 172.21.15.49:0/1532843504 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:59:42.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.804+0000 7fecff7fe640 1 --2- 172.21.15.49:0/1532843504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed000cc470 0x7fed001572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:42.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.892+0000 7fecfdffb640 1 -- 172.21.15.49:0/1532843504 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478477051 0 0) 0x7fed000c9aa0 con 0x7fed0015a830 2023-11-18T20:59:42.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.892+0000 7fecfdffb640 1 -- 172.21.15.49:0/1532843504 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fece8003530 con 0x7fed0015a830 2023-11-18T20:59:42.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.896+0000 7fecfdffb640 1 -- 172.21.15.49:0/1532843504 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 906610111 0 0) 0x7fece8003530 con 0x7fed0015a830 2023-11-18T20:59:42.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.896+0000 7fecfdffb640 1 -- 172.21.15.49:0/1532843504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed000cc470 msgr2=0x7fed001572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:42.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.896+0000 7fecfdffb640 1 --2- 172.21.15.49:0/1532843504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed000cc470 0x7fed001572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:42.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.896+0000 7fecfdffb640 1 -- 172.21.15.49:0/1532843504 >> v1:172.21.15.106:6789/0 conn(0x7fed000ccfb0 legacy=0x7fed00151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:42.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.896+0000 7fecfdffb640 1 -- 172.21.15.49:0/1532843504 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0015b050 con 0x7fed0015a830 2023-11-18T20:59:42.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.896+0000 7fecfdffb640 1 -- 172.21.15.49:0/1532843504 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7fecf4001680 con 0x7fed0015a830 2023-11-18T20:59:42.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.896+0000 7fecfdffb640 1 -- 172.21.15.49:0/1532843504 >> v1:172.21.15.49:6789/0 conn(0x7fed0015a830 legacy=0x7fed0015fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:42.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.900+0000 7fecfdffb640 1 --2- 172.21.15.49:0/1532843504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed000cc470 0x7fece8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:42.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.900+0000 7fecfdffb640 1 --2- 172.21.15.49:0/1532843504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece8004180 0x7fece80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:42.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.900+0000 7fecfdffb640 1 --2- 172.21.15.49:0/1532843504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece8004f10 0x7fece800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:42.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.900+0000 7fecfdffb640 1 -- 172.21.15.49:0/1532843504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed000cc8a0 con 0x7fece8004180 2023-11-18T20:59:42.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.900+0000 7fecfdffb640 1 -- 172.21.15.49:0/1532843504 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece8005660 con 0x7fece8004f10 2023-11-18T20:59:42.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.900+0000 7fecfdffb640 1 -- 172.21.15.49:0/1532843504 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece800bf20 con 0x7fed000cc470 2023-11-18T20:59:42.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.904+0000 7fecff7fe640 1 --2- 172.21.15.49:0/1532843504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece8004f10 0x7fece800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:42.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.904+0000 7fecfe7fc640 1 --2- 172.21.15.49:0/1532843504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece8004180 0x7fece80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:42.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.912+0000 7fecfe7fc640 1 -- 172.21.15.49:0/1532843504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed000cc470 msgr2=0x7fece8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.912+0000 7fecfe7fc640 1 --2- 172.21.15.49:0/1532843504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed000cc470 0x7fece8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.912+0000 7fecfe7fc640 1 -- 172.21.15.49:0/1532843504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece8004f10 msgr2=0x7fece800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.912+0000 7fecfe7fc640 1 --2- 172.21.15.49:0/1532843504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece8004f10 0x7fece800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.912+0000 7fecfe7fc640 1 -- 172.21.15.49:0/1532843504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece8003530 con 0x7fece8004180 2023-11-18T20:59:42.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.924+0000 7fecfe7fc640 1 --2- 172.21.15.49:0/1532843504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece8004180 0x7fece80047d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fecf4007f50 tx=0x7fecf401ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508e5fea243dd0de server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:42.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.932+0000 7fecfdffb640 1 -- 172.21.15.49:0/1532843504 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf40a5970 con 0x7fece8004180 2023-11-18T20:59:42.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.932+0000 7fecfdffb640 1 -- 172.21.15.49:0/1532843504 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf40a5af0 con 0x7fece8004180 2023-11-18T20:59:42.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.932+0000 7fecfdffb640 1 -- 172.21.15.49:0/1532843504 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf40a5ea0 con 0x7fece8004180 2023-11-18T20:59:42.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.936+0000 7fed0576b640 1 -- 172.21.15.49:0/1532843504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece8004180 msgr2=0x7fece80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:42.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.936+0000 7fed0576b640 1 --2- 172.21.15.49:0/1532843504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece8004180 0x7fece80047d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fecf4007f50 tx=0x7fecf401ca80 comp rx=0 tx=0).stop 2023-11-18T20:59:42.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.936+0000 7fecff7fe640 1 -- 172.21.15.49:0/1532843504 reap_dead start 2023-11-18T20:59:42.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.936+0000 7fed0576b640 1 -- 172.21.15.49:0/1532843504 shutdown_connections 2023-11-18T20:59:42.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.936+0000 7fed0576b640 1 -- 172.21.15.49:0/1532843504 >> 172.21.15.49:0/1532843504 conn(0x7fed00061400 msgr2=0x7fed00061810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:42.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.936+0000 7fed0576b640 1 -- 172.21.15.49:0/1532843504 shutdown_connections 2023-11-18T20:59:42.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.936+0000 7fed0576b640 1 -- 172.21.15.49:0/1532843504 wait complete. 2023-11-18T20:59:42.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.940+0000 7fed0576b640 1 Processor -- start 2023-11-18T20:59:42.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.940+0000 7fed0576b640 1 -- start start 2023-11-18T20:59:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.940+0000 7fed0576b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece8004180 0x7fed0014fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.940+0000 7fed0576b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed001f1c60 0x7fed000c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:42.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.940+0000 7fed0576b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed0014b7e0 0x7fed0014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.940+0000 7fed0576b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0014f980 con 0x7fed0014b7e0 2023-11-18T20:59:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.940+0000 7fed0576b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0014f3a0 con 0x7fece8004180 2023-11-18T20:59:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.940+0000 7fed0576b640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed001f20e0 con 0x7fed001f1c60 2023-11-18T20:59:42.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.940+0000 7fecfe7fc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed001f1c60 0x7fed000c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:42.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.940+0000 7fecfeffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece8004180 0x7fed0014fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.944+0000 7fecfeffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece8004180 0x7fed0014fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:33382/0 (socket says 172.21.15.49:33382) 2023-11-18T20:59:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.944+0000 7fecfeffd640 1 -- 172.21.15.49:0/3108842802 learned_addr learned my addr 172.21.15.49:0/3108842802 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:42.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.952+0000 7fecfeffd640 1 -- 172.21.15.49:0/3108842802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed001f1c60 msgr2=0x7fed000c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:42.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.952+0000 7fecfeffd640 1 --2- 172.21.15.49:0/3108842802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed001f1c60 0x7fed000c5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:42.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.952+0000 7fecfeffd640 1 -- 172.21.15.49:0/3108842802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed0014b7e0 msgr2=0x7fed0014bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:42.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.952+0000 7fecfeffd640 1 --2- 172.21.15.49:0/3108842802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed0014b7e0 0x7fed0014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:42.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.952+0000 7fecfeffd640 1 -- 172.21.15.49:0/3108842802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0014d640 con 0x7fece8004180 2023-11-18T20:59:42.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.960+0000 7fecfeffd640 1 --2- 172.21.15.49:0/3108842802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece8004180 0x7fed0014fe10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fecf000c500 tx=0x7fecf000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:42.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.972+0000 7fece77fe640 1 -- 172.21.15.49:0/3108842802 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0005cf0 con 0x7fece8004180 2023-11-18T20:59:42.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.972+0000 7fece77fe640 1 -- 172.21.15.49:0/3108842802 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf0005e50 con 0x7fece8004180 2023-11-18T20:59:42.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.972+0000 7fece77fe640 1 -- 172.21.15.49:0/3108842802 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0007290 con 0x7fece8004180 2023-11-18T20:59:42.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.972+0000 7fed0576b640 1 -- 172.21.15.49:0/3108842802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0006fc50 con 0x7fece8004180 2023-11-18T20:59:42.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.972+0000 7fed0576b640 1 -- 172.21.15.49:0/3108842802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0014dbe0 con 0x7fece8004180 2023-11-18T20:59:42.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.976+0000 7fed0889a000 1 Processor -- start 2023-11-18T20:59:42.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.976+0000 7fed0889a000 1 -- start start 2023-11-18T20:59:42.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.976+0000 7fed0889a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289e1930 0x5651289e1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:42.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.976+0000 7fed0889a000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 0x5651289e6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:42.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.976+0000 7fed0889a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e7310 0x5651289e76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:42.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.976+0000 7fed0889a000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x565128810130 con 0x5651289e69f0 2023-11-18T20:59:42.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.976+0000 7fed0889a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651287fd9a0 con 0x5651289e1930 2023-11-18T20:59:42.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.976+0000 7fed0889a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651287faed0 con 0x5651289e7310 2023-11-18T20:59:42.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.976+0000 7fecfe7fc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e7310 0x5651289e76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:42.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.976+0000 7fecfe7fc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e7310 0x5651289e76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:55850/0 (socket says 172.21.15.49:55850) 2023-11-18T20:59:42.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.976+0000 7fecfe7fc640 1 -- 172.21.15.49:0/844334933 learned_addr learned my addr 172.21.15.49:0/844334933 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:42.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.984+0000 7fecfe7fc640 1 -- 172.21.15.49:0/844334933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289e1930 msgr2=0x5651289e1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:42.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.984+0000 7fecfe7fc640 1 --2- 172.21.15.49:0/844334933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289e1930 0x5651289e1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:42.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.984+0000 7fecfe7fc640 1 -- 172.21.15.49:0/844334933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 msgr2=0x5651289e6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:42.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.984+0000 7fecfe7fc640 1 --2- 172.21.15.49:0/844334933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 0x5651289e6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:42.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.984+0000 7fecfe7fc640 1 -- 172.21.15.49:0/844334933 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651284ee890 con 0x5651289e7310 2023-11-18T20:59:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:42.988+0000 7fecfe7fc640 1 --2- 172.21.15.49:0/844334933 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e7310 0x5651289e76f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fecf40b0040 tx=0x7fed000b1780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6a9cd52912a5016 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:43.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.000+0000 7fece4ff9640 1 -- 172.21.15.49:0/844334933 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf40015c0 con 0x5651289e7310 2023-11-18T20:59:43.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.000+0000 7fece4ff9640 1 -- 172.21.15.49:0/844334933 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf40a5930 con 0x5651289e7310 2023-11-18T20:59:43.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.000+0000 7fece4ff9640 1 -- 172.21.15.49:0/844334933 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf40052c0 con 0x5651289e7310 2023-11-18T20:59:43.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.000+0000 7fed0889a000 1 -- 172.21.15.49:0/844334933 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e7310 msgr2=0x5651289e76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:43.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.000+0000 7fed0889a000 1 --2- 172.21.15.49:0/844334933 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e7310 0x5651289e76f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fecf40b0040 tx=0x7fed000b1780 comp rx=0 tx=0).stop 2023-11-18T20:59:43.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.000+0000 7fed0889a000 1 -- 172.21.15.49:0/844334933 shutdown_connections 2023-11-18T20:59:43.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.000+0000 7fed0889a000 1 --2- 172.21.15.49:0/844334933 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e7310 0x5651289e76f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.000+0000 7fed0889a000 1 --2- 172.21.15.49:0/844334933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 0x5651289e6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.000+0000 7fed0889a000 1 --2- 172.21.15.49:0/844334933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289e1930 0x5651289e1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.000+0000 7fed0889a000 1 -- 172.21.15.49:0/844334933 >> 172.21.15.49:0/844334933 conn(0x5651289e27a0 msgr2=0x5651289e4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:43.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.000+0000 7fed0889a000 1 -- 172.21.15.49:0/844334933 shutdown_connections 2023-11-18T20:59:43.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.000+0000 7fed0889a000 1 -- 172.21.15.49:0/844334933 wait complete. 2023-11-18T20:59:43.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.004+0000 7fed0889a000 1 -- start start 2023-11-18T20:59:43.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.004+0000 7fed0889a000 1 Processor -- start 2023-11-18T20:59:43.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.004+0000 7fed0889a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e1930 0x5651289e0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:43.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.004+0000 7fed0889a000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 0x5651289e1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:43.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.004+0000 7fed0889a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289e7310 0x5651289f0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:43.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.004+0000 7fed0889a000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651287f67c0 con 0x5651289e69f0 2023-11-18T20:59:43.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.004+0000 7fed0889a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651287aebf0 con 0x5651289e7310 2023-11-18T20:59:43.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.004+0000 7fed0889a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651287b4a90 con 0x5651289e1930 2023-11-18T20:59:43.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.004+0000 7fed0889a000 10 client.0 _ll_register_callbacks cb 0x5651289913c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T20:59:43.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.008+0000 7fecff7fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e1930 0x5651289e0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:43.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.008+0000 7fecff7fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e1930 0x5651289e0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:55864/0 (socket says 172.21.15.49:55864) 2023-11-18T20:59:43.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.008+0000 7fecff7fe640 1 -- 172.21.15.49:0/621780040 learned_addr learned my addr 172.21.15.49:0/621780040 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:43.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.016+0000 7fece77fe640 1 -- 172.21.15.49:0/3108842802 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fecf00073f0 con 0x7fece8004180 2023-11-18T20:59:43.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.016+0000 7fece77fe640 1 --2- 172.21.15.49:0/3108842802 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fecec066430 0x7fecec0688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:43.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.016+0000 7fecff7fe640 1 -- 172.21.15.49:0/621780040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289e7310 msgr2=0x5651289f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:43.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.016+0000 7fecff7fe640 1 --2- 172.21.15.49:0/621780040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289e7310 0x5651289f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.016+0000 7fecff7fe640 1 -- 172.21.15.49:0/621780040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 msgr2=0x5651289e1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:43.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.016+0000 7fecff7fe640 1 --2- 172.21.15.49:0/621780040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 0x5651289e1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.016+0000 7fecff7fe640 1 -- 172.21.15.49:0/621780040 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece8003530 con 0x5651289e1930 2023-11-18T20:59:43.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.016+0000 7fecff7fe640 1 --2- 172.21.15.49:0/3108842802 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fecec066430 0x7fecec0688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:43.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.016+0000 7fecff7fe640 1 --2- 172.21.15.49:0/3108842802 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fecec066430 0x7fecec0688f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fed0006ed50 tx=0x7fecf8013070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:43.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.024+0000 7fece77fe640 1 -- 172.21.15.49:0/3108842802 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fecf0057320 con 0x7fece8004180 2023-11-18T20:59:43.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.140+0000 7fecff7fe640 1 --2- 172.21.15.49:0/621780040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e1930 0x5651289e0d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed0006e420 tx=0x7fecf800edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a885b0f4a034fe3a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:43.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.140+0000 7fecddffb640 10 client.0 ms_handle_connect on v2:172.21.15.106:3301/0 2023-11-18T20:59:43.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.156+0000 7fecddffb640 1 -- 172.21.15.49:0/621780040 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf8011230 con 0x5651289e1930 2023-11-18T20:59:43.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.156+0000 7fecddffb640 1 -- 172.21.15.49:0/621780040 <== mon.2 v2:172.21.15.106:3301/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fecf801e480 con 0x5651289e1930 2023-11-18T20:59:43.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.156+0000 7fed0889a000 1 -- 172.21.15.49:0/621780040 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651287b8470 con 0x5651289e1930 2023-11-18T20:59:43.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.160+0000 7fecddffb640 1 -- 172.21.15.49:0/621780040 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecf800ca20 con 0x5651289e1930 2023-11-18T20:59:43.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.160+0000 7fed0889a000 10 client.4316 fetch_fsmap learned FSMap version 8 2023-11-18T20:59:43.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.160+0000 7fed0889a000 1 -- 172.21.15.49:0/621780040 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5651287b7190 con 0x5651289e1930 2023-11-18T20:59:43.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.208+0000 7fecddffb640 1 -- 172.21.15.49:0/621780040 <== mon.2 v2:172.21.15.106:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5651287b8470 con 0x5651289e1930 2023-11-18T20:59:43.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.208+0000 7fecddffb640 1 -- 172.21.15.49:0/621780040 <== mon.2 v2:172.21.15.106:3301/0 5 ==== fsmap(e 8) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fecf8005d20 con 0x5651289e1930 2023-11-18T20:59:43.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.208+0000 7fed0889a000 10 client.4316 fetch_fsmap finished waiting for FSMap version 8 2023-11-18T20:59:43.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.208+0000 7fed0889a000 10 client.4316 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-18T20:59:43.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.208+0000 7fed0889a000 20 client.4316 populate_metadata read hostname 'smithi049' 2023-11-18T20:59:43.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.208+0000 7fed0889a000 1 --2- 172.21.15.49:0/621780040 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x5651289f16d0 0x5651289f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:43.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.208+0000 7fed0889a000 4 client.4316 mds_command: new command op to 4252 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-18T20:59:43.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.208+0000 7fed0889a000 1 -- 172.21.15.49:0/621780040 --> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651287bbb50 con 0x5651289f16d0 2023-11-18T20:59:43.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.232+0000 7fecfeffd640 1 --2- 172.21.15.49:0/621780040 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x5651289f16d0 0x5651289f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:43.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.368+0000 7fecddffb640 10 client.4316 ms_handle_connect on v2:172.21.15.49:6836/321839377 2023-11-18T20:59:43.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.368+0000 7fecfeffd640 1 --2- 172.21.15.49:0/621780040 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x5651289f16d0 0x5651289f1ab0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63faac4e2ca36758 server_cookie=bad68124c61a1089 in_seq=0 out_seq=0 2023-11-18T20:59:43.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fecddffb640 1 -- 172.21.15.49:0/621780040 <== mds.0 v2:172.21.15.49:6836/321839377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5651287bbb50 con 0x5651289f16d0 2023-11-18T20:59:43.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fecddffb640 10 client.4316 handle_command_reply: tid=0 2023-11-18T20:59:43.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fed0889a000 1 client.4316 shutdown 2023-11-18T20:59:43.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fed0889a000 1 -- 172.21.15.49:0/621780040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e1930 msgr2=0x5651289e0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:43.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fed0889a000 1 --2- 172.21.15.49:0/621780040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e1930 0x5651289e0d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed0006e420 tx=0x7fecf800edc0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fed0889a000 1 -- 172.21.15.49:0/621780040 shutdown_connections 2023-11-18T20:59:43.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fed0889a000 1 --2- 172.21.15.49:0/621780040 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x5651289f16d0 0x5651289f1ab0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fed0889a000 1 --2- 172.21.15.49:0/621780040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289e7310 0x5651289f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fed0889a000 1 --2- 172.21.15.49:0/621780040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 0x5651289e1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fed0889a000 1 --2- 172.21.15.49:0/621780040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e1930 0x5651289e0d10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fecddffb640 0 client.4316 ms_handle_reset on v2:172.21.15.49:6836/321839377 2023-11-18T20:59:43.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fed0889a000 1 -- 172.21.15.49:0/621780040 >> 172.21.15.49:0/621780040 conn(0x5651289e27a0 msgr2=0x5651289abba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:43.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fed0889a000 1 -- 172.21.15.49:0/621780040 shutdown_connections 2023-11-18T20:59:43.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fed0889a000 1 -- 172.21.15.49:0/621780040 wait complete. 2023-11-18T20:59:43.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.612+0000 7fed0889a000 20 client.4316 trim_cache size 0 max 16384 2023-11-18T20:59:43.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.652+0000 7fed0889a000 1 Processor -- start 2023-11-18T20:59:43.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.652+0000 7fed0889a000 1 -- start start 2023-11-18T20:59:43.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.652+0000 7fed0889a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e1930 0x5651289f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:43.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.652+0000 7fed0889a000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 0x5651289f3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:43.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.652+0000 7fed0889a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289e7310 0x5651289a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.652+0000 7fed0889a000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651284af940 con 0x5651289e69f0 2023-11-18T20:59:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.652+0000 7fed0889a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651287f2130 con 0x5651289e7310 2023-11-18T20:59:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.652+0000 7fed0889a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651287ada10 con 0x5651289e1930 2023-11-18T20:59:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.652+0000 7fecfe7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 0x5651289f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.656+0000 7fecfe7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 0x5651289f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60750/0 (socket says 172.21.15.49:60750) 2023-11-18T20:59:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.656+0000 7fecfe7fc640 1 -- 172.21.15.49:0/264770991 learned_addr learned my addr 172.21.15.49:0/264770991 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.656+0000 7fecfeffd640 1 --2- 172.21.15.49:0/264770991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e1930 0x5651289f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:43.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.660+0000 7fecfe7fc640 1 -- 172.21.15.49:0/264770991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e1930 msgr2=0x5651289f2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:43.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.660+0000 7fecfe7fc640 1 --2- 172.21.15.49:0/264770991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e1930 0x5651289f2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.660+0000 7fecfe7fc640 1 -- 172.21.15.49:0/264770991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289e7310 msgr2=0x5651289a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:43.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.660+0000 7fecfe7fc640 1 --2- 172.21.15.49:0/264770991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289e7310 0x5651289a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.660+0000 7fecfe7fc640 1 -- 172.21.15.49:0/264770991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651289e62f0 con 0x5651289e69f0 2023-11-18T20:59:43.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.664+0000 7fecfe7fc640 1 --2- 172.21.15.49:0/264770991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 0x5651289f3000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fecf401cf60 tx=0x7fecf401b2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f016dbdb9920a85b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.668+0000 7fece57fa640 1 -- 172.21.15.49:0/264770991 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf40013c0 con 0x5651289e69f0 2023-11-18T20:59:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.668+0000 7fece57fa640 1 -- 172.21.15.49:0/264770991 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf4001520 con 0x5651289e69f0 2023-11-18T20:59:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.668+0000 7fece57fa640 1 -- 172.21.15.49:0/264770991 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf40052c0 con 0x5651289e69f0 2023-11-18T20:59:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.668+0000 7fed0889a000 1 -- 172.21.15.49:0/264770991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 msgr2=0x5651289f3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.668+0000 7fed0889a000 1 --2- 172.21.15.49:0/264770991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 0x5651289f3000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fecf401cf60 tx=0x7fecf401b2c0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.668+0000 7fed0889a000 1 -- 172.21.15.49:0/264770991 shutdown_connections 2023-11-18T20:59:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.668+0000 7fed0889a000 1 --2- 172.21.15.49:0/264770991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289e7310 0x5651289a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.668+0000 7fed0889a000 1 --2- 172.21.15.49:0/264770991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e69f0 0x5651289f3000 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.668+0000 7fed0889a000 1 --2- 172.21.15.49:0/264770991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e1930 0x5651289f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.668+0000 7fed0889a000 1 -- 172.21.15.49:0/264770991 >> 172.21.15.49:0/264770991 conn(0x5651289e27a0 msgr2=0x5651289ef730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.668+0000 7fed0889a000 1 -- 172.21.15.49:0/264770991 shutdown_connections 2023-11-18T20:59:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.668+0000 7fed0889a000 1 -- 172.21.15.49:0/264770991 wait complete. 2023-11-18T20:59:43.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.672+0000 7fed0889a000 1 -- start start 2023-11-18T20:59:43.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.672+0000 7fed0889a000 1 Processor -- start 2023-11-18T20:59:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.672+0000 7fed0889a000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e1930 0x565128a46640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.672+0000 7fed0889a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e7310 0x565128a46b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.672+0000 7fed0889a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289a90d0 0x5651289a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.672+0000 7fed0889a000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651287b58f0 con 0x5651289e1930 2023-11-18T20:59:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.672+0000 7fed0889a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651287f9320 con 0x5651289a90d0 2023-11-18T20:59:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.672+0000 7fed0889a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651289e5c10 con 0x5651289e7310 2023-11-18T20:59:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.672+0000 7fed0889a000 10 client.0 _ll_register_callbacks cb 0x565128971bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T20:59:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.672+0000 7fecfeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e1930 0x565128a46640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.672+0000 7fecfeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e1930 0x565128a46640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60760/0 (socket says 172.21.15.49:60760) 2023-11-18T20:59:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.672+0000 7fecfeffd640 1 -- 172.21.15.49:0/3116519758 learned_addr learned my addr 172.21.15.49:0/3116519758 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:43.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.676+0000 7fecfe7fc640 1 --2- 172.21.15.49:0/3116519758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e7310 0x565128a46b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:43.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.680+0000 7fecfeffd640 1 -- 172.21.15.49:0/3116519758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e7310 msgr2=0x565128a46b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:43.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.680+0000 7fecfeffd640 1 --2- 172.21.15.49:0/3116519758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e7310 0x565128a46b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.680+0000 7fecfeffd640 1 -- 172.21.15.49:0/3116519758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289a90d0 msgr2=0x5651289a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:43.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.680+0000 7fecfeffd640 1 --2- 172.21.15.49:0/3116519758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289a90d0 0x5651289a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.680+0000 7fecfeffd640 1 -- 172.21.15.49:0/3116519758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651284ee890 con 0x5651289e1930 2023-11-18T20:59:43.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.684+0000 7fecfeffd640 1 --2- 172.21.15.49:0/3116519758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e1930 0x565128a46640 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fecf0056920 tx=0x7fecf0007760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e8b8027971df00 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:43.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.684+0000 7fecddffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-18T20:59:43.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.688+0000 7fecddffb640 1 -- 172.21.15.49:0/3116519758 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0056310 con 0x5651289e1930 2023-11-18T20:59:43.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.688+0000 7fecddffb640 1 -- 172.21.15.49:0/3116519758 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fecf0081030 con 0x5651289e1930 2023-11-18T20:59:43.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.688+0000 7fed0889a000 1 -- 172.21.15.49:0/3116519758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651287f5110 con 0x5651289e1930 2023-11-18T20:59:43.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.696+0000 7fecddffb640 1 -- 172.21.15.49:0/3116519758 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecf005ea90 con 0x5651289e1930 2023-11-18T20:59:43.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.696+0000 7fed0889a000 10 client.4272 fetch_fsmap learned FSMap version 8 2023-11-18T20:59:43.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.696+0000 7fed0889a000 1 -- 172.21.15.49:0/3116519758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56512879d490 con 0x5651289e1930 2023-11-18T20:59:43.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.776+0000 7fecddffb640 1 -- 172.21.15.49:0/3116519758 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf0078080 con 0x5651289e1930 2023-11-18T20:59:43.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.776+0000 7fecddffb640 1 -- 172.21.15.49:0/3116519758 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 8) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fecf0019020 con 0x5651289e1930 2023-11-18T20:59:43.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.776+0000 7fed0889a000 10 client.4272 fetch_fsmap finished waiting for FSMap version 8 2023-11-18T20:59:43.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.776+0000 7fed0889a000 10 client.4272 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-18T20:59:43.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.776+0000 7fed0889a000 20 client.4272 populate_metadata read hostname 'smithi049' 2023-11-18T20:59:43.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.776+0000 7fed0889a000 1 --2- 172.21.15.49:0/3116519758 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x565128a53b30 0x5651289aa050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:43.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.776+0000 7fed0889a000 4 client.4272 mds_command: new command op to 4252 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-18T20:59:43.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.776+0000 7fed0889a000 1 -- 172.21.15.49:0/3116519758 --> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5651288249a0 con 0x565128a53b30 2023-11-18T20:59:43.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.776+0000 7fecfe7fc640 1 --2- 172.21.15.49:0/3116519758 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x565128a53b30 0x5651289aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:43.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.784+0000 7fecddffb640 10 client.4272 ms_handle_connect on v2:172.21.15.49:6836/321839377 2023-11-18T20:59:43.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.784+0000 7fecfe7fc640 1 --2- 172.21.15.49:0/3116519758 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x565128a53b30 0x5651289aa050 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80f13d4db81cb0b5 server_cookie=801703964d7f1a4a in_seq=0 out_seq=0 2023-11-18T20:59:43.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fecddffb640 1 -- 172.21.15.49:0/3116519758 <== mds.0 v2:172.21.15.49:6836/321839377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5651288249a0 con 0x565128a53b30 2023-11-18T20:59:43.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fecddffb640 10 client.4272 handle_command_reply: tid=0 2023-11-18T20:59:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fed0889a000 1 client.4272 shutdown 2023-11-18T20:59:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fed0889a000 1 -- 172.21.15.49:0/3116519758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e1930 msgr2=0x565128a46640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fed0889a000 1 --2- 172.21.15.49:0/3116519758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e1930 0x565128a46640 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fecf0056920 tx=0x7fecf0007760 comp rx=0 tx=0).stop 2023-11-18T20:59:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fed0889a000 1 -- 172.21.15.49:0/3116519758 shutdown_connections 2023-11-18T20:59:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fed0889a000 1 --2- 172.21.15.49:0/3116519758 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x565128a53b30 0x5651289aa050 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fed0889a000 1 --2- 172.21.15.49:0/3116519758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651289a90d0 0x5651289a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fecddffb640 0 client.4272 ms_handle_reset on v2:172.21.15.49:6836/321839377 2023-11-18T20:59:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fed0889a000 1 --2- 172.21.15.49:0/3116519758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651289e7310 0x565128a46b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fed0889a000 1 --2- 172.21.15.49:0/3116519758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651289e1930 0x565128a46640 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fed0889a000 1 -- 172.21.15.49:0/3116519758 >> 172.21.15.49:0/3116519758 conn(0x5651289e27a0 msgr2=0x5651289f01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fed0889a000 1 -- 172.21.15.49:0/3116519758 shutdown_connections 2023-11-18T20:59:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fed0889a000 1 -- 172.21.15.49:0/3116519758 wait complete. 2023-11-18T20:59:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.812+0000 7fed0889a000 20 client.4272 trim_cache size 0 max 16384 2023-11-18T20:59:43.816 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T20:59:43.816 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "4b788c4a-a91a-4c5d-8f44-e74d82d94e56", 2023-11-18T20:59:43.816 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-11-18T20:59:43.816 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4252, 2023-11-18T20:59:43.816 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-18T20:59:43.816 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-18T20:59:43.816 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-18T20:59:43.817 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 14.252875924, 2023-11-18T20:59:43.817 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 8, 2023-11-18T20:59:43.817 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 29, 2023-11-18T20:59:43.817 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 29, 2023-11-18T20:59:43.817 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 32.166293183999997 2023-11-18T20:59:43.817 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T20:59:43.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.816+0000 7fed0576b640 1 -- 172.21.15.49:0/3108842802 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fecec066430 msgr2=0x7fecec0688f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:43.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.816+0000 7fed0576b640 1 --2- 172.21.15.49:0/3108842802 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fecec066430 0x7fecec0688f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fed0006ed50 tx=0x7fecf8013070 comp rx=0 tx=0).stop 2023-11-18T20:59:43.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.816+0000 7fed0576b640 1 -- 172.21.15.49:0/3108842802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece8004180 msgr2=0x7fed0014fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:43.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.816+0000 7fed0576b640 1 --2- 172.21.15.49:0/3108842802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece8004180 0x7fed0014fe10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fecf000c500 tx=0x7fecf000c9c0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.816+0000 7fed0576b640 1 -- 172.21.15.49:0/3108842802 shutdown_connections 2023-11-18T20:59:43.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.816+0000 7fed0576b640 1 --2- 172.21.15.49:0/3108842802 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fecec066430 0x7fecec0688f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.816+0000 7fed0576b640 1 --2- 172.21.15.49:0/3108842802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed0014b7e0 0x7fed0014bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.816+0000 7fed0576b640 1 --2- 172.21.15.49:0/3108842802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed001f1c60 0x7fed000c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.816+0000 7fed0576b640 1 --2- 172.21.15.49:0/3108842802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece8004180 0x7fed0014fe10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.816+0000 7fed0576b640 1 -- 172.21.15.49:0/3108842802 >> 172.21.15.49:0/3108842802 conn(0x7fed00061400 msgr2=0x7fed000c1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.816+0000 7fed0576b640 1 -- 172.21.15.49:0/3108842802 shutdown_connections 2023-11-18T20:59:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.816+0000 7fed0576b640 1 -- 172.21.15.49:0/3108842802 wait complete. 2023-11-18T20:59:43.841 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-18T20:59:43.841 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-18T20:59:43.841 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T20:59:43.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.968+0000 7f16ffd6c640 1 Processor -- start 2023-11-18T20:59:43.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.968+0000 7f16ffd6c640 1 -- start start 2023-11-18T20:59:43.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.972+0000 7f16ffd6c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f16f81513a0 0x7f16f80c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:43.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.972+0000 7f16ffd6c640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16f815b3f0 0x7f16f80c5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:43.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.972+0000 7f16ffd6c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f8157970 con 0x7f16f8150fc0 2023-11-18T20:59:43.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.972+0000 7f16ffd6c640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f8157c30 con 0x7f16f81513a0 2023-11-18T20:59:43.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.972+0000 7f16ffd6c640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f8157f10 con 0x7f16f815b3f0 2023-11-18T20:59:43.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.972+0000 7f16fe309640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16f815b3f0 0x7f16f80c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:43.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.972+0000 7f16fd307640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f16f81513a0 0x7f16f80c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:43.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.972+0000 7f16fd307640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f16f81513a0 0x7f16f80c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:33428/0 (socket says 172.21.15.49:33428) 2023-11-18T20:59:43.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.972+0000 7f16fd307640 1 -- 172.21.15.49:0/3714147860 learned_addr learned my addr 172.21.15.49:0/3714147860 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:43.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.972+0000 7f16fe309640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16f815b3f0 0x7f16f80c5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:55882/0 (socket says 172.21.15.49:55882) 2023-11-18T20:59:43.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.980+0000 7f16fe309640 1 -- 172.21.15.49:0/3714147860 >> v2:172.21.15.106:3300/0 conn(0x7f16f81513a0 msgr2=0x7f16f80c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:43.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.980+0000 7f16fe309640 1 --2- 172.21.15.49:0/3714147860 >> v2:172.21.15.106:3300/0 conn(0x7f16f81513a0 0x7f16f80c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:43.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.980+0000 7f16fe309640 1 -- 172.21.15.49:0/3714147860 >> v1:172.21.15.106:6789/0 conn(0x7f16f8150fc0 legacy=0x7f16f8157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:43.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.980+0000 7f16fe309640 1 -- 172.21.15.49:0/3714147860 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f815a910 con 0x7f16f815b3f0 2023-11-18T20:59:43.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.988+0000 7f16fe309640 1 --2- 172.21.15.49:0/3714147860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16f815b3f0 0x7f16f80c5290 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009d90 tx=0x7f16f001f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1663a1ebf4a8ead6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.996+0000 7f16fcb06640 1 -- 172.21.15.49:0/3714147860 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f00af600 con 0x7f16f815b3f0 2023-11-18T20:59:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.996+0000 7f16fcb06640 1 -- 172.21.15.49:0/3714147860 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f00ab050 con 0x7f16f815b3f0 2023-11-18T20:59:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:43.996+0000 7f16fcb06640 1 -- 172.21.15.49:0/3714147860 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f00af980 con 0x7f16f815b3f0 2023-11-18T20:59:43.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 -- 172.21.15.49:0/3714147860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16f815b3f0 msgr2=0x7f16f80c5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 --2- 172.21.15.49:0/3714147860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16f815b3f0 0x7f16f80c5290 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009d90 tx=0x7f16f001f130 comp rx=0 tx=0).stop 2023-11-18T20:59:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 -- 172.21.15.49:0/3714147860 shutdown_connections 2023-11-18T20:59:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 --2- 172.21.15.49:0/3714147860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16f815b3f0 0x7f16f80c5290 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 --2- 172.21.15.49:0/3714147860 >> v2:172.21.15.106:3300/0 conn(0x7f16f81513a0 0x7f16f80c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 -- 172.21.15.49:0/3714147860 >> 172.21.15.49:0/3714147860 conn(0x7f16f806b670 msgr2=0x7f16f806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 -- 172.21.15.49:0/3714147860 shutdown_connections 2023-11-18T20:59:44.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 -- 172.21.15.49:0/3714147860 wait complete. 2023-11-18T20:59:44.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 Processor -- start 2023-11-18T20:59:44.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 -- start start 2023-11-18T20:59:44.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16f8150fc0 0x7f16f81f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:44.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16f81513a0 0x7f16f81ed780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:44.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16f815b3f0 0x7f16f81e3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:44.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f81575b0 con 0x7f16f8150fc0 2023-11-18T20:59:44.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f81f1330 con 0x7f16f815b3f0 2023-11-18T20:59:44.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16ffd6c640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f815a120 con 0x7f16f81513a0 2023-11-18T20:59:44.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.000+0000 7f16fdb08640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16f8150fc0 0x7f16f81f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:44.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.004+0000 7f16fe309640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16f815b3f0 0x7f16f81e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:44.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.004+0000 7f16fdb08640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16f8150fc0 0x7f16f81f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60768/0 (socket says 172.21.15.49:60768) 2023-11-18T20:59:44.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.004+0000 7f16fdb08640 1 -- 172.21.15.49:0/4035637046 learned_addr learned my addr 172.21.15.49:0/4035637046 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:44.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.004+0000 7f16fd307640 1 --2- 172.21.15.49:0/4035637046 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16f81513a0 0x7f16f81ed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:44.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.008+0000 7f16fdb08640 1 -- 172.21.15.49:0/4035637046 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16f81513a0 msgr2=0x7f16f81ed780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:44.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.008+0000 7f16fdb08640 1 --2- 172.21.15.49:0/4035637046 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16f81513a0 0x7f16f81ed780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:44.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.008+0000 7f16fdb08640 1 -- 172.21.15.49:0/4035637046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16f815b3f0 msgr2=0x7f16f81e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:44.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.008+0000 7f16fdb08640 1 --2- 172.21.15.49:0/4035637046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16f815b3f0 0x7f16f81e3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:44.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.008+0000 7f16fdb08640 1 -- 172.21.15.49:0/4035637046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0009a70 con 0x7f16f8150fc0 2023-11-18T20:59:44.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.008+0000 7f16fdb08640 1 --2- 172.21.15.49:0/4035637046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16f8150fc0 0x7f16f81f0df0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f16f400c3a0 tx=0x7f16f400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:44.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.012+0000 7f16ee7fc640 1 -- 172.21.15.49:0/4035637046 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f40052d0 con 0x7f16f8150fc0 2023-11-18T20:59:44.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.012+0000 7f16ee7fc640 1 -- 172.21.15.49:0/4035637046 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f4005430 con 0x7f16f8150fc0 2023-11-18T20:59:44.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.012+0000 7f16ee7fc640 1 -- 172.21.15.49:0/4035637046 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4007260 con 0x7f16f8150fc0 2023-11-18T20:59:44.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.012+0000 7f16ffd6c640 1 -- 172.21.15.49:0/4035637046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f81e32b0 con 0x7f16f8150fc0 2023-11-18T20:59:44.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.012+0000 7f16ffd6c640 1 -- 172.21.15.49:0/4035637046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f81ecf80 con 0x7f16f8150fc0 2023-11-18T20:59:44.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.016+0000 7f16ffd6c640 1 -- 172.21.15.49:0/4035637046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f8073e70 con 0x7f16f8150fc0 2023-11-18T20:59:44.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.284+0000 7f16ee7fc640 1 -- 172.21.15.49:0/4035637046 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16f40073c0 con 0x7f16f8150fc0 2023-11-18T20:59:44.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.284+0000 7f16ee7fc640 1 --2- 172.21.15.49:0/4035637046 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f16dc06a8d0 0x7f16dc06cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:44.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.284+0000 7f16fd307640 1 --2- 172.21.15.49:0/4035637046 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f16dc06a8d0 0x7f16dc06cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:44.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.288+0000 7f16fd307640 1 --2- 172.21.15.49:0/4035637046 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f16dc06a8d0 0x7f16dc06cd90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f16f80c93d0 tx=0x7f16e8009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:44.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.300+0000 7f16ee7fc640 1 -- 172.21.15.49:0/4035637046 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f16f4007670 con 0x7f16f8150fc0 2023-11-18T20:59:44.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.300+0000 7f16ee7fc640 1 -- 172.21.15.49:0/4035637046 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16f4050ea0 con 0x7f16f8150fc0 2023-11-18T20:59:44.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.492+0000 7f16ffd6c640 1 -- 172.21.15.49:0/4035637046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f16f8070550 con 0x7f16f8150fc0 2023-11-18T20:59:44.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.512+0000 7f16ee7fc640 1 -- 172.21.15.49:0/4035637046 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f16f4020020 con 0x7f16f8150fc0 2023-11-18T20:59:44.512 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-18T20:59:44.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.512+0000 7f16ffd6c640 1 -- 172.21.15.49:0/4035637046 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f16dc06a8d0 msgr2=0x7f16dc06cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:44.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.512+0000 7f16ffd6c640 1 --2- 172.21.15.49:0/4035637046 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f16dc06a8d0 0x7f16dc06cd90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f16f80c93d0 tx=0x7f16e8009240 comp rx=0 tx=0).stop 2023-11-18T20:59:44.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.512+0000 7f16ffd6c640 1 -- 172.21.15.49:0/4035637046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16f8150fc0 msgr2=0x7f16f81f0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:44.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.512+0000 7f16ffd6c640 1 --2- 172.21.15.49:0/4035637046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16f8150fc0 0x7f16f81f0df0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f16f400c3a0 tx=0x7f16f400c860 comp rx=0 tx=0).stop 2023-11-18T20:59:44.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.512+0000 7f16ffd6c640 1 -- 172.21.15.49:0/4035637046 shutdown_connections 2023-11-18T20:59:44.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.512+0000 7f16ffd6c640 1 --2- 172.21.15.49:0/4035637046 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f16dc06a8d0 0x7f16dc06cd90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:44.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.512+0000 7f16ffd6c640 1 --2- 172.21.15.49:0/4035637046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16f815b3f0 0x7f16f81e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:44.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.512+0000 7f16ffd6c640 1 --2- 172.21.15.49:0/4035637046 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16f81513a0 0x7f16f81ed780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:44.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.512+0000 7f16ffd6c640 1 --2- 172.21.15.49:0/4035637046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16f8150fc0 0x7f16f81f0df0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:44.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.512+0000 7f16ffd6c640 1 -- 172.21.15.49:0/4035637046 >> 172.21.15.49:0/4035637046 conn(0x7f16f806b670 msgr2=0x7f16f80c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:44.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.512+0000 7f16ffd6c640 1 -- 172.21.15.49:0/4035637046 shutdown_connections 2023-11-18T20:59:44.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:44.512+0000 7f16ffd6c640 1 -- 172.21.15.49:0/4035637046 wait complete. 2023-11-18T20:59:44.532 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-18T20:59:44.532 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T20:59:44.532 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-18T20:59:44.532 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-18T20:59:44.532 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-18T20:59:44.532 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-18T20:59:44.532 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-18T20:59:44.532 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T20:59:44.532 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-18T20:59:44.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:44.533 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-18T20:59:44.539 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T20:59:44.539 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T20:59:44.539 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T20:59:44.539 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:59:44.539 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-18T20:59:44.539 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:59:44.539 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-18T20:59:44.539 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:59:44.540 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-18T20:59:44.540 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-18T20:59:44.540 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:59:44.540 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-18T20:59:44.540 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T20:59:44.540 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:59:44.540 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-18T20:59:44.540 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-18T20:59:44.540 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42108sec preferred_lft 42108sec 2023-11-18T20:59:44.540 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-18T20:59:44.540 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:59:44.540 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-18T20:59:44.540 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-18T20:59:44.541 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-18T20:59:44.541 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-18T20:59:44.541 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:fd:06:92:9c brd ff:ff:ff:ff:ff:ff 2023-11-18T20:59:44.541 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-18T20:59:44.541 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-18T20:59:44.541 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-18T20:59:44.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:44.542 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-18T20:59:44.542 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-18T20:59:44.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2023-11-18T20:59:44.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2023-11-18T20:59:44.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2023-11-18T20:59:44.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-18T20:59:44.542 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-18T20:59:44.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:44.619 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T20:59:44.671 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-18T20:59:44.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:44.673 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-18T20:59:44.734 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-18T20:59:44.734 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T20:59:44.734 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-18T20:59:44.734 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-18T20:59:44.735 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-18T20:59:44.735 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T20:59:44.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:44.735 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-18T20:59:44.735 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-18T20:59:44.736 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-18T20:59:44.736 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-18T20:59:44.736 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-18T20:59:44.736 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-18T20:59:44.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:44.811 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-18T20:59:44.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:44.860 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2023-11-18T20:59:44.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:44.909 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-18T20:59:44.909 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-18T20:59:44.909 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T20:59:44.909 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-18T20:59:44.909 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-18T20:59:44.976 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-18T20:59:44.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:44.977 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-18T20:59:44.977 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-18T20:59:44.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-18T20:59:44.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-18T20:59:44.978 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-18T20:59:44.978 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-18T20:59:44.978 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-18T20:59:44.978 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-18T20:59:45.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:45.090 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-18T20:59:45.090 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-18T20:59:45.090 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-11-18T20:59:45.091 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2023-11-18T20:59:45.091 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-18T20:59:45.109 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-18T20:59:45.109 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:59:45.109 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-18T20:59:45.155 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-18T20:59:45.155 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T20:59:45.155 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-18T20:59:45.203 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-11-18T20:59:45.260 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T20:59:45.309 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2023-11-18T20:59:45.309 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2023-11-18T20:59:45.309 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2023-11-18T20:59:45.309 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2023-11-18T20:59:45.309 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2023-11-18T20:59:45.309 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2023-11-18T20:59:45.309 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2023-11-18T20:59:45.309 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2023-11-18T20:59:45.309 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2023-11-18T20:59:45.309 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2023-11-18T20:59:45.310 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2023-11-18T20:59:45.310 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2023-11-18T20:59:45.310 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T20:59:45.310 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2023-11-18T20:59:45.310 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2023-11-18T20:59:45.310 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2023-11-18T20:59:45.310 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2023-11-18T20:59:45.310 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2023-11-18T20:59:45.310 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2023-11-18T20:59:45.310 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2023-11-18T20:59:45.310 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2023-11-18T20:59:45.310 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2023-11-18T20:59:45.311 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2023-11-18T20:59:45.311 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2023-11-18T20:59:45.311 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T20:59:45.311 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T20:59:45.311 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T20:59:45.311 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T20:59:45.311 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2023-11-18T20:59:45.311 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T20:59:45.311 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T20:59:45.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:45.312 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-11-18T20:59:45.359 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-18T20:59:45.359 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-11-18T20:59:45.405 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-11-18T20:59:45.419 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T20:59:45.472 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2023-11-18T20:59:45.472 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2023-11-18T20:59:45.472 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2023-11-18T20:59:45.472 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2023-11-18T20:59:45.472 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2023-11-18T20:59:45.472 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2023-11-18T20:59:45.473 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2023-11-18T20:59:45.473 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2023-11-18T20:59:45.473 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2023-11-18T20:59:45.473 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2023-11-18T20:59:45.473 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2023-11-18T20:59:45.473 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2023-11-18T20:59:45.473 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T20:59:45.473 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2023-11-18T20:59:45.473 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2023-11-18T20:59:45.473 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2023-11-18T20:59:45.473 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2023-11-18T20:59:45.473 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2023-11-18T20:59:45.474 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2023-11-18T20:59:45.474 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2023-11-18T20:59:45.474 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2023-11-18T20:59:45.474 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2023-11-18T20:59:45.474 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2023-11-18T20:59:45.474 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2023-11-18T20:59:45.474 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T20:59:45.474 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T20:59:45.474 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T20:59:45.474 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T20:59:45.474 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2023-11-18T20:59:45.474 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T20:59:45.474 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T20:59:45.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:45.475 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-11-18T20:59:45.503 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:2023-11-18T20:59:45.500+0000 7f217540e580 -1 init, newargv = 0x55d2e0314420 newargc=15 2023-11-18T20:59:45.503 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[43907]: starting ceph client 2023-11-18T20:59:45.964 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[43907]: starting fuse 2023-11-18T20:59:46.608 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-11-18T20:59:46.625 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T20:59:46.673 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2023-11-18T20:59:46.673 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2023-11-18T20:59:46.673 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2023-11-18T20:59:46.673 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2023-11-18T20:59:46.673 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2023-11-18T20:59:46.673 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2023-11-18T20:59:46.673 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2023-11-18T20:59:46.674 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2023-11-18T20:59:46.674 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2023-11-18T20:59:46.674 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2023-11-18T20:59:46.674 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2023-11-18T20:59:46.674 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2023-11-18T20:59:46.674 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T20:59:46.674 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2023-11-18T20:59:46.674 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2023-11-18T20:59:46.674 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2023-11-18T20:59:46.674 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2023-11-18T20:59:46.674 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2023-11-18T20:59:46.674 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2023-11-18T20:59:46.675 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2023-11-18T20:59:46.675 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2023-11-18T20:59:46.675 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2023-11-18T20:59:46.675 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2023-11-18T20:59:46.675 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2023-11-18T20:59:46.675 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T20:59:46.675 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T20:59:46.675 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T20:59:46.675 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T20:59:46.675 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2023-11-18T20:59:46.675 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T20:59:46.675 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T20:59:46.675 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.admin 2023-11-18T20:59:46.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:46.676 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-11-18T20:59:46.724 INFO:teuthology.orchestra.run.smithi049.stdout:45 2023-11-18T20:59:46.724 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-18T20:59:46.724 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2023-11-18T20:59:46.725 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2023-11-18T20:59:46.725 DEBUG:teuthology.orchestra.run.smithi049:> import re 2023-11-18T20:59:46.725 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-11-18T20:59:46.725 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-11-18T20:59:46.725 DEBUG:teuthology.orchestra.run.smithi049:> 2023-11-18T20:59:46.725 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2023-11-18T20:59:46.725 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-18T20:59:46.725 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2023-11-18T20:59:46.725 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-18T20:59:46.725 DEBUG:teuthology.orchestra.run.smithi049:> 2023-11-18T20:59:46.725 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2023-11-18T20:59:46.725 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2023-11-18T20:59:46.725 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2023-11-18T20:59:46.725 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2023-11-18T20:59:46.726 DEBUG:teuthology.orchestra.run.smithi049:> 2023-11-18T20:59:46.726 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2023-11-18T20:59:46.726 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-18T20:59:46.726 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-18T20:59:46.726 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-18T20:59:46.726 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2023-11-18T20:59:46.726 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2023-11-18T20:59:46.726 DEBUG:teuthology.orchestra.run.smithi049:> return f 2023-11-18T20:59:46.726 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-18T20:59:46.726 DEBUG:teuthology.orchestra.run.smithi049:> 2023-11-18T20:59:46.726 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.admin")) 2023-11-18T20:59:46.726 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-11-18T20:59:46.855 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.admin.43907.asok 2023-11-18T20:59:46.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-18T20:59:46.867 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43907.asok 2023-11-18T20:59:46.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:46.867 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43907.asok status 2023-11-18T20:59:47.026 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T20:59:47.026 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2023-11-18T20:59:47.026 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe", 2023-11-18T20:59:47.026 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 18.0.0-7418-gb0f45a51 (b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe) reef (dev)", 2023-11-18T20:59:47.026 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "admin", 2023-11-18T20:59:47.026 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2023-11-18T20:59:47.026 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-18T20:59:47.026 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "43907", 2023-11-18T20:59:47.027 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2023-11-18T20:59:47.027 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-18T20:59:47.027 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2023-11-18T20:59:47.027 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2023-11-18T20:59:47.027 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4281, 2023-11-18T20:59:47.027 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2023-11-18T20:59:47.027 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2023-11-18T20:59:47.027 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2023-11-18T20:59:47.027 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4281 2023-11-18T20:59:47.027 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-18T20:59:47.027 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-11-18T20:59:47.027 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-11-18T20:59:47.027 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-11-18T20:59:47.028 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1992093494 2023-11-18T20:59:47.028 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-18T20:59:47.028 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-18T20:59:47.028 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-11-18T20:59:47.028 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-11-18T20:59:47.028 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-11-18T20:59:47.028 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1992093494 2023-11-18T20:59:47.028 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-18T20:59:47.028 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4281 192.168.0.1:0/1992093494", 2023-11-18T20:59:47.028 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/1992093494", 2023-11-18T20:59:47.028 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2023-11-18T20:59:47.028 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 8, 2023-11-18T20:59:47.028 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 29, 2023-11-18T20:59:47.028 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2023-11-18T20:59:47.029 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2023-11-18T20:59:47.029 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2023-11-18T20:59:47.029 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T20:59:47.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:47.040 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2023-11-18T20:59:47.040 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-18T20:59:47.062 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2023-11-18T20:59:47.062 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-18T20:59:47.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:47.063 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-18T20:59:47.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:47.271 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-18T20:59:47.675 INFO:teuthology.orchestra.run.smithi049.stdout:# file: . 2023-11-18T20:59:47.675 INFO:teuthology.orchestra.run.smithi049.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-18T20:59:47.675 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:59:47.676 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:59:47.677 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:59:47.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:59:47.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.848+0000 7fd210790640 1 Processor -- start 2023-11-18T20:59:47.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.848+0000 7fd210790640 1 -- start start 2023-11-18T20:59:47.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.848+0000 7fd210790640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208151340 0x7fd20806ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:47.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.848+0000 7fd210790640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd208151720 0x7fd208157c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:47.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.848+0000 7fd210790640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20806f4a0 con 0x7fd2080c40e0 2023-11-18T20:59:47.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.848+0000 7fd210790640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd208072570 con 0x7fd208151720 2023-11-18T20:59:47.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.848+0000 7fd210790640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd208070be0 con 0x7fd208151340 2023-11-18T20:59:47.851 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.852+0000 7fd20dd2b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd208151720 0x7fd208157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:47.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.852+0000 7fd20ed2d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd2080c40e0 0x7fd2080c70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38618/0 (socket says 172.21.15.49:38618) 2023-11-18T20:59:47.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.852+0000 7fd20ed2d640 1 -- 172.21.15.49:0/2421607412 learned_addr learned my addr 172.21.15.49:0/2421607412 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:59:47.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.852+0000 7fd20e52c640 1 --2- 172.21.15.49:0/2421607412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208151340 0x7fd20806ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:47.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.852+0000 7fd20dd2b640 1 -- 172.21.15.49:0/2421607412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208151340 msgr2=0x7fd20806ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:47.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.852+0000 7fd20dd2b640 1 --2- 172.21.15.49:0/2421607412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208151340 0x7fd20806ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:47.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.852+0000 7fd20dd2b640 1 -- 172.21.15.49:0/2421607412 >> v1:172.21.15.49:6789/0 conn(0x7fd2080c40e0 legacy=0x7fd2080c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:47.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.852+0000 7fd20dd2b640 1 -- 172.21.15.49:0/2421607412 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd208158190 con 0x7fd208151720 2023-11-18T20:59:47.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.856+0000 7fd20dd2b640 1 --2- 172.21.15.49:0/2421607412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd208151720 0x7fd208157c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80097c0 tx=0x7fd1f801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7735cb10fcb2e1f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:47.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.864+0000 7fd20d52a640 1 -- 172.21.15.49:0/2421607412 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f80ab650 con 0x7fd208151720 2023-11-18T20:59:47.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.864+0000 7fd20d52a640 1 -- 172.21.15.49:0/2421607412 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f80ab7b0 con 0x7fd208151720 2023-11-18T20:59:47.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.864+0000 7fd20d52a640 1 -- 172.21.15.49:0/2421607412 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f80abb40 con 0x7fd208151720 2023-11-18T20:59:47.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.864+0000 7fd210790640 1 -- 172.21.15.49:0/2421607412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd208151720 msgr2=0x7fd208157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:47.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.864+0000 7fd210790640 1 --2- 172.21.15.49:0/2421607412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd208151720 0x7fd208157c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80097c0 tx=0x7fd1f801c450 comp rx=0 tx=0).stop 2023-11-18T20:59:47.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.864+0000 7fd210790640 1 -- 172.21.15.49:0/2421607412 shutdown_connections 2023-11-18T20:59:47.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.864+0000 7fd210790640 1 --2- 172.21.15.49:0/2421607412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd208151720 0x7fd208157c50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:47.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.864+0000 7fd210790640 1 --2- 172.21.15.49:0/2421607412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208151340 0x7fd20806ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.864+0000 7fd210790640 1 -- 172.21.15.49:0/2421607412 >> 172.21.15.49:0/2421607412 conn(0x7fd20806c6a0 msgr2=0x7fd20806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.864+0000 7fd210790640 1 -- 172.21.15.49:0/2421607412 shutdown_connections 2023-11-18T20:59:47.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.864+0000 7fd210790640 1 -- 172.21.15.49:0/2421607412 wait complete. 2023-11-18T20:59:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.868+0000 7fd210790640 1 Processor -- start 2023-11-18T20:59:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.868+0000 7fd210790640 1 -- start start 2023-11-18T20:59:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.868+0000 7fd210790640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2080c40e0 0x7fd208148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.868+0000 7fd210790640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208151340 0x7fd20814b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.868+0000 7fd210790640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd208151720 0x7fd20814b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:47.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.868+0000 7fd210790640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2080c2260 con 0x7fd208151720 2023-11-18T20:59:47.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.868+0000 7fd210790640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081475a0 con 0x7fd2080c40e0 2023-11-18T20:59:47.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.868+0000 7fd210790640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20815fd00 con 0x7fd208151340 2023-11-18T20:59:47.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.868+0000 7fd20dd2b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208151340 0x7fd20814b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:47.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.868+0000 7fd20e52c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2080c40e0 0x7fd208148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.868+0000 7fd20dd2b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208151340 0x7fd20814b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:43912/0 (socket says 172.21.15.49:43912) 2023-11-18T20:59:47.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.868+0000 7fd20dd2b640 1 -- 172.21.15.49:0/2712121383 learned_addr learned my addr 172.21.15.49:0/2712121383 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:47.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.876+0000 7fd20ed2d640 1 --2- 172.21.15.49:0/2712121383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd208151720 0x7fd20814b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:47.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.880+0000 7fd20dd2b640 1 -- 172.21.15.49:0/2712121383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2080c40e0 msgr2=0x7fd208148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:47.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.880+0000 7fd20dd2b640 1 --2- 172.21.15.49:0/2712121383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2080c40e0 0x7fd208148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:47.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.880+0000 7fd20dd2b640 1 -- 172.21.15.49:0/2712121383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd208151720 msgr2=0x7fd20814b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:47.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.880+0000 7fd20dd2b640 1 --2- 172.21.15.49:0/2712121383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd208151720 0x7fd20814b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:47.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.880+0000 7fd20dd2b640 1 -- 172.21.15.49:0/2712121383 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f8009420 con 0x7fd208151340 2023-11-18T20:59:47.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.892+0000 7fd20dd2b640 1 --2- 172.21.15.49:0/2712121383 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208151340 0x7fd20814b440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd1f801ab00 tx=0x7fd1f80191f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:47.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.912+0000 7fd1feffd640 1 -- 172.21.15.49:0/2712121383 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f80abe30 con 0x7fd208151340 2023-11-18T20:59:47.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.912+0000 7fd1feffd640 1 -- 172.21.15.49:0/2712121383 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f80bf450 con 0x7fd208151340 2023-11-18T20:59:47.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.912+0000 7fd210790640 1 -- 172.21.15.49:0/2712121383 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd208149150 con 0x7fd208151340 2023-11-18T20:59:47.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.912+0000 7fd1feffd640 1 -- 172.21.15.49:0/2712121383 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f80bf800 con 0x7fd208151340 2023-11-18T20:59:47.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.912+0000 7fd210790640 1 -- 172.21.15.49:0/2712121383 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd208147b20 con 0x7fd208151340 2023-11-18T20:59:47.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:47.912+0000 7fd210790640 1 -- 172.21.15.49:0/2712121383 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd208067520 con 0x7fd208151340 2023-11-18T20:59:48.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.212+0000 7fd1feffd640 1 -- 172.21.15.49:0/2712121383 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1f80bf960 con 0x7fd208151340 2023-11-18T20:59:48.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.216+0000 7fd1feffd640 1 --2- 172.21.15.49:0/2712121383 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd1ec0664c0 0x7fd1ec068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:48.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.216+0000 7fd20e52c640 1 --2- 172.21.15.49:0/2712121383 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd1ec0664c0 0x7fd1ec068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:48.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.216+0000 7fd1feffd640 1 -- 172.21.15.49:0/2712121383 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1f80f02b0 con 0x7fd208151340 2023-11-18T20:59:48.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.216+0000 7fd20e52c640 1 --2- 172.21.15.49:0/2712121383 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd1ec0664c0 0x7fd1ec068980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd2000113e0 tx=0x7fd20000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:48.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.228+0000 7fd1feffd640 1 -- 172.21.15.49:0/2712121383 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1f80ec5f0 con 0x7fd208151340 2023-11-18T20:59:48.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.420+0000 7fd210790640 1 -- 172.21.15.49:0/2712121383 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd208156670 con 0x7fd208151340 2023-11-18T20:59:48.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.584+0000 7fd1feffd640 1 -- 172.21.15.49:0/2712121383 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18314 (secure 0 0 0) 0x7fd1f80efc10 con 0x7fd208151340 2023-11-18T20:59:48.587 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:59:48.588 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":29,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:59:36.521114+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:59:48.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.588+0000 7fd210790640 1 -- 172.21.15.49:0/2712121383 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd1ec0664c0 msgr2=0x7fd1ec068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:48.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.588+0000 7fd210790640 1 --2- 172.21.15.49:0/2712121383 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd1ec0664c0 0x7fd1ec068980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd2000113e0 tx=0x7fd20000b040 comp rx=0 tx=0).stop 2023-11-18T20:59:48.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.588+0000 7fd210790640 1 -- 172.21.15.49:0/2712121383 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208151340 msgr2=0x7fd20814b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:48.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.588+0000 7fd210790640 1 --2- 172.21.15.49:0/2712121383 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208151340 0x7fd20814b440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd1f801ab00 tx=0x7fd1f80191f0 comp rx=0 tx=0).stop 2023-11-18T20:59:48.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.588+0000 7fd210790640 1 -- 172.21.15.49:0/2712121383 shutdown_connections 2023-11-18T20:59:48.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.588+0000 7fd210790640 1 --2- 172.21.15.49:0/2712121383 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd1ec0664c0 0x7fd1ec068980 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:48.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.588+0000 7fd210790640 1 --2- 172.21.15.49:0/2712121383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd208151720 0x7fd20814b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:48.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.588+0000 7fd210790640 1 --2- 172.21.15.49:0/2712121383 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208151340 0x7fd20814b440 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:48.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.588+0000 7fd210790640 1 --2- 172.21.15.49:0/2712121383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2080c40e0 0x7fd208148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:48.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.588+0000 7fd210790640 1 -- 172.21.15.49:0/2712121383 >> 172.21.15.49:0/2712121383 conn(0x7fd20806c6a0 msgr2=0x7fd20806ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:48.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.588+0000 7fd210790640 1 -- 172.21.15.49:0/2712121383 shutdown_connections 2023-11-18T20:59:48.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.588+0000 7fd210790640 1 -- 172.21.15.49:0/2712121383 wait complete. 2023-11-18T20:59:48.611 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:58:42.362631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:59:22.756454+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:59:25.252588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-18T20:59:33.423071+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-18T20:59:48.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:59:48.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.748+0000 7f0344718640 1 Processor -- start 2023-11-18T20:59:48.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.748+0000 7f0344718640 1 -- start start 2023-11-18T20:59:48.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.748+0000 7f0344718640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f033c0c5180 0x7f033c156f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:48.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.748+0000 7f0344718640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f033c0c5560 0x7f033c0c2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:48.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.748+0000 7f0344718640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f033c0c7440 0x7f033c06b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:48.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.748+0000 7f0344718640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c0c4370 con 0x7f033c0c7440 2023-11-18T20:59:48.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.748+0000 7f0344718640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c0c6820 con 0x7f033c0c5560 2023-11-18T20:59:48.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.748+0000 7f0344718640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c156af0 con 0x7f033c0c5180 2023-11-18T20:59:48.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.748+0000 7f0342cb5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f033c0c7440 0x7f033c06b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:48.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.748+0000 7f0342cb5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f033c0c7440 0x7f033c06b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55314/0 (socket says 172.21.15.49:55314) 2023-11-18T20:59:48.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.748+0000 7f0342cb5640 1 -- 172.21.15.49:0/4046603604 learned_addr learned my addr 172.21.15.49:0/4046603604 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:48.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.752+0000 7f0342cb5640 1 -- 172.21.15.49:0/4046603604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f033c0c5180 msgr2=0x7f033c156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:48.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.752+0000 7f0342cb5640 1 --2- 172.21.15.49:0/4046603604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f033c0c5180 0x7f033c156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:48.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.752+0000 7f0342cb5640 1 -- 172.21.15.49:0/4046603604 >> v2:172.21.15.106:3300/0 conn(0x7f033c0c5560 msgr2=0x7f033c0c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:48.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.752+0000 7f0342cb5640 1 --2- 172.21.15.49:0/4046603604 >> v2:172.21.15.106:3300/0 conn(0x7f033c0c5560 0x7f033c0c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:48.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.752+0000 7f0342cb5640 1 -- 172.21.15.49:0/4046603604 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c0c6260 con 0x7f033c0c7440 2023-11-18T20:59:48.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.756+0000 7f0342cb5640 1 --2- 172.21.15.49:0/4046603604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0c7440 0x7f033c06b800 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f033c0c8e90 tx=0x7f032c01ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac4f4bb062bd2c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:48.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f03414b2640 1 -- 172.21.15.49:0/4046603604 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c00b2d0 con 0x7f033c0c7440 2023-11-18T20:59:48.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f03414b2640 1 -- 172.21.15.49:0/4046603604 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c00b430 con 0x7f033c0c7440 2023-11-18T20:59:48.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f03414b2640 1 -- 172.21.15.49:0/4046603604 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c0a7c80 con 0x7f033c0c7440 2023-11-18T20:59:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 -- 172.21.15.49:0/4046603604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0c7440 msgr2=0x7f033c06b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 --2- 172.21.15.49:0/4046603604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0c7440 0x7f033c06b800 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f033c0c8e90 tx=0x7f032c01ebd0 comp rx=0 tx=0).stop 2023-11-18T20:59:48.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 -- 172.21.15.49:0/4046603604 shutdown_connections 2023-11-18T20:59:48.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 --2- 172.21.15.49:0/4046603604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0c7440 0x7f033c06b800 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:48.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 --2- 172.21.15.49:0/4046603604 >> v2:172.21.15.106:3300/0 conn(0x7f033c0c5560 0x7f033c0c2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:48.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 --2- 172.21.15.49:0/4046603604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f033c0c5180 0x7f033c156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:48.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 -- 172.21.15.49:0/4046603604 >> 172.21.15.49:0/4046603604 conn(0x7f033c06d220 msgr2=0x7f033c06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:48.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 -- 172.21.15.49:0/4046603604 shutdown_connections 2023-11-18T20:59:48.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 -- 172.21.15.49:0/4046603604 wait complete. 2023-11-18T20:59:48.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 Processor -- start 2023-11-18T20:59:48.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 -- start start 2023-11-18T20:59:48.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0c5180 0x7f033c0c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:48.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f033c0c5560 0x7f033c150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:48.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f033c0c7440 0x7f033c1f0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:48.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c14ce60 con 0x7f033c0c5180 2023-11-18T20:59:48.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0c9130 con 0x7f033c0c7440 2023-11-18T20:59:48.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f0344718640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0cac60 con 0x7f033c0c5560 2023-11-18T20:59:48.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.760+0000 7f03424b4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0c5180 0x7f033c0c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:48.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.764+0000 7f03424b4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0c5180 0x7f033c0c7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55324/0 (socket says 172.21.15.49:55324) 2023-11-18T20:59:48.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.764+0000 7f03424b4640 1 -- 172.21.15.49:0/4190084352 learned_addr learned my addr 172.21.15.49:0/4190084352 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:48.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.764+0000 7f03424b4640 1 -- 172.21.15.49:0/4190084352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f033c0c5560 msgr2=0x7f033c150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:48.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.764+0000 7f03424b4640 1 --2- 172.21.15.49:0/4190084352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f033c0c5560 0x7f033c150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:48.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.764+0000 7f03424b4640 1 -- 172.21.15.49:0/4190084352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f033c0c7440 msgr2=0x7f033c1f0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:48.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.764+0000 7f03424b4640 1 --2- 172.21.15.49:0/4190084352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f033c0c7440 0x7f033c1f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:48.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.764+0000 7f03424b4640 1 -- 172.21.15.49:0/4190084352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c00bd40 con 0x7f033c0c5180 2023-11-18T20:59:48.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.768+0000 7f03424b4640 1 --2- 172.21.15.49:0/4190084352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0c5180 0x7f033c0c7ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f033400b580 tx=0x7f033400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:48.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.772+0000 7f033affd640 1 -- 172.21.15.49:0/4190084352 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0334011890 con 0x7f033c0c5180 2023-11-18T20:59:48.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.772+0000 7f033affd640 1 -- 172.21.15.49:0/4190084352 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0334011a10 con 0x7f033c0c5180 2023-11-18T20:59:48.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.772+0000 7f033affd640 1 -- 172.21.15.49:0/4190084352 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0334011dc0 con 0x7f033c0c5180 2023-11-18T20:59:48.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.772+0000 7f0344718640 1 -- 172.21.15.49:0/4190084352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c0cb0f0 con 0x7f033c0c5180 2023-11-18T20:59:48.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.772+0000 7f0344718640 1 -- 172.21.15.49:0/4190084352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c0ca050 con 0x7f033c0c5180 2023-11-18T20:59:48.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.772+0000 7f0344718640 1 -- 172.21.15.49:0/4190084352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033c073e70 con 0x7f033c0c5180 2023-11-18T20:59:48.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.792+0000 7f033affd640 1 -- 172.21.15.49:0/4190084352 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f033401a400 con 0x7f033c0c5180 2023-11-18T20:59:48.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.796+0000 7f033affd640 1 --2- 172.21.15.49:0/4190084352 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f03280664c0 0x7f0328068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:48.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.796+0000 7f0341cb3640 1 --2- 172.21.15.49:0/4190084352 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f03280664c0 0x7f0328068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:48.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.796+0000 7f0341cb3640 1 --2- 172.21.15.49:0/4190084352 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f03280664c0 0x7f0328068980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f033c1f1bd0 tx=0x7f0330006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:48.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:48.800+0000 7f033affd640 1 -- 172.21.15.49:0/4190084352 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0334056000 con 0x7f033c0c5180 2023-11-18T20:59:49.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.088+0000 7f033affd640 1 -- 172.21.15.49:0/4190084352 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0334051c40 con 0x7f033c0c5180 2023-11-18T20:59:49.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.252+0000 7f0344718640 1 -- 172.21.15.49:0/4190084352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f033c06d6a0 con 0x7f033c0c5180 2023-11-18T20:59:49.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.268+0000 7f033affd640 1 -- 172.21.15.49:0/4190084352 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0334015020 con 0x7f033c0c5180 2023-11-18T20:59:49.268 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-18T20:59:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.268+0000 7f0344718640 1 -- 172.21.15.49:0/4190084352 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f03280664c0 msgr2=0x7f0328068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.268+0000 7f0344718640 1 --2- 172.21.15.49:0/4190084352 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f03280664c0 0x7f0328068980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f033c1f1bd0 tx=0x7f0330006ca0 comp rx=0 tx=0).stop 2023-11-18T20:59:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.268+0000 7f0344718640 1 -- 172.21.15.49:0/4190084352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0c5180 msgr2=0x7f033c0c7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.268+0000 7f0344718640 1 --2- 172.21.15.49:0/4190084352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0c5180 0x7f033c0c7ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f033400b580 tx=0x7f033400ba40 comp rx=0 tx=0).stop 2023-11-18T20:59:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.268+0000 7f0344718640 1 -- 172.21.15.49:0/4190084352 shutdown_connections 2023-11-18T20:59:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.268+0000 7f0344718640 1 --2- 172.21.15.49:0/4190084352 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f03280664c0 0x7f0328068980 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.268+0000 7f0344718640 1 --2- 172.21.15.49:0/4190084352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f033c0c7440 0x7f033c1f0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.268+0000 7f0344718640 1 --2- 172.21.15.49:0/4190084352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f033c0c5560 0x7f033c150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.268+0000 7f0344718640 1 --2- 172.21.15.49:0/4190084352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f033c0c5180 0x7f033c0c7ab0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:49.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.268+0000 7f0344718640 1 -- 172.21.15.49:0/4190084352 >> 172.21.15.49:0/4190084352 conn(0x7f033c06d220 msgr2=0x7f033c1491a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:49.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.268+0000 7f0344718640 1 -- 172.21.15.49:0/4190084352 shutdown_connections 2023-11-18T20:59:49.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.268+0000 7f0344718640 1 -- 172.21.15.49:0/4190084352 wait complete. 2023-11-18T20:59:49.289 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:59:49.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.412+0000 7fcf2d756640 1 Processor -- start 2023-11-18T20:59:49.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.412+0000 7fcf2d756640 1 -- start start 2023-11-18T20:59:49.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.412+0000 7fcf2d756640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf2814ff30 0x7fcf2815a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:49.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.412+0000 7fcf2d756640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2815d1f0 0x7fcf2815d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:49.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.412+0000 7fcf2d756640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2806b4c0 con 0x7fcf280cb290 2023-11-18T20:59:49.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.412+0000 7fcf2d756640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2815cd60 con 0x7fcf2814ff30 2023-11-18T20:59:49.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.412+0000 7fcf2d756640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2806bcd0 con 0x7fcf2815d1f0 2023-11-18T20:59:49.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.436+0000 7fcf26ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf2814ff30 0x7fcf2815a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.436+0000 7fcf26ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf2814ff30 0x7fcf2815a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:59950/0 (socket says 172.21.15.49:59950) 2023-11-18T20:59:49.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.436+0000 7fcf26ffd640 1 -- 172.21.15.49:0/2121008761 learned_addr learned my addr 172.21.15.49:0/2121008761 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.444+0000 7fcf26ffd640 1 -- 172.21.15.49:0/2121008761 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2815d1f0 msgr2=0x7fcf2815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.444+0000 7fcf26ffd640 1 --2- 172.21.15.49:0/2121008761 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2815d1f0 0x7fcf2815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.444+0000 7fcf26ffd640 1 -- 172.21.15.49:0/2121008761 >> v1:172.21.15.49:6789/0 conn(0x7fcf280cb290 legacy=0x7fcf280c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:49.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.444+0000 7fcf26ffd640 1 -- 172.21.15.49:0/2121008761 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2806ab30 con 0x7fcf2814ff30 2023-11-18T20:59:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.544+0000 7fcf26ffd640 1 --2- 172.21.15.49:0/2121008761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf2814ff30 0x7fcf2815a050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009870 tx=0x7fcf1801c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5a6cc8ddce79929 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:49.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.556+0000 7fcf267fc640 1 -- 172.21.15.49:0/2121008761 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf180ac410 con 0x7fcf2814ff30 2023-11-18T20:59:49.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.556+0000 7fcf267fc640 1 -- 172.21.15.49:0/2121008761 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf180ac570 con 0x7fcf2814ff30 2023-11-18T20:59:49.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.556+0000 7fcf267fc640 1 -- 172.21.15.49:0/2121008761 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf180ac900 con 0x7fcf2814ff30 2023-11-18T20:59:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.556+0000 7fcf2d756640 1 -- 172.21.15.49:0/2121008761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf2814ff30 msgr2=0x7fcf2815a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.556+0000 7fcf2d756640 1 --2- 172.21.15.49:0/2121008761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf2814ff30 0x7fcf2815a050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009870 tx=0x7fcf1801c500 comp rx=0 tx=0).stop 2023-11-18T20:59:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.556+0000 7fcf2d756640 1 -- 172.21.15.49:0/2121008761 shutdown_connections 2023-11-18T20:59:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.556+0000 7fcf2d756640 1 --2- 172.21.15.49:0/2121008761 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2815d1f0 0x7fcf2815d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.556+0000 7fcf2d756640 1 --2- 172.21.15.49:0/2121008761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf2814ff30 0x7fcf2815a050 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.556+0000 7fcf2d756640 1 -- 172.21.15.49:0/2121008761 >> 172.21.15.49:0/2121008761 conn(0x7fcf2806d220 msgr2=0x7fcf2806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.556+0000 7fcf2d756640 1 -- 172.21.15.49:0/2121008761 shutdown_connections 2023-11-18T20:59:49.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.556+0000 7fcf2d756640 1 -- 172.21.15.49:0/2121008761 wait complete. 2023-11-18T20:59:49.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.560+0000 7fcf2d756640 1 Processor -- start 2023-11-18T20:59:49.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.560+0000 7fcf2d756640 1 -- start start 2023-11-18T20:59:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.560+0000 7fcf2d756640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf280cb290 0x7fcf28140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.560+0000 7fcf2d756640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2814ff30 0x7fcf281f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.560+0000 7fcf2d756640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf2815d1f0 0x7fcf28142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.560+0000 7fcf2d756640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf281491a0 con 0x7fcf280cb290 2023-11-18T20:59:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.560+0000 7fcf2d756640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf281f2540 con 0x7fcf2815d1f0 2023-11-18T20:59:49.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.560+0000 7fcf2d756640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf281493f0 con 0x7fcf2814ff30 2023-11-18T20:59:49.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.560+0000 7fcf26ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf280cb290 0x7fcf28140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:49.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.560+0000 7fcf26ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf280cb290 0x7fcf28140160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55340/0 (socket says 172.21.15.49:55340) 2023-11-18T20:59:49.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.560+0000 7fcf26ffd640 1 -- 172.21.15.49:0/1932334557 learned_addr learned my addr 172.21.15.49:0/1932334557 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:49.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.560+0000 7fcf1ffff640 1 --2- 172.21.15.49:0/1932334557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2814ff30 0x7fcf281f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:49.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.564+0000 7fcf277fe640 1 --2- 172.21.15.49:0/1932334557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf2815d1f0 0x7fcf28142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:49.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.564+0000 7fcf26ffd640 1 -- 172.21.15.49:0/1932334557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2814ff30 msgr2=0x7fcf281f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:49.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.564+0000 7fcf26ffd640 1 --2- 172.21.15.49:0/1932334557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2814ff30 0x7fcf281f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:49.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.564+0000 7fcf26ffd640 1 -- 172.21.15.49:0/1932334557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf2815d1f0 msgr2=0x7fcf28142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:49.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.564+0000 7fcf26ffd640 1 --2- 172.21.15.49:0/1932334557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf2815d1f0 0x7fcf28142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:49.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.564+0000 7fcf26ffd640 1 -- 172.21.15.49:0/1932334557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf180094d0 con 0x7fcf280cb290 2023-11-18T20:59:49.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.568+0000 7fcf26ffd640 1 --2- 172.21.15.49:0/1932334557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf280cb290 0x7fcf28140160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf1801a130 tx=0x7fcf180192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:49.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.572+0000 7fcf1f7fe640 1 -- 172.21.15.49:0/1932334557 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf180ac410 con 0x7fcf280cb290 2023-11-18T20:59:49.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.572+0000 7fcf2d756640 1 -- 172.21.15.49:0/1932334557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf281496d0 con 0x7fcf280cb290 2023-11-18T20:59:49.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.572+0000 7fcf2d756640 1 -- 172.21.15.49:0/1932334557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf281f27e0 con 0x7fcf280cb290 2023-11-18T20:59:49.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.572+0000 7fcf1f7fe640 1 -- 172.21.15.49:0/1932334557 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf180b6650 con 0x7fcf280cb290 2023-11-18T20:59:49.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.572+0000 7fcf1f7fe640 1 -- 172.21.15.49:0/1932334557 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf180b69c0 con 0x7fcf280cb290 2023-11-18T20:59:49.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.572+0000 7fcf2d756640 1 -- 172.21.15.49:0/1932334557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0c005260 con 0x7fcf280cb290 2023-11-18T20:59:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.596+0000 7fcf1f7fe640 1 -- 172.21.15.49:0/1932334557 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf180b6b20 con 0x7fcf280cb290 2023-11-18T20:59:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.596+0000 7fcf1f7fe640 1 --2- 172.21.15.49:0/1932334557 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf08066470 0x7fcf08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.596+0000 7fcf1ffff640 1 --2- 172.21.15.49:0/1932334557 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf08066470 0x7fcf08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.596+0000 7fcf1ffff640 1 --2- 172.21.15.49:0/1932334557 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf08066470 0x7fcf08068930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcf2814e830 tx=0x7fcf10006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.600+0000 7fcf1f7fe640 1 -- 172.21.15.49:0/1932334557 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcf180f04d0 con 0x7fcf280cb290 2023-11-18T20:59:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:49.884+0000 7fcf1f7fe640 1 -- 172.21.15.49:0/1932334557 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf180ec110 con 0x7fcf280cb290 2023-11-18T20:59:50.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.056+0000 7fcf2d756640 1 -- 172.21.15.49:0/1932334557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf0c005a90 con 0x7fcf280cb290 2023-11-18T20:59:50.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.064+0000 7fcf1f7fe640 1 -- 172.21.15.49:0/1932334557 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcf180ef730 con 0x7fcf280cb290 2023-11-18T20:59:50.066 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-11-18T20:59:50.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.068+0000 7fcf2d756640 1 -- 172.21.15.49:0/1932334557 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf08066470 msgr2=0x7fcf08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:50.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.068+0000 7fcf2d756640 1 --2- 172.21.15.49:0/1932334557 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf08066470 0x7fcf08068930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcf2814e830 tx=0x7fcf10006f90 comp rx=0 tx=0).stop 2023-11-18T20:59:50.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.068+0000 7fcf2d756640 1 -- 172.21.15.49:0/1932334557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf280cb290 msgr2=0x7fcf28140160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:50.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.068+0000 7fcf2d756640 1 --2- 172.21.15.49:0/1932334557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf280cb290 0x7fcf28140160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf1801a130 tx=0x7fcf180192a0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.068+0000 7fcf2d756640 1 -- 172.21.15.49:0/1932334557 shutdown_connections 2023-11-18T20:59:50.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.068+0000 7fcf2d756640 1 --2- 172.21.15.49:0/1932334557 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf08066470 0x7fcf08068930 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.068+0000 7fcf2d756640 1 --2- 172.21.15.49:0/1932334557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf2815d1f0 0x7fcf28142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.068+0000 7fcf2d756640 1 --2- 172.21.15.49:0/1932334557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2814ff30 0x7fcf281f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.068+0000 7fcf2d756640 1 --2- 172.21.15.49:0/1932334557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf280cb290 0x7fcf28140160 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.068+0000 7fcf2d756640 1 -- 172.21.15.49:0/1932334557 >> 172.21.15.49:0/1932334557 conn(0x7fcf2806d220 msgr2=0x7fcf2814ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:50.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.068+0000 7fcf2d756640 1 -- 172.21.15.49:0/1932334557 shutdown_connections 2023-11-18T20:59:50.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.068+0000 7fcf2d756640 1 -- 172.21.15.49:0/1932334557 wait complete. 2023-11-18T20:59:50.087 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:59:50.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.216+0000 7fb600bc1640 1 Processor -- start 2023-11-18T20:59:50.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.216+0000 7fb600bc1640 1 -- start start 2023-11-18T20:59:50.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.216+0000 7fb600bc1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb5fc14f850 0x7fb5fc0c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:50.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.216+0000 7fb600bc1640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb5fc0c1ed0 0x7fb5fc06e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:50.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.216+0000 7fb600bc1640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5fc070ab0 0x7fb5fc06ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:50.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.216+0000 7fb600bc1640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5fc0c3b10 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.216+0000 7fb600bc1640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5fc14fc30 con 0x7fb5fc14f850 2023-11-18T20:59:50.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.216+0000 7fb600bc1640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc0c11e0 con 0x7fb5fc070ab0 2023-11-18T20:59:50.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.216+0000 7fb5f9d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb5fc0c1ed0 0x7fb5fc06e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:50.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.216+0000 7fb5f9d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb5fc0c1ed0 0x7fb5fc06e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55346/0 (socket says 172.21.15.49:55346) 2023-11-18T20:59:50.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.216+0000 7fb5f9d9b640 1 -- 172.21.15.49:0/1223026440 learned_addr learned my addr 172.21.15.49:0/1223026440 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:50.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.216+0000 7fb5fa59c640 1 --2- 172.21.15.49:0/1223026440 >> v2:172.21.15.106:3300/0 conn(0x7fb5fc14f850 0x7fb5fc0c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:50.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.216+0000 7fb5fad9d640 1 --2- 172.21.15.49:0/1223026440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5fc070ab0 0x7fb5fc06ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:50.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.220+0000 7fb5f9d9b640 1 -- 172.21.15.49:0/1223026440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5fc070ab0 msgr2=0x7fb5fc06ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:50.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.220+0000 7fb5f9d9b640 1 --2- 172.21.15.49:0/1223026440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5fc070ab0 0x7fb5fc06ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.220+0000 7fb5f9d9b640 1 -- 172.21.15.49:0/1223026440 >> v2:172.21.15.106:3300/0 conn(0x7fb5fc14f850 msgr2=0x7fb5fc0c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:50.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.220+0000 7fb5f9d9b640 1 --2- 172.21.15.49:0/1223026440 >> v2:172.21.15.106:3300/0 conn(0x7fb5fc14f850 0x7fb5fc0c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.220+0000 7fb5f9d9b640 1 -- 172.21.15.49:0/1223026440 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc0c2410 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.220+0000 7fb5fad9d640 1 --2- 172.21.15.49:0/1223026440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5fc070ab0 0x7fb5fc06ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T20:59:50.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.224+0000 7fb5f9d9b640 1 --2- 172.21.15.49:0/1223026440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5fc0c1ed0 0x7fb5fc06e530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc06f120 tx=0x7fb5f001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7456fa962398136 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.232+0000 7fb5f959a640 1 -- 172.21.15.49:0/1223026440 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00aa5f0 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.232+0000 7fb5f959a640 1 -- 172.21.15.49:0/1223026440 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f00aa750 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.232+0000 7fb5f959a640 1 -- 172.21.15.49:0/1223026440 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00aaae0 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.232+0000 7fb600bc1640 1 -- 172.21.15.49:0/1223026440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5fc0c1ed0 msgr2=0x7fb5fc06e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.232+0000 7fb600bc1640 1 --2- 172.21.15.49:0/1223026440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5fc0c1ed0 0x7fb5fc06e530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc06f120 tx=0x7fb5f001c4d0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.232+0000 7fb600bc1640 1 -- 172.21.15.49:0/1223026440 shutdown_connections 2023-11-18T20:59:50.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.232+0000 7fb600bc1640 1 --2- 172.21.15.49:0/1223026440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5fc070ab0 0x7fb5fc06ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.232+0000 7fb600bc1640 1 --2- 172.21.15.49:0/1223026440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5fc0c1ed0 0x7fb5fc06e530 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.232+0000 7fb600bc1640 1 --2- 172.21.15.49:0/1223026440 >> v2:172.21.15.106:3300/0 conn(0x7fb5fc14f850 0x7fb5fc0c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.232+0000 7fb600bc1640 1 -- 172.21.15.49:0/1223026440 >> 172.21.15.49:0/1223026440 conn(0x7fb5fc06c6a0 msgr2=0x7fb5fc06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:50.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.232+0000 7fb600bc1640 1 -- 172.21.15.49:0/1223026440 shutdown_connections 2023-11-18T20:59:50.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.232+0000 7fb600bc1640 1 -- 172.21.15.49:0/1223026440 wait complete. 2023-11-18T20:59:50.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.232+0000 7fb600bc1640 1 Processor -- start 2023-11-18T20:59:50.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.232+0000 7fb600bc1640 1 -- start start 2023-11-18T20:59:50.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.236+0000 7fb600bc1640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5fc070ab0 0x7fb5fc160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:50.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.236+0000 7fb600bc1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5fc0c1ed0 0x7fb5fc1f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.236+0000 7fb600bc1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5fc14f850 0x7fb5fc1526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.236+0000 7fb600bc1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc151a10 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.236+0000 7fb600bc1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc1521e0 con 0x7fb5fc14f850 2023-11-18T20:59:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.236+0000 7fb600bc1640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc150160 con 0x7fb5fc070ab0 2023-11-18T20:59:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.236+0000 7fb5f9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5fc0c1ed0 0x7fb5fc1f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.236+0000 7fb5f9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5fc0c1ed0 0x7fb5fc1f4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55352/0 (socket says 172.21.15.49:55352) 2023-11-18T20:59:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.236+0000 7fb5f9d9b640 1 -- 172.21.15.49:0/3587951180 learned_addr learned my addr 172.21.15.49:0/3587951180 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:50.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.236+0000 7fb5fad9d640 1 --2- 172.21.15.49:0/3587951180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5fc14f850 0x7fb5fc1526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:50.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.236+0000 7fb5fa59c640 1 --2- 172.21.15.49:0/3587951180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5fc070ab0 0x7fb5fc160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:50.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.240+0000 7fb5f9d9b640 1 -- 172.21.15.49:0/3587951180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5fc070ab0 msgr2=0x7fb5fc160c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:50.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.240+0000 7fb5f9d9b640 1 --2- 172.21.15.49:0/3587951180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5fc070ab0 0x7fb5fc160c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.240+0000 7fb5f9d9b640 1 -- 172.21.15.49:0/3587951180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5fc14f850 msgr2=0x7fb5fc1526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:50.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.240+0000 7fb5f9d9b640 1 --2- 172.21.15.49:0/3587951180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5fc14f850 0x7fb5fc1526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.240+0000 7fb5f9d9b640 1 -- 172.21.15.49:0/3587951180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f00094d0 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.244+0000 7fb5f9d9b640 1 --2- 172.21.15.49:0/3587951180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5fc0c1ed0 0x7fb5fc1f4fc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0097f60 tx=0x7fb5f001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.248+0000 7fb5eaffd640 1 -- 172.21.15.49:0/3587951180 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00bd5f0 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.248+0000 7fb5eaffd640 1 -- 172.21.15.49:0/3587951180 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f00bd770 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.248+0000 7fb600bc1640 1 -- 172.21.15.49:0/3587951180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5fc151c20 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.248+0000 7fb5eaffd640 1 -- 172.21.15.49:0/3587951180 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00bdb20 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.248+0000 7fb600bc1640 1 -- 172.21.15.49:0/3587951180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5fc160480 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.248+0000 7fb600bc1640 1 -- 172.21.15.49:0/3587951180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5fc067520 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.268+0000 7fb5eaffd640 1 -- 172.21.15.49:0/3587951180 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb5f00c8470 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.272+0000 7fb5eaffd640 1 --2- 172.21.15.49:0/3587951180 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb5dc0664c0 0x7fb5dc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.272+0000 7fb5fa59c640 1 --2- 172.21.15.49:0/3587951180 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb5dc0664c0 0x7fb5dc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:50.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.272+0000 7fb5fa59c640 1 --2- 172.21.15.49:0/3587951180 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb5dc0664c0 0x7fb5dc068980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec009ac0 tx=0x7fb5ec009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:50.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.568+0000 7fb5eaffd640 1 -- 172.21.15.49:0/3587951180 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb5f00a7070 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.568+0000 7fb5eaffd640 1 -- 172.21.15.49:0/3587951180 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5f00ec3c0 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.760+0000 7fb600bc1640 1 -- 172.21.15.49:0/3587951180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5fc06cb20 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.768+0000 7fb5eaffd640 1 -- 172.21.15.49:0/3587951180 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb5f00f4e60 con 0x7fb5fc0c1ed0 2023-11-18T20:59:50.770 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-18T20:59:50.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.772+0000 7fb600bc1640 1 -- 172.21.15.49:0/3587951180 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb5dc0664c0 msgr2=0x7fb5dc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:50.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.772+0000 7fb600bc1640 1 --2- 172.21.15.49:0/3587951180 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb5dc0664c0 0x7fb5dc068980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec009ac0 tx=0x7fb5ec009190 comp rx=0 tx=0).stop 2023-11-18T20:59:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.772+0000 7fb600bc1640 1 -- 172.21.15.49:0/3587951180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5fc0c1ed0 msgr2=0x7fb5fc1f4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.772+0000 7fb600bc1640 1 --2- 172.21.15.49:0/3587951180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5fc0c1ed0 0x7fb5fc1f4fc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0097f60 tx=0x7fb5f001ad10 comp rx=0 tx=0).stop 2023-11-18T20:59:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.772+0000 7fb600bc1640 1 -- 172.21.15.49:0/3587951180 shutdown_connections 2023-11-18T20:59:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.772+0000 7fb600bc1640 1 --2- 172.21.15.49:0/3587951180 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb5dc0664c0 0x7fb5dc068980 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.772+0000 7fb600bc1640 1 --2- 172.21.15.49:0/3587951180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5fc14f850 0x7fb5fc1526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.772+0000 7fb600bc1640 1 --2- 172.21.15.49:0/3587951180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5fc0c1ed0 0x7fb5fc1f4fc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.772+0000 7fb600bc1640 1 --2- 172.21.15.49:0/3587951180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5fc070ab0 0x7fb5fc160c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.772+0000 7fb600bc1640 1 -- 172.21.15.49:0/3587951180 >> 172.21.15.49:0/3587951180 conn(0x7fb5fc06c6a0 msgr2=0x7fb5fc146560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.772+0000 7fb600bc1640 1 -- 172.21.15.49:0/3587951180 shutdown_connections 2023-11-18T20:59:50.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.772+0000 7fb600bc1640 1 -- 172.21.15.49:0/3587951180 wait complete. 2023-11-18T20:59:50.792 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-18T20:59:50.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.916+0000 7f78193ba640 1 Processor -- start 2023-11-18T20:59:50.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.916+0000 7f78193ba640 1 -- start start 2023-11-18T20:59:50.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.920+0000 7f78193ba640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f78140c5460 0x7f781415a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:50.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.920+0000 7f78193ba640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f78140c5840 0x7f781406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:50.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.920+0000 7f78193ba640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78140c3ce0 con 0x7f78141560b0 2023-11-18T20:59:50.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.920+0000 7f78193ba640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78140c80e0 con 0x7f78140c5460 2023-11-18T20:59:50.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.920+0000 7f78193ba640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7814159bb0 con 0x7f78140c5840 2023-11-18T20:59:50.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.920+0000 7f7812ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f78140c5460 0x7f781415a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:50.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.920+0000 7f7812ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f78140c5460 0x7f781415a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55366/0 (socket says 172.21.15.49:55366) 2023-11-18T20:59:50.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.920+0000 7f7812ffd640 1 -- 172.21.15.49:0/1293479495 learned_addr learned my addr 172.21.15.49:0/1293479495 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.924+0000 7f7812ffd640 1 -- 172.21.15.49:0/1293479495 >> v2:172.21.15.106:3300/0 conn(0x7f78140c5840 msgr2=0x7f781406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:50.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.924+0000 7f7812ffd640 1 --2- 172.21.15.49:0/1293479495 >> v2:172.21.15.106:3300/0 conn(0x7f78140c5840 0x7f781406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.924+0000 7f7812ffd640 1 -- 172.21.15.49:0/1293479495 >> v1:172.21.15.106:6789/0 conn(0x7f78141560b0 legacy=0x7f781414fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:50.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.924+0000 7f7812ffd640 1 -- 172.21.15.49:0/1293479495 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781415a580 con 0x7f78140c5460 2023-11-18T20:59:50.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.928+0000 7f7812ffd640 1 --2- 172.21.15.49:0/1293479495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78140c5460 0x7f781415a040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f78140c5100 tx=0x7f780401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c013b37f9ae24c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.936+0000 7f78127fc640 1 -- 172.21.15.49:0/1293479495 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78040a89b0 con 0x7f78140c5460 2023-11-18T20:59:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.936+0000 7f78127fc640 1 -- 172.21.15.49:0/1293479495 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78040a8b10 con 0x7f78140c5460 2023-11-18T20:59:50.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.936+0000 7f78127fc640 1 -- 172.21.15.49:0/1293479495 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78040a8ea0 con 0x7f78140c5460 2023-11-18T20:59:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.936+0000 7f78193ba640 1 -- 172.21.15.49:0/1293479495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78140c5460 msgr2=0x7f781415a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.936+0000 7f78193ba640 1 --2- 172.21.15.49:0/1293479495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78140c5460 0x7f781415a040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f78140c5100 tx=0x7f780401ecb0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.936+0000 7f78193ba640 1 -- 172.21.15.49:0/1293479495 shutdown_connections 2023-11-18T20:59:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.936+0000 7f78193ba640 1 --2- 172.21.15.49:0/1293479495 >> v2:172.21.15.106:3300/0 conn(0x7f78140c5840 0x7f781406d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.936+0000 7f78193ba640 1 --2- 172.21.15.49:0/1293479495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78140c5460 0x7f781415a040 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.936+0000 7f78193ba640 1 -- 172.21.15.49:0/1293479495 >> 172.21.15.49:0/1293479495 conn(0x7f781406f780 msgr2=0x7f781406fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:50.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.936+0000 7f78193ba640 1 -- 172.21.15.49:0/1293479495 shutdown_connections 2023-11-18T20:59:50.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.940+0000 7f78193ba640 1 -- 172.21.15.49:0/1293479495 wait complete. 2023-11-18T20:59:50.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.940+0000 7f78193ba640 1 Processor -- start 2023-11-18T20:59:50.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.940+0000 7f78193ba640 1 -- start start 2023-11-18T20:59:50.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.940+0000 7f78193ba640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78140c5460 0x7f78141efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:50.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.940+0000 7f78193ba640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78140c5840 0x7f781413c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:50.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.940+0000 7f78193ba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78141560b0 0x7f78141f0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:50.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.940+0000 7f78193ba640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781413d2d0 con 0x7f78141560b0 2023-11-18T20:59:50.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.940+0000 7f78193ba640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7814149f90 con 0x7f78140c5460 2023-11-18T20:59:50.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.940+0000 7f78193ba640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781413cb60 con 0x7f78140c5840 2023-11-18T20:59:50.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.940+0000 7f78137fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78141560b0 0x7f78141f0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:50.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.940+0000 7f78137fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78141560b0 0x7f78141f0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55374/0 (socket says 172.21.15.49:55374) 2023-11-18T20:59:50.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.940+0000 7f78137fe640 1 -- 172.21.15.49:0/2755020983 learned_addr learned my addr 172.21.15.49:0/2755020983 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:50.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.948+0000 7f78137fe640 1 -- 172.21.15.49:0/2755020983 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78140c5840 msgr2=0x7f781413c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:50.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.948+0000 7f78137fe640 1 --2- 172.21.15.49:0/2755020983 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78140c5840 0x7f781413c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.948+0000 7f78137fe640 1 -- 172.21.15.49:0/2755020983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78140c5460 msgr2=0x7f78141efc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:50.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.948+0000 7f78137fe640 1 --2- 172.21.15.49:0/2755020983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78140c5460 0x7f78141efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:50.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.948+0000 7f78137fe640 1 -- 172.21.15.49:0/2755020983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78040094d0 con 0x7f78141560b0 2023-11-18T20:59:50.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.948+0000 7f78137fe640 1 --2- 172.21.15.49:0/2755020983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78141560b0 0x7f78141f0510 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f780c00b990 tx=0x7f780c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:50.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.956+0000 7f780bfff640 1 -- 172.21.15.49:0/2755020983 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c00cba0 con 0x7f78141560b0 2023-11-18T20:59:50.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.956+0000 7f780bfff640 1 -- 172.21.15.49:0/2755020983 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c00cd00 con 0x7f78141560b0 2023-11-18T20:59:50.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.956+0000 7f780bfff640 1 -- 172.21.15.49:0/2755020983 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c014680 con 0x7f78141560b0 2023-11-18T20:59:50.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.956+0000 7f78193ba640 1 -- 172.21.15.49:0/2755020983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781414a420 con 0x7f78141560b0 2023-11-18T20:59:50.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.956+0000 7f78193ba640 1 -- 172.21.15.49:0/2755020983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7814149380 con 0x7f78141560b0 2023-11-18T20:59:50.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:50.956+0000 7f78193ba640 1 -- 172.21.15.49:0/2755020983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7814067520 con 0x7f78141560b0 2023-11-18T20:59:51.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.244+0000 7f780bfff640 1 -- 172.21.15.49:0/2755020983 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f780c01d3b0 con 0x7f78141560b0 2023-11-18T20:59:51.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.244+0000 7f780bfff640 1 --2- 172.21.15.49:0/2755020983 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f77f4066470 0x7f77f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:51.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.244+0000 7f7812ffd640 1 --2- 172.21.15.49:0/2755020983 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f77f4066470 0x7f77f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:51.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.244+0000 7f7812ffd640 1 --2- 172.21.15.49:0/2755020983 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f77f4066470 0x7f77f4068930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78040b2000 tx=0x7f7804004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:51.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.284+0000 7f780bfff640 1 -- 172.21.15.49:0/2755020983 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f780c055e60 con 0x7f78141560b0 2023-11-18T20:59:51.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.288+0000 7f780bfff640 1 -- 172.21.15.49:0/2755020983 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f780c051aa0 con 0x7f78141560b0 2023-11-18T20:59:51.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.448+0000 7f78193ba640 1 -- 172.21.15.49:0/2755020983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f781414a0d0 con 0x7f78141560b0 2023-11-18T20:59:51.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.456+0000 7f780bfff640 1 -- 172.21.15.49:0/2755020983 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f780c019020 con 0x7f78141560b0 2023-11-18T20:59:51.458 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-11-18T20:59:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.460+0000 7f78193ba640 1 -- 172.21.15.49:0/2755020983 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f77f4066470 msgr2=0x7f77f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.460+0000 7f78193ba640 1 --2- 172.21.15.49:0/2755020983 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f77f4066470 0x7f77f4068930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78040b2000 tx=0x7f7804004740 comp rx=0 tx=0).stop 2023-11-18T20:59:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.460+0000 7f78193ba640 1 -- 172.21.15.49:0/2755020983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78141560b0 msgr2=0x7f78141f0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.460+0000 7f78193ba640 1 --2- 172.21.15.49:0/2755020983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78141560b0 0x7f78141f0510 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f780c00b990 tx=0x7f780c00be50 comp rx=0 tx=0).stop 2023-11-18T20:59:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.460+0000 7f78193ba640 1 -- 172.21.15.49:0/2755020983 shutdown_connections 2023-11-18T20:59:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.460+0000 7f78193ba640 1 --2- 172.21.15.49:0/2755020983 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f77f4066470 0x7f77f4068930 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.460+0000 7f78193ba640 1 --2- 172.21.15.49:0/2755020983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78141560b0 0x7f78141f0510 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.460+0000 7f78193ba640 1 --2- 172.21.15.49:0/2755020983 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78140c5840 0x7f781413c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.460+0000 7f78193ba640 1 --2- 172.21.15.49:0/2755020983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78140c5460 0x7f78141efc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.460+0000 7f78193ba640 1 -- 172.21.15.49:0/2755020983 >> 172.21.15.49:0/2755020983 conn(0x7f781406f780 msgr2=0x7f78140c6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:51.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.460+0000 7f78193ba640 1 -- 172.21.15.49:0/2755020983 shutdown_connections 2023-11-18T20:59:51.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.460+0000 7f78193ba640 1 -- 172.21.15.49:0/2755020983 wait complete. 2023-11-18T20:59:51.478 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:59:51.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.604+0000 7f9dbffff640 1 Processor -- start 2023-11-18T20:59:51.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.604+0000 7f9dbffff640 1 -- start start 2023-11-18T20:59:51.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.604+0000 7f9dbffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9dc0150550 0x7f9dc00ad720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:51.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.604+0000 7f9dbffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9dc00c6f60 0x7f9dc00adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:51.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.604+0000 7f9dbffff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc00c02a0 con 0x7f9dc00c2270 2023-11-18T20:59:51.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.604+0000 7f9dbffff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc0150930 con 0x7f9dc00c6f60 2023-11-18T20:59:51.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.604+0000 7f9dbffff640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc0156c40 con 0x7f9dc0150550 2023-11-18T20:59:51.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.604+0000 7f9dbf7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9dc00c6f60 0x7f9dc00adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:51.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.604+0000 7f9dbe7fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9dc00c2270 0x7f9dc00c6850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38634/0 (socket says 172.21.15.49:38634) 2023-11-18T20:59:51.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.604+0000 7f9dbe7fc640 1 -- 172.21.15.49:0/3610700655 learned_addr learned my addr 172.21.15.49:0/3610700655 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:59:51.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.608+0000 7f9dbeffd640 1 --2- 172.21.15.49:0/3610700655 >> v2:172.21.15.106:3300/0 conn(0x7f9dc0150550 0x7f9dc00ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:51.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.612+0000 7f9dbf7fe640 1 -- 172.21.15.49:0/3610700655 >> v2:172.21.15.106:3300/0 conn(0x7f9dc0150550 msgr2=0x7f9dc00ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:51.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.612+0000 7f9dbf7fe640 1 --2- 172.21.15.49:0/3610700655 >> v2:172.21.15.106:3300/0 conn(0x7f9dc0150550 0x7f9dc00ad720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:51.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.612+0000 7f9dbf7fe640 1 -- 172.21.15.49:0/3610700655 >> v1:172.21.15.49:6789/0 conn(0x7f9dc00c2270 legacy=0x7f9dc00c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:51.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.612+0000 7f9dbf7fe640 1 -- 172.21.15.49:0/3610700655 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc0156f20 con 0x7f9dc00c6f60 2023-11-18T20:59:51.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.616+0000 7f9dbf7fe640 1 --2- 172.21.15.49:0/3610700655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dc00c6f60 0x7f9dc00adc60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0070780 tx=0x7f9db801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd33c78d70188aca server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:51.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.620+0000 7f9dbdffb640 1 -- 172.21.15.49:0/3610700655 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db80a7070 con 0x7f9dc00c6f60 2023-11-18T20:59:51.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.620+0000 7f9dbdffb640 1 -- 172.21.15.49:0/3610700655 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db80ab430 con 0x7f9dc00c6f60 2023-11-18T20:59:51.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.620+0000 7f9dbdffb640 1 -- 172.21.15.49:0/3610700655 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db80ab7c0 con 0x7f9dc00c6f60 2023-11-18T20:59:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.620+0000 7f9dbffff640 1 -- 172.21.15.49:0/3610700655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dc00c6f60 msgr2=0x7f9dc00adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.620+0000 7f9dbffff640 1 --2- 172.21.15.49:0/3610700655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dc00c6f60 0x7f9dc00adc60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0070780 tx=0x7f9db801c430 comp rx=0 tx=0).stop 2023-11-18T20:59:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.620+0000 7f9dbffff640 1 -- 172.21.15.49:0/3610700655 shutdown_connections 2023-11-18T20:59:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.620+0000 7f9dbffff640 1 --2- 172.21.15.49:0/3610700655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dc00c6f60 0x7f9dc00adc60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.620+0000 7f9dbffff640 1 --2- 172.21.15.49:0/3610700655 >> v2:172.21.15.106:3300/0 conn(0x7f9dc0150550 0x7f9dc00ad720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.620+0000 7f9dbffff640 1 -- 172.21.15.49:0/3610700655 >> 172.21.15.49:0/3610700655 conn(0x7f9dc00cb280 msgr2=0x7f9dc00cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.620+0000 7f9dbffff640 1 -- 172.21.15.49:0/3610700655 shutdown_connections 2023-11-18T20:59:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.620+0000 7f9dbffff640 1 -- 172.21.15.49:0/3610700655 wait complete. 2023-11-18T20:59:51.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.624+0000 7f9dbffff640 1 Processor -- start 2023-11-18T20:59:51.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.624+0000 7f9dbffff640 1 -- start start 2023-11-18T20:59:51.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.624+0000 7f9dbffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dc00c2270 0x7f9dc01f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.624+0000 7f9dbffff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9dc00c6f60 0x7f9dc0146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.624+0000 7f9dbffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dc0150550 0x7f9dc01496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.624+0000 7f9dbffff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc014fe20 con 0x7f9dc00c2270 2023-11-18T20:59:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.624+0000 7f9dbffff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc014f610 con 0x7f9dc0150550 2023-11-18T20:59:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.624+0000 7f9dbffff640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc00cafe0 con 0x7f9dc00c6f60 2023-11-18T20:59:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.624+0000 7f9dbeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dc00c2270 0x7f9dc01f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.624+0000 7f9dbeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dc00c2270 0x7f9dc01f6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55400/0 (socket says 172.21.15.49:55400) 2023-11-18T20:59:51.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.624+0000 7f9dbeffd640 1 -- 172.21.15.49:0/3085961229 learned_addr learned my addr 172.21.15.49:0/3085961229 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:51.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.624+0000 7f9dbf7fe640 1 --2- 172.21.15.49:0/3085961229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dc0150550 0x7f9dc01496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:51.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.624+0000 7f9dbe7fc640 1 --2- 172.21.15.49:0/3085961229 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9dc00c6f60 0x7f9dc0146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:51.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.632+0000 7f9dbeffd640 1 -- 172.21.15.49:0/3085961229 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9dc00c6f60 msgr2=0x7f9dc0146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:51.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.632+0000 7f9dbeffd640 1 --2- 172.21.15.49:0/3085961229 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9dc00c6f60 0x7f9dc0146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:51.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.632+0000 7f9dbeffd640 1 -- 172.21.15.49:0/3085961229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dc0150550 msgr2=0x7f9dc01496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:51.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.632+0000 7f9dbeffd640 1 --2- 172.21.15.49:0/3085961229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dc0150550 0x7f9dc01496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:51.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.632+0000 7f9dbeffd640 1 -- 172.21.15.49:0/3085961229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db8009420 con 0x7f9dc00c2270 2023-11-18T20:59:51.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.640+0000 7f9dbeffd640 1 --2- 172.21.15.49:0/3085961229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dc00c2270 0x7f9dc01f6210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9db000efc0 tx=0x7f9db000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:51.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.644+0000 7f9db7fff640 1 -- 172.21.15.49:0/3085961229 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0009b80 con 0x7f9dc00c2270 2023-11-18T20:59:51.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.644+0000 7f9db7fff640 1 -- 172.21.15.49:0/3085961229 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db000f040 con 0x7f9dc00c2270 2023-11-18T20:59:51.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.644+0000 7f9dbffff640 1 -- 172.21.15.49:0/3085961229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc01f5a70 con 0x7f9dc00c2270 2023-11-18T20:59:51.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.644+0000 7f9db7fff640 1 -- 172.21.15.49:0/3085961229 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db00146a0 con 0x7f9dc00c2270 2023-11-18T20:59:51.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.644+0000 7f9dbffff640 1 -- 172.21.15.49:0/3085961229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc014fb40 con 0x7f9dc00c2270 2023-11-18T20:59:51.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.644+0000 7f9dbffff640 1 -- 172.21.15.49:0/3085961229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc01f58d0 con 0x7f9dc00c2270 2023-11-18T20:59:51.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.664+0000 7f9db7fff640 1 -- 172.21.15.49:0/3085961229 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9db0014800 con 0x7f9dc00c2270 2023-11-18T20:59:51.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.664+0000 7f9db7fff640 1 --2- 172.21.15.49:0/3085961229 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9da00664c0 0x7f9da0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:51.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.664+0000 7f9dbe7fc640 1 --2- 172.21.15.49:0/3085961229 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9da00664c0 0x7f9da0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:51.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.668+0000 7f9dbe7fc640 1 --2- 172.21.15.49:0/3085961229 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9da00664c0 0x7f9da0068980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00c1d90 tx=0x7f9da8007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:51.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.668+0000 7f9db7fff640 1 -- 172.21.15.49:0/3085961229 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9db0056110 con 0x7f9dc00c2270 2023-11-18T20:59:51.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:51.980+0000 7f9db7fff640 1 -- 172.21.15.49:0/3085961229 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9db0052450 con 0x7f9dc00c2270 2023-11-18T20:59:52.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.176+0000 7f9dbffff640 1 -- 172.21.15.49:0/3085961229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9dc01f58d0 con 0x7f9dc00c2270 2023-11-18T20:59:52.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.232+0000 7f9db7fff640 1 -- 172.21.15.49:0/3085961229 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9dc01f58d0 con 0x7f9dc00c2270 2023-11-18T20:59:52.233 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-11-18T20:59:52.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.236+0000 7f9dbffff640 1 -- 172.21.15.49:0/3085961229 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9da00664c0 msgr2=0x7f9da0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:52.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.236+0000 7f9dbffff640 1 --2- 172.21.15.49:0/3085961229 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9da00664c0 0x7f9da0068980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00c1d90 tx=0x7f9da8007e90 comp rx=0 tx=0).stop 2023-11-18T20:59:52.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.236+0000 7f9dbffff640 1 -- 172.21.15.49:0/3085961229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dc00c2270 msgr2=0x7f9dc01f6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:52.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.236+0000 7f9dbffff640 1 --2- 172.21.15.49:0/3085961229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dc00c2270 0x7f9dc01f6210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9db000efc0 tx=0x7f9db000c490 comp rx=0 tx=0).stop 2023-11-18T20:59:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.236+0000 7f9dbffff640 1 -- 172.21.15.49:0/3085961229 shutdown_connections 2023-11-18T20:59:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.236+0000 7f9dbffff640 1 --2- 172.21.15.49:0/3085961229 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9da00664c0 0x7f9da0068980 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.236+0000 7f9dbffff640 1 --2- 172.21.15.49:0/3085961229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dc0150550 0x7f9dc01496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.236+0000 7f9dbffff640 1 --2- 172.21.15.49:0/3085961229 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9dc00c6f60 0x7f9dc0146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.236+0000 7f9dbffff640 1 --2- 172.21.15.49:0/3085961229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dc00c2270 0x7f9dc01f6210 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.236+0000 7f9dbffff640 1 -- 172.21.15.49:0/3085961229 >> 172.21.15.49:0/3085961229 conn(0x7f9dc00cb280 msgr2=0x7f9dc00710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.236+0000 7f9dbffff640 1 -- 172.21.15.49:0/3085961229 shutdown_connections 2023-11-18T20:59:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.236+0000 7f9dbffff640 1 -- 172.21.15.49:0/3085961229 wait complete. 2023-11-18T20:59:52.259 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T20:59:52.259 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T20:59:52.264 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T20:59:52.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.436+0000 7f2b29dfd640 1 Processor -- start 2023-11-18T20:59:52.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.436+0000 7f2b29dfd640 1 -- start start 2023-11-18T20:59:52.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.436+0000 7f2b29dfd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2b2414f850 0x7f2b240c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:52.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.436+0000 7f2b29dfd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2b240c1ed0 0x7f2b2406e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:52.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.436+0000 7f2b29dfd640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b240c3b10 con 0x7f2b24070ab0 2023-11-18T20:59:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.436+0000 7f2b29dfd640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2414fc30 con 0x7f2b2414f850 2023-11-18T20:59:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.436+0000 7f2b29dfd640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b240c11e0 con 0x7f2b240c1ed0 2023-11-18T20:59:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.436+0000 7f2b237fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2b2414f850 0x7f2b240c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.436+0000 7f2b23fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2b24070ab0 0x7f2b24158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38650/0 (socket says 172.21.15.49:38650) 2023-11-18T20:59:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.436+0000 7f2b23fff640 1 -- 172.21.15.49:0/1098376418 learned_addr learned my addr 172.21.15.49:0/1098376418 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:59:52.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.436+0000 7f2b22ffd640 1 --2- 172.21.15.49:0/1098376418 >> v2:172.21.15.106:3300/0 conn(0x7f2b240c1ed0 0x7f2b2406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:52.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.440+0000 7f2b237fe640 1 -- 172.21.15.49:0/1098376418 >> v2:172.21.15.106:3300/0 conn(0x7f2b240c1ed0 msgr2=0x7f2b2406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:52.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.440+0000 7f2b237fe640 1 --2- 172.21.15.49:0/1098376418 >> v2:172.21.15.106:3300/0 conn(0x7f2b240c1ed0 0x7f2b2406e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.440+0000 7f2b237fe640 1 -- 172.21.15.49:0/1098376418 >> v1:172.21.15.49:6789/0 conn(0x7f2b24070ab0 legacy=0x7f2b24158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.440+0000 7f2b237fe640 1 -- 172.21.15.49:0/1098376418 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b240c2410 con 0x7f2b2414f850 2023-11-18T20:59:52.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.444+0000 7f2b237fe640 1 --2- 172.21.15.49:0/1098376418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b2414f850 0x7f2b240c3fa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2b24070a40 tx=0x7f2b1401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1189e0651faedfd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:52.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.452+0000 7f2b227fc640 1 -- 172.21.15.49:0/1098376418 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b140ab600 con 0x7f2b2414f850 2023-11-18T20:59:52.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b227fc640 1 -- 172.21.15.49:0/1098376418 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b140a7050 con 0x7f2b2414f850 2023-11-18T20:59:52.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b227fc640 1 -- 172.21.15.49:0/1098376418 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b140ab980 con 0x7f2b2414f850 2023-11-18T20:59:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1098376418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b2414f850 msgr2=0x7f2b240c3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 --2- 172.21.15.49:0/1098376418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b2414f850 0x7f2b240c3fa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2b24070a40 tx=0x7f2b1401c430 comp rx=0 tx=0).stop 2023-11-18T20:59:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1098376418 shutdown_connections 2023-11-18T20:59:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 --2- 172.21.15.49:0/1098376418 >> v2:172.21.15.106:3300/0 conn(0x7f2b240c1ed0 0x7f2b2406e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 --2- 172.21.15.49:0/1098376418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b2414f850 0x7f2b240c3fa0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1098376418 >> 172.21.15.49:0/1098376418 conn(0x7f2b2406c6a0 msgr2=0x7f2b2406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1098376418 shutdown_connections 2023-11-18T20:59:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1098376418 wait complete. 2023-11-18T20:59:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 Processor -- start 2023-11-18T20:59:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 -- start start 2023-11-18T20:59:52.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b24070ab0 0x7f2b240c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:52.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b240c1ed0 0x7f2b241f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:52.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b2414f850 0x7f2b2413e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:52.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240c8ba0 con 0x7f2b2414f850 2023-11-18T20:59:52.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240c9a70 con 0x7f2b24070ab0 2023-11-18T20:59:52.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b29dfd640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240c9490 con 0x7f2b240c1ed0 2023-11-18T20:59:52.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.456+0000 7f2b23fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b2414f850 0x7f2b2413e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:52.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.460+0000 7f2b23fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b2414f850 0x7f2b2413e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55404/0 (socket says 172.21.15.49:55404) 2023-11-18T20:59:52.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.460+0000 7f2b23fff640 1 -- 172.21.15.49:0/1509908318 learned_addr learned my addr 172.21.15.49:0/1509908318 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:52.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.460+0000 7f2b237fe640 1 --2- 172.21.15.49:0/1509908318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b24070ab0 0x7f2b240c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:52.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.460+0000 7f2b22ffd640 1 --2- 172.21.15.49:0/1509908318 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b240c1ed0 0x7f2b241f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.464+0000 7f2b23fff640 1 -- 172.21.15.49:0/1509908318 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b240c1ed0 msgr2=0x7f2b241f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.464+0000 7f2b23fff640 1 --2- 172.21.15.49:0/1509908318 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b240c1ed0 0x7f2b241f3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:52.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.464+0000 7f2b23fff640 1 -- 172.21.15.49:0/1509908318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b24070ab0 msgr2=0x7f2b240c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:52.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.464+0000 7f2b23fff640 1 --2- 172.21.15.49:0/1509908318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b24070ab0 0x7f2b240c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:52.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.464+0000 7f2b23fff640 1 -- 172.21.15.49:0/1509908318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b14009420 con 0x7f2b2414f850 2023-11-18T20:59:52.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.464+0000 7f2b23fff640 1 --2- 172.21.15.49:0/1509908318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b2414f850 0x7f2b2413e8b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00ca80 tx=0x7f2b1c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.468+0000 7f2b0bfff640 1 -- 172.21.15.49:0/1509908318 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c00ac30 con 0x7f2b2414f850 2023-11-18T20:59:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.468+0000 7f2b0bfff640 1 -- 172.21.15.49:0/1509908318 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c00ad90 con 0x7f2b2414f850 2023-11-18T20:59:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.468+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1509908318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b240c8df0 con 0x7f2b2414f850 2023-11-18T20:59:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.468+0000 7f2b0bfff640 1 -- 172.21.15.49:0/1509908318 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c012600 con 0x7f2b2414f850 2023-11-18T20:59:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.468+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1509908318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2413edf0 con 0x7f2b2414f850 2023-11-18T20:59:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.468+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1509908318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b240c9be0 con 0x7f2b2414f850 2023-11-18T20:59:52.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.760+0000 7f2b0bfff640 1 -- 172.21.15.49:0/1509908318 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2b1c007070 con 0x7f2b2414f850 2023-11-18T20:59:52.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.760+0000 7f2b0bfff640 1 --2- 172.21.15.49:0/1509908318 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2b100664c0 0x7f2b10068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:52.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.760+0000 7f2b237fe640 1 --2- 172.21.15.49:0/1509908318 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2b100664c0 0x7f2b10068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:52.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.760+0000 7f2b237fe640 1 --2- 172.21.15.49:0/1509908318 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2b100664c0 0x7f2b10068980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b24071d10 tx=0x7f2b14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:52.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.796+0000 7f2b0bfff640 1 -- 172.21.15.49:0/1509908318 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2b1c055380 con 0x7f2b2414f850 2023-11-18T20:59:52.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.796+0000 7f2b0bfff640 1 -- 172.21.15.49:0/1509908318 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2b1c0516c0 con 0x7f2b2414f850 2023-11-18T20:59:52.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:52.968+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1509908318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b24067520 con 0x7f2b2414f850 2023-11-18T20:59:53.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.060+0000 7f2b0bfff640 1 -- 172.21.15.49:0/1509908318 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18314 (secure 0 0 0) 0x7f2b1c054ce0 con 0x7f2b2414f850 2023-11-18T20:59:53.063 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T20:59:53.063 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":29,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:59:36.521114+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T20:59:53.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.064+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1509908318 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2b100664c0 msgr2=0x7f2b10068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:53.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.064+0000 7f2b29dfd640 1 --2- 172.21.15.49:0/1509908318 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2b100664c0 0x7f2b10068980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b24071d10 tx=0x7f2b14008040 comp rx=0 tx=0).stop 2023-11-18T20:59:53.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.064+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1509908318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b2414f850 msgr2=0x7f2b2413e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:53.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.064+0000 7f2b29dfd640 1 --2- 172.21.15.49:0/1509908318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b2414f850 0x7f2b2413e8b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00ca80 tx=0x7f2b1c00cf40 comp rx=0 tx=0).stop 2023-11-18T20:59:53.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.064+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1509908318 shutdown_connections 2023-11-18T20:59:53.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.064+0000 7f2b29dfd640 1 --2- 172.21.15.49:0/1509908318 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2b100664c0 0x7f2b10068980 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.064+0000 7f2b29dfd640 1 --2- 172.21.15.49:0/1509908318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b2414f850 0x7f2b2413e8b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.064+0000 7f2b29dfd640 1 --2- 172.21.15.49:0/1509908318 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b240c1ed0 0x7f2b241f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.064+0000 7f2b29dfd640 1 --2- 172.21.15.49:0/1509908318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b24070ab0 0x7f2b240c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.064+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1509908318 >> 172.21.15.49:0/1509908318 conn(0x7f2b2406c6a0 msgr2=0x7f2b24158de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:53.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.064+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1509908318 shutdown_connections 2023-11-18T20:59:53.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.064+0000 7f2b29dfd640 1 -- 172.21.15.49:0/1509908318 wait complete. 2023-11-18T20:59:53.090 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:58:42.362631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:59:22.756454+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:59:25.252588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-18T20:59:33.423071+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-18T20:59:53.091 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T20:59:53.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.216+0000 7f56ec6b1640 1 Processor -- start 2023-11-18T20:59:53.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.216+0000 7f56ec6b1640 1 -- start start 2023-11-18T20:59:53.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.220+0000 7f56ec6b1640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f56e40c5080 0x7f56e406ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:53.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.220+0000 7f56ec6b1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e4157a60 con 0x7f56e4157ef0 2023-11-18T20:59:53.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.220+0000 7f56ec6b1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e4157150 con 0x7f56e40c5460 2023-11-18T20:59:53.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.220+0000 7f56ec6b1640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e40c6a80 con 0x7f56e40c5080 2023-11-18T20:59:53.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.220+0000 7f56e9c4c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f56e4157ef0 0x7f56e4071c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38652/0 (socket says 172.21.15.49:38652) 2023-11-18T20:59:53.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.220+0000 7f56e9c4c640 1 -- 172.21.15.49:0/3622960132 learned_addr learned my addr 172.21.15.49:0/3622960132 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:59:53.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.220+0000 7f56ea44d640 1 --2- 172.21.15.49:0/3622960132 >> v2:172.21.15.49:3300/0 conn(0x7f56e40c5080 0x7f56e406ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:53.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.224+0000 7f56ea44d640 1 -- 172.21.15.49:0/3622960132 >> v1:172.21.15.106:6789/0 conn(0x7f56e40c5460 legacy=0x7f56e40c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:53.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.224+0000 7f56ea44d640 1 -- 172.21.15.49:0/3622960132 >> v1:172.21.15.49:6789/0 conn(0x7f56e4157ef0 legacy=0x7f56e4071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:53.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.224+0000 7f56ea44d640 1 -- 172.21.15.49:0/3622960132 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e40c6c90 con 0x7f56e40c5080 2023-11-18T20:59:53.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.228+0000 7f56ea44d640 1 --2- 172.21.15.49:0/3622960132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56e40c5080 0x7f56e406ae40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56e00097c0 tx=0x7f56e001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7255942ed792a01c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:53.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.232+0000 7f56e944b640 1 -- 172.21.15.49:0/3622960132 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e00a8930 con 0x7f56e40c5080 2023-11-18T20:59:53.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.232+0000 7f56e944b640 1 -- 172.21.15.49:0/3622960132 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e00a8a90 con 0x7f56e40c5080 2023-11-18T20:59:53.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.232+0000 7f56e944b640 1 -- 172.21.15.49:0/3622960132 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e00a8e20 con 0x7f56e40c5080 2023-11-18T20:59:53.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.232+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3622960132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56e40c5080 msgr2=0x7f56e406ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:53.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.232+0000 7f56ec6b1640 1 --2- 172.21.15.49:0/3622960132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56e40c5080 0x7f56e406ae40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56e00097c0 tx=0x7f56e001ec30 comp rx=0 tx=0).stop 2023-11-18T20:59:53.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.232+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3622960132 shutdown_connections 2023-11-18T20:59:53.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.232+0000 7f56ec6b1640 1 --2- 172.21.15.49:0/3622960132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56e40c5080 0x7f56e406ae40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.232+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3622960132 >> 172.21.15.49:0/3622960132 conn(0x7f56e406b670 msgr2=0x7f56e406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:53.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.232+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3622960132 shutdown_connections 2023-11-18T20:59:53.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.232+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3622960132 wait complete. 2023-11-18T20:59:53.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.236+0000 7f56ec6b1640 1 Processor -- start 2023-11-18T20:59:53.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.236+0000 7f56ec6b1640 1 -- start start 2023-11-18T20:59:53.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.236+0000 7f56ec6b1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56e40c5080 0x7f56e40cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:53.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.236+0000 7f56ec6b1640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e40c5460 0x7f56e4145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:53.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.236+0000 7f56ec6b1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56e4157ef0 0x7f56e40ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:53.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.236+0000 7f56ec6b1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e414b2c0 con 0x7f56e40c5080 2023-11-18T20:59:53.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.236+0000 7f56ec6b1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e4155960 con 0x7f56e4157ef0 2023-11-18T20:59:53.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.236+0000 7f56ec6b1640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e414cc70 con 0x7f56e40c5460 2023-11-18T20:59:53.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.236+0000 7f56ea44d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56e40c5080 0x7f56e40cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:53.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.236+0000 7f56ea44d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56e40c5080 0x7f56e40cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55420/0 (socket says 172.21.15.49:55420) 2023-11-18T20:59:53.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.236+0000 7f56ea44d640 1 -- 172.21.15.49:0/3902404768 learned_addr learned my addr 172.21.15.49:0/3902404768 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:53.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.240+0000 7f56ea44d640 1 -- 172.21.15.49:0/3902404768 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e40c5460 msgr2=0x7f56e4145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:53.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.240+0000 7f56ea44d640 1 --2- 172.21.15.49:0/3902404768 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e40c5460 0x7f56e4145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.240+0000 7f56ea44d640 1 -- 172.21.15.49:0/3902404768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56e4157ef0 msgr2=0x7f56e40ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:53.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.240+0000 7f56ea44d640 1 --2- 172.21.15.49:0/3902404768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56e4157ef0 0x7f56e40ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.240+0000 7f56ea44d640 1 -- 172.21.15.49:0/3902404768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e0009420 con 0x7f56e40c5080 2023-11-18T20:59:53.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.244+0000 7f56ea44d640 1 --2- 172.21.15.49:0/3902404768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56e40c5080 0x7f56e40cb520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f56e001b840 tx=0x7f56e001b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:53.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.248+0000 7f56daffd640 1 -- 172.21.15.49:0/3902404768 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e00a88d0 con 0x7f56e40c5080 2023-11-18T20:59:53.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.248+0000 7f56daffd640 1 -- 172.21.15.49:0/3902404768 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e00b9410 con 0x7f56e40c5080 2023-11-18T20:59:53.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.248+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3902404768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e414cf50 con 0x7f56e40c5080 2023-11-18T20:59:53.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.248+0000 7f56daffd640 1 -- 172.21.15.49:0/3902404768 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e00b97c0 con 0x7f56e40c5080 2023-11-18T20:59:53.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.248+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3902404768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e40c9b70 con 0x7f56e40c5080 2023-11-18T20:59:53.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.248+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3902404768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e40c9d60 con 0x7f56e40c5080 2023-11-18T20:59:53.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.516+0000 7f56daffd640 1 -- 172.21.15.49:0/3902404768 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f56e00b7040 con 0x7f56e40c5080 2023-11-18T20:59:53.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.516+0000 7f56daffd640 1 --2- 172.21.15.49:0/3902404768 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f56c8066470 0x7f56c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:53.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.520+0000 7f56e9c4c640 1 --2- 172.21.15.49:0/3902404768 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f56c8066470 0x7f56c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:53.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.520+0000 7f56e9c4c640 1 --2- 172.21.15.49:0/3902404768 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f56c8066470 0x7f56c8068930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f56d4000f70 tx=0x7f56d4007a90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:53.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.556+0000 7f56daffd640 1 -- 172.21.15.49:0/3902404768 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f56e00aee20 con 0x7f56e40c5080 2023-11-18T20:59:53.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.556+0000 7f56daffd640 1 -- 172.21.15.49:0/3902404768 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56e00ef810 con 0x7f56e40c5080 2023-11-18T20:59:53.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.728+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3902404768 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56e40cbb90 con 0x7f56e40c5080 2023-11-18T20:59:53.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.792+0000 7f56daffd640 1 -- 172.21.15.49:0/3902404768 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56e40cbb90 con 0x7f56e40c5080 2023-11-18T20:59:53.792 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-18T20:59:53.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.796+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3902404768 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f56c8066470 msgr2=0x7f56c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:53.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.796+0000 7f56ec6b1640 1 --2- 172.21.15.49:0/3902404768 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f56c8066470 0x7f56c8068930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f56d4000f70 tx=0x7f56d4007a90 comp rx=0 tx=0).stop 2023-11-18T20:59:53.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.796+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3902404768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56e40c5080 msgr2=0x7f56e40cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:53.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.796+0000 7f56ec6b1640 1 --2- 172.21.15.49:0/3902404768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56e40c5080 0x7f56e40cb520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f56e001b840 tx=0x7f56e001b9d0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.796+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3902404768 shutdown_connections 2023-11-18T20:59:53.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.796+0000 7f56ec6b1640 1 --2- 172.21.15.49:0/3902404768 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f56c8066470 0x7f56c8068930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.796+0000 7f56ec6b1640 1 --2- 172.21.15.49:0/3902404768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56e4157ef0 0x7f56e40ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.796+0000 7f56ec6b1640 1 --2- 172.21.15.49:0/3902404768 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e40c5460 0x7f56e4145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.796+0000 7f56ec6b1640 1 --2- 172.21.15.49:0/3902404768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56e40c5080 0x7f56e40cb520 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.796+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3902404768 >> 172.21.15.49:0/3902404768 conn(0x7f56e406b670 msgr2=0x7f56e4156530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:53.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.796+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3902404768 shutdown_connections 2023-11-18T20:59:53.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.796+0000 7f56ec6b1640 1 -- 172.21.15.49:0/3902404768 wait complete. 2023-11-18T20:59:53.818 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T20:59:53.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.948+0000 7f6c9e56e640 1 Processor -- start 2023-11-18T20:59:53.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.948+0000 7f6c9e56e640 1 -- start start 2023-11-18T20:59:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.948+0000 7f6c9e56e640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6c98157280 0x7f6c9806f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.948+0000 7f6c9e56e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6c9806f840 0x7f6c980ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.948+0000 7f6c9e56e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c980c21d0 con 0x7f6c98151460 2023-11-18T20:59:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.948+0000 7f6c9e56e640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9806ec00 con 0x7f6c98157280 2023-11-18T20:59:53.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.948+0000 7f6c9e56e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c98157750 con 0x7f6c9806f840 2023-11-18T20:59:53.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.952+0000 7f6c9cb0b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6c9806f840 0x7f6c980ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:53.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.952+0000 7f6c9cb0b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6c9806f840 0x7f6c980ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:60066/0 (socket says 172.21.15.49:60066) 2023-11-18T20:59:53.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.952+0000 7f6c9cb0b640 1 -- 172.21.15.49:0/1757010407 learned_addr learned my addr 172.21.15.49:0/1757010407 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.956+0000 7f6c9cb0b640 1 -- 172.21.15.49:0/1757010407 >> v2:172.21.15.49:3300/0 conn(0x7f6c98157280 msgr2=0x7f6c9806f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.956+0000 7f6c9cb0b640 1 --2- 172.21.15.49:0/1757010407 >> v2:172.21.15.49:3300/0 conn(0x7f6c98157280 0x7f6c9806f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.956+0000 7f6c9cb0b640 1 -- 172.21.15.49:0/1757010407 >> v1:172.21.15.106:6789/0 conn(0x7f6c98151460 legacy=0x7f6c980c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:53.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.956+0000 7f6c9cb0b640 1 -- 172.21.15.49:0/1757010407 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c98157a30 con 0x7f6c9806f840 2023-11-18T20:59:53.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.968+0000 7f6c9cb0b640 1 --2- 172.21.15.49:0/1757010407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c9806f840 0x7f6c980ccad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009e50 tx=0x7f6c9001c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d685c4267631fba server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:53.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.976+0000 7f6c96ffd640 1 -- 172.21.15.49:0/1757010407 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900a56a0 con 0x7f6c9806f840 2023-11-18T20:59:53.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.976+0000 7f6c96ffd640 1 -- 172.21.15.49:0/1757010407 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900a5800 con 0x7f6c9806f840 2023-11-18T20:59:53.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.976+0000 7f6c96ffd640 1 -- 172.21.15.49:0/1757010407 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900a5b90 con 0x7f6c9806f840 2023-11-18T20:59:53.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.976+0000 7f6c9e56e640 1 -- 172.21.15.49:0/1757010407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c9806f840 msgr2=0x7f6c980ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:53.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.976+0000 7f6c9e56e640 1 --2- 172.21.15.49:0/1757010407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c9806f840 0x7f6c980ccad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009e50 tx=0x7f6c9001c8d0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.976+0000 7f6c9e56e640 1 -- 172.21.15.49:0/1757010407 shutdown_connections 2023-11-18T20:59:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.976+0000 7f6c9e56e640 1 --2- 172.21.15.49:0/1757010407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c9806f840 0x7f6c980ccad0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.976+0000 7f6c9e56e640 1 --2- 172.21.15.49:0/1757010407 >> v2:172.21.15.49:3300/0 conn(0x7f6c98157280 0x7f6c9806f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.976+0000 7f6c9e56e640 1 -- 172.21.15.49:0/1757010407 >> 172.21.15.49:0/1757010407 conn(0x7f6c980708a0 msgr2=0x7f6c98070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.976+0000 7f6c9e56e640 1 -- 172.21.15.49:0/1757010407 shutdown_connections 2023-11-18T20:59:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.976+0000 7f6c9e56e640 1 -- 172.21.15.49:0/1757010407 wait complete. 2023-11-18T20:59:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.976+0000 7f6c9e56e640 1 Processor -- start 2023-11-18T20:59:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.976+0000 7f6c9e56e640 1 -- start start 2023-11-18T20:59:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.980+0000 7f6c9e56e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9806f840 0x7f6c980cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:53.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.980+0000 7f6c9e56e640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c98151460 0x7f6c9814fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.980+0000 7f6c9e56e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c98157280 0x7f6c981502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.980+0000 7f6c9e56e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9814d690 con 0x7f6c9806f840 2023-11-18T20:59:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.980+0000 7f6c9e56e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980cc360 con 0x7f6c98157280 2023-11-18T20:59:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.980+0000 7f6c9e56e640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980ccb30 con 0x7f6c98151460 2023-11-18T20:59:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.980+0000 7f6c97fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9806f840 0x7f6c980cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.980+0000 7f6c97fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9806f840 0x7f6c980cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55452/0 (socket says 172.21.15.49:55452) 2023-11-18T20:59:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.980+0000 7f6c97fff640 1 -- 172.21.15.49:0/841865583 learned_addr learned my addr 172.21.15.49:0/841865583 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:53.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.984+0000 7f6c97fff640 1 -- 172.21.15.49:0/841865583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c98151460 msgr2=0x7f6c9814fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:53.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.984+0000 7f6c97fff640 1 --2- 172.21.15.49:0/841865583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c98151460 0x7f6c9814fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.984+0000 7f6c97fff640 1 -- 172.21.15.49:0/841865583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c98157280 msgr2=0x7f6c981502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:53.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.984+0000 7f6c97fff640 1 --2- 172.21.15.49:0/841865583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c98157280 0x7f6c981502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:53.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.984+0000 7f6c97fff640 1 -- 172.21.15.49:0/841865583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90009b30 con 0x7f6c9806f840 2023-11-18T20:59:53.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.988+0000 7f6c97fff640 1 --2- 172.21.15.49:0/841865583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9806f840 0x7f6c980cbdb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00b3e0 tx=0x7f6c8c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:53.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.996+0000 7f6c94ff9640 1 -- 172.21.15.49:0/841865583 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c011830 con 0x7f6c9806f840 2023-11-18T20:59:53.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.996+0000 7f6c94ff9640 1 -- 172.21.15.49:0/841865583 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8c0119b0 con 0x7f6c9806f840 2023-11-18T20:59:53.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.996+0000 7f6c94ff9640 1 -- 172.21.15.49:0/841865583 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c011d60 con 0x7f6c9806f840 2023-11-18T20:59:53.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.996+0000 7f6c9e56e640 1 -- 172.21.15.49:0/841865583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c980cc570 con 0x7f6c9806f840 2023-11-18T20:59:53.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.996+0000 7f6c9e56e640 1 -- 172.21.15.49:0/841865583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9814d2b0 con 0x7f6c9806f840 2023-11-18T20:59:53.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:53.996+0000 7f6c9e56e640 1 -- 172.21.15.49:0/841865583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c98073e70 con 0x7f6c9806f840 2023-11-18T20:59:54.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.300+0000 7f6c94ff9640 1 -- 172.21.15.49:0/841865583 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c8c023430 con 0x7f6c9806f840 2023-11-18T20:59:54.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.300+0000 7f6c94ff9640 1 --2- 172.21.15.49:0/841865583 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6c84066470 0x7f6c84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:54.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.300+0000 7f6c977fe640 1 --2- 172.21.15.49:0/841865583 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6c84066470 0x7f6c84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:54.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.300+0000 7f6c977fe640 1 --2- 172.21.15.49:0/841865583 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6c84066470 0x7f6c84068930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6c980c3900 tx=0x7f6c88006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:54.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.340+0000 7f6c94ff9640 1 -- 172.21.15.49:0/841865583 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c8c055960 con 0x7f6c9806f840 2023-11-18T20:59:54.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.340+0000 7f6c94ff9640 1 -- 172.21.15.49:0/841865583 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c8c0515a0 con 0x7f6c9806f840 2023-11-18T20:59:54.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.500+0000 7f6c9e56e640 1 -- 172.21.15.49:0/841865583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c980c8450 con 0x7f6c9806f840 2023-11-18T20:59:54.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.516+0000 7f6c94ff9640 1 -- 172.21.15.49:0/841865583 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c8c015020 con 0x7f6c9806f840 2023-11-18T20:59:54.518 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-11-18T20:59:54.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.520+0000 7f6c9e56e640 1 -- 172.21.15.49:0/841865583 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6c84066470 msgr2=0x7f6c84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:54.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.520+0000 7f6c9e56e640 1 --2- 172.21.15.49:0/841865583 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6c84066470 0x7f6c84068930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6c980c3900 tx=0x7f6c88006ca0 comp rx=0 tx=0).stop 2023-11-18T20:59:54.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.520+0000 7f6c9e56e640 1 -- 172.21.15.49:0/841865583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9806f840 msgr2=0x7f6c980cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:54.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.520+0000 7f6c9e56e640 1 --2- 172.21.15.49:0/841865583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9806f840 0x7f6c980cbdb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00b3e0 tx=0x7f6c8c00b8a0 comp rx=0 tx=0).stop 2023-11-18T20:59:54.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.520+0000 7f6c9e56e640 1 -- 172.21.15.49:0/841865583 shutdown_connections 2023-11-18T20:59:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.520+0000 7f6c9e56e640 1 --2- 172.21.15.49:0/841865583 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6c84066470 0x7f6c84068930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.520+0000 7f6c9e56e640 1 --2- 172.21.15.49:0/841865583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c98157280 0x7f6c981502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.520+0000 7f6c9e56e640 1 --2- 172.21.15.49:0/841865583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c98151460 0x7f6c9814fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.520+0000 7f6c9e56e640 1 --2- 172.21.15.49:0/841865583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c9806f840 0x7f6c980cbdb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.520+0000 7f6c9e56e640 1 -- 172.21.15.49:0/841865583 >> 172.21.15.49:0/841865583 conn(0x7f6c980708a0 msgr2=0x7f6c980c9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.520+0000 7f6c9e56e640 1 -- 172.21.15.49:0/841865583 shutdown_connections 2023-11-18T20:59:54.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.520+0000 7f6c9e56e640 1 -- 172.21.15.49:0/841865583 wait complete. 2023-11-18T20:59:54.539 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T20:59:54.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.668+0000 7f0f1e6ae640 1 Processor -- start 2023-11-18T20:59:54.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.668+0000 7f0f1e6ae640 1 -- start start 2023-11-18T20:59:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.668+0000 7f0f1e6ae640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0f1806adc0 0x7f0f18072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.668+0000 7f0f1e6ae640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0f1806b1a0 0x7f0f18159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.668+0000 7f0f1e6ae640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f180c65f0 0x7f0f181532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.668+0000 7f0f1e6ae640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f180c2440 con 0x7f0f1806adc0 2023-11-18T20:59:54.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.668+0000 7f0f1e6ae640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f180c2720 con 0x7f0f1806b1a0 2023-11-18T20:59:54.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.668+0000 7f0f1e6ae640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f180c2a00 con 0x7f0f180c65f0 2023-11-18T20:59:54.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.668+0000 7f0f177fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0f1806b1a0 0x7f0f18159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.668+0000 7f0f1cc4b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f180c65f0 0x7f0f181532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.672+0000 7f0f1cc4b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f180c65f0 0x7f0f181532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:44014/0 (socket says 172.21.15.49:44014) 2023-11-18T20:59:54.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.672+0000 7f0f1cc4b640 1 -- 172.21.15.49:0/379815729 learned_addr learned my addr 172.21.15.49:0/379815729 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:54.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.676+0000 7f0f1cc4b640 1 -- 172.21.15.49:0/379815729 >> v2:172.21.15.106:3300/0 conn(0x7f0f1806b1a0 msgr2=0x7f0f18159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:54.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.676+0000 7f0f1cc4b640 1 --2- 172.21.15.49:0/379815729 >> v2:172.21.15.106:3300/0 conn(0x7f0f1806b1a0 0x7f0f18159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:54.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.676+0000 7f0f1cc4b640 1 -- 172.21.15.49:0/379815729 >> v2:172.21.15.49:3300/0 conn(0x7f0f1806adc0 msgr2=0x7f0f18072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:54.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.676+0000 7f0f1cc4b640 1 --2- 172.21.15.49:0/379815729 >> v2:172.21.15.49:3300/0 conn(0x7f0f1806adc0 0x7f0f18072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:54.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.676+0000 7f0f1cc4b640 1 -- 172.21.15.49:0/379815729 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f180c2ce0 con 0x7f0f180c65f0 2023-11-18T20:59:54.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.680+0000 7f0f1cc4b640 1 --2- 172.21.15.49:0/379815729 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f180c65f0 0x7f0f181532a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0f18157030 tx=0x7f0f1001f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e53d44729de611e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:54.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.692+0000 7f0f16ffd640 1 -- 172.21.15.49:0/379815729 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f100af400 con 0x7f0f180c65f0 2023-11-18T20:59:54.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.692+0000 7f0f16ffd640 1 -- 172.21.15.49:0/379815729 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f100ab050 con 0x7f0f180c65f0 2023-11-18T20:59:54.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.692+0000 7f0f16ffd640 1 -- 172.21.15.49:0/379815729 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f100af780 con 0x7f0f180c65f0 2023-11-18T20:59:54.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.692+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/379815729 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f180c65f0 msgr2=0x7f0f181532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:54.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.692+0000 7f0f1e6ae640 1 --2- 172.21.15.49:0/379815729 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f180c65f0 0x7f0f181532a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0f18157030 tx=0x7f0f1001f1c0 comp rx=0 tx=0).stop 2023-11-18T20:59:54.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.692+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/379815729 shutdown_connections 2023-11-18T20:59:54.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.692+0000 7f0f1e6ae640 1 --2- 172.21.15.49:0/379815729 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f180c65f0 0x7f0f181532a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:54.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.692+0000 7f0f1e6ae640 1 --2- 172.21.15.49:0/379815729 >> v2:172.21.15.106:3300/0 conn(0x7f0f1806b1a0 0x7f0f18159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:54.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.692+0000 7f0f1e6ae640 1 --2- 172.21.15.49:0/379815729 >> v2:172.21.15.49:3300/0 conn(0x7f0f1806adc0 0x7f0f18072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:54.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.692+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/379815729 >> 172.21.15.49:0/379815729 conn(0x7f0f18070160 msgr2=0x7f0f1806b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:54.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.692+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/379815729 shutdown_connections 2023-11-18T20:59:54.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.692+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/379815729 wait complete. 2023-11-18T20:59:54.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.696+0000 7f0f1e6ae640 1 Processor -- start 2023-11-18T20:59:54.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.696+0000 7f0f1e6ae640 1 -- start start 2023-11-18T20:59:54.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.696+0000 7f0f1e6ae640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f1806adc0 0x7f0f1815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:54.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.696+0000 7f0f1e6ae640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f1806b1a0 0x7f0f181f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:54.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.696+0000 7f0f1e6ae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f180c65f0 0x7f0f1814e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:54.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.696+0000 7f0f1e6ae640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f180c4260 con 0x7f0f180c65f0 2023-11-18T20:59:54.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.696+0000 7f0f1e6ae640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f181f2e90 con 0x7f0f1806adc0 2023-11-18T20:59:54.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.696+0000 7f0f1e6ae640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18153ce0 con 0x7f0f1806b1a0 2023-11-18T20:59:54.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.696+0000 7f0f17fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f1806adc0 0x7f0f1815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:54.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.696+0000 7f0f17fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f1806adc0 0x7f0f1815cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:60096/0 (socket says 172.21.15.49:60096) 2023-11-18T20:59:54.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.696+0000 7f0f17fff640 1 -- 172.21.15.49:0/3714573772 learned_addr learned my addr 172.21.15.49:0/3714573772 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:54.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.700+0000 7f0f177fe640 1 --2- 172.21.15.49:0/3714573772 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f1806b1a0 0x7f0f181f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:54.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.708+0000 7f0f17fff640 1 -- 172.21.15.49:0/3714573772 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f1806b1a0 msgr2=0x7f0f181f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:54.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.708+0000 7f0f17fff640 1 --2- 172.21.15.49:0/3714573772 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f1806b1a0 0x7f0f181f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:54.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.708+0000 7f0f17fff640 1 -- 172.21.15.49:0/3714573772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f180c65f0 msgr2=0x7f0f1814e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:54.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.708+0000 7f0f17fff640 1 --2- 172.21.15.49:0/3714573772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f180c65f0 0x7f0f1814e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:54.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.708+0000 7f0f17fff640 1 -- 172.21.15.49:0/3714573772 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f10009b30 con 0x7f0f1806adc0 2023-11-18T20:59:54.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.712+0000 7f0f17fff640 1 --2- 172.21.15.49:0/3714573772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f1806adc0 0x7f0f1815cc60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00b550 tx=0x7f0f0c00ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:54.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.724+0000 7f0f14ff9640 1 -- 172.21.15.49:0/3714573772 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c011890 con 0x7f0f1806adc0 2023-11-18T20:59:54.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.724+0000 7f0f14ff9640 1 -- 172.21.15.49:0/3714573772 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0c011a10 con 0x7f0f1806adc0 2023-11-18T20:59:54.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.724+0000 7f0f14ff9640 1 -- 172.21.15.49:0/3714573772 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c011dc0 con 0x7f0f1806adc0 2023-11-18T20:59:54.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.724+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/3714573772 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f18153fc0 con 0x7f0f1806adc0 2023-11-18T20:59:54.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.724+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/3714573772 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1815c460 con 0x7f0f1806adc0 2023-11-18T20:59:54.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.724+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/3714573772 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f18073e70 con 0x7f0f1806adc0 2023-11-18T20:59:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.808+0000 7f0f14ff9640 1 -- 172.21.15.49:0/3714573772 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0f0c01a400 con 0x7f0f1806adc0 2023-11-18T20:59:54.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.808+0000 7f0f14ff9640 1 --2- 172.21.15.49:0/3714573772 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0f040664f0 0x7f0f040689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:54.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.808+0000 7f0f177fe640 1 --2- 172.21.15.49:0/3714573772 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0f040664f0 0x7f0f040689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:54.811 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.812+0000 7f0f177fe640 1 --2- 172.21.15.49:0/3714573772 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0f040664f0 0x7f0f040689b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0f181e9500 tx=0x7f0f08009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:54.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:54.816+0000 7f0f14ff9640 1 -- 172.21.15.49:0/3714573772 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f0c055f80 con 0x7f0f1806adc0 2023-11-18T20:59:55.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.188+0000 7f0f14ff9640 1 -- 172.21.15.49:0/3714573772 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0f0c051bc0 con 0x7f0f1806adc0 2023-11-18T20:59:55.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.352+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/3714573772 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f180c8030 con 0x7f0f1806adc0 2023-11-18T20:59:55.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.376+0000 7f0f14ff9640 1 -- 172.21.15.49:0/3714573772 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f0c015070 con 0x7f0f1806adc0 2023-11-18T20:59:55.377 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-18T20:59:55.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.376+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/3714573772 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0f040664f0 msgr2=0x7f0f040689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:55.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.376+0000 7f0f1e6ae640 1 --2- 172.21.15.49:0/3714573772 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0f040664f0 0x7f0f040689b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0f181e9500 tx=0x7f0f08009190 comp rx=0 tx=0).stop 2023-11-18T20:59:55.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.376+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/3714573772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f1806adc0 msgr2=0x7f0f1815cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:55.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.376+0000 7f0f1e6ae640 1 --2- 172.21.15.49:0/3714573772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f1806adc0 0x7f0f1815cc60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00b550 tx=0x7f0f0c00ba10 comp rx=0 tx=0).stop 2023-11-18T20:59:55.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.380+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/3714573772 shutdown_connections 2023-11-18T20:59:55.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.380+0000 7f0f1e6ae640 1 --2- 172.21.15.49:0/3714573772 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0f040664f0 0x7f0f040689b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:55.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.380+0000 7f0f1e6ae640 1 --2- 172.21.15.49:0/3714573772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f180c65f0 0x7f0f1814e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:55.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.380+0000 7f0f1e6ae640 1 --2- 172.21.15.49:0/3714573772 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f1806b1a0 0x7f0f181f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:55.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.380+0000 7f0f1e6ae640 1 --2- 172.21.15.49:0/3714573772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f1806adc0 0x7f0f1815cc60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:55.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.380+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/3714573772 >> 172.21.15.49:0/3714573772 conn(0x7f0f18070160 msgr2=0x7f0f18153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:55.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.380+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/3714573772 shutdown_connections 2023-11-18T20:59:55.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.380+0000 7f0f1e6ae640 1 -- 172.21.15.49:0/3714573772 wait complete. 2023-11-18T20:59:55.398 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-18T20:59:55.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:59:55.401 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T20:59:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.520+0000 7f302703a640 1 Processor -- start 2023-11-18T20:59:55.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.520+0000 7f302703a640 1 -- start start 2023-11-18T20:59:55.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.524+0000 7f302703a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f30200ce0c0 0x7f30200ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:55.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.524+0000 7f302703a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30200cc3c0 0x7f3020159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:55.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.524+0000 7f302703a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30200cd9a0 con 0x7f30200cdb70 2023-11-18T20:59:55.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.524+0000 7f302703a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30200ca550 con 0x7f30200ce0c0 2023-11-18T20:59:55.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.524+0000 7f302703a640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30200ce9e0 con 0x7f30200cc3c0 2023-11-18T20:59:55.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.524+0000 7f3024dd6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f30200ce0c0 0x7f30200ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:55.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.524+0000 7f3024dd6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f30200ce0c0 0x7f30200ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55494/0 (socket says 172.21.15.49:55494) 2023-11-18T20:59:55.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.524+0000 7f3024dd6640 1 -- 172.21.15.49:0/1817591964 learned_addr learned my addr 172.21.15.49:0/1817591964 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:55.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.524+0000 7f301ffff640 1 --2- 172.21.15.49:0/1817591964 >> v2:172.21.15.106:3300/0 conn(0x7f30200cc3c0 0x7f3020159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:55.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.528+0000 7f3024dd6640 1 -- 172.21.15.49:0/1817591964 >> v2:172.21.15.106:3300/0 conn(0x7f30200cc3c0 msgr2=0x7f3020159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:55.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.528+0000 7f3024dd6640 1 --2- 172.21.15.49:0/1817591964 >> v2:172.21.15.106:3300/0 conn(0x7f30200cc3c0 0x7f3020159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:55.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.528+0000 7f3024dd6640 1 -- 172.21.15.49:0/1817591964 >> v1:172.21.15.106:6789/0 conn(0x7f30200cdb70 legacy=0x7f302015cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:55.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.528+0000 7f3024dd6640 1 -- 172.21.15.49:0/1817591964 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30201596c0 con 0x7f30200ce0c0 2023-11-18T20:59:55.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.528+0000 7f3024dd6640 1 --2- 172.21.15.49:0/1817591964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30200ce0c0 0x7f30200ce4a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f302015dbc0 tx=0x7f301001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f575de3344ca634e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f301f7fe640 1 -- 172.21.15.49:0/1817591964 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30100aa620 con 0x7f30200ce0c0 2023-11-18T20:59:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f301f7fe640 1 -- 172.21.15.49:0/1817591964 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30100aa780 con 0x7f30200ce0c0 2023-11-18T20:59:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f301f7fe640 1 -- 172.21.15.49:0/1817591964 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30100aab10 con 0x7f30200ce0c0 2023-11-18T20:59:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 -- 172.21.15.49:0/1817591964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30200ce0c0 msgr2=0x7f30200ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 --2- 172.21.15.49:0/1817591964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30200ce0c0 0x7f30200ce4a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f302015dbc0 tx=0x7f301001c4c0 comp rx=0 tx=0).stop 2023-11-18T20:59:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 -- 172.21.15.49:0/1817591964 shutdown_connections 2023-11-18T20:59:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 --2- 172.21.15.49:0/1817591964 >> v2:172.21.15.106:3300/0 conn(0x7f30200cc3c0 0x7f3020159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 --2- 172.21.15.49:0/1817591964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30200ce0c0 0x7f30200ce4a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 -- 172.21.15.49:0/1817591964 >> 172.21.15.49:0/1817591964 conn(0x7f30200b07c0 msgr2=0x7f30200b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 -- 172.21.15.49:0/1817591964 shutdown_connections 2023-11-18T20:59:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 -- 172.21.15.49:0/1817591964 wait complete. 2023-11-18T20:59:55.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 Processor -- start 2023-11-18T20:59:55.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 -- start start 2023-11-18T20:59:55.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30200cc3c0 0x7f3020156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:55.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30200cdb70 0x7f30200c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:55.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30200ce0c0 0x7f30200c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:55.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3020155910 con 0x7f30200cdb70 2023-11-18T20:59:55.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3020154e40 con 0x7f30200cc3c0 2023-11-18T20:59:55.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.536+0000 7f302703a640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3020155070 con 0x7f30200ce0c0 2023-11-18T20:59:55.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.540+0000 7f301ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30200cdb70 0x7f30200c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:55.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.540+0000 7f301ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30200cdb70 0x7f30200c61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55504/0 (socket says 172.21.15.49:55504) 2023-11-18T20:59:55.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.540+0000 7f301ffff640 1 -- 172.21.15.49:0/3171543118 learned_addr learned my addr 172.21.15.49:0/3171543118 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:55.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.540+0000 7f3024dd6640 1 --2- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30200cc3c0 0x7f3020156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:55.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.540+0000 7f30255d7640 1 --2- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30200ce0c0 0x7f30200c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.556+0000 7f3024dd6640 1 -- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30200ce0c0 msgr2=0x7f30200c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.556+0000 7f3024dd6640 1 --2- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30200ce0c0 0x7f30200c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.556+0000 7f3024dd6640 1 -- 172.21.15.49:0/3171543118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30200cdb70 msgr2=0x7f30200c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.556+0000 7f3024dd6640 1 --2- 172.21.15.49:0/3171543118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30200cdb70 0x7f30200c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:55.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.556+0000 7f3024dd6640 1 -- 172.21.15.49:0/3171543118 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30100094d0 con 0x7f30200cc3c0 2023-11-18T20:59:55.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.564+0000 7f3024dd6640 1 --2- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30200cc3c0 0x7f3020156700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f30100ab000 tx=0x7f301001ad00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:55.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.576+0000 7f301d7fa640 1 -- 172.21.15.49:0/3171543118 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30100aae80 con 0x7f30200cc3c0 2023-11-18T20:59:55.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.576+0000 7f301d7fa640 1 -- 172.21.15.49:0/3171543118 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30100bd3f0 con 0x7f30200cc3c0 2023-11-18T20:59:55.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.576+0000 7f301d7fa640 1 -- 172.21.15.49:0/3171543118 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30100bd7a0 con 0x7f30200cc3c0 2023-11-18T20:59:55.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.576+0000 7f302703a640 1 -- 172.21.15.49:0/3171543118 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3020155350 con 0x7f30200cc3c0 2023-11-18T20:59:55.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.576+0000 7f302703a640 1 -- 172.21.15.49:0/3171543118 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30200c71b0 con 0x7f30200cc3c0 2023-11-18T20:59:55.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.580+0000 7f302703a640 1 -- 172.21.15.49:0/3171543118 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3020067520 con 0x7f30200cc3c0 2023-11-18T20:59:55.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.908+0000 7f301d7fa640 1 -- 172.21.15.49:0/3171543118 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f30100c7420 con 0x7f30200cc3c0 2023-11-18T20:59:55.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.908+0000 7f301d7fa640 1 --2- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f300c0664c0 0x7f300c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:55.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.908+0000 7f301ffff640 1 --2- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f300c0664c0 0x7f300c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:55.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.908+0000 7f301ffff640 1 --2- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f300c0664c0 0x7f300c068980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f30200c6ca0 tx=0x7f3014008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:55.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.956+0000 7f301d7fa640 1 -- 172.21.15.49:0/3171543118 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f30100ef580 con 0x7f30200cc3c0 2023-11-18T20:59:55.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:55.984+0000 7f301d7fa640 1 -- 172.21.15.49:0/3171543118 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30100eb8c0 con 0x7f30200cc3c0 2023-11-18T20:59:56.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.164+0000 7f302703a640 1 -- 172.21.15.49:0/3171543118 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f30200b1570 con 0x7f30200cc3c0 2023-11-18T20:59:56.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.184+0000 7f301d7fa640 1 -- 172.21.15.49:0/3171543118 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f30100eeee0 con 0x7f30200cc3c0 2023-11-18T20:59:56.184 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-11-18T20:59:56.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.184+0000 7f302703a640 1 -- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f300c0664c0 msgr2=0x7f300c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:56.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.184+0000 7f302703a640 1 --2- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f300c0664c0 0x7f300c068980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f30200c6ca0 tx=0x7f3014008040 comp rx=0 tx=0).stop 2023-11-18T20:59:56.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.184+0000 7f302703a640 1 -- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30200cc3c0 msgr2=0x7f3020156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:56.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.184+0000 7f302703a640 1 --2- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30200cc3c0 0x7f3020156700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f30100ab000 tx=0x7f301001ad00 comp rx=0 tx=0).stop 2023-11-18T20:59:56.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.184+0000 7f302703a640 1 -- 172.21.15.49:0/3171543118 shutdown_connections 2023-11-18T20:59:56.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.184+0000 7f302703a640 1 --2- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f300c0664c0 0x7f300c068980 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:56.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.184+0000 7f302703a640 1 --2- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30200ce0c0 0x7f30200c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:56.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.184+0000 7f302703a640 1 --2- 172.21.15.49:0/3171543118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30200cdb70 0x7f30200c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:56.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.184+0000 7f302703a640 1 --2- 172.21.15.49:0/3171543118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30200cc3c0 0x7f3020156700 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:56.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.184+0000 7f302703a640 1 -- 172.21.15.49:0/3171543118 >> 172.21.15.49:0/3171543118 conn(0x7f30200b07c0 msgr2=0x7f3020158f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:56.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.188+0000 7f302703a640 1 -- 172.21.15.49:0/3171543118 shutdown_connections 2023-11-18T20:59:56.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.188+0000 7f302703a640 1 -- 172.21.15.49:0/3171543118 wait complete. 2023-11-18T20:59:56.206 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T20:59:56.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.332+0000 7fe06475b640 1 Processor -- start 2023-11-18T20:59:56.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.332+0000 7fe06475b640 1 -- start start 2023-11-18T20:59:56.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.332+0000 7fe06475b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe05c1533e0 0x7fe05c0cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:56.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.332+0000 7fe06475b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe05c15d300 0x7fe05c0cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:56.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.332+0000 7fe06475b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05c15a300 con 0x7fe05c072780 2023-11-18T20:59:56.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.332+0000 7fe06475b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05c1537c0 con 0x7fe05c1533e0 2023-11-18T20:59:56.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.332+0000 7fe06475b640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c159430 con 0x7fe05c15d300 2023-11-18T20:59:56.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.376+0000 7fe061cf6640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe05c072780 0x7fe05c15cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33254/0 (socket says 172.21.15.49:33254) 2023-11-18T20:59:56.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.376+0000 7fe061cf6640 1 -- 172.21.15.49:0/3082161941 learned_addr learned my addr 172.21.15.49:0/3082161941 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T20:59:56.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.380+0000 7fe0624f7640 1 --2- 172.21.15.49:0/3082161941 >> v2:172.21.15.49:3300/0 conn(0x7fe05c1533e0 0x7fe05c0cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:56.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.388+0000 7fe0614f5640 1 -- 172.21.15.49:0/3082161941 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042162309 0 0) 0x7fe05c15a300 con 0x7fe05c072780 2023-11-18T20:59:56.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.388+0000 7fe0614f5640 1 -- 172.21.15.49:0/3082161941 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe044003530 con 0x7fe05c072780 2023-11-18T20:59:56.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.400+0000 7fe0624f7640 1 -- 172.21.15.49:0/3082161941 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe05c15d300 msgr2=0x7fe05c0cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T20:59:56.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.400+0000 7fe0624f7640 1 --2- 172.21.15.49:0/3082161941 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe05c15d300 0x7fe05c0cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:56.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.400+0000 7fe0624f7640 1 -- 172.21.15.49:0/3082161941 >> v1:172.21.15.49:6789/0 conn(0x7fe05c072780 legacy=0x7fe05c15cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:56.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.400+0000 7fe0624f7640 1 -- 172.21.15.49:0/3082161941 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c1596f0 con 0x7fe05c1533e0 2023-11-18T20:59:56.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.412+0000 7fe0624f7640 1 --2- 172.21.15.49:0/3082161941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe05c1533e0 0x7fe05c0cc000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe054009d90 tx=0x7fe05401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6faf2edcedccbae server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:56.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.424+0000 7fe0614f5640 1 -- 172.21.15.49:0/3082161941 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0540a5900 con 0x7fe05c1533e0 2023-11-18T20:59:56.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.424+0000 7fe0614f5640 1 -- 172.21.15.49:0/3082161941 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0540a5a60 con 0x7fe05c1533e0 2023-11-18T20:59:56.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.424+0000 7fe0614f5640 1 -- 172.21.15.49:0/3082161941 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0540a5df0 con 0x7fe05c1533e0 2023-11-18T20:59:56.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.424+0000 7fe06475b640 1 -- 172.21.15.49:0/3082161941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe05c1533e0 msgr2=0x7fe05c0cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:56.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.424+0000 7fe06475b640 1 --2- 172.21.15.49:0/3082161941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe05c1533e0 0x7fe05c0cc000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe054009d90 tx=0x7fe05401c950 comp rx=0 tx=0).stop 2023-11-18T20:59:56.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.424+0000 7fe06475b640 1 -- 172.21.15.49:0/3082161941 shutdown_connections 2023-11-18T20:59:56.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.424+0000 7fe06475b640 1 --2- 172.21.15.49:0/3082161941 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe05c15d300 0x7fe05c0cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:56.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.424+0000 7fe06475b640 1 --2- 172.21.15.49:0/3082161941 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe05c1533e0 0x7fe05c0cc000 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:56.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.424+0000 7fe06475b640 1 -- 172.21.15.49:0/3082161941 >> 172.21.15.49:0/3082161941 conn(0x7fe05c06b670 msgr2=0x7fe05c06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:56.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.428+0000 7fe06475b640 1 -- 172.21.15.49:0/3082161941 shutdown_connections 2023-11-18T20:59:56.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.428+0000 7fe06475b640 1 -- 172.21.15.49:0/3082161941 wait complete. 2023-11-18T20:59:56.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.428+0000 7fe06475b640 1 Processor -- start 2023-11-18T20:59:56.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.428+0000 7fe06475b640 1 -- start start 2023-11-18T20:59:56.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.428+0000 7fe06475b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe05c072780 0x7fe05c1f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:56.430 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.428+0000 7fe06475b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe05c1533e0 0x7fe05c14e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:56.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.428+0000 7fe06475b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe05c15d300 0x7fe05c0cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:56.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.428+0000 7fe06475b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c14ef20 con 0x7fe05c1533e0 2023-11-18T20:59:56.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.428+0000 7fe06475b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c14d7f0 con 0x7fe05c15d300 2023-11-18T20:59:56.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.428+0000 7fe06475b640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c14fa70 con 0x7fe05c072780 2023-11-18T20:59:56.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.432+0000 7fe062cf8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe05c15d300 0x7fe05c0cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:56.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.432+0000 7fe0624f7640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe05c072780 0x7fe05c1f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:56.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.432+0000 7fe062cf8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe05c15d300 0x7fe05c0cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:54124/0 (socket says 172.21.15.49:54124) 2023-11-18T20:59:56.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.432+0000 7fe062cf8640 1 -- 172.21.15.49:0/4193911139 learned_addr learned my addr 172.21.15.49:0/4193911139 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T20:59:56.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.440+0000 7fe062cf8640 1 -- 172.21.15.49:0/4193911139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe05c072780 msgr2=0x7fe05c1f5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:56.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.440+0000 7fe062cf8640 1 --2- 172.21.15.49:0/4193911139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe05c072780 0x7fe05c1f5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:56.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.440+0000 7fe062cf8640 1 -- 172.21.15.49:0/4193911139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe05c1533e0 msgr2=0x7fe05c14e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:56.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.440+0000 7fe062cf8640 1 --2- 172.21.15.49:0/4193911139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe05c1533e0 0x7fe05c14e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:56.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.440+0000 7fe062cf8640 1 -- 172.21.15.49:0/4193911139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe054009a70 con 0x7fe05c15d300 2023-11-18T20:59:56.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.444+0000 7fe062cf8640 1 --2- 172.21.15.49:0/4193911139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe05c15d300 0x7fe05c0cac70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00b390 tx=0x7fe04c00b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:56.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.452+0000 7fe05affd640 1 -- 172.21.15.49:0/4193911139 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c011830 con 0x7fe05c15d300 2023-11-18T20:59:56.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.452+0000 7fe05affd640 1 -- 172.21.15.49:0/4193911139 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c011990 con 0x7fe05c15d300 2023-11-18T20:59:56.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.452+0000 7fe05affd640 1 -- 172.21.15.49:0/4193911139 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c011d40 con 0x7fe05c15d300 2023-11-18T20:59:56.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.452+0000 7fe06475b640 1 -- 172.21.15.49:0/4193911139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05c14e8b0 con 0x7fe05c15d300 2023-11-18T20:59:56.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.452+0000 7fe06475b640 1 -- 172.21.15.49:0/4193911139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c14fc80 con 0x7fe05c15d300 2023-11-18T20:59:56.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.456+0000 7fe06475b640 1 -- 172.21.15.49:0/4193911139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c14eca0 con 0x7fe05c15d300 2023-11-18T20:59:56.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.724+0000 7fe05affd640 1 -- 172.21.15.49:0/4193911139 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe04c01a400 con 0x7fe05c15d300 2023-11-18T20:59:56.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.724+0000 7fe05affd640 1 --2- 172.21.15.49:0/4193911139 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe0480664c0 0x7fe048068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T20:59:56.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.724+0000 7fe0624f7640 1 --2- 172.21.15.49:0/4193911139 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe0480664c0 0x7fe048068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T20:59:56.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.728+0000 7fe0624f7640 1 --2- 172.21.15.49:0/4193911139 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe0480664c0 0x7fe048068980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe0540af000 tx=0x7fe0540a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T20:59:56.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.728+0000 7fe05affd640 1 -- 172.21.15.49:0/4193911139 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe04c055bc0 con 0x7fe05c15d300 2023-11-18T20:59:56.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.744+0000 7fe05affd640 1 -- 172.21.15.49:0/4193911139 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe04c051800 con 0x7fe05c15d300 2023-11-18T20:59:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.948+0000 7fe06475b640 1 -- 172.21.15.49:0/4193911139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe05c14f060 con 0x7fe05c15d300 2023-11-18T20:59:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.956+0000 7fe05affd640 1 -- 172.21.15.49:0/4193911139 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe05c14f060 con 0x7fe05c15d300 2023-11-18T20:59:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-11-18T20:59:56.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.956+0000 7fe06475b640 1 -- 172.21.15.49:0/4193911139 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe0480664c0 msgr2=0x7fe048068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.956+0000 7fe06475b640 1 --2- 172.21.15.49:0/4193911139 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe0480664c0 0x7fe048068980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe0540af000 tx=0x7fe0540a7070 comp rx=0 tx=0).stop 2023-11-18T20:59:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.956+0000 7fe06475b640 1 -- 172.21.15.49:0/4193911139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe05c15d300 msgr2=0x7fe05c0cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T20:59:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.956+0000 7fe06475b640 1 --2- 172.21.15.49:0/4193911139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe05c15d300 0x7fe05c0cac70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00b390 tx=0x7fe04c00b850 comp rx=0 tx=0).stop 2023-11-18T20:59:56.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.956+0000 7fe06475b640 1 -- 172.21.15.49:0/4193911139 shutdown_connections 2023-11-18T20:59:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.956+0000 7fe06475b640 1 --2- 172.21.15.49:0/4193911139 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe0480664c0 0x7fe048068980 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.956+0000 7fe06475b640 1 --2- 172.21.15.49:0/4193911139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe05c15d300 0x7fe05c0cac70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.956+0000 7fe06475b640 1 --2- 172.21.15.49:0/4193911139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe05c1533e0 0x7fe05c14e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.956+0000 7fe06475b640 1 --2- 172.21.15.49:0/4193911139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe05c072780 0x7fe05c1f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T20:59:56.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.956+0000 7fe06475b640 1 -- 172.21.15.49:0/4193911139 >> 172.21.15.49:0/4193911139 conn(0x7fe05c06b670 msgr2=0x7fe05c15cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T20:59:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.956+0000 7fe06475b640 1 -- 172.21.15.49:0/4193911139 shutdown_connections 2023-11-18T20:59:56.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T20:59:56.956+0000 7fe06475b640 1 -- 172.21.15.49:0/4193911139 wait complete. 2023-11-18T20:59:56.977 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2023-11-18T20:59:56.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T20:59:56.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-18T20:59:56.994 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[43907]: fuse finished with error 0 and tester_r 0 2023-11-18T20:59:56.996 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:00:03.097 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-18T21:00:03.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:03.098 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-18T21:00:03.112 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T21:00:03.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.284+0000 7f37b3dd0640 1 Processor -- start 2023-11-18T21:00:03.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.288+0000 7f37b3dd0640 1 -- start start 2023-11-18T21:00:03.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.288+0000 7f37b3dd0640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f37ac151340 0x7f37ac06ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:03.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.288+0000 7f37b3dd0640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37ac151720 0x7f37ac157c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:03.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.288+0000 7f37b3dd0640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ac06f4a0 con 0x7f37ac0c40e0 2023-11-18T21:00:03.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.288+0000 7f37b3dd0640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ac072570 con 0x7f37ac151340 2023-11-18T21:00:03.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.288+0000 7f37b3dd0640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac070be0 con 0x7f37ac151720 2023-11-18T21:00:03.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.288+0000 7f37b236d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f37ac0c40e0 0x7f37ac0c70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33258/0 (socket says 172.21.15.49:33258) 2023-11-18T21:00:03.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.288+0000 7f37b236d640 1 -- 172.21.15.49:0/2543369497 learned_addr learned my addr 172.21.15.49:0/2543369497 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:03.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.288+0000 7f37b136b640 1 --2- 172.21.15.49:0/2543369497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37ac151720 0x7f37ac157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:03.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.288+0000 7f37b1b6c640 1 --2- 172.21.15.49:0/2543369497 >> v2:172.21.15.106:3300/0 conn(0x7f37ac151340 0x7f37ac06ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:03.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.292+0000 7f37b0b6a640 1 -- 172.21.15.49:0/2543369497 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148527521 0 0) 0x7f37ac06f4a0 con 0x7f37ac0c40e0 2023-11-18T21:00:03.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.292+0000 7f37b0b6a640 1 -- 172.21.15.49:0/2543369497 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3798003530 con 0x7f37ac0c40e0 2023-11-18T21:00:03.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b0b6a640 1 -- 172.21.15.49:0/2543369497 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1450165668 0 0) 0x7f3798003530 con 0x7f37ac0c40e0 2023-11-18T21:00:03.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b0b6a640 1 -- 172.21.15.49:0/2543369497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37ac151720 msgr2=0x7f37ac157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:03.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b0b6a640 1 --2- 172.21.15.49:0/2543369497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37ac151720 0x7f37ac157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:03.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b0b6a640 1 -- 172.21.15.49:0/2543369497 >> v2:172.21.15.106:3300/0 conn(0x7f37ac151340 msgr2=0x7f37ac06ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:03.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b0b6a640 1 --2- 172.21.15.49:0/2543369497 >> v2:172.21.15.106:3300/0 conn(0x7f37ac151340 0x7f37ac06ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:03.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b0b6a640 1 -- 172.21.15.49:0/2543369497 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac158190 con 0x7f37ac0c40e0 2023-11-18T21:00:03.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b0b6a640 1 -- 172.21.15.49:0/2543369497 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7f37a4001a00 con 0x7f37ac0c40e0 2023-11-18T21:00:03.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b0b6a640 1 -- 172.21.15.49:0/2543369497 >> v1:172.21.15.49:6789/0 conn(0x7f37ac0c40e0 legacy=0x7f37ac0c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:03.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b0b6a640 1 --2- 172.21.15.49:0/2543369497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37ac151720 0x7f37980039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:03.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b0b6a640 1 --2- 172.21.15.49:0/2543369497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3798003fc0 0x7f37980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:03.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b0b6a640 1 --2- 172.21.15.49:0/2543369497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3798004d10 0x7f3798005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:03.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b0b6a640 1 -- 172.21.15.49:0/2543369497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac070be0 con 0x7f3798004d10 2023-11-18T21:00:03.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b0b6a640 1 -- 172.21.15.49:0/2543369497 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379800b990 con 0x7f3798003fc0 2023-11-18T21:00:03.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b0b6a640 1 -- 172.21.15.49:0/2543369497 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379800bb50 con 0x7f37ac151720 2023-11-18T21:00:03.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.296+0000 7f37b236d640 1 --2- 172.21.15.49:0/2543369497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3798004d10 0x7f3798005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:03.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.300+0000 7f37b236d640 1 -- 172.21.15.49:0/2543369497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37ac151720 msgr2=0x7f37980039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:03.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.300+0000 7f37b236d640 1 --2- 172.21.15.49:0/2543369497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37ac151720 0x7f37980039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:03.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.300+0000 7f37b236d640 1 -- 172.21.15.49:0/2543369497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3798003fc0 msgr2=0x7f37980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:03.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.300+0000 7f37b236d640 1 --2- 172.21.15.49:0/2543369497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3798003fc0 0x7f37980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:03.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.300+0000 7f37b236d640 1 -- 172.21.15.49:0/2543369497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3798003530 con 0x7f3798004d10 2023-11-18T21:00:03.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.304+0000 7f37b236d640 1 --2- 172.21.15.49:0/2543369497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3798004d10 0x7f3798005190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f37a400a810 tx=0x7f37a401d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98923b30eec5a5e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:03.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.308+0000 7f37b0b6a640 1 -- 172.21.15.49:0/2543369497 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a40ad630 con 0x7f3798004d10 2023-11-18T21:00:03.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.308+0000 7f37b0b6a640 1 -- 172.21.15.49:0/2543369497 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a40a8070 con 0x7f3798004d10 2023-11-18T21:00:03.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.308+0000 7f37b0b6a640 1 -- 172.21.15.49:0/2543369497 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a40ada30 con 0x7f3798004d10 2023-11-18T21:00:03.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.308+0000 7f37b3dd0640 1 -- 172.21.15.49:0/2543369497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3798004d10 msgr2=0x7f3798005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:03.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.308+0000 7f37b3dd0640 1 --2- 172.21.15.49:0/2543369497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3798004d10 0x7f3798005190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f37a400a810 tx=0x7f37a401d320 comp rx=0 tx=0).stop 2023-11-18T21:00:03.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.308+0000 7f37b236d640 1 -- 172.21.15.49:0/2543369497 reap_dead start 2023-11-18T21:00:03.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.308+0000 7f37b3dd0640 1 -- 172.21.15.49:0/2543369497 shutdown_connections 2023-11-18T21:00:03.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.308+0000 7f37b3dd0640 1 -- 172.21.15.49:0/2543369497 >> 172.21.15.49:0/2543369497 conn(0x7f37ac06c6a0 msgr2=0x7f37ac06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:03.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.308+0000 7f37b3dd0640 1 -- 172.21.15.49:0/2543369497 shutdown_connections 2023-11-18T21:00:03.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.308+0000 7f37b3dd0640 1 -- 172.21.15.49:0/2543369497 wait complete. 2023-11-18T21:00:03.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.312+0000 7f37b3dd0640 1 Processor -- start 2023-11-18T21:00:03.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.312+0000 7f37b3dd0640 1 -- start start 2023-11-18T21:00:03.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.312+0000 7f37b3dd0640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37ac0c7d10 0x7f37ac152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:03.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.312+0000 7f37b3dd0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37ac0c80f0 0x7f37ac149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:03.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.312+0000 7f37b3dd0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37ac151b20 0x7f37ac15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:03.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.312+0000 7f37b3dd0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac1ed120 con 0x7f37ac151b20 2023-11-18T21:00:03.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.312+0000 7f37b3dd0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac152c60 con 0x7f37ac0c80f0 2023-11-18T21:00:03.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.312+0000 7f37b3dd0640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac14b920 con 0x7f37ac0c7d10 2023-11-18T21:00:03.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.312+0000 7f37b236d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37ac151b20 0x7f37ac15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:03.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.312+0000 7f37b236d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37ac151b20 0x7f37ac15ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50686/0 (socket says 172.21.15.49:50686) 2023-11-18T21:00:03.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.312+0000 7f37b236d640 1 -- 172.21.15.49:0/3716207463 learned_addr learned my addr 172.21.15.49:0/3716207463 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:03.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.312+0000 7f37b136b640 1 --2- 172.21.15.49:0/3716207463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37ac0c80f0 0x7f37ac149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:03.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.312+0000 7f37b1b6c640 1 --2- 172.21.15.49:0/3716207463 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37ac0c7d10 0x7f37ac152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:03.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.316+0000 7f37b236d640 1 -- 172.21.15.49:0/3716207463 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37ac0c7d10 msgr2=0x7f37ac152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:03.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.316+0000 7f37b236d640 1 --2- 172.21.15.49:0/3716207463 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37ac0c7d10 0x7f37ac152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:03.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.316+0000 7f37b236d640 1 -- 172.21.15.49:0/3716207463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37ac0c80f0 msgr2=0x7f37ac149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:03.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.316+0000 7f37b236d640 1 --2- 172.21.15.49:0/3716207463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37ac0c80f0 0x7f37ac149fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:03.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.316+0000 7f37b236d640 1 -- 172.21.15.49:0/3716207463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac14bbc0 con 0x7f37ac151b20 2023-11-18T21:00:03.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.320+0000 7f37b236d640 1 --2- 172.21.15.49:0/3716207463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37ac151b20 0x7f37ac15ac00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37a401dbc0 tx=0x7f3798005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:03.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.320+0000 7f379e7fc640 1 -- 172.21.15.49:0/3716207463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a4001950 con 0x7f37ac151b20 2023-11-18T21:00:03.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.320+0000 7f379e7fc640 1 -- 172.21.15.49:0/3716207463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a40b6450 con 0x7f37ac151b20 2023-11-18T21:00:03.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.320+0000 7f37b3dd0640 1 -- 172.21.15.49:0/3716207463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ac14be60 con 0x7f37ac151b20 2023-11-18T21:00:03.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.320+0000 7f379e7fc640 1 -- 172.21.15.49:0/3716207463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a40b67c0 con 0x7f37ac151b20 2023-11-18T21:00:03.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.320+0000 7f37b3dd0640 1 -- 172.21.15.49:0/3716207463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ac1ecad0 con 0x7f37ac151b20 2023-11-18T21:00:03.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.324+0000 7f37b3dd0640 1 -- 172.21.15.49:0/3716207463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ac1ed2d0 con 0x7f37ac151b20 2023-11-18T21:00:03.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.344+0000 7f379e7fc640 1 -- 172.21.15.49:0/3716207463 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f37a40aa030 con 0x7f37ac151b20 2023-11-18T21:00:03.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.344+0000 7f379e7fc640 1 --2- 172.21.15.49:0/3716207463 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3790066470 0x7f3790068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:03.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.344+0000 7f37b1b6c640 1 --2- 172.21.15.49:0/3716207463 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3790066470 0x7f3790068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:03.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.344+0000 7f37b1b6c640 1 --2- 172.21.15.49:0/3716207463 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3790066470 0x7f3790068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f37a00093f0 tx=0x7f37a00094c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:03.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.628+0000 7f379e7fc640 1 -- 172.21.15.49:0/3716207463 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f37a40ef290 con 0x7f37ac151b20 2023-11-18T21:00:03.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.628+0000 7f379e7fc640 1 -- 172.21.15.49:0/3716207463 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37a40eb5d0 con 0x7f37ac151b20 2023-11-18T21:00:03.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:03.804+0000 7f37b3dd0640 1 -- 172.21.15.49:0/3716207463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37ac067520 con 0x7f37ac151b20 2023-11-18T21:00:04.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.036+0000 7f379e7fc640 1 -- 172.21.15.49:0/3716207463 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18314 (secure 0 0 0) 0x7f37a40bb020 con 0x7f37ac151b20 2023-11-18T21:00:04.038 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:04.038 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":29,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:59:36.521114+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T21:00:04.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.040+0000 7f37b3dd0640 1 -- 172.21.15.49:0/3716207463 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3790066470 msgr2=0x7f3790068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:04.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.040+0000 7f37b3dd0640 1 --2- 172.21.15.49:0/3716207463 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3790066470 0x7f3790068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f37a00093f0 tx=0x7f37a00094c0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.040+0000 7f37b3dd0640 1 -- 172.21.15.49:0/3716207463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37ac151b20 msgr2=0x7f37ac15ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:04.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.040+0000 7f37b3dd0640 1 --2- 172.21.15.49:0/3716207463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37ac151b20 0x7f37ac15ac00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37a401dbc0 tx=0x7f3798005800 comp rx=0 tx=0).stop 2023-11-18T21:00:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.040+0000 7f37b3dd0640 1 -- 172.21.15.49:0/3716207463 shutdown_connections 2023-11-18T21:00:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.040+0000 7f37b3dd0640 1 --2- 172.21.15.49:0/3716207463 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3790066470 0x7f3790068930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.040+0000 7f37b3dd0640 1 --2- 172.21.15.49:0/3716207463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37ac151b20 0x7f37ac15ac00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.040+0000 7f37b3dd0640 1 --2- 172.21.15.49:0/3716207463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37ac0c80f0 0x7f37ac149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.040+0000 7f37b3dd0640 1 --2- 172.21.15.49:0/3716207463 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37ac0c7d10 0x7f37ac152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.040+0000 7f37b3dd0640 1 -- 172.21.15.49:0/3716207463 >> 172.21.15.49:0/3716207463 conn(0x7f37ac06c6a0 msgr2=0x7f37ac14f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.040+0000 7f37b3dd0640 1 -- 172.21.15.49:0/3716207463 shutdown_connections 2023-11-18T21:00:04.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.040+0000 7f37b3dd0640 1 -- 172.21.15.49:0/3716207463 wait complete. 2023-11-18T21:00:04.067 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T21:00:04.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.192+0000 7f63b7dd0640 1 Processor -- start 2023-11-18T21:00:04.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.192+0000 7f63b7dd0640 1 -- start start 2023-11-18T21:00:04.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.192+0000 7f63b7dd0640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f63b0156db0 0x7f63b01596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:04.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.192+0000 7f63b7dd0640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f63b00725c0 0x7f63b00cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:04.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.192+0000 7f63b7dd0640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b00c9640 con 0x7f63b00c9260 2023-11-18T21:00:04.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.192+0000 7f63b7dd0640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b00c4090 con 0x7f63b00725c0 2023-11-18T21:00:04.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.192+0000 7f63b7dd0640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b0139070 con 0x7f63b0156db0 2023-11-18T21:00:04.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.192+0000 7f63b5b6c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f63b00c9260 0x7f63b00c3120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33268/0 (socket says 172.21.15.49:33268) 2023-11-18T21:00:04.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.192+0000 7f63b5b6c640 1 -- 172.21.15.49:0/316106934 learned_addr learned my addr 172.21.15.49:0/316106934 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:04.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.192+0000 7f63b636d640 1 --2- 172.21.15.49:0/316106934 >> v2:172.21.15.49:3300/0 conn(0x7f63b00725c0 0x7f63b00cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:04.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.196+0000 7f63b4b6a640 1 -- 172.21.15.49:0/316106934 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867975345 0 0) 0x7f63b00c9640 con 0x7f63b00c9260 2023-11-18T21:00:04.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.196+0000 7f63b4b6a640 1 -- 172.21.15.49:0/316106934 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f639c005740 con 0x7f63b00c9260 2023-11-18T21:00:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.200+0000 7f63b636d640 1 -- 172.21.15.49:0/316106934 >> v2:172.21.15.106:3300/0 conn(0x7f63b0156db0 msgr2=0x7f63b01596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.200+0000 7f63b636d640 1 --2- 172.21.15.49:0/316106934 >> v2:172.21.15.106:3300/0 conn(0x7f63b0156db0 0x7f63b01596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.200+0000 7f63b636d640 1 -- 172.21.15.49:0/316106934 >> v1:172.21.15.49:6789/0 conn(0x7f63b00c9260 legacy=0x7f63b00c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.200+0000 7f63b636d640 1 -- 172.21.15.49:0/316106934 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b0159bf0 con 0x7f63b00725c0 2023-11-18T21:00:04.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.204+0000 7f63b636d640 1 --2- 172.21.15.49:0/316106934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63b00725c0 0x7f63b00cbbb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f63b0070700 tx=0x7f63a801f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9df3f74583ff40 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:04.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.204+0000 7f63b4b6a640 1 -- 172.21.15.49:0/316106934 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a80b0440 con 0x7f63b00725c0 2023-11-18T21:00:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.208+0000 7f63b4b6a640 1 -- 172.21.15.49:0/316106934 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a80b05a0 con 0x7f63b00725c0 2023-11-18T21:00:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.208+0000 7f63b4b6a640 1 -- 172.21.15.49:0/316106934 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a80b0910 con 0x7f63b00725c0 2023-11-18T21:00:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.208+0000 7f63b7dd0640 1 -- 172.21.15.49:0/316106934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63b00725c0 msgr2=0x7f63b00cbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.208+0000 7f63b7dd0640 1 --2- 172.21.15.49:0/316106934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63b00725c0 0x7f63b00cbbb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f63b0070700 tx=0x7f63a801f0f0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.208+0000 7f63b7dd0640 1 -- 172.21.15.49:0/316106934 shutdown_connections 2023-11-18T21:00:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.208+0000 7f63b7dd0640 1 --2- 172.21.15.49:0/316106934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63b00725c0 0x7f63b00cbbb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.208+0000 7f63b7dd0640 1 --2- 172.21.15.49:0/316106934 >> v2:172.21.15.106:3300/0 conn(0x7f63b0156db0 0x7f63b01596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.208+0000 7f63b7dd0640 1 -- 172.21.15.49:0/316106934 >> 172.21.15.49:0/316106934 conn(0x7f63b006d7d0 msgr2=0x7f63b006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.208+0000 7f63b7dd0640 1 -- 172.21.15.49:0/316106934 shutdown_connections 2023-11-18T21:00:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.208+0000 7f63b7dd0640 1 -- 172.21.15.49:0/316106934 wait complete. 2023-11-18T21:00:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.208+0000 7f63b7dd0640 1 Processor -- start 2023-11-18T21:00:04.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.208+0000 7f63b7dd0640 1 -- start start 2023-11-18T21:00:04.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.212+0000 7f63b7dd0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63b00725c0 0x7f63b01531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:04.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.212+0000 7f63b7dd0640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b00c9260 0x7f63b014ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.212+0000 7f63b7dd0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63b0156db0 0x7f63b01509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.212+0000 7f63b7dd0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b01536e0 con 0x7f63b0156db0 2023-11-18T21:00:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.212+0000 7f63b7dd0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b0151e50 con 0x7f63b00725c0 2023-11-18T21:00:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.212+0000 7f63b7dd0640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b01ec0e0 con 0x7f63b00c9260 2023-11-18T21:00:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.212+0000 7f63b636d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63b0156db0 0x7f63b01509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.212+0000 7f63b636d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63b0156db0 0x7f63b01509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50704/0 (socket says 172.21.15.49:50704) 2023-11-18T21:00:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.212+0000 7f63b636d640 1 -- 172.21.15.49:0/2056320352 learned_addr learned my addr 172.21.15.49:0/2056320352 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:04.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.216+0000 7f63b636d640 1 -- 172.21.15.49:0/2056320352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b00c9260 msgr2=0x7f63b014ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:04.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.216+0000 7f63b636d640 1 --2- 172.21.15.49:0/2056320352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b00c9260 0x7f63b014ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.216+0000 7f63b636d640 1 -- 172.21.15.49:0/2056320352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63b00725c0 msgr2=0x7f63b01531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:04.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.216+0000 7f63b636d640 1 --2- 172.21.15.49:0/2056320352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63b00725c0 0x7f63b01531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.216+0000 7f63b636d640 1 -- 172.21.15.49:0/2056320352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a8009a70 con 0x7f63b0156db0 2023-11-18T21:00:04.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.216+0000 7f63b636d640 1 --2- 172.21.15.49:0/2056320352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63b0156db0 0x7f63b01509b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f63a801cd20 tx=0x7f63a801be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:04.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.220+0000 7f63a67fc640 1 -- 172.21.15.49:0/2056320352 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a80b0b20 con 0x7f63b0156db0 2023-11-18T21:00:04.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.224+0000 7f63a67fc640 1 -- 172.21.15.49:0/2056320352 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a80b0c80 con 0x7f63b0156db0 2023-11-18T21:00:04.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.224+0000 7f63b7dd0640 1 -- 172.21.15.49:0/2056320352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b01387b0 con 0x7f63b0156db0 2023-11-18T21:00:04.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.224+0000 7f63a67fc640 1 -- 172.21.15.49:0/2056320352 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a8004040 con 0x7f63b0156db0 2023-11-18T21:00:04.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.224+0000 7f63b7dd0640 1 -- 172.21.15.49:0/2056320352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b01520a0 con 0x7f63b0156db0 2023-11-18T21:00:04.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.224+0000 7f63b7dd0640 1 -- 172.21.15.49:0/2056320352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b01523e0 con 0x7f63b0156db0 2023-11-18T21:00:04.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.244+0000 7f63a67fc640 1 -- 172.21.15.49:0/2056320352 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f63a80b7030 con 0x7f63b0156db0 2023-11-18T21:00:04.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.244+0000 7f63a67fc640 1 --2- 172.21.15.49:0/2056320352 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f63940664f0 0x7f63940689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:04.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.244+0000 7f63b5b6c640 1 --2- 172.21.15.49:0/2056320352 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f63940664f0 0x7f63940689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:04.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.244+0000 7f63b5b6c640 1 --2- 172.21.15.49:0/2056320352 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f63940664f0 0x7f63940689b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f63ac007fd0 tx=0x7f63ac007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:04.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.524+0000 7f63a67fc640 1 -- 172.21.15.49:0/2056320352 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f63a80f4460 con 0x7f63b0156db0 2023-11-18T21:00:04.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.528+0000 7f63a67fc640 1 -- 172.21.15.49:0/2056320352 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63a80f00a0 con 0x7f63b0156db0 2023-11-18T21:00:04.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.700+0000 7f63b7dd0640 1 -- 172.21.15.49:0/2056320352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63b01ec220 con 0x7f63b0156db0 2023-11-18T21:00:04.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.764+0000 7f63a67fc640 1 -- 172.21.15.49:0/2056320352 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18314 (secure 0 0 0) 0x7f63a80f36c0 con 0x7f63b0156db0 2023-11-18T21:00:04.765 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:04.766 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":29,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:59:36.521114+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T21:00:04.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.768+0000 7f63b7dd0640 1 -- 172.21.15.49:0/2056320352 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f63940664f0 msgr2=0x7f63940689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:04.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.768+0000 7f63b7dd0640 1 --2- 172.21.15.49:0/2056320352 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f63940664f0 0x7f63940689b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f63ac007fd0 tx=0x7f63ac007900 comp rx=0 tx=0).stop 2023-11-18T21:00:04.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.768+0000 7f63b7dd0640 1 -- 172.21.15.49:0/2056320352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63b0156db0 msgr2=0x7f63b01509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:04.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.768+0000 7f63b7dd0640 1 --2- 172.21.15.49:0/2056320352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63b0156db0 0x7f63b01509b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f63a801cd20 tx=0x7f63a801be90 comp rx=0 tx=0).stop 2023-11-18T21:00:04.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.768+0000 7f63b7dd0640 1 -- 172.21.15.49:0/2056320352 shutdown_connections 2023-11-18T21:00:04.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.768+0000 7f63b7dd0640 1 --2- 172.21.15.49:0/2056320352 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f63940664f0 0x7f63940689b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.768+0000 7f63b7dd0640 1 --2- 172.21.15.49:0/2056320352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63b0156db0 0x7f63b01509b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.768+0000 7f63b7dd0640 1 --2- 172.21.15.49:0/2056320352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b00c9260 0x7f63b014ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.768+0000 7f63b7dd0640 1 --2- 172.21.15.49:0/2056320352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63b00725c0 0x7f63b01531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.768+0000 7f63b7dd0640 1 -- 172.21.15.49:0/2056320352 >> 172.21.15.49:0/2056320352 conn(0x7f63b006d7d0 msgr2=0x7f63b00c59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:04.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.768+0000 7f63b7dd0640 1 -- 172.21.15.49:0/2056320352 shutdown_connections 2023-11-18T21:00:04.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.768+0000 7f63b7dd0640 1 -- 172.21.15.49:0/2056320352 wait complete. 2023-11-18T21:00:04.787 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-18T21:00:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.916+0000 7f5902142640 1 Processor -- start 2023-11-18T21:00:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.916+0000 7f5902142640 1 -- start start 2023-11-18T21:00:04.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.916+0000 7f5902142640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f58fc151460 0x7f58fc0c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:04.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.916+0000 7f5902142640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58fc157280 0x7f58fc06f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:04.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.916+0000 7f5902142640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc0c21d0 con 0x7f58fc0c9130 2023-11-18T21:00:04.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.916+0000 7f5902142640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc06ec00 con 0x7f58fc157280 2023-11-18T21:00:04.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.916+0000 7f5902142640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc157750 con 0x7f58fc151460 2023-11-18T21:00:04.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.916+0000 7f58faffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58fc157280 0x7f58fc06f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:04.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.916+0000 7f58faffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58fc157280 0x7f58fc06f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50718/0 (socket says 172.21.15.49:50718) 2023-11-18T21:00:04.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.916+0000 7f58faffd640 1 -- 172.21.15.49:0/3275047595 learned_addr learned my addr 172.21.15.49:0/3275047595 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:04.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.916+0000 7f58fb7fe640 1 --2- 172.21.15.49:0/3275047595 >> v2:172.21.15.106:3300/0 conn(0x7f58fc151460 0x7f58fc0c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:04.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.920+0000 7f58faffd640 1 -- 172.21.15.49:0/3275047595 >> v2:172.21.15.106:3300/0 conn(0x7f58fc151460 msgr2=0x7f58fc0c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:04.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.920+0000 7f58faffd640 1 --2- 172.21.15.49:0/3275047595 >> v2:172.21.15.106:3300/0 conn(0x7f58fc151460 0x7f58fc0c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.920+0000 7f58faffd640 1 -- 172.21.15.49:0/3275047595 >> v1:172.21.15.106:6789/0 conn(0x7f58fc0c9130 legacy=0x7f58fc0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:04.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.920+0000 7f58faffd640 1 -- 172.21.15.49:0/3275047595 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc157a30 con 0x7f58fc157280 2023-11-18T21:00:04.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.924+0000 7f58faffd640 1 --2- 172.21.15.49:0/3275047595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58fc157280 0x7f58fc06f300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f58f0009870 tx=0x7f58f001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab6afe954d5d0a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:04.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.928+0000 7f58fa7fc640 1 -- 172.21.15.49:0/3275047595 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f00ab640 con 0x7f58fc157280 2023-11-18T21:00:04.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.928+0000 7f58fa7fc640 1 -- 172.21.15.49:0/3275047595 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f00a7070 con 0x7f58fc157280 2023-11-18T21:00:04.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.928+0000 7f58fa7fc640 1 -- 172.21.15.49:0/3275047595 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f00ab9c0 con 0x7f58fc157280 2023-11-18T21:00:04.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 -- 172.21.15.49:0/3275047595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58fc157280 msgr2=0x7f58fc06f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:04.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 --2- 172.21.15.49:0/3275047595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58fc157280 0x7f58fc06f300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f58f0009870 tx=0x7f58f001c440 comp rx=0 tx=0).stop 2023-11-18T21:00:04.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 -- 172.21.15.49:0/3275047595 shutdown_connections 2023-11-18T21:00:04.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 --2- 172.21.15.49:0/3275047595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58fc157280 0x7f58fc06f300 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 --2- 172.21.15.49:0/3275047595 >> v2:172.21.15.106:3300/0 conn(0x7f58fc151460 0x7f58fc0c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 -- 172.21.15.49:0/3275047595 >> 172.21.15.49:0/3275047595 conn(0x7f58fc0708a0 msgr2=0x7f58fc070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:04.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 -- 172.21.15.49:0/3275047595 shutdown_connections 2023-11-18T21:00:04.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 -- 172.21.15.49:0/3275047595 wait complete. 2023-11-18T21:00:04.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 Processor -- start 2023-11-18T21:00:04.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 -- start start 2023-11-18T21:00:04.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58fc0c9130 0x7f58fc0cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:04.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58fc151460 0x7f58fc0cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:04.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58fc157280 0x7f58fc142330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:04.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0caf90 con 0x7f58fc151460 2023-11-18T21:00:04.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc14c000 con 0x7f58fc0c9130 2023-11-18T21:00:04.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f5902142640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc1f56f0 con 0x7f58fc157280 2023-11-18T21:00:04.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f58faffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58fc151460 0x7f58fc0cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:04.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f58faffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58fc151460 0x7f58fc0cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50724/0 (socket says 172.21.15.49:50724) 2023-11-18T21:00:04.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.932+0000 7f58faffd640 1 -- 172.21.15.49:0/2580464470 learned_addr learned my addr 172.21.15.49:0/2580464470 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:04.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.936+0000 7f58fbfff640 1 --2- 172.21.15.49:0/2580464470 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58fc157280 0x7f58fc142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:04.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.936+0000 7f58fb7fe640 1 --2- 172.21.15.49:0/2580464470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58fc0c9130 0x7f58fc0cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:04.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.936+0000 7f58faffd640 1 -- 172.21.15.49:0/2580464470 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58fc157280 msgr2=0x7f58fc142330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:04.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.936+0000 7f58faffd640 1 --2- 172.21.15.49:0/2580464470 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58fc157280 0x7f58fc142330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.936+0000 7f58faffd640 1 -- 172.21.15.49:0/2580464470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58fc0c9130 msgr2=0x7f58fc0cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:04.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.936+0000 7f58faffd640 1 --2- 172.21.15.49:0/2580464470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58fc0c9130 0x7f58fc0cbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:04.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.936+0000 7f58faffd640 1 -- 172.21.15.49:0/2580464470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f00094d0 con 0x7f58fc151460 2023-11-18T21:00:04.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.940+0000 7f58faffd640 1 --2- 172.21.15.49:0/2580464470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58fc151460 0x7f58fc0cc4a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f58f00ad040 tx=0x7f58f001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:04.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.952+0000 7f58e3fff640 1 -- 172.21.15.49:0/2580464470 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f00abe90 con 0x7f58fc151460 2023-11-18T21:00:04.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.952+0000 7f58e3fff640 1 -- 172.21.15.49:0/2580464470 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f00be3f0 con 0x7f58fc151460 2023-11-18T21:00:04.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.952+0000 7f5902142640 1 -- 172.21.15.49:0/2580464470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc0cb1a0 con 0x7f58fc151460 2023-11-18T21:00:04.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.952+0000 7f58e3fff640 1 -- 172.21.15.49:0/2580464470 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f00be7a0 con 0x7f58fc151460 2023-11-18T21:00:04.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.952+0000 7f5902142640 1 -- 172.21.15.49:0/2580464470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc0cb760 con 0x7f58fc151460 2023-11-18T21:00:04.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:04.952+0000 7f5902142640 1 -- 172.21.15.49:0/2580464470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc073e70 con 0x7f58fc151460 2023-11-18T21:00:05.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:05.244+0000 7f58e3fff640 1 -- 172.21.15.49:0/2580464470 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f58f00b43f0 con 0x7f58fc151460 2023-11-18T21:00:05.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:05.244+0000 7f58e3fff640 1 --2- 172.21.15.49:0/2580464470 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58e80664c0 0x7f58e8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:05.244+0000 7f58fb7fe640 1 --2- 172.21.15.49:0/2580464470 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58e80664c0 0x7f58e8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:05.244+0000 7f58fb7fe640 1 --2- 172.21.15.49:0/2580464470 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58e80664c0 0x7f58e8068980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00b930 tx=0x7f58ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:05.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:05.280+0000 7f58e3fff640 1 -- 172.21.15.49:0/2580464470 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f58f00ef900 con 0x7f58fc151460 2023-11-18T21:00:05.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:05.280+0000 7f58e3fff640 1 -- 172.21.15.49:0/2580464470 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58f00ebc40 con 0x7f58fc151460 2023-11-18T21:00:05.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:05.488+0000 7f5902142640 1 -- 172.21.15.49:0/2580464470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f58fc0b0310 con 0x7f58fc151460 2023-11-18T21:00:06.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.052+0000 7f58e3fff640 1 -- 172.21.15.49:0/2580464470 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v9) v1 ==== 118+0+0 (secure 0 0 0) 0x7f58f00ef260 con 0x7f58fc151460 2023-11-18T21:00:06.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.052+0000 7f5902142640 1 -- 172.21.15.49:0/2580464470 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58e80664c0 msgr2=0x7f58e8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:06.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.052+0000 7f5902142640 1 --2- 172.21.15.49:0/2580464470 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58e80664c0 0x7f58e8068980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00b930 tx=0x7f58ec008040 comp rx=0 tx=0).stop 2023-11-18T21:00:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.052+0000 7f5902142640 1 -- 172.21.15.49:0/2580464470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58fc151460 msgr2=0x7f58fc0cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.052+0000 7f5902142640 1 --2- 172.21.15.49:0/2580464470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58fc151460 0x7f58fc0cc4a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f58f00ad040 tx=0x7f58f001ac80 comp rx=0 tx=0).stop 2023-11-18T21:00:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.052+0000 7f5902142640 1 -- 172.21.15.49:0/2580464470 shutdown_connections 2023-11-18T21:00:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.052+0000 7f5902142640 1 --2- 172.21.15.49:0/2580464470 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58e80664c0 0x7f58e8068980 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.052+0000 7f5902142640 1 --2- 172.21.15.49:0/2580464470 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58fc157280 0x7f58fc142330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.052+0000 7f5902142640 1 --2- 172.21.15.49:0/2580464470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58fc151460 0x7f58fc0cc4a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.052+0000 7f5902142640 1 --2- 172.21.15.49:0/2580464470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58fc0c9130 0x7f58fc0cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.052+0000 7f5902142640 1 -- 172.21.15.49:0/2580464470 >> 172.21.15.49:0/2580464470 conn(0x7f58fc0708a0 msgr2=0x7f58fc155860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.052+0000 7f5902142640 1 -- 172.21.15.49:0/2580464470 shutdown_connections 2023-11-18T21:00:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.052+0000 7f5902142640 1 -- 172.21.15.49:0/2580464470 wait complete. 2023-11-18T21:00:06.079 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2023-11-18T21:00:06.080 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-11-18T21:00:06.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.212+0000 7ff253108640 1 Processor -- start 2023-11-18T21:00:06.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.212+0000 7ff253108640 1 -- start start 2023-11-18T21:00:06.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.216+0000 7ff253108640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff24c153720 0x7ff24c15a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:06.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.216+0000 7ff253108640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff24c06ab60 0x7ff24c06afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:06.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.216+0000 7ff253108640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24c159ba0 con 0x7ff24c0c83c0 2023-11-18T21:00:06.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.216+0000 7ff253108640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24c0c6c90 con 0x7ff24c153720 2023-11-18T21:00:06.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.216+0000 7ff253108640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24c0c8830 con 0x7ff24c06ab60 2023-11-18T21:00:06.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.216+0000 7ff2516a5640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff24c06ab60 0x7ff24c06afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:06.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.220+0000 7ff2516a5640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff24c06ab60 0x7ff24c06afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:37592/0 (socket says 172.21.15.49:37592) 2023-11-18T21:00:06.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.220+0000 7ff2516a5640 1 -- 172.21.15.49:0/1086004947 learned_addr learned my addr 172.21.15.49:0/1086004947 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:06.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.224+0000 7ff2516a5640 1 -- 172.21.15.49:0/1086004947 >> v2:172.21.15.49:3300/0 conn(0x7ff24c153720 msgr2=0x7ff24c15a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:06.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.224+0000 7ff2516a5640 1 --2- 172.21.15.49:0/1086004947 >> v2:172.21.15.49:3300/0 conn(0x7ff24c153720 0x7ff24c15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:06.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.224+0000 7ff2516a5640 1 -- 172.21.15.49:0/1086004947 >> v1:172.21.15.49:6789/0 conn(0x7ff24c0c83c0 legacy=0x7ff24c0c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:06.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.224+0000 7ff2516a5640 1 -- 172.21.15.49:0/1086004947 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c072910 con 0x7ff24c06ab60 2023-11-18T21:00:06.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.228+0000 7ff2516a5640 1 --2- 172.21.15.49:0/1086004947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff24c06ab60 0x7ff24c06afb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0b2210 tx=0x7ff24401f180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=541e229bbc6e38a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:06.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.240+0000 7ff24b7fe640 1 -- 172.21.15.49:0/1086004947 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2440af400 con 0x7ff24c06ab60 2023-11-18T21:00:06.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.240+0000 7ff24b7fe640 1 -- 172.21.15.49:0/1086004947 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2440ab050 con 0x7ff24c06ab60 2023-11-18T21:00:06.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.240+0000 7ff24b7fe640 1 -- 172.21.15.49:0/1086004947 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2440af780 con 0x7ff24c06ab60 2023-11-18T21:00:06.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.240+0000 7ff253108640 1 -- 172.21.15.49:0/1086004947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff24c06ab60 msgr2=0x7ff24c06afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:06.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.240+0000 7ff253108640 1 --2- 172.21.15.49:0/1086004947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff24c06ab60 0x7ff24c06afb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0b2210 tx=0x7ff24401f180 comp rx=0 tx=0).stop 2023-11-18T21:00:06.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.240+0000 7ff253108640 1 -- 172.21.15.49:0/1086004947 shutdown_connections 2023-11-18T21:00:06.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.240+0000 7ff253108640 1 --2- 172.21.15.49:0/1086004947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff24c06ab60 0x7ff24c06afb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:06.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.240+0000 7ff253108640 1 --2- 172.21.15.49:0/1086004947 >> v2:172.21.15.49:3300/0 conn(0x7ff24c153720 0x7ff24c15a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:06.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.240+0000 7ff253108640 1 -- 172.21.15.49:0/1086004947 >> 172.21.15.49:0/1086004947 conn(0x7ff24c070160 msgr2=0x7ff24c06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:06.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.240+0000 7ff253108640 1 -- 172.21.15.49:0/1086004947 shutdown_connections 2023-11-18T21:00:06.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.240+0000 7ff253108640 1 -- 172.21.15.49:0/1086004947 wait complete. 2023-11-18T21:00:06.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.240+0000 7ff253108640 1 Processor -- start 2023-11-18T21:00:06.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.240+0000 7ff253108640 1 -- start start 2023-11-18T21:00:06.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.244+0000 7ff253108640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff24c06ab60 0x7ff24c1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:06.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.244+0000 7ff253108640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff24c0c83c0 0x7ff24c15c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:06.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.244+0000 7ff253108640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff24c153720 0x7ff24c15cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:06.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.244+0000 7ff253108640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c15c150 con 0x7ff24c153720 2023-11-18T21:00:06.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.244+0000 7ff253108640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c156ef0 con 0x7ff24c0c83c0 2023-11-18T21:00:06.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.244+0000 7ff253108640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c15ac90 con 0x7ff24c06ab60 2023-11-18T21:00:06.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.244+0000 7ff2516a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff24c153720 0x7ff24c15cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:06.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.244+0000 7ff2516a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff24c153720 0x7ff24c15cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49064/0 (socket says 172.21.15.49:49064) 2023-11-18T21:00:06.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.244+0000 7ff2516a5640 1 -- 172.21.15.49:0/1308539171 learned_addr learned my addr 172.21.15.49:0/1308539171 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:06.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.248+0000 7ff250ea4640 1 --2- 172.21.15.49:0/1308539171 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff24c06ab60 0x7ff24c1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:06.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.248+0000 7ff2516a5640 1 -- 172.21.15.49:0/1308539171 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff24c06ab60 msgr2=0x7ff24c1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:06.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.248+0000 7ff2516a5640 1 --2- 172.21.15.49:0/1308539171 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff24c06ab60 0x7ff24c1569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:06.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.248+0000 7ff2516a5640 1 -- 172.21.15.49:0/1308539171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff24c0c83c0 msgr2=0x7ff24c15c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:06.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.248+0000 7ff2516a5640 1 --2- 172.21.15.49:0/1308539171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff24c0c83c0 0x7ff24c15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:06.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.248+0000 7ff2516a5640 1 -- 172.21.15.49:0/1308539171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff244009b30 con 0x7ff24c153720 2023-11-18T21:00:06.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.252+0000 7ff2516a5640 1 --2- 172.21.15.49:0/1308539171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff24c153720 0x7ff24c15cab0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff2440b2040 tx=0x7ff24401bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:06.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.256+0000 7ff2497fa640 1 -- 172.21.15.49:0/1308539171 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2440c0070 con 0x7ff24c153720 2023-11-18T21:00:06.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.256+0000 7ff2497fa640 1 -- 172.21.15.49:0/1308539171 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2440afb80 con 0x7ff24c153720 2023-11-18T21:00:06.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.256+0000 7ff2497fa640 1 -- 172.21.15.49:0/1308539171 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2440b8400 con 0x7ff24c153720 2023-11-18T21:00:06.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.256+0000 7ff253108640 1 -- 172.21.15.49:0/1308539171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff24c15af70 con 0x7ff24c153720 2023-11-18T21:00:06.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.256+0000 7ff253108640 1 -- 172.21.15.49:0/1308539171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff24c15b530 con 0x7ff24c153720 2023-11-18T21:00:06.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.260+0000 7ff253108640 1 -- 172.21.15.49:0/1308539171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff24c15c290 con 0x7ff24c153720 2023-11-18T21:00:06.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.560+0000 7ff2497fa640 1 -- 172.21.15.49:0/1308539171 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2440cb080 con 0x7ff24c153720 2023-11-18T21:00:06.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.560+0000 7ff2497fa640 1 --2- 172.21.15.49:0/1308539171 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff2380664a0 0x7ff238068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:06.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.560+0000 7ff250ea4640 1 --2- 172.21.15.49:0/1308539171 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff2380664a0 0x7ff238068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:06.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.560+0000 7ff250ea4640 1 --2- 172.21.15.49:0/1308539171 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff2380664a0 0x7ff238068960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff23c006fd0 tx=0x7ff23c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:06.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.596+0000 7ff2497fa640 1 -- 172.21.15.49:0/1308539171 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff2440f3080 con 0x7ff24c153720 2023-11-18T21:00:06.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.596+0000 7ff2497fa640 1 -- 172.21.15.49:0/1308539171 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff2440eecc0 con 0x7ff24c153720 2023-11-18T21:00:06.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:06.804+0000 7ff253108640 1 -- 172.21.15.49:0/1308539171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7ff24c15c290 con 0x7ff24c153720 2023-11-18T21:00:08.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.328+0000 7ff2497fa640 1 -- 172.21.15.49:0/1308539171 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v10) v1 ==== 105+0+0 (secure 0 0 0) 0x7ff24c15c290 con 0x7ff24c153720 2023-11-18T21:00:08.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.332+0000 7ff253108640 1 -- 172.21.15.49:0/1308539171 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff2380664a0 msgr2=0x7ff238068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:08.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.332+0000 7ff253108640 1 --2- 172.21.15.49:0/1308539171 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff2380664a0 0x7ff238068960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff23c006fd0 tx=0x7ff23c008040 comp rx=0 tx=0).stop 2023-11-18T21:00:08.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.332+0000 7ff253108640 1 -- 172.21.15.49:0/1308539171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff24c153720 msgr2=0x7ff24c15cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:08.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.332+0000 7ff253108640 1 --2- 172.21.15.49:0/1308539171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff24c153720 0x7ff24c15cab0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff2440b2040 tx=0x7ff24401bf20 comp rx=0 tx=0).stop 2023-11-18T21:00:08.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.332+0000 7ff253108640 1 -- 172.21.15.49:0/1308539171 shutdown_connections 2023-11-18T21:00:08.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.332+0000 7ff253108640 1 --2- 172.21.15.49:0/1308539171 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff2380664a0 0x7ff238068960 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:08.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.332+0000 7ff253108640 1 --2- 172.21.15.49:0/1308539171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff24c153720 0x7ff24c15cab0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:08.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.332+0000 7ff253108640 1 --2- 172.21.15.49:0/1308539171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff24c0c83c0 0x7ff24c15c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:08.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.332+0000 7ff253108640 1 --2- 172.21.15.49:0/1308539171 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff24c06ab60 0x7ff24c1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:08.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.332+0000 7ff253108640 1 -- 172.21.15.49:0/1308539171 >> 172.21.15.49:0/1308539171 conn(0x7ff24c070160 msgr2=0x7ff24c1529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:08.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.332+0000 7ff253108640 1 -- 172.21.15.49:0/1308539171 shutdown_connections 2023-11-18T21:00:08.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.332+0000 7ff253108640 1 -- 172.21.15.49:0/1308539171 wait complete. 2023-11-18T21:00:08.356 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-18T21:00:08.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.492+0000 7fead2e05640 1 Processor -- start 2023-11-18T21:00:08.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.492+0000 7fead2e05640 1 -- start start 2023-11-18T21:00:08.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.492+0000 7fead2e05640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feacc14fea0 0x7feacc06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:08.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.492+0000 7fead2e05640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feacc06b9e0 0x7feacc0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:08.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.492+0000 7fead2e05640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feacc0c3ed0 con 0x7feacc0cb7b0 2023-11-18T21:00:08.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.492+0000 7fead2e05640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feacc159850 con 0x7feacc14fea0 2023-11-18T21:00:08.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.492+0000 7fead2e05640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feacc159af0 con 0x7feacc06b9e0 2023-11-18T21:00:08.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.604+0000 7feacbfff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feacc06b9e0 0x7feacc0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:08.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.604+0000 7fead13a2640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7feacc0cb7b0 0x7feacc0c4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:43022/0 (socket says 172.21.15.49:43022) 2023-11-18T21:00:08.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.604+0000 7fead13a2640 1 -- 172.21.15.49:0/128900583 learned_addr learned my addr 172.21.15.49:0/128900583 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:08.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.612+0000 7feacb7fe640 1 -- 172.21.15.49:0/128900583 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3696412346 0 0) 0x7feacc0c3ed0 con 0x7feacc0cb7b0 2023-11-18T21:00:08.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.612+0000 7feacb7fe640 1 -- 172.21.15.49:0/128900583 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feab4003530 con 0x7feacc0cb7b0 2023-11-18T21:00:08.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.612+0000 7fead0ba1640 1 --2- 172.21.15.49:0/128900583 >> v2:172.21.15.49:3300/0 conn(0x7feacc14fea0 0x7feacc06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:08.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.616+0000 7feacbfff640 1 -- 172.21.15.49:0/128900583 >> v2:172.21.15.49:3300/0 conn(0x7feacc14fea0 msgr2=0x7feacc06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:08.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.616+0000 7feacbfff640 1 --2- 172.21.15.49:0/128900583 >> v2:172.21.15.49:3300/0 conn(0x7feacc14fea0 0x7feacc06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:08.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.616+0000 7feacbfff640 1 -- 172.21.15.49:0/128900583 >> v1:172.21.15.106:6789/0 conn(0x7feacc0cb7b0 legacy=0x7feacc0c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:08.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.616+0000 7feacbfff640 1 -- 172.21.15.49:0/128900583 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc159db0 con 0x7feacc06b9e0 2023-11-18T21:00:08.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.632+0000 7feacbfff640 1 --2- 172.21.15.49:0/128900583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feacc06b9e0 0x7feacc0cb270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feacc06b250 tx=0x7feac001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8274a1ffe49ee3b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:08.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.644+0000 7feacb7fe640 1 -- 172.21.15.49:0/128900583 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac00ab600 con 0x7feacc06b9e0 2023-11-18T21:00:08.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.644+0000 7feacb7fe640 1 -- 172.21.15.49:0/128900583 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac00a7050 con 0x7feacc06b9e0 2023-11-18T21:00:08.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.644+0000 7feacb7fe640 1 -- 172.21.15.49:0/128900583 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac00ab980 con 0x7feacc06b9e0 2023-11-18T21:00:08.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.644+0000 7fead2e05640 1 -- 172.21.15.49:0/128900583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feacc06b9e0 msgr2=0x7feacc0cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:08.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.644+0000 7fead2e05640 1 --2- 172.21.15.49:0/128900583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feacc06b9e0 0x7feacc0cb270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feacc06b250 tx=0x7feac001c460 comp rx=0 tx=0).stop 2023-11-18T21:00:08.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.644+0000 7fead2e05640 1 -- 172.21.15.49:0/128900583 shutdown_connections 2023-11-18T21:00:08.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.644+0000 7fead2e05640 1 --2- 172.21.15.49:0/128900583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feacc06b9e0 0x7feacc0cb270 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:08.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.644+0000 7fead2e05640 1 --2- 172.21.15.49:0/128900583 >> v2:172.21.15.49:3300/0 conn(0x7feacc14fea0 0x7feacc06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:08.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.644+0000 7fead2e05640 1 -- 172.21.15.49:0/128900583 >> 172.21.15.49:0/128900583 conn(0x7feacc06d220 msgr2=0x7feacc06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:08.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.644+0000 7fead2e05640 1 -- 172.21.15.49:0/128900583 shutdown_connections 2023-11-18T21:00:08.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.644+0000 7fead2e05640 1 -- 172.21.15.49:0/128900583 wait complete. 2023-11-18T21:00:08.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.644+0000 7fead2e05640 1 Processor -- start 2023-11-18T21:00:08.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.644+0000 7fead2e05640 1 -- start start 2023-11-18T21:00:08.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.648+0000 7fead2e05640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feacc06b9e0 0x7feacc149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:08.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.648+0000 7fead2e05640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feacc0cb7b0 0x7feacc15a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:08.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.648+0000 7fead2e05640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feacc14fea0 0x7feacc15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:08.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.648+0000 7fead2e05640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc15b880 con 0x7feacc06b9e0 2023-11-18T21:00:08.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.648+0000 7fead2e05640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc1f5670 con 0x7feacc0cb7b0 2023-11-18T21:00:08.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.648+0000 7fead2e05640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feacc157ee0 con 0x7feacc14fea0 2023-11-18T21:00:08.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.648+0000 7fead0ba1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feacc06b9e0 0x7feacc149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:08.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.648+0000 7fead0ba1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feacc06b9e0 0x7feacc149560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49082/0 (socket says 172.21.15.49:49082) 2023-11-18T21:00:08.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.648+0000 7fead0ba1640 1 -- 172.21.15.49:0/2131999013 learned_addr learned my addr 172.21.15.49:0/2131999013 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:08.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.648+0000 7feacbfff640 1 --2- 172.21.15.49:0/2131999013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feacc0cb7b0 0x7feacc15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:08.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.652+0000 7fead0ba1640 1 -- 172.21.15.49:0/2131999013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feacc14fea0 msgr2=0x7feacc15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:08.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.652+0000 7fead0ba1640 1 --2- 172.21.15.49:0/2131999013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feacc14fea0 0x7feacc15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:08.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.652+0000 7fead0ba1640 1 -- 172.21.15.49:0/2131999013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feacc0cb7b0 msgr2=0x7feacc15a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:08.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.652+0000 7fead0ba1640 1 --2- 172.21.15.49:0/2131999013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feacc0cb7b0 0x7feacc15a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:08.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.652+0000 7fead0ba1640 1 -- 172.21.15.49:0/2131999013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac0009420 con 0x7feacc06b9e0 2023-11-18T21:00:08.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.656+0000 7fead0ba1640 1 --2- 172.21.15.49:0/2131999013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feacc06b9e0 0x7feacc149560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feabc00efc0 tx=0x7feabc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:08.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.660+0000 7feac97fa640 1 -- 172.21.15.49:0/2131999013 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc009b80 con 0x7feacc06b9e0 2023-11-18T21:00:08.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.660+0000 7feac97fa640 1 -- 172.21.15.49:0/2131999013 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc00f040 con 0x7feacc06b9e0 2023-11-18T21:00:08.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.660+0000 7feac97fa640 1 -- 172.21.15.49:0/2131999013 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc0146a0 con 0x7feacc06b9e0 2023-11-18T21:00:08.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.660+0000 7fead2e05640 1 -- 172.21.15.49:0/2131999013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feacc1f58c0 con 0x7feacc06b9e0 2023-11-18T21:00:08.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.660+0000 7fead2e05640 1 -- 172.21.15.49:0/2131999013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feacc1f5e80 con 0x7feacc06b9e0 2023-11-18T21:00:08.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.664+0000 7fead2e05640 1 -- 172.21.15.49:0/2131999013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feacc073e70 con 0x7feacc06b9e0 2023-11-18T21:00:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.684+0000 7feac97fa640 1 -- 172.21.15.49:0/2131999013 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feabc014800 con 0x7feacc06b9e0 2023-11-18T21:00:08.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.684+0000 7feac97fa640 1 --2- 172.21.15.49:0/2131999013 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7feab80664f0 0x7feab80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:08.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.684+0000 7feacbfff640 1 --2- 172.21.15.49:0/2131999013 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7feab80664f0 0x7feab80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:08.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.684+0000 7feacbfff640 1 --2- 172.21.15.49:0/2131999013 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7feab80664f0 0x7feab80689b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feac00ad000 tx=0x7feac00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:08.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:08.688+0000 7feac97fa640 1 -- 172.21.15.49:0/2131999013 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feabc0568c0 con 0x7feacc06b9e0 2023-11-18T21:00:09.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:09.000+0000 7feac97fa640 1 -- 172.21.15.49:0/2131999013 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feabc052500 con 0x7feacc06b9e0 2023-11-18T21:00:09.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:09.216+0000 7fead2e05640 1 -- 172.21.15.49:0/2131999013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7feacc06b7c0 con 0x7feacc06b9e0 2023-11-18T21:00:10.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.572+0000 7feac97fa640 1 -- 172.21.15.49:0/2131999013 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7feabc055b20 con 0x7feacc06b9e0 2023-11-18T21:00:10.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.572+0000 7fead2e05640 1 -- 172.21.15.49:0/2131999013 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7feab80664f0 msgr2=0x7feab80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:10.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.572+0000 7fead2e05640 1 --2- 172.21.15.49:0/2131999013 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7feab80664f0 0x7feab80689b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feac00ad000 tx=0x7feac00a6000 comp rx=0 tx=0).stop 2023-11-18T21:00:10.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.572+0000 7fead2e05640 1 -- 172.21.15.49:0/2131999013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feacc06b9e0 msgr2=0x7feacc149560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:10.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.572+0000 7fead2e05640 1 --2- 172.21.15.49:0/2131999013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feacc06b9e0 0x7feacc149560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feabc00efc0 tx=0x7feabc00c490 comp rx=0 tx=0).stop 2023-11-18T21:00:10.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.572+0000 7fead2e05640 1 -- 172.21.15.49:0/2131999013 shutdown_connections 2023-11-18T21:00:10.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.572+0000 7fead2e05640 1 --2- 172.21.15.49:0/2131999013 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7feab80664f0 0x7feab80689b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:10.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.572+0000 7fead2e05640 1 --2- 172.21.15.49:0/2131999013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feacc14fea0 0x7feacc15aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:10.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.572+0000 7fead2e05640 1 --2- 172.21.15.49:0/2131999013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feacc0cb7b0 0x7feacc15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:10.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.572+0000 7fead2e05640 1 --2- 172.21.15.49:0/2131999013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feacc06b9e0 0x7feacc149560 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:10.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.572+0000 7fead2e05640 1 -- 172.21.15.49:0/2131999013 >> 172.21.15.49:0/2131999013 conn(0x7feacc06d220 msgr2=0x7feacc06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:10.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.572+0000 7fead2e05640 1 -- 172.21.15.49:0/2131999013 shutdown_connections 2023-11-18T21:00:10.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.572+0000 7fead2e05640 1 -- 172.21.15.49:0/2131999013 wait complete. 2023-11-18T21:00:10.595 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-11-18T21:00:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.724+0000 7fcbecf71640 1 Processor -- start 2023-11-18T21:00:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.724+0000 7fcbecf71640 1 -- start start 2023-11-18T21:00:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.724+0000 7fcbecf71640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcbe81505d0 0x7fcbe8156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.724+0000 7fcbecf71640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbe80c1ed0 0x7fcbe80c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.724+0000 7fcbecf71640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe81568c0 con 0x7fcbe81501f0 2023-11-18T21:00:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.724+0000 7fcbecf71640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe80c4ed0 con 0x7fcbe81505d0 2023-11-18T21:00:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.724+0000 7fcbecf71640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe815a650 con 0x7fcbe80c1ed0 2023-11-18T21:00:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.724+0000 7fcbe5d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcbe81505d0 0x7fcbe8156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.724+0000 7fcbe5d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcbe81505d0 0x7fcbe8156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49088/0 (socket says 172.21.15.49:49088) 2023-11-18T21:00:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.724+0000 7fcbe5d9b640 1 -- 172.21.15.49:0/3532542341 learned_addr learned my addr 172.21.15.49:0/3532542341 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.724+0000 7fcbe6d9d640 1 --2- 172.21.15.49:0/3532542341 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbe80c1ed0 0x7fcbe80c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:10.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.728+0000 7fcbe5d9b640 1 -- 172.21.15.49:0/3532542341 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbe80c1ed0 msgr2=0x7fcbe80c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:10.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.728+0000 7fcbe5d9b640 1 --2- 172.21.15.49:0/3532542341 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbe80c1ed0 0x7fcbe80c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:10.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.728+0000 7fcbe5d9b640 1 -- 172.21.15.49:0/3532542341 >> v1:172.21.15.106:6789/0 conn(0x7fcbe81501f0 legacy=0x7fcbe81596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:10.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.728+0000 7fcbe5d9b640 1 -- 172.21.15.49:0/3532542341 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe8159dd0 con 0x7fcbe81505d0 2023-11-18T21:00:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.732+0000 7fcbe5d9b640 1 --2- 172.21.15.49:0/3532542341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe81505d0 0x7fcbe8156d50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009870 tx=0x7fcbd801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3d51f334ac6c41 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.736+0000 7fcbe559a640 1 -- 172.21.15.49:0/3532542341 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80ac630 con 0x7fcbe81505d0 2023-11-18T21:00:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.736+0000 7fcbe559a640 1 -- 172.21.15.49:0/3532542341 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd80ac790 con 0x7fcbe81505d0 2023-11-18T21:00:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.736+0000 7fcbe559a640 1 -- 172.21.15.49:0/3532542341 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80acb20 con 0x7fcbe81505d0 2023-11-18T21:00:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.736+0000 7fcbecf71640 1 -- 172.21.15.49:0/3532542341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe81505d0 msgr2=0x7fcbe8156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.736+0000 7fcbecf71640 1 --2- 172.21.15.49:0/3532542341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe81505d0 0x7fcbe8156d50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009870 tx=0x7fcbd801c500 comp rx=0 tx=0).stop 2023-11-18T21:00:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.736+0000 7fcbecf71640 1 -- 172.21.15.49:0/3532542341 shutdown_connections 2023-11-18T21:00:10.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.736+0000 7fcbecf71640 1 --2- 172.21.15.49:0/3532542341 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbe80c1ed0 0x7fcbe80c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:10.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.736+0000 7fcbecf71640 1 --2- 172.21.15.49:0/3532542341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe81505d0 0x7fcbe8156d50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:10.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.736+0000 7fcbecf71640 1 -- 172.21.15.49:0/3532542341 >> 172.21.15.49:0/3532542341 conn(0x7fcbe806c6a0 msgr2=0x7fcbe806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:10.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.736+0000 7fcbecf71640 1 -- 172.21.15.49:0/3532542341 shutdown_connections 2023-11-18T21:00:10.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.736+0000 7fcbecf71640 1 -- 172.21.15.49:0/3532542341 wait complete. 2023-11-18T21:00:10.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.740+0000 7fcbecf71640 1 Processor -- start 2023-11-18T21:00:10.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.740+0000 7fcbecf71640 1 -- start start 2023-11-18T21:00:10.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.740+0000 7fcbecf71640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbe80c1ed0 0x7fcbe81f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:10.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.740+0000 7fcbecf71640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe81501f0 0x7fcbe80c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:10.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.740+0000 7fcbecf71640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbe8071b00 0x7fcbe813f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:10.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.740+0000 7fcbecf71640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe81f2960 con 0x7fcbe81501f0 2023-11-18T21:00:10.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.740+0000 7fcbecf71640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe81402f0 con 0x7fcbe80c1ed0 2023-11-18T21:00:10.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.740+0000 7fcbecf71640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8140e30 con 0x7fcbe8071b00 2023-11-18T21:00:10.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.740+0000 7fcbe5d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe81501f0 0x7fcbe80c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:10.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.740+0000 7fcbe659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbe80c1ed0 0x7fcbe81f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:10.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.740+0000 7fcbe5d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe81501f0 0x7fcbe80c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49098/0 (socket says 172.21.15.49:49098) 2023-11-18T21:00:10.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.740+0000 7fcbe5d9b640 1 -- 172.21.15.49:0/2567633303 learned_addr learned my addr 172.21.15.49:0/2567633303 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:10.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.740+0000 7fcbe6d9d640 1 --2- 172.21.15.49:0/2567633303 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbe8071b00 0x7fcbe813f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:10.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.744+0000 7fcbe5d9b640 1 -- 172.21.15.49:0/2567633303 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbe8071b00 msgr2=0x7fcbe813f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:10.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.744+0000 7fcbe5d9b640 1 --2- 172.21.15.49:0/2567633303 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbe8071b00 0x7fcbe813f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:10.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.744+0000 7fcbe5d9b640 1 -- 172.21.15.49:0/2567633303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbe80c1ed0 msgr2=0x7fcbe81f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.744+0000 7fcbe5d9b640 1 --2- 172.21.15.49:0/2567633303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbe80c1ed0 0x7fcbe81f2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.744+0000 7fcbe5d9b640 1 -- 172.21.15.49:0/2567633303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd80094d0 con 0x7fcbe81501f0 2023-11-18T21:00:10.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.748+0000 7fcbe5d9b640 1 --2- 172.21.15.49:0/2567633303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe81501f0 0x7fcbe80c8810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcbd801abb0 tx=0x7fcbd80192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:10.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.752+0000 7fcbdeffd640 1 -- 172.21.15.49:0/2567633303 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80b6600 con 0x7fcbe81501f0 2023-11-18T21:00:10.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.752+0000 7fcbdeffd640 1 -- 172.21.15.49:0/2567633303 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd80b6760 con 0x7fcbe81501f0 2023-11-18T21:00:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.752+0000 7fcbecf71640 1 -- 172.21.15.49:0/2567633303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe81f22e0 con 0x7fcbe81501f0 2023-11-18T21:00:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.752+0000 7fcbdeffd640 1 -- 172.21.15.49:0/2567633303 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80b6b10 con 0x7fcbe81501f0 2023-11-18T21:00:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.752+0000 7fcbecf71640 1 -- 172.21.15.49:0/2567633303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe80722d0 con 0x7fcbe81501f0 2023-11-18T21:00:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:10.752+0000 7fcbecf71640 1 -- 172.21.15.49:0/2567633303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe81f2aa0 con 0x7fcbe81501f0 2023-11-18T21:00:11.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:11.040+0000 7fcbdeffd640 1 -- 172.21.15.49:0/2567633303 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcbd80b6c70 con 0x7fcbe81501f0 2023-11-18T21:00:11.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:11.040+0000 7fcbdeffd640 1 --2- 172.21.15.49:0/2567633303 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcbc80664f0 0x7fcbc80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:11.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:11.040+0000 7fcbe659c640 1 --2- 172.21.15.49:0/2567633303 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcbc80664f0 0x7fcbc80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:11.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:11.044+0000 7fcbe659c640 1 --2- 172.21.15.49:0/2567633303 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcbc80664f0 0x7fcbc80689b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0007fd0 tx=0x7fcbd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:11.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:11.076+0000 7fcbdeffd640 1 -- 172.21.15.49:0/2567633303 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbd80efa10 con 0x7fcbe81501f0 2023-11-18T21:00:11.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:11.080+0000 7fcbdeffd640 1 -- 172.21.15.49:0/2567633303 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbd80ebd50 con 0x7fcbe81501f0 2023-11-18T21:00:11.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:11.280+0000 7fcbecf71640 1 -- 172.21.15.49:0/2567633303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fcbe81f2aa0 con 0x7fcbe81501f0 2023-11-18T21:00:12.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.004+0000 7fcbdeffd640 1 -- 172.21.15.49:0/2567633303 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7fcbe81f2aa0 con 0x7fcbe81501f0 2023-11-18T21:00:12.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.008+0000 7fcbecf71640 1 -- 172.21.15.49:0/2567633303 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcbc80664f0 msgr2=0x7fcbc80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:12.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.008+0000 7fcbecf71640 1 --2- 172.21.15.49:0/2567633303 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcbc80664f0 0x7fcbc80689b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0007fd0 tx=0x7fcbd0009040 comp rx=0 tx=0).stop 2023-11-18T21:00:12.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.008+0000 7fcbecf71640 1 -- 172.21.15.49:0/2567633303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe81501f0 msgr2=0x7fcbe80c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:12.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.008+0000 7fcbecf71640 1 --2- 172.21.15.49:0/2567633303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe81501f0 0x7fcbe80c8810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcbd801abb0 tx=0x7fcbd80192a0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.008+0000 7fcbecf71640 1 -- 172.21.15.49:0/2567633303 shutdown_connections 2023-11-18T21:00:12.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.008+0000 7fcbecf71640 1 --2- 172.21.15.49:0/2567633303 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcbc80664f0 0x7fcbc80689b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.008+0000 7fcbecf71640 1 --2- 172.21.15.49:0/2567633303 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbe8071b00 0x7fcbe813f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.008+0000 7fcbecf71640 1 --2- 172.21.15.49:0/2567633303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe81501f0 0x7fcbe80c8810 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.008+0000 7fcbecf71640 1 --2- 172.21.15.49:0/2567633303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbe80c1ed0 0x7fcbe81f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.008+0000 7fcbecf71640 1 -- 172.21.15.49:0/2567633303 >> 172.21.15.49:0/2567633303 conn(0x7fcbe806c6a0 msgr2=0x7fcbe806f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:12.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.008+0000 7fcbecf71640 1 -- 172.21.15.49:0/2567633303 shutdown_connections 2023-11-18T21:00:12.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.008+0000 7fcbecf71640 1 -- 172.21.15.49:0/2567633303 wait complete. 2023-11-18T21:00:12.032 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-18T21:00:12.033 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T21:00:12.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.156+0000 7f10729d9640 1 Processor -- start 2023-11-18T21:00:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.156+0000 7f10729d9640 1 -- start start 2023-11-18T21:00:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.156+0000 7f10729d9640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c1505a0 0x7f106c0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.156+0000 7f10729d9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106c0c72b0 con 0x7f106c0c4a10 2023-11-18T21:00:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.156+0000 7f10729d9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106c15a100 con 0x7f106c0c4630 2023-11-18T21:00:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.156+0000 7f10729d9640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0c4f40 con 0x7f106c1505a0 2023-11-18T21:00:12.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.160+0000 7f1070f76640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c1505a0 0x7f106c0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:12.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.160+0000 7f106bfff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f106c0c4630 0x7f106c1596c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:43034/0 (socket says 172.21.15.49:43034) 2023-11-18T21:00:12.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.160+0000 7f106bfff640 1 -- 172.21.15.49:0/3782833177 learned_addr learned my addr 172.21.15.49:0/3782833177 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:12.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.164+0000 7f1070f76640 1 -- 172.21.15.49:0/3782833177 >> v1:172.21.15.106:6789/0 conn(0x7f106c0c4630 legacy=0x7f106c1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:12.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.164+0000 7f1070f76640 1 -- 172.21.15.49:0/3782833177 >> v1:172.21.15.49:6789/0 conn(0x7f106c0c4a10 legacy=0x7f106c14fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:12.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.164+0000 7f1070f76640 1 -- 172.21.15.49:0/3782833177 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c15a3e0 con 0x7f106c1505a0 2023-11-18T21:00:12.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.172+0000 7f1070f76640 1 --2- 172.21.15.49:0/3782833177 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c1505a0 0x7f106c0c6d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f10640097f0 tx=0x7f106401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2ac1a6e574bd68 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:12.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.188+0000 7f106affd640 1 -- 172.21.15.49:0/3782833177 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10640a8970 con 0x7f106c1505a0 2023-11-18T21:00:12.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.188+0000 7f106affd640 1 -- 172.21.15.49:0/3782833177 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10640a8ad0 con 0x7f106c1505a0 2023-11-18T21:00:12.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.188+0000 7f106affd640 1 -- 172.21.15.49:0/3782833177 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10640a8e60 con 0x7f106c1505a0 2023-11-18T21:00:12.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.188+0000 7f10729d9640 1 -- 172.21.15.49:0/3782833177 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c1505a0 msgr2=0x7f106c0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:12.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.188+0000 7f10729d9640 1 --2- 172.21.15.49:0/3782833177 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c1505a0 0x7f106c0c6d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f10640097f0 tx=0x7f106401ec70 comp rx=0 tx=0).stop 2023-11-18T21:00:12.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.188+0000 7f10729d9640 1 -- 172.21.15.49:0/3782833177 shutdown_connections 2023-11-18T21:00:12.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.188+0000 7f10729d9640 1 --2- 172.21.15.49:0/3782833177 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c1505a0 0x7f106c0c6d70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.188+0000 7f10729d9640 1 -- 172.21.15.49:0/3782833177 >> 172.21.15.49:0/3782833177 conn(0x7f106c06c6a0 msgr2=0x7f106c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:12.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.188+0000 7f10729d9640 1 -- 172.21.15.49:0/3782833177 shutdown_connections 2023-11-18T21:00:12.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.188+0000 7f10729d9640 1 -- 172.21.15.49:0/3782833177 wait complete. 2023-11-18T21:00:12.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.192+0000 7f10729d9640 1 Processor -- start 2023-11-18T21:00:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.192+0000 7f10729d9640 1 -- start start 2023-11-18T21:00:12.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.192+0000 7f10729d9640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c0c4630 0x7f106c1eda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:12.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.192+0000 7f10729d9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0c4a10 0x7f106c1f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:12.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.192+0000 7f10729d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c1505a0 0x7f106c0720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:12.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.192+0000 7f10729d9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c1f05e0 con 0x7f106c1505a0 2023-11-18T21:00:12.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.192+0000 7f10729d9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c1412c0 con 0x7f106c0c4a10 2023-11-18T21:00:12.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.192+0000 7f10729d9640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c141dd0 con 0x7f106c0c4630 2023-11-18T21:00:12.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.192+0000 7f1070f76640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c1505a0 0x7f106c0720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:12.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.192+0000 7f1070f76640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c1505a0 0x7f106c0720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49104/0 (socket says 172.21.15.49:49104) 2023-11-18T21:00:12.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.192+0000 7f1070f76640 1 -- 172.21.15.49:0/665120844 learned_addr learned my addr 172.21.15.49:0/665120844 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:12.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.192+0000 7f106b7fe640 1 --2- 172.21.15.49:0/665120844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0c4a10 0x7f106c1f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:12.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.196+0000 7f1070f76640 1 -- 172.21.15.49:0/665120844 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c0c4630 msgr2=0x7f106c1eda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:12.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.196+0000 7f1070f76640 1 --2- 172.21.15.49:0/665120844 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c0c4630 0x7f106c1eda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.196+0000 7f1070f76640 1 -- 172.21.15.49:0/665120844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0c4a10 msgr2=0x7f106c1f0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:12.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.196+0000 7f1070f76640 1 --2- 172.21.15.49:0/665120844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0c4a10 0x7f106c1f0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.196+0000 7f1070f76640 1 -- 172.21.15.49:0/665120844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1064009420 con 0x7f106c1505a0 2023-11-18T21:00:12.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.200+0000 7f1070f76640 1 --2- 172.21.15.49:0/665120844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c1505a0 0x7f106c0720e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f106401d320 tx=0x7f106401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:12.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.204+0000 7f1068ff9640 1 -- 172.21.15.49:0/665120844 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10640c2070 con 0x7f106c1505a0 2023-11-18T21:00:12.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.204+0000 7f1068ff9640 1 -- 172.21.15.49:0/665120844 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10640a8910 con 0x7f106c1505a0 2023-11-18T21:00:12.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.204+0000 7f10729d9640 1 -- 172.21.15.49:0/665120844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c1eced0 con 0x7f106c1505a0 2023-11-18T21:00:12.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.204+0000 7f1068ff9640 1 -- 172.21.15.49:0/665120844 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10640ba410 con 0x7f106c1505a0 2023-11-18T21:00:12.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.204+0000 7f10729d9640 1 -- 172.21.15.49:0/665120844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106c141530 con 0x7f106c1505a0 2023-11-18T21:00:12.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.204+0000 7f10729d9640 1 -- 172.21.15.49:0/665120844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106c0c67a0 con 0x7f106c1505a0 2023-11-18T21:00:12.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.472+0000 7f1068ff9640 1 -- 172.21.15.49:0/665120844 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f10640b7050 con 0x7f106c1505a0 2023-11-18T21:00:12.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.472+0000 7f1068ff9640 1 --2- 172.21.15.49:0/665120844 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f104c0664f0 0x7f104c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.472+0000 7f106bfff640 1 --2- 172.21.15.49:0/665120844 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f104c0664f0 0x7f104c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.472+0000 7f106bfff640 1 --2- 172.21.15.49:0/665120844 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f104c0664f0 0x7f104c0689b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f105c001560 tx=0x7f105c007a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:12.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.492+0000 7f1068ff9640 1 -- 172.21.15.49:0/665120844 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f10640f3800 con 0x7f106c1505a0 2023-11-18T21:00:12.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.492+0000 7f1068ff9640 1 -- 172.21.15.49:0/665120844 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10640ef440 con 0x7f106c1505a0 2023-11-18T21:00:12.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.700+0000 7f10729d9640 1 -- 172.21.15.49:0/665120844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f106c0c67a0 con 0x7f106c1505a0 2023-11-18T21:00:12.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.732+0000 7f1068ff9640 1 -- 172.21.15.49:0/665120844 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+6512 (secure 0 0 0) 0x7f10640b5090 con 0x7f106c1505a0 2023-11-18T21:00:12.732 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:12.733 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1013296856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1013296856},{"type":"v1","addr":"172.21.15.49:6833","nonce":1013296856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3397458527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3397458527},{"type":"v1","addr":"172.21.15.49:6835","nonce":3397458527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2795994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2795994685},{"type":"v1","addr":"172.21.15.106:6835","nonce":2795994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2839781261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":2839781261},{"type":"v1","addr":"172.21.15.106:6837","nonce":2839781261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:59:27.571192+0000","modified":"2023-11-18T21:00:11.289690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4252,"mds_1":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"b","rank":1,"incarnation":11,"state":"up:creating","state_seq":1,"addr":"172.21.15.106:6839/957974967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":957974967},{"type":"v1","addr":"172.21.15.106:6839","nonce":957974967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4252":{"gid":4252,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.49:6837/321839377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":321839377},{"type":"v1","addr":"172.21.15.49:6837","nonce":321839377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T21:00:12.733 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 13 2023-11-18T21:00:12.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.736+0000 7f10729d9640 1 -- 172.21.15.49:0/665120844 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f104c0664f0 msgr2=0x7f104c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:12.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.736+0000 7f10729d9640 1 --2- 172.21.15.49:0/665120844 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f104c0664f0 0x7f104c0689b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f105c001560 tx=0x7f105c007a50 comp rx=0 tx=0).stop 2023-11-18T21:00:12.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.736+0000 7f10729d9640 1 -- 172.21.15.49:0/665120844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c1505a0 msgr2=0x7f106c0720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:12.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.736+0000 7f10729d9640 1 --2- 172.21.15.49:0/665120844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c1505a0 0x7f106c0720e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f106401d320 tx=0x7f106401ba10 comp rx=0 tx=0).stop 2023-11-18T21:00:12.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.736+0000 7f10729d9640 1 -- 172.21.15.49:0/665120844 shutdown_connections 2023-11-18T21:00:12.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.736+0000 7f10729d9640 1 --2- 172.21.15.49:0/665120844 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f104c0664f0 0x7f104c0689b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.736+0000 7f10729d9640 1 --2- 172.21.15.49:0/665120844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c1505a0 0x7f106c0720e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.736+0000 7f10729d9640 1 --2- 172.21.15.49:0/665120844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0c4a10 0x7f106c1f0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.736+0000 7f10729d9640 1 --2- 172.21.15.49:0/665120844 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c0c4630 0x7f106c1eda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.736+0000 7f10729d9640 1 -- 172.21.15.49:0/665120844 >> 172.21.15.49:0/665120844 conn(0x7f106c06c6a0 msgr2=0x7f106c06e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:12.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.736+0000 7f10729d9640 1 -- 172.21.15.49:0/665120844 shutdown_connections 2023-11-18T21:00:12.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.736+0000 7f10729d9640 1 -- 172.21.15.49:0/665120844 wait complete. 2023-11-18T21:00:12.753 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T21:00:12.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.888+0000 7fe3fe995640 1 Processor -- start 2023-11-18T21:00:12.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.888+0000 7fe3fe995640 1 -- start start 2023-11-18T21:00:12.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.892+0000 7fe3fe995640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe3f806b620 0x7fe3f80c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:12.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.892+0000 7fe3fe995640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe3f806ba90 0x7fe3f80c5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:12.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.892+0000 7fe3fe995640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f81595f0 con 0x7fe3f80c82d0 2023-11-18T21:00:12.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.892+0000 7fe3fe995640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f8157060 con 0x7fe3f806ba90 2023-11-18T21:00:12.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.892+0000 7fe3fe995640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f80c2c50 con 0x7fe3f806b620 2023-11-18T21:00:12.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.892+0000 7fe3f77fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe3f806b620 0x7fe3f80c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:12.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.892+0000 7fe3f77fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe3f806b620 0x7fe3f80c4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:37636/0 (socket says 172.21.15.49:37636) 2023-11-18T21:00:12.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.892+0000 7fe3f77fe640 1 -- 172.21.15.49:0/1153062998 learned_addr learned my addr 172.21.15.49:0/1153062998 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:12.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.900+0000 7fe3f77fe640 1 -- 172.21.15.49:0/1153062998 >> v2:172.21.15.49:3300/0 conn(0x7fe3f806ba90 msgr2=0x7fe3f80c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:12.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.900+0000 7fe3f77fe640 1 --2- 172.21.15.49:0/1153062998 >> v2:172.21.15.49:3300/0 conn(0x7fe3f806ba90 0x7fe3f80c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.900+0000 7fe3f77fe640 1 -- 172.21.15.49:0/1153062998 >> v1:172.21.15.106:6789/0 conn(0x7fe3f80c82d0 legacy=0x7fe3f8159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:12.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.900+0000 7fe3f77fe640 1 -- 172.21.15.49:0/1153062998 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f80c2f30 con 0x7fe3f806b620 2023-11-18T21:00:12.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.908+0000 7fe3f77fe640 1 --2- 172.21.15.49:0/1153062998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f806b620 0x7fe3f80c4cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8153c40 tx=0x7fe3e001c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42c3ba69f4f96bb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:12.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.920+0000 7fe3f6ffd640 1 -- 172.21.15.49:0/1153062998 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00ac410 con 0x7fe3f806b620 2023-11-18T21:00:12.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.920+0000 7fe3f6ffd640 1 -- 172.21.15.49:0/1153062998 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e00ac570 con 0x7fe3f806b620 2023-11-18T21:00:12.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.920+0000 7fe3f6ffd640 1 -- 172.21.15.49:0/1153062998 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00ac900 con 0x7fe3f806b620 2023-11-18T21:00:12.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.920+0000 7fe3fe995640 1 -- 172.21.15.49:0/1153062998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f806b620 msgr2=0x7fe3f80c4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:12.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.920+0000 7fe3fe995640 1 --2- 172.21.15.49:0/1153062998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f806b620 0x7fe3f80c4cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8153c40 tx=0x7fe3e001c4c0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.920+0000 7fe3fe995640 1 -- 172.21.15.49:0/1153062998 shutdown_connections 2023-11-18T21:00:12.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.920+0000 7fe3fe995640 1 --2- 172.21.15.49:0/1153062998 >> v2:172.21.15.49:3300/0 conn(0x7fe3f806ba90 0x7fe3f80c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.920+0000 7fe3fe995640 1 --2- 172.21.15.49:0/1153062998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f806b620 0x7fe3f80c4cc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.920+0000 7fe3fe995640 1 -- 172.21.15.49:0/1153062998 >> 172.21.15.49:0/1153062998 conn(0x7fe3f80713a0 msgr2=0x7fe3f80717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:12.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.920+0000 7fe3fe995640 1 -- 172.21.15.49:0/1153062998 shutdown_connections 2023-11-18T21:00:12.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.920+0000 7fe3fe995640 1 -- 172.21.15.49:0/1153062998 wait complete. 2023-11-18T21:00:12.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.920+0000 7fe3fe995640 1 Processor -- start 2023-11-18T21:00:12.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.920+0000 7fe3fe995640 1 -- start start 2023-11-18T21:00:12.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.924+0000 7fe3fe995640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f806b620 0x7fe3f813b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:12.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.924+0000 7fe3fe995640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe3f806ba90 0x7fe3f81554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:12.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.924+0000 7fe3fe995640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3f80c82d0 0x7fe3f81f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:12.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.924+0000 7fe3fe995640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f813be50 con 0x7fe3f80c82d0 2023-11-18T21:00:12.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.924+0000 7fe3fe995640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f81f1fb0 con 0x7fe3f806b620 2023-11-18T21:00:12.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.924+0000 7fe3fe995640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f81347e0 con 0x7fe3f806ba90 2023-11-18T21:00:12.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.924+0000 7fe3f77fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe3f806ba90 0x7fe3f81554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:12.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.924+0000 7fe3f77fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe3f806ba90 0x7fe3f81554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:40490/0 (socket says 172.21.15.49:40490) 2023-11-18T21:00:12.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.924+0000 7fe3f77fe640 1 -- 172.21.15.49:0/3324116309 learned_addr learned my addr 172.21.15.49:0/3324116309 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:12.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.924+0000 7fe3f7fff640 1 --2- 172.21.15.49:0/3324116309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f806b620 0x7fe3f813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:12.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.932+0000 7fe3fcf32640 1 --2- 172.21.15.49:0/3324116309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3f80c82d0 0x7fe3f81f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:12.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.936+0000 7fe3f7fff640 1 -- 172.21.15.49:0/3324116309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe3f806ba90 msgr2=0x7fe3f81554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:12.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.936+0000 7fe3f7fff640 1 --2- 172.21.15.49:0/3324116309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe3f806ba90 0x7fe3f81554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.936+0000 7fe3f7fff640 1 -- 172.21.15.49:0/3324116309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3f80c82d0 msgr2=0x7fe3f81f2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:12.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.936+0000 7fe3f7fff640 1 --2- 172.21.15.49:0/3324116309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3f80c82d0 0x7fe3f81f2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:12.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.936+0000 7fe3f7fff640 1 -- 172.21.15.49:0/3324116309 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e00094d0 con 0x7fe3f806b620 2023-11-18T21:00:12.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:12.944+0000 7fe3f7fff640 1 --2- 172.21.15.49:0/3324116309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f806b620 0x7fe3f813b910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800b410 tx=0x7fe3e800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:13.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.084+0000 7fe3f4ff9640 1 -- 172.21.15.49:0/3324116309 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8004020 con 0x7fe3f806b620 2023-11-18T21:00:13.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.084+0000 7fe3f4ff9640 1 -- 172.21.15.49:0/3324116309 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e8004180 con 0x7fe3f806b620 2023-11-18T21:00:13.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.084+0000 7fe3f4ff9640 1 -- 172.21.15.49:0/3324116309 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8011630 con 0x7fe3f806b620 2023-11-18T21:00:13.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.084+0000 7fe3fe995640 1 -- 172.21.15.49:0/3324116309 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f81f1c60 con 0x7fe3f806b620 2023-11-18T21:00:13.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.084+0000 7fe3fe995640 1 -- 172.21.15.49:0/3324116309 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f81360e0 con 0x7fe3f806b620 2023-11-18T21:00:13.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.084+0000 7fe3fe995640 1 -- 172.21.15.49:0/3324116309 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f8073e70 con 0x7fe3f806b620 2023-11-18T21:00:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.392+0000 7fe3f4ff9640 1 -- 172.21.15.49:0/3324116309 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe3e8011790 con 0x7fe3f806b620 2023-11-18T21:00:13.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.392+0000 7fe3f4ff9640 1 --2- 172.21.15.49:0/3324116309 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe3d80664c0 0x7fe3d8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:13.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.392+0000 7fe3f77fe640 1 --2- 172.21.15.49:0/3324116309 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe3d80664c0 0x7fe3d8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:13.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.396+0000 7fe3f77fe640 1 --2- 172.21.15.49:0/3324116309 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe3d80664c0 0x7fe3d8068980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe3e001c500 tx=0x7fe3e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:13.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.400+0000 7fe3f4ff9640 1 -- 172.21.15.49:0/3324116309 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe3e8025e20 con 0x7fe3f806b620 2023-11-18T21:00:13.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.424+0000 7fe3f4ff9640 1 -- 172.21.15.49:0/3324116309 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe3e8051760 con 0x7fe3f806b620 2023-11-18T21:00:13.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.600+0000 7fe3fe995640 1 -- 172.21.15.49:0/3324116309 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3f806c000 con 0x7fe3f806b620 2023-11-18T21:00:13.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.748+0000 7fe3f4ff9640 1 -- 172.21.15.49:0/3324116309 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18314 (secure 0 0 0) 0x7fe3e8015020 con 0x7fe3f806b620 2023-11-18T21:00:13.750 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:13.750 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":29,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:59:36.521114+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T21:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.752+0000 7fe3fe995640 1 -- 172.21.15.49:0/3324116309 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe3d80664c0 msgr2=0x7fe3d8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.752+0000 7fe3fe995640 1 --2- 172.21.15.49:0/3324116309 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe3d80664c0 0x7fe3d8068980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe3e001c500 tx=0x7fe3e0008040 comp rx=0 tx=0).stop 2023-11-18T21:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.752+0000 7fe3fe995640 1 -- 172.21.15.49:0/3324116309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f806b620 msgr2=0x7fe3f813b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.752+0000 7fe3fe995640 1 --2- 172.21.15.49:0/3324116309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f806b620 0x7fe3f813b910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800b410 tx=0x7fe3e800b8d0 comp rx=0 tx=0).stop 2023-11-18T21:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.752+0000 7fe3fe995640 1 -- 172.21.15.49:0/3324116309 shutdown_connections 2023-11-18T21:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.752+0000 7fe3fe995640 1 --2- 172.21.15.49:0/3324116309 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe3d80664c0 0x7fe3d8068980 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.752+0000 7fe3fe995640 1 --2- 172.21.15.49:0/3324116309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3f80c82d0 0x7fe3f81f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.752+0000 7fe3fe995640 1 --2- 172.21.15.49:0/3324116309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe3f806ba90 0x7fe3f81554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.752+0000 7fe3fe995640 1 --2- 172.21.15.49:0/3324116309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f806b620 0x7fe3f813b910 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.752+0000 7fe3fe995640 1 -- 172.21.15.49:0/3324116309 >> 172.21.15.49:0/3324116309 conn(0x7fe3f80713a0 msgr2=0x7fe3f8137d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:13.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.752+0000 7fe3fe995640 1 -- 172.21.15.49:0/3324116309 shutdown_connections 2023-11-18T21:00:13.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.752+0000 7fe3fe995640 1 -- 172.21.15.49:0/3324116309 wait complete. 2023-11-18T21:00:13.776 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-18T21:00:13.776 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T21:00:13.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.904+0000 7fb50019d640 1 Processor -- start 2023-11-18T21:00:13.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.904+0000 7fb50019d640 1 -- start start 2023-11-18T21:00:13.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.904+0000 7fb50019d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4f814f850 0x7fb4f80c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:13.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.904+0000 7fb50019d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4f80c1ed0 0x7fb4f806e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:13.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.904+0000 7fb50019d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb4f8070ab0 0x7fb4f806ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:13.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.904+0000 7fb50019d640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f80c3b10 con 0x7fb4f814f850 2023-11-18T21:00:13.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.904+0000 7fb50019d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f814fc30 con 0x7fb4f8070ab0 2023-11-18T21:00:13.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.904+0000 7fb50019d640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f80c11e0 con 0x7fb4f80c1ed0 2023-11-18T21:00:13.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.904+0000 7fb4fdf39640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4f814f850 0x7fb4f80c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:13.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.904+0000 7fb4fdf39640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4f814f850 0x7fb4f80c3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49124/0 (socket says 172.21.15.49:49124) 2023-11-18T21:00:13.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.904+0000 7fb4fdf39640 1 -- 172.21.15.49:0/1805464294 learned_addr learned my addr 172.21.15.49:0/1805464294 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:13.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.904+0000 7fb4fd738640 1 --2- 172.21.15.49:0/1805464294 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4f80c1ed0 0x7fb4f806e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:13.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.904+0000 7fb4fe73a640 1 --2- 172.21.15.49:0/1805464294 >> v2:172.21.15.106:3300/0 conn(0x7fb4f8070ab0 0x7fb4f806ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:13.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.908+0000 7fb4fdf39640 1 -- 172.21.15.49:0/1805464294 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4f80c1ed0 msgr2=0x7fb4f806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:13.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.908+0000 7fb4fdf39640 1 --2- 172.21.15.49:0/1805464294 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4f80c1ed0 0x7fb4f806e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:13.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.908+0000 7fb4fdf39640 1 -- 172.21.15.49:0/1805464294 >> v2:172.21.15.106:3300/0 conn(0x7fb4f8070ab0 msgr2=0x7fb4f806ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:13.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.908+0000 7fb4fdf39640 1 --2- 172.21.15.49:0/1805464294 >> v2:172.21.15.106:3300/0 conn(0x7fb4f8070ab0 0x7fb4f806ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:13.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.908+0000 7fb4fdf39640 1 -- 172.21.15.49:0/1805464294 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f80c2410 con 0x7fb4f814f850 2023-11-18T21:00:13.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.916+0000 7fb4fdf39640 1 --2- 172.21.15.49:0/1805464294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4f814f850 0x7fb4f80c3fa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8071d10 tx=0x7fb4f401d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f971122cf7001a02 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:13.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb4fcf37640 1 -- 172.21.15.49:0/1805464294 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40a6910 con 0x7fb4f814f850 2023-11-18T21:00:13.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb4fcf37640 1 -- 172.21.15.49:0/1805464294 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f40a6a70 con 0x7fb4f814f850 2023-11-18T21:00:13.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb4fcf37640 1 -- 172.21.15.49:0/1805464294 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40a6e00 con 0x7fb4f814f850 2023-11-18T21:00:13.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 -- 172.21.15.49:0/1805464294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4f814f850 msgr2=0x7fb4f80c3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:13.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 --2- 172.21.15.49:0/1805464294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4f814f850 0x7fb4f80c3fa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8071d10 tx=0x7fb4f401d8a0 comp rx=0 tx=0).stop 2023-11-18T21:00:13.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 -- 172.21.15.49:0/1805464294 shutdown_connections 2023-11-18T21:00:13.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 --2- 172.21.15.49:0/1805464294 >> v2:172.21.15.106:3300/0 conn(0x7fb4f8070ab0 0x7fb4f806ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 --2- 172.21.15.49:0/1805464294 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4f80c1ed0 0x7fb4f806e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 --2- 172.21.15.49:0/1805464294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4f814f850 0x7fb4f80c3fa0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 -- 172.21.15.49:0/1805464294 >> 172.21.15.49:0/1805464294 conn(0x7fb4f806c6a0 msgr2=0x7fb4f806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 -- 172.21.15.49:0/1805464294 shutdown_connections 2023-11-18T21:00:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 -- 172.21.15.49:0/1805464294 wait complete. 2023-11-18T21:00:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 Processor -- start 2023-11-18T21:00:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 -- start start 2023-11-18T21:00:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4f8070ab0 0x7fb4f8146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4f80c1ed0 0x7fb4f81492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4f814f850 0x7fb4f8149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f8159700 con 0x7fb4f80c1ed0 2023-11-18T21:00:13.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f814eea0 con 0x7fb4f8070ab0 2023-11-18T21:00:13.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.924+0000 7fb50019d640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f8144b40 con 0x7fb4f814f850 2023-11-18T21:00:13.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.928+0000 7fb4fd738640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4f80c1ed0 0x7fb4f81492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:13.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.928+0000 7fb4fd738640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4f80c1ed0 0x7fb4f81492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49132/0 (socket says 172.21.15.49:49132) 2023-11-18T21:00:13.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.928+0000 7fb4fd738640 1 -- 172.21.15.49:0/785522359 learned_addr learned my addr 172.21.15.49:0/785522359 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:13.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.928+0000 7fb4fdf39640 1 --2- 172.21.15.49:0/785522359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4f8070ab0 0x7fb4f8146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:13.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.928+0000 7fb4fe73a640 1 --2- 172.21.15.49:0/785522359 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4f814f850 0x7fb4f8149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:13.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.932+0000 7fb4fd738640 1 -- 172.21.15.49:0/785522359 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4f814f850 msgr2=0x7fb4f8149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:13.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.932+0000 7fb4fd738640 1 --2- 172.21.15.49:0/785522359 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4f814f850 0x7fb4f8149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:13.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.932+0000 7fb4fd738640 1 -- 172.21.15.49:0/785522359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4f8070ab0 msgr2=0x7fb4f8146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:13.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.932+0000 7fb4fd738640 1 --2- 172.21.15.49:0/785522359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4f8070ab0 0x7fb4f8146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:13.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.932+0000 7fb4fd738640 1 -- 172.21.15.49:0/785522359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f400a670 con 0x7fb4f80c1ed0 2023-11-18T21:00:13.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.932+0000 7fb4fd738640 1 --2- 172.21.15.49:0/785522359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4f80c1ed0 0x7fb4f81492d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800e840 tx=0x7fb4e800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:13.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.936+0000 7fb4ee7fc640 1 -- 172.21.15.49:0/785522359 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8009510 con 0x7fb4f80c1ed0 2023-11-18T21:00:13.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.936+0000 7fb4ee7fc640 1 -- 172.21.15.49:0/785522359 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e800ee90 con 0x7fb4f80c1ed0 2023-11-18T21:00:13.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.936+0000 7fb4ee7fc640 1 -- 172.21.15.49:0/785522359 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e800cb60 con 0x7fb4f80c1ed0 2023-11-18T21:00:13.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.936+0000 7fb50019d640 1 -- 172.21.15.49:0/785522359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f8159420 con 0x7fb4f80c1ed0 2023-11-18T21:00:13.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.936+0000 7fb50019d640 1 -- 172.21.15.49:0/785522359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f81f2e10 con 0x7fb4f80c1ed0 2023-11-18T21:00:13.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.936+0000 7fb50019d640 1 -- 172.21.15.49:0/785522359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f8067520 con 0x7fb4f80c1ed0 2023-11-18T21:00:13.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.956+0000 7fb4ee7fc640 1 -- 172.21.15.49:0/785522359 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb4e800ccc0 con 0x7fb4f80c1ed0 2023-11-18T21:00:13.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.956+0000 7fb4ee7fc640 1 --2- 172.21.15.49:0/785522359 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb4dc0664c0 0x7fb4dc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:13.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.956+0000 7fb4fdf39640 1 --2- 172.21.15.49:0/785522359 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb4dc0664c0 0x7fb4dc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:13.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.960+0000 7fb4fdf39640 1 --2- 172.21.15.49:0/785522359 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb4dc0664c0 0x7fb4dc068980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40b0000 tx=0x7fb4f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:13.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:13.960+0000 7fb4ee7fc640 1 -- 172.21.15.49:0/785522359 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb4e8055890 con 0x7fb4f80c1ed0 2023-11-18T21:00:14.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.216+0000 7fb4ee7fc640 1 -- 172.21.15.49:0/785522359 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4e8051bd0 con 0x7fb4f80c1ed0 2023-11-18T21:00:14.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.384+0000 7fb50019d640 1 -- 172.21.15.49:0/785522359 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4f8071d80 con 0x7fb4dc0664c0 2023-11-18T21:00:14.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.416+0000 7fb4ee7fc640 1 -- 172.21.15.49:0/785522359 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368425 (secure 0 0 0) 0x7fb4f40bf090 con 0x7fb4dc0664c0 2023-11-18T21:00:14.418 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:14.422 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-18T21:00:14.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.420+0000 7fb50019d640 1 -- 172.21.15.49:0/785522359 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb4dc0664c0 msgr2=0x7fb4dc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:14.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.420+0000 7fb50019d640 1 --2- 172.21.15.49:0/785522359 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb4dc0664c0 0x7fb4dc068980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40b0000 tx=0x7fb4f4008040 comp rx=0 tx=0).stop 2023-11-18T21:00:14.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.420+0000 7fb50019d640 1 -- 172.21.15.49:0/785522359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4f80c1ed0 msgr2=0x7fb4f81492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:14.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.420+0000 7fb50019d640 1 --2- 172.21.15.49:0/785522359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4f80c1ed0 0x7fb4f81492d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800e840 tx=0x7fb4e800ec40 comp rx=0 tx=0).stop 2023-11-18T21:00:14.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.420+0000 7fb50019d640 1 -- 172.21.15.49:0/785522359 shutdown_connections 2023-11-18T21:00:14.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.420+0000 7fb50019d640 1 --2- 172.21.15.49:0/785522359 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb4dc0664c0 0x7fb4dc068980 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:14.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.420+0000 7fb50019d640 1 --2- 172.21.15.49:0/785522359 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4f814f850 0x7fb4f8149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:14.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.420+0000 7fb50019d640 1 --2- 172.21.15.49:0/785522359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4f80c1ed0 0x7fb4f81492d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:14.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.420+0000 7fb50019d640 1 --2- 172.21.15.49:0/785522359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4f8070ab0 0x7fb4f8146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:14.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.420+0000 7fb50019d640 1 -- 172.21.15.49:0/785522359 >> 172.21.15.49:0/785522359 conn(0x7fb4f806c6a0 msgr2=0x7fb4f806e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:14.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.420+0000 7fb50019d640 1 -- 172.21.15.49:0/785522359 shutdown_connections 2023-11-18T21:00:14.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.420+0000 7fb50019d640 1 -- 172.21.15.49:0/785522359 wait complete. 2023-11-18T21:00:14.439 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-11-18T21:00:13.794897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596323,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":240,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236428,"kb_used_data":3660,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738292,"statfs":{"total":773094113280,"available":772852011008,"internally_reserved":0,"allocated":3747840,"data_stored":2173104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1316,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005259"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.832939+0000","last_change":"2023-11-18T20:59:25.350113+0000","last_active":"2023-11-18T20:59:35.832939+0000","last_peered":"2023-11-18T20:59:35.832939+0000","last_clean":"2023-11-18T20:59:35.832939+0000","last_became_active":"2023-11-18T20:59:25.349869+0000","last_became_peered":"2023-11-18T20:59:25.349869+0000","last_unstale":"2023-11-18T20:59:35.832939+0000","last_undegraded":"2023-11-18T20:59:35.832939+0000","last_fullsized":"2023-11-18T20:59:35.832939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:56:07.719325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.771586+0000","last_change":"2023-11-18T20:59:27.895973+0000","last_active":"2023-11-18T20:59:35.771586+0000","last_peered":"2023-11-18T20:59:35.771586+0000","last_clean":"2023-11-18T20:59:35.771586+0000","last_became_active":"2023-11-18T20:59:27.895678+0000","last_became_peered":"2023-11-18T20:59:27.895678+0000","last_unstale":"2023-11-18T20:59:35.771586+0000","last_undegraded":"2023-11-18T20:59:35.771586+0000","last_fullsized":"2023-11-18T20:59:35.771586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.784993+0000","last_change":"2023-11-18T20:59:35.848621+0000","last_active":"2023-11-18T20:59:36.784993+0000","last_peered":"2023-11-18T20:59:36.784993+0000","last_clean":"2023-11-18T20:59:36.784993+0000","last_became_active":"2023-11-18T20:59:35.848140+0000","last_became_peered":"2023-11-18T20:59:35.848140+0000","last_unstale":"2023-11-18T20:59:36.784993+0000","last_undegraded":"2023-11-18T20:59:36.784993+0000","last_fullsized":"2023-11-18T20:59:36.784993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:12.962470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.771992+0000","last_change":"2023-11-18T20:59:25.463657+0000","last_active":"2023-11-18T20:59:35.771992+0000","last_peered":"2023-11-18T20:59:35.771992+0000","last_clean":"2023-11-18T20:59:35.771992+0000","last_became_active":"2023-11-18T20:59:25.463001+0000","last_became_peered":"2023-11-18T20:59:25.463001+0000","last_unstale":"2023-11-18T20:59:35.771992+0000","last_undegraded":"2023-11-18T20:59:35.771992+0000","last_fullsized":"2023-11-18T20:59:35.771992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.772550+0000","last_change":"2023-11-18T20:59:27.837801+0000","last_active":"2023-11-18T20:59:35.772550+0000","last_peered":"2023-11-18T20:59:35.772550+0000","last_clean":"2023-11-18T20:59:35.772550+0000","last_became_active":"2023-11-18T20:59:27.836937+0000","last_became_peered":"2023-11-18T20:59:27.836937+0000","last_unstale":"2023-11-18T20:59:35.772550+0000","last_undegraded":"2023-11-18T20:59:35.772550+0000","last_fullsized":"2023-11-18T20:59:35.772550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947102+0000","last_change":"2023-11-18T20:59:35.843015+0000","last_active":"2023-11-18T20:59:37.947102+0000","last_peered":"2023-11-18T20:59:37.947102+0000","last_clean":"2023-11-18T20:59:37.947102+0000","last_became_active":"2023-11-18T20:59:35.842552+0000","last_became_peered":"2023-11-18T20:59:35.842552+0000","last_unstale":"2023-11-18T20:59:37.947102+0000","last_undegraded":"2023-11-18T20:59:37.947102+0000","last_fullsized":"2023-11-18T20:59:37.947102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:17.222664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759823+0000","last_change":"2023-11-18T20:59:25.497907+0000","last_active":"2023-11-18T20:59:35.759823+0000","last_peered":"2023-11-18T20:59:35.759823+0000","last_clean":"2023-11-18T20:59:35.759823+0000","last_became_active":"2023-11-18T20:59:25.497070+0000","last_became_peered":"2023-11-18T20:59:25.497070+0000","last_unstale":"2023-11-18T20:59:35.759823+0000","last_undegraded":"2023-11-18T20:59:35.759823+0000","last_fullsized":"2023-11-18T20:59:35.759823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769239+0000","last_change":"2023-11-18T20:59:27.868161+0000","last_active":"2023-11-18T20:59:35.769239+0000","last_peered":"2023-11-18T20:59:35.769239+0000","last_clean":"2023-11-18T20:59:35.769239+0000","last_became_active":"2023-11-18T20:59:27.867021+0000","last_became_peered":"2023-11-18T20:59:27.867021+0000","last_unstale":"2023-11-18T20:59:35.769239+0000","last_undegraded":"2023-11-18T20:59:35.769239+0000","last_fullsized":"2023-11-18T20:59:35.769239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.950153+0000","last_change":"2023-11-18T20:59:35.830210+0000","last_active":"2023-11-18T20:59:37.950153+0000","last_peered":"2023-11-18T20:59:37.950153+0000","last_clean":"2023-11-18T20:59:37.950153+0000","last_became_active":"2023-11-18T20:59:35.829636+0000","last_became_peered":"2023-11-18T20:59:35.829636+0000","last_unstale":"2023-11-18T20:59:37.950153+0000","last_undegraded":"2023-11-18T20:59:37.950153+0000","last_fullsized":"2023-11-18T20:59:37.950153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759499+0000","last_change":"2023-11-18T20:59:25.493859+0000","last_active":"2023-11-18T20:59:35.759499+0000","last_peered":"2023-11-18T20:59:35.759499+0000","last_clean":"2023-11-18T20:59:35.759499+0000","last_became_active":"2023-11-18T20:59:25.493087+0000","last_became_peered":"2023-11-18T20:59:25.493087+0000","last_unstale":"2023-11-18T20:59:35.759499+0000","last_undegraded":"2023-11-18T20:59:35.759499+0000","last_fullsized":"2023-11-18T20:59:35.759499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.697210+0000","last_change":"2023-11-18T20:59:27.871929+0000","last_active":"2023-11-18T20:59:35.697210+0000","last_peered":"2023-11-18T20:59:35.697210+0000","last_clean":"2023-11-18T20:59:35.697210+0000","last_became_active":"2023-11-18T20:59:27.871076+0000","last_became_peered":"2023-11-18T20:59:27.871076+0000","last_unstale":"2023-11-18T20:59:35.697210+0000","last_undegraded":"2023-11-18T20:59:35.697210+0000","last_fullsized":"2023-11-18T20:59:35.697210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:24:09.546791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.948997+0000","last_change":"2023-11-18T20:59:35.833547+0000","last_active":"2023-11-18T20:59:37.948997+0000","last_peered":"2023-11-18T20:59:37.948997+0000","last_clean":"2023-11-18T20:59:37.948997+0000","last_became_active":"2023-11-18T20:59:35.833016+0000","last_became_peered":"2023-11-18T20:59:35.833016+0000","last_unstale":"2023-11-18T20:59:37.948997+0000","last_undegraded":"2023-11-18T20:59:37.948997+0000","last_fullsized":"2023-11-18T20:59:37.948997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:58.416590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696332+0000","last_change":"2023-11-18T20:59:27.682005+0000","last_active":"2023-11-18T20:59:35.696332+0000","last_peered":"2023-11-18T20:59:35.696332+0000","last_clean":"2023-11-18T20:59:35.696332+0000","last_became_active":"2023-11-18T20:59:27.681154+0000","last_became_peered":"2023-11-18T20:59:27.681154+0000","last_unstale":"2023-11-18T20:59:35.696332+0000","last_undegraded":"2023-11-18T20:59:35.696332+0000","last_fullsized":"2023-11-18T20:59:35.696332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:10.426499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:09.997710+0000","last_change":"2023-11-18T20:59:25.339269+0000","last_active":"2023-11-18T21:00:09.997710+0000","last_peered":"2023-11-18T21:00:09.997710+0000","last_clean":"2023-11-18T21:00:09.997710+0000","last_became_active":"2023-11-18T20:59:25.338067+0000","last_became_peered":"2023-11-18T20:59:25.338067+0000","last_unstale":"2023-11-18T21:00:09.997710+0000","last_undegraded":"2023-11-18T21:00:09.997710+0000","last_fullsized":"2023-11-18T21:00:09.997710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.310566+0000","last_change":"2023-11-18T20:59:35.776790+0000","last_active":"2023-11-18T20:59:37.310566+0000","last_peered":"2023-11-18T20:59:37.310566+0000","last_clean":"2023-11-18T20:59:37.310566+0000","last_became_active":"2023-11-18T20:59:35.776286+0000","last_became_peered":"2023-11-18T20:59:35.776286+0000","last_unstale":"2023-11-18T20:59:37.310566+0000","last_undegraded":"2023-11-18T20:59:37.310566+0000","last_fullsized":"2023-11-18T20:59:37.310566+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:06.870579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.682428+0000","last_change":"2023-11-18T20:59:27.861550+0000","last_active":"2023-11-18T20:59:35.682428+0000","last_peered":"2023-11-18T20:59:35.682428+0000","last_clean":"2023-11-18T20:59:35.682428+0000","last_became_active":"2023-11-18T20:59:27.861045+0000","last_became_peered":"2023-11-18T20:59:27.861045+0000","last_unstale":"2023-11-18T20:59:35.682428+0000","last_undegraded":"2023-11-18T20:59:35.682428+0000","last_fullsized":"2023-11-18T20:59:35.682428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.820347+0000","last_change":"2023-11-18T20:59:25.458601+0000","last_active":"2023-11-18T20:59:35.820347+0000","last_peered":"2023-11-18T20:59:35.820347+0000","last_clean":"2023-11-18T20:59:35.820347+0000","last_became_active":"2023-11-18T20:59:25.457871+0000","last_became_peered":"2023-11-18T20:59:25.457871+0000","last_unstale":"2023-11-18T20:59:35.820347+0000","last_undegraded":"2023-11-18T20:59:35.820347+0000","last_fullsized":"2023-11-18T20:59:35.820347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:09.387812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.685157+0000","last_change":"2023-11-18T20:59:35.842967+0000","last_active":"2023-11-18T20:59:36.685157+0000","last_peered":"2023-11-18T20:59:36.685157+0000","last_clean":"2023-11-18T20:59:36.685157+0000","last_became_active":"2023-11-18T20:59:35.842583+0000","last_became_peered":"2023-11-18T20:59:35.842583+0000","last_unstale":"2023-11-18T20:59:36.685157+0000","last_undegraded":"2023-11-18T20:59:36.685157+0000","last_fullsized":"2023-11-18T20:59:36.685157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:40.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.824183+0000","last_change":"2023-11-18T20:59:27.688043+0000","last_active":"2023-11-18T20:59:35.824183+0000","last_peered":"2023-11-18T20:59:35.824183+0000","last_clean":"2023-11-18T20:59:35.824183+0000","last_became_active":"2023-11-18T20:59:27.687250+0000","last_became_peered":"2023-11-18T20:59:27.687250+0000","last_unstale":"2023-11-18T20:59:35.824183+0000","last_undegraded":"2023-11-18T20:59:35.824183+0000","last_fullsized":"2023-11-18T20:59:35.824183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:16:48.432607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.823611+0000","last_change":"2023-11-18T20:59:25.351927+0000","last_active":"2023-11-18T20:59:35.823611+0000","last_peered":"2023-11-18T20:59:35.823611+0000","last_clean":"2023-11-18T20:59:35.823611+0000","last_became_active":"2023-11-18T20:59:25.351318+0000","last_became_peered":"2023-11-18T20:59:25.351318+0000","last_unstale":"2023-11-18T20:59:35.823611+0000","last_undegraded":"2023-11-18T20:59:35.823611+0000","last_fullsized":"2023-11-18T20:59:35.823611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:20:38.006315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.785771+0000","last_change":"2023-11-18T20:59:35.835375+0000","last_active":"2023-11-18T20:59:36.785771+0000","last_peered":"2023-11-18T20:59:36.785771+0000","last_clean":"2023-11-18T20:59:36.785771+0000","last_became_active":"2023-11-18T20:59:35.834894+0000","last_became_peered":"2023-11-18T20:59:35.834894+0000","last_unstale":"2023-11-18T20:59:36.785771+0000","last_undegraded":"2023-11-18T20:59:36.785771+0000","last_fullsized":"2023-11-18T20:59:36.785771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:33.448377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.695870+0000","last_change":"2023-11-18T20:59:27.687356+0000","last_active":"2023-11-18T20:59:35.695870+0000","last_peered":"2023-11-18T20:59:35.695870+0000","last_clean":"2023-11-18T20:59:35.695870+0000","last_became_active":"2023-11-18T20:59:27.686692+0000","last_became_peered":"2023-11-18T20:59:27.686692+0000","last_unstale":"2023-11-18T20:59:35.695870+0000","last_undegraded":"2023-11-18T20:59:35.695870+0000","last_fullsized":"2023-11-18T20:59:35.695870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:20:58.633153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.169191+0000","last_change":"2023-11-18T20:59:25.347589+0000","last_active":"2023-11-18T21:00:10.169191+0000","last_peered":"2023-11-18T21:00:10.169191+0000","last_clean":"2023-11-18T21:00:10.169191+0000","last_became_active":"2023-11-18T20:59:25.347022+0000","last_became_peered":"2023-11-18T20:59:25.347022+0000","last_unstale":"2023-11-18T21:00:10.169191+0000","last_undegraded":"2023-11-18T21:00:10.169191+0000","last_fullsized":"2023-11-18T21:00:10.169191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.949612+0000","last_change":"2023-11-18T20:59:35.771398+0000","last_active":"2023-11-18T20:59:37.949612+0000","last_peered":"2023-11-18T20:59:37.949612+0000","last_clean":"2023-11-18T20:59:37.949612+0000","last_became_active":"2023-11-18T20:59:35.770923+0000","last_became_peered":"2023-11-18T20:59:35.770923+0000","last_unstale":"2023-11-18T20:59:37.949612+0000","last_undegraded":"2023-11-18T20:59:37.949612+0000","last_fullsized":"2023-11-18T20:59:37.949612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.824728+0000","last_change":"2023-11-18T20:59:27.689972+0000","last_active":"2023-11-18T20:59:35.824728+0000","last_peered":"2023-11-18T20:59:35.824728+0000","last_clean":"2023-11-18T20:59:35.824728+0000","last_became_active":"2023-11-18T20:59:27.689156+0000","last_became_peered":"2023-11-18T20:59:27.689156+0000","last_unstale":"2023-11-18T20:59:35.824728+0000","last_undegraded":"2023-11-18T20:59:35.824728+0000","last_fullsized":"2023-11-18T20:59:35.824728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:58.264895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:09.999479+0000","last_change":"2023-11-18T20:59:25.348005+0000","last_active":"2023-11-18T21:00:09.999479+0000","last_peered":"2023-11-18T21:00:09.999479+0000","last_clean":"2023-11-18T21:00:09.999479+0000","last_became_active":"2023-11-18T20:59:25.346318+0000","last_became_peered":"2023-11-18T20:59:25.346318+0000","last_unstale":"2023-11-18T21:00:09.999479+0000","last_undegraded":"2023-11-18T21:00:09.999479+0000","last_fullsized":"2023-11-18T21:00:09.999479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:37.045716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947894+0000","last_change":"2023-11-18T20:59:35.833754+0000","last_active":"2023-11-18T20:59:37.947894+0000","last_peered":"2023-11-18T20:59:37.947894+0000","last_clean":"2023-11-18T20:59:37.947894+0000","last_became_active":"2023-11-18T20:59:35.833407+0000","last_became_peered":"2023-11-18T20:59:35.833407+0000","last_unstale":"2023-11-18T20:59:37.947894+0000","last_undegraded":"2023-11-18T20:59:37.947894+0000","last_fullsized":"2023-11-18T20:59:37.947894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:38:06.355389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.827293+0000","last_change":"2023-11-18T20:59:27.863887+0000","last_active":"2023-11-18T20:59:35.827293+0000","last_peered":"2023-11-18T20:59:35.827293+0000","last_clean":"2023-11-18T20:59:35.827293+0000","last_became_active":"2023-11-18T20:59:27.863358+0000","last_became_peered":"2023-11-18T20:59:27.863358+0000","last_unstale":"2023-11-18T20:59:35.827293+0000","last_undegraded":"2023-11-18T20:59:35.827293+0000","last_fullsized":"2023-11-18T20:59:35.827293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:50.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.235441+0000","last_change":"2023-11-18T20:59:25.351394+0000","last_active":"2023-11-18T20:59:36.235441+0000","last_peered":"2023-11-18T20:59:36.235441+0000","last_clean":"2023-11-18T20:59:36.235441+0000","last_became_active":"2023-11-18T20:59:25.350705+0000","last_became_peered":"2023-11-18T20:59:25.350705+0000","last_unstale":"2023-11-18T20:59:36.235441+0000","last_undegraded":"2023-11-18T20:59:36.235441+0000","last_fullsized":"2023-11-18T20:59:36.235441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:01:57.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.687959+0000","last_change":"2023-11-18T20:59:35.840991+0000","last_active":"2023-11-18T20:59:36.687959+0000","last_peered":"2023-11-18T20:59:36.687959+0000","last_clean":"2023-11-18T20:59:36.687959+0000","last_became_active":"2023-11-18T20:59:35.840533+0000","last_became_peered":"2023-11-18T20:59:35.840533+0000","last_unstale":"2023-11-18T20:59:36.687959+0000","last_undegraded":"2023-11-18T20:59:36.687959+0000","last_fullsized":"2023-11-18T20:59:36.687959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:06:47.876845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.821773+0000","last_change":"2023-11-18T20:59:27.869100+0000","last_active":"2023-11-18T20:59:35.821773+0000","last_peered":"2023-11-18T20:59:35.821773+0000","last_clean":"2023-11-18T20:59:35.821773+0000","last_became_active":"2023-11-18T20:59:27.868355+0000","last_became_peered":"2023-11-18T20:59:27.868355+0000","last_unstale":"2023-11-18T20:59:35.821773+0000","last_undegraded":"2023-11-18T20:59:35.821773+0000","last_fullsized":"2023-11-18T20:59:35.821773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:25.235096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311843+0000","last_change":"2023-11-18T20:59:25.350304+0000","last_active":"2023-11-18T20:59:37.311843+0000","last_peered":"2023-11-18T20:59:37.311843+0000","last_clean":"2023-11-18T20:59:37.311843+0000","last_became_active":"2023-11-18T20:59:25.349346+0000","last_became_peered":"2023-11-18T20:59:25.349346+0000","last_unstale":"2023-11-18T20:59:37.311843+0000","last_undegraded":"2023-11-18T20:59:37.311843+0000","last_fullsized":"2023-11-18T20:59:37.311843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:41.179268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.445590+0000","last_change":"2023-11-18T20:59:35.847005+0000","last_active":"2023-11-18T20:59:37.445590+0000","last_peered":"2023-11-18T20:59:37.445590+0000","last_clean":"2023-11-18T20:59:37.445590+0000","last_became_active":"2023-11-18T20:59:35.846458+0000","last_became_peered":"2023-11-18T20:59:35.846458+0000","last_unstale":"2023-11-18T20:59:37.445590+0000","last_undegraded":"2023-11-18T20:59:37.445590+0000","last_fullsized":"2023-11-18T20:59:37.445590+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746436+0000","last_change":"2023-11-18T20:59:27.889369+0000","last_active":"2023-11-18T20:59:35.746436+0000","last_peered":"2023-11-18T20:59:35.746436+0000","last_clean":"2023-11-18T20:59:35.746436+0000","last_became_active":"2023-11-18T20:59:27.887876+0000","last_became_peered":"2023-11-18T20:59:27.887876+0000","last_unstale":"2023-11-18T20:59:35.746436+0000","last_undegraded":"2023-11-18T20:59:35.746436+0000","last_fullsized":"2023-11-18T20:59:35.746436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:38.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770796+0000","last_change":"2023-11-18T20:59:25.459620+0000","last_active":"2023-11-18T20:59:35.770796+0000","last_peered":"2023-11-18T20:59:35.770796+0000","last_clean":"2023-11-18T20:59:35.770796+0000","last_became_active":"2023-11-18T20:59:25.459235+0000","last_became_peered":"2023-11-18T20:59:25.459235+0000","last_unstale":"2023-11-18T20:59:35.770796+0000","last_undegraded":"2023-11-18T20:59:35.770796+0000","last_fullsized":"2023-11-18T20:59:35.770796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:02.325885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.445133+0000","last_change":"2023-11-18T20:59:35.835800+0000","last_active":"2023-11-18T20:59:37.445133+0000","last_peered":"2023-11-18T20:59:37.445133+0000","last_clean":"2023-11-18T20:59:37.445133+0000","last_became_active":"2023-11-18T20:59:35.834275+0000","last_became_peered":"2023-11-18T20:59:35.834275+0000","last_unstale":"2023-11-18T20:59:37.445133+0000","last_undegraded":"2023-11-18T20:59:37.445133+0000","last_fullsized":"2023-11-18T20:59:37.445133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.758369+0000","last_change":"2023-11-18T20:59:27.892676+0000","last_active":"2023-11-18T20:59:35.758369+0000","last_peered":"2023-11-18T20:59:35.758369+0000","last_clean":"2023-11-18T20:59:35.758369+0000","last_became_active":"2023-11-18T20:59:27.892150+0000","last_became_peered":"2023-11-18T20:59:27.892150+0000","last_unstale":"2023-11-18T20:59:35.758369+0000","last_undegraded":"2023-11-18T20:59:35.758369+0000","last_fullsized":"2023-11-18T20:59:35.758369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:04.716391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696607+0000","last_change":"2023-11-18T20:59:25.355096+0000","last_active":"2023-11-18T20:59:35.696607+0000","last_peered":"2023-11-18T20:59:35.696607+0000","last_clean":"2023-11-18T20:59:35.696607+0000","last_became_active":"2023-11-18T20:59:25.354716+0000","last_became_peered":"2023-11-18T20:59:25.354716+0000","last_unstale":"2023-11-18T20:59:35.696607+0000","last_undegraded":"2023-11-18T20:59:35.696607+0000","last_fullsized":"2023-11-18T20:59:35.696607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:51.039181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.446212+0000","last_change":"2023-11-18T20:59:35.839218+0000","last_active":"2023-11-18T20:59:37.446212+0000","last_peered":"2023-11-18T20:59:37.446212+0000","last_clean":"2023-11-18T20:59:37.446212+0000","last_became_active":"2023-11-18T20:59:35.838732+0000","last_became_peered":"2023-11-18T20:59:35.838732+0000","last_unstale":"2023-11-18T20:59:37.446212+0000","last_undegraded":"2023-11-18T20:59:37.446212+0000","last_fullsized":"2023-11-18T20:59:37.446212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:50.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769410+0000","last_change":"2023-11-18T20:59:27.839403+0000","last_active":"2023-11-18T20:59:35.769410+0000","last_peered":"2023-11-18T20:59:35.769410+0000","last_clean":"2023-11-18T20:59:35.769410+0000","last_became_active":"2023-11-18T20:59:27.838664+0000","last_became_peered":"2023-11-18T20:59:27.838664+0000","last_unstale":"2023-11-18T20:59:35.769410+0000","last_undegraded":"2023-11-18T20:59:35.769410+0000","last_fullsized":"2023-11-18T20:59:35.769410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.785228+0000","last_change":"2023-11-18T20:59:25.458840+0000","last_active":"2023-11-18T20:59:36.785228+0000","last_peered":"2023-11-18T20:59:36.785228+0000","last_clean":"2023-11-18T20:59:36.785228+0000","last_became_active":"2023-11-18T20:59:25.458075+0000","last_became_peered":"2023-11-18T20:59:25.458075+0000","last_unstale":"2023-11-18T20:59:36.785228+0000","last_undegraded":"2023-11-18T20:59:36.785228+0000","last_fullsized":"2023-11-18T20:59:36.785228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:48.644992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.446595+0000","last_change":"2023-11-18T20:59:35.833736+0000","last_active":"2023-11-18T20:59:37.446595+0000","last_peered":"2023-11-18T20:59:37.446595+0000","last_clean":"2023-11-18T20:59:37.446595+0000","last_became_active":"2023-11-18T20:59:35.832891+0000","last_became_peered":"2023-11-18T20:59:35.832891+0000","last_unstale":"2023-11-18T20:59:37.446595+0000","last_undegraded":"2023-11-18T20:59:37.446595+0000","last_fullsized":"2023-11-18T20:59:37.446595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:12.929672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819600+0000","last_change":"2023-11-18T20:59:27.889690+0000","last_active":"2023-11-18T20:59:35.819600+0000","last_peered":"2023-11-18T20:59:35.819600+0000","last_clean":"2023-11-18T20:59:35.819600+0000","last_became_active":"2023-11-18T20:59:27.889115+0000","last_became_peered":"2023-11-18T20:59:27.889115+0000","last_unstale":"2023-11-18T20:59:35.819600+0000","last_undegraded":"2023-11-18T20:59:35.819600+0000","last_fullsized":"2023-11-18T20:59:35.819600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:57:08.995074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.310518+0000","last_change":"2023-11-18T20:59:25.460190+0000","last_active":"2023-11-18T20:59:37.310518+0000","last_peered":"2023-11-18T20:59:37.310518+0000","last_clean":"2023-11-18T20:59:37.310518+0000","last_became_active":"2023-11-18T20:59:25.459405+0000","last_became_peered":"2023-11-18T20:59:25.459405+0000","last_unstale":"2023-11-18T20:59:37.310518+0000","last_undegraded":"2023-11-18T20:59:37.310518+0000","last_fullsized":"2023-11-18T20:59:37.310518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947065+0000","last_change":"2023-11-18T20:59:35.842229+0000","last_active":"2023-11-18T20:59:37.947065+0000","last_peered":"2023-11-18T20:59:37.947065+0000","last_clean":"2023-11-18T20:59:37.947065+0000","last_became_active":"2023-11-18T20:59:35.835644+0000","last_became_peered":"2023-11-18T20:59:35.835644+0000","last_unstale":"2023-11-18T20:59:37.947065+0000","last_undegraded":"2023-11-18T20:59:37.947065+0000","last_fullsized":"2023-11-18T20:59:37.947065+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:28.212029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.822632+0000","last_change":"2023-11-18T20:59:27.890885+0000","last_active":"2023-11-18T20:59:35.822632+0000","last_peered":"2023-11-18T20:59:35.822632+0000","last_clean":"2023-11-18T20:59:35.822632+0000","last_became_active":"2023-11-18T20:59:27.890499+0000","last_became_peered":"2023-11-18T20:59:27.890499+0000","last_unstale":"2023-11-18T20:59:35.822632+0000","last_undegraded":"2023-11-18T20:59:35.822632+0000","last_fullsized":"2023-11-18T20:59:35.822632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:33:26.362872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.000719+0000","last_change":"2023-11-18T20:59:25.339255+0000","last_active":"2023-11-18T21:00:10.000719+0000","last_peered":"2023-11-18T21:00:10.000719+0000","last_clean":"2023-11-18T21:00:10.000719+0000","last_became_active":"2023-11-18T20:59:25.338020+0000","last_became_peered":"2023-11-18T20:59:25.338020+0000","last_unstale":"2023-11-18T21:00:10.000719+0000","last_undegraded":"2023-11-18T21:00:10.000719+0000","last_fullsized":"2023-11-18T21:00:10.000719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:07.183625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769201+0000","last_change":"2023-11-18T20:58:44.731742+0000","last_active":"2023-11-18T20:59:35.769201+0000","last_peered":"2023-11-18T20:59:35.769201+0000","last_clean":"2023-11-18T20:59:35.769201+0000","last_became_active":"2023-11-18T20:58:44.731076+0000","last_became_peered":"2023-11-18T20:58:44.731076+0000","last_unstale":"2023-11-18T20:59:35.769201+0000","last_undegraded":"2023-11-18T20:59:35.769201+0000","last_fullsized":"2023-11-18T20:59:35.769201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:58:42.561435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:58:42.561435+0000","last_clean_scrub_stamp":"2023-11-18T20:58:42.561435+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:48:40.458317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311487+0000","last_change":"2023-11-18T20:59:35.771637+0000","last_active":"2023-11-18T20:59:37.311487+0000","last_peered":"2023-11-18T20:59:37.311487+0000","last_clean":"2023-11-18T20:59:37.311487+0000","last_became_active":"2023-11-18T20:59:35.771146+0000","last_became_peered":"2023-11-18T20:59:35.771146+0000","last_unstale":"2023-11-18T20:59:37.311487+0000","last_undegraded":"2023-11-18T20:59:37.311487+0000","last_fullsized":"2023-11-18T20:59:37.311487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:15.290602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.697296+0000","last_change":"2023-11-18T20:59:27.684091+0000","last_active":"2023-11-18T20:59:35.697296+0000","last_peered":"2023-11-18T20:59:35.697296+0000","last_clean":"2023-11-18T20:59:35.697296+0000","last_became_active":"2023-11-18T20:59:27.683316+0000","last_became_peered":"2023-11-18T20:59:27.683316+0000","last_unstale":"2023-11-18T20:59:35.697296+0000","last_undegraded":"2023-11-18T20:59:35.697296+0000","last_fullsized":"2023-11-18T20:59:35.697296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:52:02.757528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.821966+0000","last_change":"2023-11-18T20:59:25.357198+0000","last_active":"2023-11-18T20:59:35.821966+0000","last_peered":"2023-11-18T20:59:35.821966+0000","last_clean":"2023-11-18T20:59:35.821966+0000","last_became_active":"2023-11-18T20:59:25.356883+0000","last_became_peered":"2023-11-18T20:59:25.356883+0000","last_unstale":"2023-11-18T20:59:35.821966+0000","last_undegraded":"2023-11-18T20:59:35.821966+0000","last_fullsized":"2023-11-18T20:59:35.821966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:09.508737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.949273+0000","last_change":"2023-11-18T20:59:35.834266+0000","last_active":"2023-11-18T20:59:37.949273+0000","last_peered":"2023-11-18T20:59:37.949273+0000","last_clean":"2023-11-18T20:59:37.949273+0000","last_became_active":"2023-11-18T20:59:35.833790+0000","last_became_peered":"2023-11-18T20:59:35.833790+0000","last_unstale":"2023-11-18T20:59:37.949273+0000","last_undegraded":"2023-11-18T20:59:37.949273+0000","last_fullsized":"2023-11-18T20:59:37.949273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:08.464650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759162+0000","last_change":"2023-11-18T20:59:27.873828+0000","last_active":"2023-11-18T20:59:35.759162+0000","last_peered":"2023-11-18T20:59:35.759162+0000","last_clean":"2023-11-18T20:59:35.759162+0000","last_became_active":"2023-11-18T20:59:27.872733+0000","last_became_peered":"2023-11-18T20:59:27.872733+0000","last_unstale":"2023-11-18T20:59:35.759162+0000","last_undegraded":"2023-11-18T20:59:35.759162+0000","last_fullsized":"2023-11-18T20:59:35.759162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.771910+0000","last_change":"2023-11-18T20:59:25.497529+0000","last_active":"2023-11-18T20:59:35.771910+0000","last_peered":"2023-11-18T20:59:35.771910+0000","last_clean":"2023-11-18T20:59:35.771910+0000","last_became_active":"2023-11-18T20:59:25.496694+0000","last_became_peered":"2023-11-18T20:59:25.496694+0000","last_unstale":"2023-11-18T20:59:35.771910+0000","last_undegraded":"2023-11-18T20:59:35.771910+0000","last_fullsized":"2023-11-18T20:59:35.771910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947265+0000","last_change":"2023-11-18T20:59:35.829393+0000","last_active":"2023-11-18T20:59:37.947265+0000","last_peered":"2023-11-18T20:59:37.947265+0000","last_clean":"2023-11-18T20:59:37.947265+0000","last_became_active":"2023-11-18T20:59:35.828446+0000","last_became_peered":"2023-11-18T20:59:35.828446+0000","last_unstale":"2023-11-18T20:59:37.947265+0000","last_undegraded":"2023-11-18T20:59:37.947265+0000","last_fullsized":"2023-11-18T20:59:37.947265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:33.544336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759870+0000","last_change":"2023-11-18T20:59:27.875122+0000","last_active":"2023-11-18T20:59:35.759870+0000","last_peered":"2023-11-18T20:59:35.759870+0000","last_clean":"2023-11-18T20:59:35.759870+0000","last_became_active":"2023-11-18T20:59:27.870220+0000","last_became_peered":"2023-11-18T20:59:27.870220+0000","last_unstale":"2023-11-18T20:59:35.759870+0000","last_undegraded":"2023-11-18T20:59:35.759870+0000","last_fullsized":"2023-11-18T20:59:35.759870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:39.557454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.825276+0000","last_change":"2023-11-18T20:59:25.457826+0000","last_active":"2023-11-18T20:59:35.825276+0000","last_peered":"2023-11-18T20:59:35.825276+0000","last_clean":"2023-11-18T20:59:35.825276+0000","last_became_active":"2023-11-18T20:59:25.457392+0000","last_became_peered":"2023-11-18T20:59:25.457392+0000","last_unstale":"2023-11-18T20:59:35.825276+0000","last_undegraded":"2023-11-18T20:59:35.825276+0000","last_fullsized":"2023-11-18T20:59:35.825276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:07:56.724852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.309761+0000","last_change":"2023-11-18T20:59:35.831579+0000","last_active":"2023-11-18T20:59:37.309761+0000","last_peered":"2023-11-18T20:59:37.309761+0000","last_clean":"2023-11-18T20:59:37.309761+0000","last_became_active":"2023-11-18T20:59:35.831147+0000","last_became_peered":"2023-11-18T20:59:35.831147+0000","last_unstale":"2023-11-18T20:59:37.309761+0000","last_undegraded":"2023-11-18T20:59:37.309761+0000","last_fullsized":"2023-11-18T20:59:37.309761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:08.730686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746569+0000","last_change":"2023-11-18T20:59:27.895618+0000","last_active":"2023-11-18T20:59:35.746569+0000","last_peered":"2023-11-18T20:59:35.746569+0000","last_clean":"2023-11-18T20:59:35.746569+0000","last_became_active":"2023-11-18T20:59:27.894931+0000","last_became_peered":"2023-11-18T20:59:27.894931+0000","last_unstale":"2023-11-18T20:59:35.746569+0000","last_undegraded":"2023-11-18T20:59:35.746569+0000","last_fullsized":"2023-11-18T20:59:35.746569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:33.165546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759903+0000","last_change":"2023-11-18T20:59:25.458603+0000","last_active":"2023-11-18T20:59:35.759903+0000","last_peered":"2023-11-18T20:59:35.759903+0000","last_clean":"2023-11-18T20:59:35.759903+0000","last_became_active":"2023-11-18T20:59:25.457932+0000","last_became_peered":"2023-11-18T20:59:25.457932+0000","last_unstale":"2023-11-18T20:59:35.759903+0000","last_undegraded":"2023-11-18T20:59:35.759903+0000","last_fullsized":"2023-11-18T20:59:35.759903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.948121+0000","last_change":"2023-11-18T20:59:35.832209+0000","last_active":"2023-11-18T20:59:37.948121+0000","last_peered":"2023-11-18T20:59:37.948121+0000","last_clean":"2023-11-18T20:59:37.948121+0000","last_became_active":"2023-11-18T20:59:35.831804+0000","last_became_peered":"2023-11-18T20:59:35.831804+0000","last_unstale":"2023-11-18T20:59:37.948121+0000","last_undegraded":"2023-11-18T20:59:37.948121+0000","last_fullsized":"2023-11-18T20:59:37.948121+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:13.050905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.695775+0000","last_change":"2023-11-18T20:59:27.884733+0000","last_active":"2023-11-18T20:59:35.695775+0000","last_peered":"2023-11-18T20:59:35.695775+0000","last_clean":"2023-11-18T20:59:35.695775+0000","last_became_active":"2023-11-18T20:59:27.884143+0000","last_became_peered":"2023-11-18T20:59:27.884143+0000","last_unstale":"2023-11-18T20:59:35.695775+0000","last_undegraded":"2023-11-18T20:59:35.695775+0000","last_fullsized":"2023-11-18T20:59:35.695775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:32.466816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.824405+0000","last_change":"2023-11-18T20:59:25.362761+0000","last_active":"2023-11-18T20:59:35.824405+0000","last_peered":"2023-11-18T20:59:35.824405+0000","last_clean":"2023-11-18T20:59:35.824405+0000","last_became_active":"2023-11-18T20:59:25.362350+0000","last_became_peered":"2023-11-18T20:59:25.362350+0000","last_unstale":"2023-11-18T20:59:35.824405+0000","last_undegraded":"2023-11-18T20:59:35.824405+0000","last_fullsized":"2023-11-18T20:59:35.824405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:32:54.741681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947512+0000","last_change":"2023-11-18T20:59:35.836797+0000","last_active":"2023-11-18T20:59:37.947512+0000","last_peered":"2023-11-18T20:59:37.947512+0000","last_clean":"2023-11-18T20:59:37.947512+0000","last_became_active":"2023-11-18T20:59:35.834153+0000","last_became_peered":"2023-11-18T20:59:35.834153+0000","last_unstale":"2023-11-18T20:59:37.947512+0000","last_undegraded":"2023-11-18T20:59:37.947512+0000","last_fullsized":"2023-11-18T20:59:37.947512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:18.639780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.768765+0000","last_change":"2023-11-18T20:59:27.841401+0000","last_active":"2023-11-18T20:59:35.768765+0000","last_peered":"2023-11-18T20:59:35.768765+0000","last_clean":"2023-11-18T20:59:35.768765+0000","last_became_active":"2023-11-18T20:59:27.840852+0000","last_became_peered":"2023-11-18T20:59:27.840852+0000","last_unstale":"2023-11-18T20:59:35.768765+0000","last_undegraded":"2023-11-18T20:59:35.768765+0000","last_fullsized":"2023-11-18T20:59:35.768765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.757878+0000","last_change":"2023-11-18T20:59:25.351707+0000","last_active":"2023-11-18T20:59:35.757878+0000","last_peered":"2023-11-18T20:59:35.757878+0000","last_clean":"2023-11-18T20:59:35.757878+0000","last_became_active":"2023-11-18T20:59:25.351149+0000","last_became_peered":"2023-11-18T20:59:25.351149+0000","last_unstale":"2023-11-18T20:59:35.757878+0000","last_undegraded":"2023-11-18T20:59:35.757878+0000","last_fullsized":"2023-11-18T20:59:35.757878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:37:55.630369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947503+0000","last_change":"2023-11-18T20:59:35.844046+0000","last_active":"2023-11-18T20:59:37.947503+0000","last_peered":"2023-11-18T20:59:37.947503+0000","last_clean":"2023-11-18T20:59:37.947503+0000","last_became_active":"2023-11-18T20:59:35.843208+0000","last_became_peered":"2023-11-18T20:59:35.843208+0000","last_unstale":"2023-11-18T20:59:37.947503+0000","last_undegraded":"2023-11-18T20:59:37.947503+0000","last_fullsized":"2023-11-18T20:59:37.947503+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:21:06.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696069+0000","last_change":"2023-11-18T20:59:27.866997+0000","last_active":"2023-11-18T20:59:35.696069+0000","last_peered":"2023-11-18T20:59:35.696069+0000","last_clean":"2023-11-18T20:59:35.696069+0000","last_became_active":"2023-11-18T20:59:27.866233+0000","last_became_peered":"2023-11-18T20:59:27.866233+0000","last_unstale":"2023-11-18T20:59:35.696069+0000","last_undegraded":"2023-11-18T20:59:35.696069+0000","last_fullsized":"2023-11-18T20:59:35.696069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:19.998748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:09.999828+0000","last_change":"2023-11-18T20:59:25.362589+0000","last_active":"2023-11-18T21:00:09.999828+0000","last_peered":"2023-11-18T21:00:09.999828+0000","last_clean":"2023-11-18T21:00:09.999828+0000","last_became_active":"2023-11-18T20:59:25.362287+0000","last_became_peered":"2023-11-18T20:59:25.362287+0000","last_unstale":"2023-11-18T21:00:09.999828+0000","last_undegraded":"2023-11-18T21:00:09.999828+0000","last_fullsized":"2023-11-18T21:00:09.999828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:24.791294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.446156+0000","last_change":"2023-11-18T20:59:35.846859+0000","last_active":"2023-11-18T20:59:37.446156+0000","last_peered":"2023-11-18T20:59:37.446156+0000","last_clean":"2023-11-18T20:59:37.446156+0000","last_became_active":"2023-11-18T20:59:35.845378+0000","last_became_peered":"2023-11-18T20:59:35.845378+0000","last_unstale":"2023-11-18T20:59:37.446156+0000","last_undegraded":"2023-11-18T20:59:37.446156+0000","last_fullsized":"2023-11-18T20:59:37.446156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.820183+0000","last_change":"2023-11-18T20:59:27.863967+0000","last_active":"2023-11-18T20:59:35.820183+0000","last_peered":"2023-11-18T20:59:35.820183+0000","last_clean":"2023-11-18T20:59:35.820183+0000","last_became_active":"2023-11-18T20:59:27.863435+0000","last_became_peered":"2023-11-18T20:59:27.863435+0000","last_unstale":"2023-11-18T20:59:35.820183+0000","last_undegraded":"2023-11-18T20:59:35.820183+0000","last_fullsized":"2023-11-18T20:59:35.820183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:04.837624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.225905+0000","last_change":"2023-11-18T20:59:25.361677+0000","last_active":"2023-11-18T21:00:10.225905+0000","last_peered":"2023-11-18T21:00:10.225905+0000","last_clean":"2023-11-18T21:00:10.225905+0000","last_became_active":"2023-11-18T20:59:25.361313+0000","last_became_peered":"2023-11-18T20:59:25.361313+0000","last_unstale":"2023-11-18T21:00:10.225905+0000","last_undegraded":"2023-11-18T21:00:10.225905+0000","last_fullsized":"2023-11-18T21:00:10.225905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311637+0000","last_change":"2023-11-18T20:59:35.832893+0000","last_active":"2023-11-18T20:59:37.311637+0000","last_peered":"2023-11-18T20:59:37.311637+0000","last_clean":"2023-11-18T20:59:37.311637+0000","last_became_active":"2023-11-18T20:59:35.832562+0000","last_became_peered":"2023-11-18T20:59:35.832562+0000","last_unstale":"2023-11-18T20:59:37.311637+0000","last_undegraded":"2023-11-18T20:59:37.311637+0000","last_fullsized":"2023-11-18T20:59:37.311637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:53:05.127511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759692+0000","last_change":"2023-11-18T20:59:27.874128+0000","last_active":"2023-11-18T20:59:35.759692+0000","last_peered":"2023-11-18T20:59:35.759692+0000","last_clean":"2023-11-18T20:59:35.759692+0000","last_became_active":"2023-11-18T20:59:27.865971+0000","last_became_peered":"2023-11-18T20:59:27.865971+0000","last_unstale":"2023-11-18T20:59:35.759692+0000","last_undegraded":"2023-11-18T20:59:35.759692+0000","last_fullsized":"2023-11-18T20:59:35.759692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.005456+0000","last_change":"2023-11-18T20:59:25.350262+0000","last_active":"2023-11-18T21:00:10.005456+0000","last_peered":"2023-11-18T21:00:10.005456+0000","last_clean":"2023-11-18T21:00:10.005456+0000","last_became_active":"2023-11-18T20:59:25.349577+0000","last_became_peered":"2023-11-18T20:59:25.349577+0000","last_unstale":"2023-11-18T21:00:10.005456+0000","last_undegraded":"2023-11-18T21:00:10.005456+0000","last_fullsized":"2023-11-18T21:00:10.005456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.688756+0000","last_change":"2023-11-18T20:59:35.849720+0000","last_active":"2023-11-18T20:59:36.688756+0000","last_peered":"2023-11-18T20:59:36.688756+0000","last_clean":"2023-11-18T20:59:36.688756+0000","last_became_active":"2023-11-18T20:59:35.848000+0000","last_became_peered":"2023-11-18T20:59:35.848000+0000","last_unstale":"2023-11-18T20:59:36.688756+0000","last_undegraded":"2023-11-18T20:59:36.688756+0000","last_fullsized":"2023-11-18T20:59:36.688756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:41:54.553006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696849+0000","last_change":"2023-11-18T20:59:27.891817+0000","last_active":"2023-11-18T20:59:35.696849+0000","last_peered":"2023-11-18T20:59:35.696849+0000","last_clean":"2023-11-18T20:59:35.696849+0000","last_became_active":"2023-11-18T20:59:27.891260+0000","last_became_peered":"2023-11-18T20:59:27.891260+0000","last_unstale":"2023-11-18T20:59:35.696849+0000","last_undegraded":"2023-11-18T20:59:35.696849+0000","last_fullsized":"2023-11-18T20:59:35.696849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:25.331055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.786039+0000","last_change":"2023-11-18T20:59:25.363983+0000","last_active":"2023-11-18T20:59:36.786039+0000","last_peered":"2023-11-18T20:59:36.786039+0000","last_clean":"2023-11-18T20:59:36.786039+0000","last_became_active":"2023-11-18T20:59:25.363289+0000","last_became_peered":"2023-11-18T20:59:25.363289+0000","last_unstale":"2023-11-18T20:59:36.786039+0000","last_undegraded":"2023-11-18T20:59:36.786039+0000","last_fullsized":"2023-11-18T20:59:36.786039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.950378+0000","last_change":"2023-11-18T20:59:35.771712+0000","last_active":"2023-11-18T20:59:37.950378+0000","last_peered":"2023-11-18T20:59:37.950378+0000","last_clean":"2023-11-18T20:59:37.950378+0000","last_became_active":"2023-11-18T20:59:35.771263+0000","last_became_peered":"2023-11-18T20:59:35.771263+0000","last_unstale":"2023-11-18T20:59:37.950378+0000","last_undegraded":"2023-11-18T20:59:37.950378+0000","last_fullsized":"2023-11-18T20:59:37.950378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.772920+0000","last_change":"2023-11-18T20:59:27.834172+0000","last_active":"2023-11-18T20:59:35.772920+0000","last_peered":"2023-11-18T20:59:35.772920+0000","last_clean":"2023-11-18T20:59:35.772920+0000","last_became_active":"2023-11-18T20:59:27.832589+0000","last_became_peered":"2023-11-18T20:59:27.832589+0000","last_unstale":"2023-11-18T20:59:35.772920+0000","last_undegraded":"2023-11-18T20:59:35.772920+0000","last_fullsized":"2023-11-18T20:59:35.772920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.169769+0000","last_change":"2023-11-18T20:59:25.494236+0000","last_active":"2023-11-18T21:00:10.169769+0000","last_peered":"2023-11-18T21:00:10.169769+0000","last_clean":"2023-11-18T21:00:10.169769+0000","last_became_active":"2023-11-18T20:59:25.493373+0000","last_became_peered":"2023-11-18T20:59:25.493373+0000","last_unstale":"2023-11-18T21:00:10.169769+0000","last_undegraded":"2023-11-18T21:00:10.169769+0000","last_fullsized":"2023-11-18T21:00:10.169769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:13.859109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.784645+0000","last_change":"2023-11-18T20:59:35.773319+0000","last_active":"2023-11-18T20:59:36.784645+0000","last_peered":"2023-11-18T20:59:36.784645+0000","last_clean":"2023-11-18T20:59:36.784645+0000","last_became_active":"2023-11-18T20:59:35.772563+0000","last_became_peered":"2023-11-18T20:59:35.772563+0000","last_unstale":"2023-11-18T20:59:36.784645+0000","last_undegraded":"2023-11-18T20:59:36.784645+0000","last_fullsized":"2023-11-18T20:59:36.784645+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:12.287749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746454+0000","last_change":"2023-11-18T20:59:27.892789+0000","last_active":"2023-11-18T20:59:35.746454+0000","last_peered":"2023-11-18T20:59:35.746454+0000","last_clean":"2023-11-18T20:59:35.746454+0000","last_became_active":"2023-11-18T20:59:27.891883+0000","last_became_peered":"2023-11-18T20:59:27.891883+0000","last_unstale":"2023-11-18T20:59:35.746454+0000","last_undegraded":"2023-11-18T20:59:35.746454+0000","last_fullsized":"2023-11-18T20:59:35.746454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:12.020475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.220320+0000","last_change":"2023-11-18T20:59:25.497309+0000","last_active":"2023-11-18T21:00:10.220320+0000","last_peered":"2023-11-18T21:00:10.220320+0000","last_clean":"2023-11-18T21:00:10.220320+0000","last_became_active":"2023-11-18T20:59:25.496680+0000","last_became_peered":"2023-11-18T20:59:25.496680+0000","last_unstale":"2023-11-18T21:00:10.220320+0000","last_undegraded":"2023-11-18T21:00:10.220320+0000","last_fullsized":"2023-11-18T21:00:10.220320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.688376+0000","last_change":"2023-11-18T20:59:35.842258+0000","last_active":"2023-11-18T20:59:36.688376+0000","last_peered":"2023-11-18T20:59:36.688376+0000","last_clean":"2023-11-18T20:59:36.688376+0000","last_became_active":"2023-11-18T20:59:35.838830+0000","last_became_peered":"2023-11-18T20:59:35.838830+0000","last_unstale":"2023-11-18T20:59:36.688376+0000","last_undegraded":"2023-11-18T20:59:36.688376+0000","last_fullsized":"2023-11-18T20:59:36.688376+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:12:39.697374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.689568+0000","last_change":"2023-11-18T20:59:35.839178+0000","last_active":"2023-11-18T20:59:36.689568+0000","last_peered":"2023-11-18T20:59:36.689568+0000","last_clean":"2023-11-18T20:59:36.689568+0000","last_became_active":"2023-11-18T20:59:35.838375+0000","last_became_peered":"2023-11-18T20:59:35.838375+0000","last_unstale":"2023-11-18T20:59:36.689568+0000","last_undegraded":"2023-11-18T20:59:36.689568+0000","last_fullsized":"2023-11-18T20:59:36.689568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:56:09.565932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.823342+0000","last_change":"2023-11-18T20:59:27.689539+0000","last_active":"2023-11-18T20:59:35.823342+0000","last_peered":"2023-11-18T20:59:35.823342+0000","last_clean":"2023-11-18T20:59:35.823342+0000","last_became_active":"2023-11-18T20:59:27.688522+0000","last_became_peered":"2023-11-18T20:59:27.688522+0000","last_unstale":"2023-11-18T20:59:35.823342+0000","last_undegraded":"2023-11-18T20:59:35.823342+0000","last_fullsized":"2023-11-18T20:59:35.823342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:06:48.337696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.310238+0000","last_change":"2023-11-18T20:59:25.494125+0000","last_active":"2023-11-18T20:59:37.310238+0000","last_peered":"2023-11-18T20:59:37.310238+0000","last_clean":"2023-11-18T20:59:37.310238+0000","last_became_active":"2023-11-18T20:59:25.493357+0000","last_became_peered":"2023-11-18T20:59:25.493357+0000","last_unstale":"2023-11-18T20:59:37.310238+0000","last_undegraded":"2023-11-18T20:59:37.310238+0000","last_fullsized":"2023-11-18T20:59:37.310238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311079+0000","last_change":"2023-11-18T20:59:35.776653+0000","last_active":"2023-11-18T20:59:37.311079+0000","last_peered":"2023-11-18T20:59:37.311079+0000","last_clean":"2023-11-18T20:59:37.311079+0000","last_became_active":"2023-11-18T20:59:35.776138+0000","last_became_peered":"2023-11-18T20:59:35.776138+0000","last_unstale":"2023-11-18T20:59:37.311079+0000","last_undegraded":"2023-11-18T20:59:37.311079+0000","last_fullsized":"2023-11-18T20:59:37.311079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:08:25.933599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770015+0000","last_change":"2023-11-18T20:59:27.860987+0000","last_active":"2023-11-18T20:59:35.770015+0000","last_peered":"2023-11-18T20:59:35.770015+0000","last_clean":"2023-11-18T20:59:35.770015+0000","last_became_active":"2023-11-18T20:59:27.860537+0000","last_became_peered":"2023-11-18T20:59:27.860537+0000","last_unstale":"2023-11-18T20:59:35.770015+0000","last_undegraded":"2023-11-18T20:59:35.770015+0000","last_fullsized":"2023-11-18T20:59:35.770015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819761+0000","last_change":"2023-11-18T20:59:25.354967+0000","last_active":"2023-11-18T20:59:35.819761+0000","last_peered":"2023-11-18T20:59:35.819761+0000","last_clean":"2023-11-18T20:59:35.819761+0000","last_became_active":"2023-11-18T20:59:25.354690+0000","last_became_peered":"2023-11-18T20:59:25.354690+0000","last_unstale":"2023-11-18T20:59:35.819761+0000","last_undegraded":"2023-11-18T20:59:35.819761+0000","last_fullsized":"2023-11-18T20:59:35.819761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:50.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696429+0000","last_change":"2023-11-18T20:59:25.346493+0000","last_active":"2023-11-18T20:59:35.696429+0000","last_peered":"2023-11-18T20:59:35.696429+0000","last_clean":"2023-11-18T20:59:35.696429+0000","last_became_active":"2023-11-18T20:59:25.346192+0000","last_became_peered":"2023-11-18T20:59:25.346192+0000","last_unstale":"2023-11-18T20:59:35.696429+0000","last_undegraded":"2023-11-18T20:59:35.696429+0000","last_fullsized":"2023-11-18T20:59:35.696429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:30.162962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819222+0000","last_change":"2023-11-18T20:59:27.868460+0000","last_active":"2023-11-18T20:59:35.819222+0000","last_peered":"2023-11-18T20:59:35.819222+0000","last_clean":"2023-11-18T20:59:35.819222+0000","last_became_active":"2023-11-18T20:59:27.867886+0000","last_became_peered":"2023-11-18T20:59:27.867886+0000","last_unstale":"2023-11-18T20:59:35.819222+0000","last_undegraded":"2023-11-18T20:59:35.819222+0000","last_fullsized":"2023-11-18T20:59:35.819222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:39.647294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.688950+0000","last_change":"2023-11-18T20:59:35.851163+0000","last_active":"2023-11-18T20:59:36.688950+0000","last_peered":"2023-11-18T20:59:36.688950+0000","last_clean":"2023-11-18T20:59:36.688950+0000","last_became_active":"2023-11-18T20:59:35.850427+0000","last_became_peered":"2023-11-18T20:59:35.850427+0000","last_unstale":"2023-11-18T20:59:36.688950+0000","last_undegraded":"2023-11-18T20:59:36.688950+0000","last_fullsized":"2023-11-18T20:59:36.688950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:20.729626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.175066+0000","last_change":"2023-11-18T20:59:25.462276+0000","last_active":"2023-11-18T21:00:10.175066+0000","last_peered":"2023-11-18T21:00:10.175066+0000","last_clean":"2023-11-18T21:00:10.175066+0000","last_became_active":"2023-11-18T20:59:25.460449+0000","last_became_peered":"2023-11-18T20:59:25.460449+0000","last_unstale":"2023-11-18T21:00:10.175066+0000","last_undegraded":"2023-11-18T21:00:10.175066+0000","last_fullsized":"2023-11-18T21:00:10.175066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:25:57.950600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.768671+0000","last_change":"2023-11-18T20:59:27.841332+0000","last_active":"2023-11-18T20:59:35.768671+0000","last_peered":"2023-11-18T20:59:35.768671+0000","last_clean":"2023-11-18T20:59:35.768671+0000","last_became_active":"2023-11-18T20:59:27.840528+0000","last_became_peered":"2023-11-18T20:59:27.840528+0000","last_unstale":"2023-11-18T20:59:35.768671+0000","last_undegraded":"2023-11-18T20:59:35.768671+0000","last_fullsized":"2023-11-18T20:59:35.768671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.785624+0000","last_change":"2023-11-18T20:59:35.776844+0000","last_active":"2023-11-18T20:59:36.785624+0000","last_peered":"2023-11-18T20:59:36.785624+0000","last_clean":"2023-11-18T20:59:36.785624+0000","last_became_active":"2023-11-18T20:59:35.775977+0000","last_became_peered":"2023-11-18T20:59:35.775977+0000","last_unstale":"2023-11-18T20:59:36.785624+0000","last_undegraded":"2023-11-18T20:59:36.785624+0000","last_fullsized":"2023-11-18T20:59:36.785624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:06:00.187752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.745152+0000","last_change":"2023-11-18T20:59:27.888673+0000","last_active":"2023-11-18T20:59:35.745152+0000","last_peered":"2023-11-18T20:59:35.745152+0000","last_clean":"2023-11-18T20:59:35.745152+0000","last_became_active":"2023-11-18T20:59:27.887716+0000","last_became_peered":"2023-11-18T20:59:27.887716+0000","last_unstale":"2023-11-18T20:59:35.745152+0000","last_undegraded":"2023-11-18T20:59:35.745152+0000","last_fullsized":"2023-11-18T20:59:35.745152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.680928+0000","last_change":"2023-11-18T20:59:27.684810+0000","last_active":"2023-11-18T20:59:35.680928+0000","last_peered":"2023-11-18T20:59:35.680928+0000","last_clean":"2023-11-18T20:59:35.680928+0000","last_became_active":"2023-11-18T20:59:27.680712+0000","last_became_peered":"2023-11-18T20:59:27.680712+0000","last_unstale":"2023-11-18T20:59:35.680928+0000","last_undegraded":"2023-11-18T20:59:35.680928+0000","last_fullsized":"2023-11-18T20:59:35.680928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696242+0000","last_change":"2023-11-18T20:59:27.835960+0000","last_active":"2023-11-18T20:59:35.696242+0000","last_peered":"2023-11-18T20:59:35.696242+0000","last_clean":"2023-11-18T20:59:35.696242+0000","last_became_active":"2023-11-18T20:59:27.835120+0000","last_became_peered":"2023-11-18T20:59:27.835120+0000","last_unstale":"2023-11-18T20:59:35.696242+0000","last_undegraded":"2023-11-18T20:59:35.696242+0000","last_fullsized":"2023-11-18T20:59:35.696242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:35:51.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770656+0000","last_change":"2023-11-18T20:59:27.833652+0000","last_active":"2023-11-18T20:59:35.770656+0000","last_peered":"2023-11-18T20:59:35.770656+0000","last_clean":"2023-11-18T20:59:35.770656+0000","last_became_active":"2023-11-18T20:59:27.833049+0000","last_became_peered":"2023-11-18T20:59:27.833049+0000","last_unstale":"2023-11-18T20:59:35.770656+0000","last_undegraded":"2023-11-18T20:59:35.770656+0000","last_fullsized":"2023-11-18T20:59:35.770656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:23.262919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.821721+0000","last_change":"2023-11-18T20:59:27.878824+0000","last_active":"2023-11-18T20:59:35.821721+0000","last_peered":"2023-11-18T20:59:35.821721+0000","last_clean":"2023-11-18T20:59:35.821721+0000","last_became_active":"2023-11-18T20:59:27.878353+0000","last_became_peered":"2023-11-18T20:59:27.878353+0000","last_unstale":"2023-11-18T20:59:35.821721+0000","last_undegraded":"2023-11-18T20:59:35.821721+0000","last_fullsized":"2023-11-18T20:59:35.821721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:04.074467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.820381+0000","last_change":"2023-11-18T20:59:27.866570+0000","last_active":"2023-11-18T20:59:35.820381+0000","last_peered":"2023-11-18T20:59:35.820381+0000","last_clean":"2023-11-18T20:59:35.820381+0000","last_became_active":"2023-11-18T20:59:27.866165+0000","last_became_peered":"2023-11-18T20:59:27.866165+0000","last_unstale":"2023-11-18T20:59:35.820381+0000","last_undegraded":"2023-11-18T20:59:35.820381+0000","last_fullsized":"2023-11-18T20:59:35.820381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:05:51.974471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746338+0000","last_change":"2023-11-18T20:59:27.895340+0000","last_active":"2023-11-18T20:59:35.746338+0000","last_peered":"2023-11-18T20:59:35.746338+0000","last_clean":"2023-11-18T20:59:35.746338+0000","last_became_active":"2023-11-18T20:59:27.893918+0000","last_became_peered":"2023-11-18T20:59:27.893918+0000","last_unstale":"2023-11-18T20:59:35.746338+0000","last_undegraded":"2023-11-18T20:59:35.746338+0000","last_fullsized":"2023-11-18T20:59:35.746338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:11.899550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.772271+0000","last_change":"2023-11-18T20:59:27.839127+0000","last_active":"2023-11-18T20:59:35.772271+0000","last_peered":"2023-11-18T20:59:35.772271+0000","last_clean":"2023-11-18T20:59:35.772271+0000","last_became_active":"2023-11-18T20:59:27.838509+0000","last_became_peered":"2023-11-18T20:59:27.838509+0000","last_unstale":"2023-11-18T20:59:35.772271+0000","last_undegraded":"2023-11-18T20:59:35.772271+0000","last_fullsized":"2023-11-18T20:59:35.772271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696213+0000","last_change":"2023-11-18T20:59:27.836167+0000","last_active":"2023-11-18T20:59:35.696213+0000","last_peered":"2023-11-18T20:59:35.696213+0000","last_clean":"2023-11-18T20:59:35.696213+0000","last_became_active":"2023-11-18T20:59:27.835226+0000","last_became_peered":"2023-11-18T20:59:27.835226+0000","last_unstale":"2023-11-18T20:59:35.696213+0000","last_undegraded":"2023-11-18T20:59:35.696213+0000","last_fullsized":"2023-11-18T20:59:35.696213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:23:46.608216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770190+0000","last_change":"2023-11-18T20:59:27.889937+0000","last_active":"2023-11-18T20:59:35.770190+0000","last_peered":"2023-11-18T20:59:35.770190+0000","last_clean":"2023-11-18T20:59:35.770190+0000","last_became_active":"2023-11-18T20:59:27.889325+0000","last_became_peered":"2023-11-18T20:59:27.889325+0000","last_unstale":"2023-11-18T20:59:35.770190+0000","last_undegraded":"2023-11-18T20:59:35.770190+0000","last_fullsized":"2023-11-18T20:59:35.770190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:39.674424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.768585+0000","last_change":"2023-11-18T20:59:27.867439+0000","last_active":"2023-11-18T20:59:35.768585+0000","last_peered":"2023-11-18T20:59:35.768585+0000","last_clean":"2023-11-18T20:59:35.768585+0000","last_became_active":"2023-11-18T20:59:27.866609+0000","last_became_peered":"2023-11-18T20:59:27.866609+0000","last_unstale":"2023-11-18T20:59:35.768585+0000","last_undegraded":"2023-11-18T20:59:35.768585+0000","last_fullsized":"2023-11-18T20:59:35.768585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:46:49.094141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819017+0000","last_change":"2023-11-18T20:59:27.883416+0000","last_active":"2023-11-18T20:59:35.819017+0000","last_peered":"2023-11-18T20:59:35.819017+0000","last_clean":"2023-11-18T20:59:35.819017+0000","last_became_active":"2023-11-18T20:59:27.882976+0000","last_became_peered":"2023-11-18T20:59:27.882976+0000","last_unstale":"2023-11-18T20:59:35.819017+0000","last_undegraded":"2023-11-18T20:59:35.819017+0000","last_fullsized":"2023-11-18T20:59:35.819017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:12.611142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759028+0000","last_change":"2023-11-18T20:59:27.873520+0000","last_active":"2023-11-18T20:59:35.759028+0000","last_peered":"2023-11-18T20:59:35.759028+0000","last_clean":"2023-11-18T20:59:35.759028+0000","last_became_active":"2023-11-18T20:59:27.872627+0000","last_became_peered":"2023-11-18T20:59:27.872627+0000","last_unstale":"2023-11-18T20:59:35.759028+0000","last_undegraded":"2023-11-18T20:59:35.759028+0000","last_fullsized":"2023-11-18T20:59:35.759028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.697486+0000","last_change":"2023-11-18T20:59:27.687118+0000","last_active":"2023-11-18T20:59:35.697486+0000","last_peered":"2023-11-18T20:59:35.697486+0000","last_clean":"2023-11-18T20:59:35.697486+0000","last_became_active":"2023-11-18T20:59:27.686311+0000","last_became_peered":"2023-11-18T20:59:27.686311+0000","last_unstale":"2023-11-18T20:59:35.697486+0000","last_undegraded":"2023-11-18T20:59:35.697486+0000","last_fullsized":"2023-11-18T20:59:35.697486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:25:27.490214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.681564+0000","last_change":"2023-11-18T20:59:27.892404+0000","last_active":"2023-11-18T20:59:35.681564+0000","last_peered":"2023-11-18T20:59:35.681564+0000","last_clean":"2023-11-18T20:59:35.681564+0000","last_became_active":"2023-11-18T20:59:27.891767+0000","last_became_peered":"2023-11-18T20:59:27.891767+0000","last_unstale":"2023-11-18T20:59:35.681564+0000","last_undegraded":"2023-11-18T20:59:35.681564+0000","last_fullsized":"2023-11-18T20:59:35.681564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.698022+0000","last_change":"2023-11-18T20:59:27.866920+0000","last_active":"2023-11-18T20:59:35.698022+0000","last_peered":"2023-11-18T20:59:35.698022+0000","last_clean":"2023-11-18T20:59:35.698022+0000","last_became_active":"2023-11-18T20:59:27.866153+0000","last_became_peered":"2023-11-18T20:59:27.866153+0000","last_unstale":"2023-11-18T20:59:35.698022+0000","last_undegraded":"2023-11-18T20:59:35.698022+0000","last_fullsized":"2023-11-18T20:59:35.698022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:50:43.894365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696090+0000","last_change":"2023-11-18T20:59:27.890399+0000","last_active":"2023-11-18T20:59:35.696090+0000","last_peered":"2023-11-18T20:59:35.696090+0000","last_clean":"2023-11-18T20:59:35.696090+0000","last_became_active":"2023-11-18T20:59:27.889704+0000","last_became_peered":"2023-11-18T20:59:27.889704+0000","last_unstale":"2023-11-18T20:59:35.696090+0000","last_undegraded":"2023-11-18T20:59:35.696090+0000","last_fullsized":"2023-11-18T20:59:35.696090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:34:37.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769850+0000","last_change":"2023-11-18T20:59:27.871794+0000","last_active":"2023-11-18T20:59:35.769850+0000","last_peered":"2023-11-18T20:59:35.769850+0000","last_clean":"2023-11-18T20:59:35.769850+0000","last_became_active":"2023-11-18T20:59:27.871337+0000","last_became_peered":"2023-11-18T20:59:27.871337+0000","last_unstale":"2023-11-18T20:59:35.769850+0000","last_undegraded":"2023-11-18T20:59:35.769850+0000","last_fullsized":"2023-11-18T20:59:35.769850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:16.370847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819983+0000","last_change":"2023-11-18T20:59:27.867288+0000","last_active":"2023-11-18T20:59:35.819983+0000","last_peered":"2023-11-18T20:59:35.819983+0000","last_clean":"2023-11-18T20:59:35.819983+0000","last_became_active":"2023-11-18T20:59:27.866560+0000","last_became_peered":"2023-11-18T20:59:27.866560+0000","last_unstale":"2023-11-18T20:59:35.819983+0000","last_undegraded":"2023-11-18T20:59:35.819983+0000","last_fullsized":"2023-11-18T20:59:35.819983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.823432+0000","last_change":"2023-11-18T20:59:27.878944+0000","last_active":"2023-11-18T20:59:35.823432+0000","last_peered":"2023-11-18T20:59:35.823432+0000","last_clean":"2023-11-18T20:59:35.823432+0000","last_became_active":"2023-11-18T20:59:27.878485+0000","last_became_peered":"2023-11-18T20:59:27.878485+0000","last_unstale":"2023-11-18T20:59:35.823432+0000","last_undegraded":"2023-11-18T20:59:35.823432+0000","last_fullsized":"2023-11-18T20:59:35.823432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:04.749189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.758902+0000","last_change":"2023-11-18T20:59:27.874019+0000","last_active":"2023-11-18T20:59:35.758902+0000","last_peered":"2023-11-18T20:59:35.758902+0000","last_clean":"2023-11-18T20:59:35.758902+0000","last_became_active":"2023-11-18T20:59:27.873255+0000","last_became_peered":"2023-11-18T20:59:27.873255+0000","last_unstale":"2023-11-18T20:59:35.758902+0000","last_undegraded":"2023-11-18T20:59:35.758902+0000","last_fullsized":"2023-11-18T20:59:35.758902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759661+0000","last_change":"2023-11-18T20:59:27.868086+0000","last_active":"2023-11-18T20:59:35.759661+0000","last_peered":"2023-11-18T20:59:35.759661+0000","last_clean":"2023-11-18T20:59:35.759661+0000","last_became_active":"2023-11-18T20:59:27.866901+0000","last_became_peered":"2023-11-18T20:59:27.866901+0000","last_unstale":"2023-11-18T20:59:35.759661+0000","last_undegraded":"2023-11-18T20:59:35.759661+0000","last_fullsized":"2023-11-18T20:59:35.759661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759791+0000","last_change":"2023-11-18T20:59:27.888617+0000","last_active":"2023-11-18T20:59:35.759791+0000","last_peered":"2023-11-18T20:59:35.759791+0000","last_clean":"2023-11-18T20:59:35.759791+0000","last_became_active":"2023-11-18T20:59:27.888068+0000","last_became_peered":"2023-11-18T20:59:27.888068+0000","last_unstale":"2023-11-18T20:59:35.759791+0000","last_undegraded":"2023-11-18T20:59:35.759791+0000","last_fullsized":"2023-11-18T20:59:35.759791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:53.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769443+0000","last_change":"2023-11-18T20:59:27.684428+0000","last_active":"2023-11-18T20:59:35.769443+0000","last_peered":"2023-11-18T20:59:35.769443+0000","last_clean":"2023-11-18T20:59:35.769443+0000","last_became_active":"2023-11-18T20:59:27.682936+0000","last_became_peered":"2023-11-18T20:59:27.682936+0000","last_unstale":"2023-11-18T20:59:35.769443+0000","last_undegraded":"2023-11-18T20:59:35.769443+0000","last_fullsized":"2023-11-18T20:59:35.769443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:52.955875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769402+0000","last_change":"2023-11-18T20:59:27.865937+0000","last_active":"2023-11-18T20:59:35.769402+0000","last_peered":"2023-11-18T20:59:35.769402+0000","last_clean":"2023-11-18T20:59:35.769402+0000","last_became_active":"2023-11-18T20:59:27.865401+0000","last_became_peered":"2023-11-18T20:59:27.865401+0000","last_unstale":"2023-11-18T20:59:35.769402+0000","last_undegraded":"2023-11-18T20:59:35.769402+0000","last_fullsized":"2023-11-18T20:59:35.769402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:00.251369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.757858+0000","last_change":"2023-11-18T20:59:27.865748+0000","last_active":"2023-11-18T20:59:35.757858+0000","last_peered":"2023-11-18T20:59:35.757858+0000","last_clean":"2023-11-18T20:59:35.757858+0000","last_became_active":"2023-11-18T20:59:27.864956+0000","last_became_peered":"2023-11-18T20:59:27.864956+0000","last_unstale":"2023-11-18T20:59:35.757858+0000","last_undegraded":"2023-11-18T20:59:35.757858+0000","last_fullsized":"2023-11-18T20:59:35.757858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746209+0000","last_change":"2023-11-18T20:59:27.889838+0000","last_active":"2023-11-18T20:59:35.746209+0000","last_peered":"2023-11-18T20:59:35.746209+0000","last_clean":"2023-11-18T20:59:35.746209+0000","last_became_active":"2023-11-18T20:59:27.889307+0000","last_became_peered":"2023-11-18T20:59:27.889307+0000","last_unstale":"2023-11-18T20:59:35.746209+0000","last_undegraded":"2023-11-18T20:59:35.746209+0000","last_fullsized":"2023-11-18T20:59:35.746209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.758577+0000","last_change":"2023-11-18T20:59:27.866394+0000","last_active":"2023-11-18T20:59:35.758577+0000","last_peered":"2023-11-18T20:59:35.758577+0000","last_clean":"2023-11-18T20:59:35.758577+0000","last_became_active":"2023-11-18T20:59:27.865625+0000","last_became_peered":"2023-11-18T20:59:27.865625+0000","last_unstale":"2023-11-18T20:59:35.758577+0000","last_undegraded":"2023-11-18T20:59:35.758577+0000","last_fullsized":"2023-11-18T20:59:35.758577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.745362+0000","last_change":"2023-11-18T20:59:27.892765+0000","last_active":"2023-11-18T20:59:35.745362+0000","last_peered":"2023-11-18T20:59:35.745362+0000","last_clean":"2023-11-18T20:59:35.745362+0000","last_became_active":"2023-11-18T20:59:27.891753+0000","last_became_peered":"2023-11-18T20:59:27.891753+0000","last_unstale":"2023-11-18T20:59:35.745362+0000","last_undegraded":"2023-11-18T20:59:35.745362+0000","last_fullsized":"2023-11-18T20:59:35.745362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:52.955875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770669+0000","last_change":"2023-11-18T20:59:27.837531+0000","last_active":"2023-11-18T20:59:35.770669+0000","last_peered":"2023-11-18T20:59:35.770669+0000","last_clean":"2023-11-18T20:59:35.770669+0000","last_became_active":"2023-11-18T20:59:27.836899+0000","last_became_peered":"2023-11-18T20:59:27.836899+0000","last_unstale":"2023-11-18T20:59:35.770669+0000","last_undegraded":"2023-11-18T20:59:35.770669+0000","last_fullsized":"2023-11-18T20:59:35.770669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:04.716391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.771353+0000","last_change":"2023-11-18T20:59:27.864494+0000","last_active":"2023-11-18T20:59:35.771353+0000","last_peered":"2023-11-18T20:59:35.771353+0000","last_clean":"2023-11-18T20:59:35.771353+0000","last_became_active":"2023-11-18T20:59:27.863732+0000","last_became_peered":"2023-11-18T20:59:27.863732+0000","last_unstale":"2023-11-18T20:59:35.771353+0000","last_undegraded":"2023-11-18T20:59:35.771353+0000","last_fullsized":"2023-11-18T20:59:35.771353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759787+0000","last_change":"2023-11-18T20:59:27.873605+0000","last_active":"2023-11-18T20:59:35.759787+0000","last_peered":"2023-11-18T20:59:35.759787+0000","last_clean":"2023-11-18T20:59:35.759787+0000","last_became_active":"2023-11-18T20:59:27.871167+0000","last_became_peered":"2023-11-18T20:59:27.871167+0000","last_unstale":"2023-11-18T20:59:35.759787+0000","last_undegraded":"2023-11-18T20:59:35.759787+0000","last_fullsized":"2023-11-18T20:59:35.759787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:54:51.212807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5955,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":11328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":123336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.133}]},{"osd":2,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.075},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.92500000000000004}]},{"osd":3,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.052},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.96099999999999997}]},{"osd":4,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.999}]},{"osd":5,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.181},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.032}]},{"osd":6,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.103}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":123252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.077},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.82499999999999996}]},{"osd":1,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.113}]},{"osd":2,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.145},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.86299999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.98599999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.0389999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.1759999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.2110000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":713712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.86899999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.97099999999999997}]},{"osd":2,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.47099999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60699999999999998}]},{"osd":4,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.80100000000000005}]},{"osd":6,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.54700000000000004}]},{"osd":7,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.024},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.94099999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":315392,"data_stored":123234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.85999999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.81000000000000005}]},{"osd":4,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.91400000000000003}]},{"osd":5,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.1659999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.046},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":1.091}]},{"osd":7,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.28},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.2190000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":126471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.79700000000000004}]},{"osd":1,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.91700000000000004}]},{"osd":4,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":1.0129999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.109},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.1439999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.1779999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.05}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":909312,"data_stored":713158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.72899999999999998}]},{"osd":3,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.056}]},{"osd":4,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.024},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.133}]},{"osd":5,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.294},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.103}]},{"osd":6,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.246}]},{"osd":7,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.181},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.1599999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":122776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.1779999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.92100000000000004}]},{"osd":3,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.81000000000000005}]},{"osd":4,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.012},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.90500000000000003}]},{"osd":5,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.359},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.0980000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.0509999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.2410000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.92900000000000005}]},{"osd":1,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.76600000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.88700000000000001},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.67500000000000004}]},{"osd":3,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.80100000000000005}]},{"osd":5,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.1299999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.98699999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.365},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.0900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T21:00:14.446 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T21:00:14.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.640+0000 7f7961712640 1 Processor -- start 2023-11-18T21:00:14.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.644+0000 7f7961712640 1 -- start start 2023-11-18T21:00:14.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.644+0000 7f7961712640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f795c0c4630 0x7f795c0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:14.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.644+0000 7f7961712640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f795c0c4a10 0x7f795c1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:14.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.644+0000 7f7961712640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795c0c72b0 con 0x7f795c159c00 2023-11-18T21:00:14.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.644+0000 7f7961712640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c0c4f40 con 0x7f795c0c4630 2023-11-18T21:00:14.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.644+0000 7f7961712640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c15a6c0 con 0x7f795c0c4a10 2023-11-18T21:00:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.652+0000 7f795affd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f795c0c4630 0x7f795c0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.652+0000 7f795affd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f795c0c4630 0x7f795c0c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49138/0 (socket says 172.21.15.49:49138) 2023-11-18T21:00:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.652+0000 7f795affd640 1 -- 172.21.15.49:0/456521442 learned_addr learned my addr 172.21.15.49:0/456521442 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:14.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.656+0000 7f795affd640 1 -- 172.21.15.49:0/456521442 >> v2:172.21.15.106:3300/0 conn(0x7f795c0c4a10 msgr2=0x7f795c1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:14.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.656+0000 7f795affd640 1 --2- 172.21.15.49:0/456521442 >> v2:172.21.15.106:3300/0 conn(0x7f795c0c4a10 0x7f795c1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:14.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.656+0000 7f795affd640 1 -- 172.21.15.49:0/456521442 >> v1:172.21.15.49:6789/0 conn(0x7f795c159c00 legacy=0x7f795c14fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:14.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.656+0000 7f795affd640 1 -- 172.21.15.49:0/456521442 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c15a100 con 0x7f795c0c4630 2023-11-18T21:00:14.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.664+0000 7f795affd640 1 --2- 172.21.15.49:0/456521442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c0c4630 0x7f795c0c6d70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f795c06f850 tx=0x7f794c0213d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc54e418a1462cb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:14.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.672+0000 7f7959ffb640 1 -- 172.21.15.49:0/456521442 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0b1400 con 0x7f795c0c4630 2023-11-18T21:00:14.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.672+0000 7f7959ffb640 1 -- 172.21.15.49:0/456521442 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c0ad050 con 0x7f795c0c4630 2023-11-18T21:00:14.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.672+0000 7f7959ffb640 1 -- 172.21.15.49:0/456521442 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0b1780 con 0x7f795c0c4630 2023-11-18T21:00:14.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.672+0000 7f7961712640 1 -- 172.21.15.49:0/456521442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c0c4630 msgr2=0x7f795c0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:14.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.672+0000 7f7961712640 1 --2- 172.21.15.49:0/456521442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c0c4630 0x7f795c0c6d70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f795c06f850 tx=0x7f794c0213d0 comp rx=0 tx=0).stop 2023-11-18T21:00:14.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.672+0000 7f7961712640 1 -- 172.21.15.49:0/456521442 shutdown_connections 2023-11-18T21:00:14.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.672+0000 7f7961712640 1 --2- 172.21.15.49:0/456521442 >> v2:172.21.15.106:3300/0 conn(0x7f795c0c4a10 0x7f795c1596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:14.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.672+0000 7f7961712640 1 --2- 172.21.15.49:0/456521442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c0c4630 0x7f795c0c6d70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:14.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.672+0000 7f7961712640 1 -- 172.21.15.49:0/456521442 >> 172.21.15.49:0/456521442 conn(0x7f795c06c6a0 msgr2=0x7f795c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:14.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.672+0000 7f7961712640 1 -- 172.21.15.49:0/456521442 shutdown_connections 2023-11-18T21:00:14.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.672+0000 7f7961712640 1 -- 172.21.15.49:0/456521442 wait complete. 2023-11-18T21:00:14.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.672+0000 7f7961712640 1 Processor -- start 2023-11-18T21:00:14.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.672+0000 7f7961712640 1 -- start start 2023-11-18T21:00:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.676+0000 7f7961712640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c0c4630 0x7f795c071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.676+0000 7f7961712640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f795c0c4a10 0x7f795c147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.676+0000 7f7961712640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f795c159c00 0x7f795c1edcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.676+0000 7f7961712640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c072ab0 con 0x7f795c0c4630 2023-11-18T21:00:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.676+0000 7f7961712640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c1595e0 con 0x7f795c159c00 2023-11-18T21:00:14.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.676+0000 7f7961712640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795c158ad0 con 0x7f795c0c4a10 2023-11-18T21:00:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.676+0000 7f795b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f795c159c00 0x7f795c1edcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.676+0000 7f795a7fc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f795c0c4a10 0x7f795c147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.676+0000 7f795affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c0c4630 0x7f795c071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:14.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.676+0000 7f795affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c0c4630 0x7f795c071e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49148/0 (socket says 172.21.15.49:49148) 2023-11-18T21:00:14.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.676+0000 7f795affd640 1 -- 172.21.15.49:0/3779873015 learned_addr learned my addr 172.21.15.49:0/3779873015 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.680+0000 7f795affd640 1 -- 172.21.15.49:0/3779873015 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f795c0c4a10 msgr2=0x7f795c147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.680+0000 7f795affd640 1 --2- 172.21.15.49:0/3779873015 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f795c0c4a10 0x7f795c147cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:14.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.680+0000 7f795affd640 1 -- 172.21.15.49:0/3779873015 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f795c159c00 msgr2=0x7f795c1edcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:14.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.680+0000 7f795affd640 1 --2- 172.21.15.49:0/3779873015 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f795c159c00 0x7f795c1edcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:14.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.680+0000 7f795affd640 1 -- 172.21.15.49:0/3779873015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c009b30 con 0x7f795c0c4630 2023-11-18T21:00:14.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.684+0000 7f795affd640 1 --2- 172.21.15.49:0/3779873015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c0c4630 0x7f795c071e70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f794c0b4040 tx=0x7f794c01e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:14.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.684+0000 7f79537fe640 1 -- 172.21.15.49:0/3779873015 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0b1e40 con 0x7f795c0c4630 2023-11-18T21:00:14.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.688+0000 7f79537fe640 1 -- 172.21.15.49:0/3779873015 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c00e150 con 0x7f795c0c4630 2023-11-18T21:00:14.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.688+0000 7f7961712640 1 -- 172.21.15.49:0/3779873015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c0724f0 con 0x7f795c0c4630 2023-11-18T21:00:14.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.688+0000 7f79537fe640 1 -- 172.21.15.49:0/3779873015 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0bc680 con 0x7f795c0c4630 2023-11-18T21:00:14.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.688+0000 7f7961712640 1 -- 172.21.15.49:0/3779873015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c158f90 con 0x7f795c0c4630 2023-11-18T21:00:14.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.688+0000 7f7961712640 1 -- 172.21.15.49:0/3779873015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c158dd0 con 0x7f795c0c4630 2023-11-18T21:00:14.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.984+0000 7f79537fe640 1 -- 172.21.15.49:0/3779873015 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f794c0c6440 con 0x7f795c0c4630 2023-11-18T21:00:14.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.984+0000 7f79537fe640 1 --2- 172.21.15.49:0/3779873015 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f793c0664c0 0x7f793c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:14.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.988+0000 7f795a7fc640 1 --2- 172.21.15.49:0/3779873015 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f793c0664c0 0x7f793c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:14.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:14.988+0000 7f795a7fc640 1 --2- 172.21.15.49:0/3779873015 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f793c0664c0 0x7f793c068980 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f795c070b20 tx=0x7f7944009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:15.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.024+0000 7f79537fe640 1 -- 172.21.15.49:0/3779873015 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f794c0f2e60 con 0x7f795c0c4630 2023-11-18T21:00:15.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.024+0000 7f79537fe640 1 -- 172.21.15.49:0/3779873015 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f794c0ef1a0 con 0x7f795c0c4630 2023-11-18T21:00:15.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.192+0000 7f7961712640 1 -- 172.21.15.49:0/3779873015 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f795c1565c0 con 0x7f793c0664c0 2023-11-18T21:00:15.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.220+0000 7f79537fe640 1 -- 172.21.15.49:0/3779873015 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368425 (secure 0 0 0) 0x7f79440095e0 con 0x7f793c0664c0 2023-11-18T21:00:15.224 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:15.228 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-18T21:00:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.228+0000 7f7961712640 1 -- 172.21.15.49:0/3779873015 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f793c0664c0 msgr2=0x7f793c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.228+0000 7f7961712640 1 --2- 172.21.15.49:0/3779873015 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f793c0664c0 0x7f793c068980 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f795c070b20 tx=0x7f7944009110 comp rx=0 tx=0).stop 2023-11-18T21:00:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.228+0000 7f7961712640 1 -- 172.21.15.49:0/3779873015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c0c4630 msgr2=0x7f795c071e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.228+0000 7f7961712640 1 --2- 172.21.15.49:0/3779873015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c0c4630 0x7f795c071e70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f794c0b4040 tx=0x7f794c01e170 comp rx=0 tx=0).stop 2023-11-18T21:00:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.228+0000 7f7961712640 1 -- 172.21.15.49:0/3779873015 shutdown_connections 2023-11-18T21:00:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.228+0000 7f7961712640 1 --2- 172.21.15.49:0/3779873015 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f793c0664c0 0x7f793c068980 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.228+0000 7f7961712640 1 --2- 172.21.15.49:0/3779873015 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f795c159c00 0x7f795c1edcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.228+0000 7f7961712640 1 --2- 172.21.15.49:0/3779873015 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f795c0c4a10 0x7f795c147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:15.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.228+0000 7f7961712640 1 --2- 172.21.15.49:0/3779873015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f795c0c4630 0x7f795c071e70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:15.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.228+0000 7f7961712640 1 -- 172.21.15.49:0/3779873015 >> 172.21.15.49:0/3779873015 conn(0x7f795c06c6a0 msgr2=0x7f795c06ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:15.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.228+0000 7f7961712640 1 -- 172.21.15.49:0/3779873015 shutdown_connections 2023-11-18T21:00:15.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.228+0000 7f7961712640 1 -- 172.21.15.49:0/3779873015 wait complete. 2023-11-18T21:00:15.251 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-11-18T21:00:13.794897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596323,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":240,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236428,"kb_used_data":3660,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738292,"statfs":{"total":773094113280,"available":772852011008,"internally_reserved":0,"allocated":3747840,"data_stored":2173104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1316,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005259"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.832939+0000","last_change":"2023-11-18T20:59:25.350113+0000","last_active":"2023-11-18T20:59:35.832939+0000","last_peered":"2023-11-18T20:59:35.832939+0000","last_clean":"2023-11-18T20:59:35.832939+0000","last_became_active":"2023-11-18T20:59:25.349869+0000","last_became_peered":"2023-11-18T20:59:25.349869+0000","last_unstale":"2023-11-18T20:59:35.832939+0000","last_undegraded":"2023-11-18T20:59:35.832939+0000","last_fullsized":"2023-11-18T20:59:35.832939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:56:07.719325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.771586+0000","last_change":"2023-11-18T20:59:27.895973+0000","last_active":"2023-11-18T20:59:35.771586+0000","last_peered":"2023-11-18T20:59:35.771586+0000","last_clean":"2023-11-18T20:59:35.771586+0000","last_became_active":"2023-11-18T20:59:27.895678+0000","last_became_peered":"2023-11-18T20:59:27.895678+0000","last_unstale":"2023-11-18T20:59:35.771586+0000","last_undegraded":"2023-11-18T20:59:35.771586+0000","last_fullsized":"2023-11-18T20:59:35.771586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.784993+0000","last_change":"2023-11-18T20:59:35.848621+0000","last_active":"2023-11-18T20:59:36.784993+0000","last_peered":"2023-11-18T20:59:36.784993+0000","last_clean":"2023-11-18T20:59:36.784993+0000","last_became_active":"2023-11-18T20:59:35.848140+0000","last_became_peered":"2023-11-18T20:59:35.848140+0000","last_unstale":"2023-11-18T20:59:36.784993+0000","last_undegraded":"2023-11-18T20:59:36.784993+0000","last_fullsized":"2023-11-18T20:59:36.784993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:12.962470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.771992+0000","last_change":"2023-11-18T20:59:25.463657+0000","last_active":"2023-11-18T20:59:35.771992+0000","last_peered":"2023-11-18T20:59:35.771992+0000","last_clean":"2023-11-18T20:59:35.771992+0000","last_became_active":"2023-11-18T20:59:25.463001+0000","last_became_peered":"2023-11-18T20:59:25.463001+0000","last_unstale":"2023-11-18T20:59:35.771992+0000","last_undegraded":"2023-11-18T20:59:35.771992+0000","last_fullsized":"2023-11-18T20:59:35.771992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.772550+0000","last_change":"2023-11-18T20:59:27.837801+0000","last_active":"2023-11-18T20:59:35.772550+0000","last_peered":"2023-11-18T20:59:35.772550+0000","last_clean":"2023-11-18T20:59:35.772550+0000","last_became_active":"2023-11-18T20:59:27.836937+0000","last_became_peered":"2023-11-18T20:59:27.836937+0000","last_unstale":"2023-11-18T20:59:35.772550+0000","last_undegraded":"2023-11-18T20:59:35.772550+0000","last_fullsized":"2023-11-18T20:59:35.772550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947102+0000","last_change":"2023-11-18T20:59:35.843015+0000","last_active":"2023-11-18T20:59:37.947102+0000","last_peered":"2023-11-18T20:59:37.947102+0000","last_clean":"2023-11-18T20:59:37.947102+0000","last_became_active":"2023-11-18T20:59:35.842552+0000","last_became_peered":"2023-11-18T20:59:35.842552+0000","last_unstale":"2023-11-18T20:59:37.947102+0000","last_undegraded":"2023-11-18T20:59:37.947102+0000","last_fullsized":"2023-11-18T20:59:37.947102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:17.222664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759823+0000","last_change":"2023-11-18T20:59:25.497907+0000","last_active":"2023-11-18T20:59:35.759823+0000","last_peered":"2023-11-18T20:59:35.759823+0000","last_clean":"2023-11-18T20:59:35.759823+0000","last_became_active":"2023-11-18T20:59:25.497070+0000","last_became_peered":"2023-11-18T20:59:25.497070+0000","last_unstale":"2023-11-18T20:59:35.759823+0000","last_undegraded":"2023-11-18T20:59:35.759823+0000","last_fullsized":"2023-11-18T20:59:35.759823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769239+0000","last_change":"2023-11-18T20:59:27.868161+0000","last_active":"2023-11-18T20:59:35.769239+0000","last_peered":"2023-11-18T20:59:35.769239+0000","last_clean":"2023-11-18T20:59:35.769239+0000","last_became_active":"2023-11-18T20:59:27.867021+0000","last_became_peered":"2023-11-18T20:59:27.867021+0000","last_unstale":"2023-11-18T20:59:35.769239+0000","last_undegraded":"2023-11-18T20:59:35.769239+0000","last_fullsized":"2023-11-18T20:59:35.769239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.950153+0000","last_change":"2023-11-18T20:59:35.830210+0000","last_active":"2023-11-18T20:59:37.950153+0000","last_peered":"2023-11-18T20:59:37.950153+0000","last_clean":"2023-11-18T20:59:37.950153+0000","last_became_active":"2023-11-18T20:59:35.829636+0000","last_became_peered":"2023-11-18T20:59:35.829636+0000","last_unstale":"2023-11-18T20:59:37.950153+0000","last_undegraded":"2023-11-18T20:59:37.950153+0000","last_fullsized":"2023-11-18T20:59:37.950153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759499+0000","last_change":"2023-11-18T20:59:25.493859+0000","last_active":"2023-11-18T20:59:35.759499+0000","last_peered":"2023-11-18T20:59:35.759499+0000","last_clean":"2023-11-18T20:59:35.759499+0000","last_became_active":"2023-11-18T20:59:25.493087+0000","last_became_peered":"2023-11-18T20:59:25.493087+0000","last_unstale":"2023-11-18T20:59:35.759499+0000","last_undegraded":"2023-11-18T20:59:35.759499+0000","last_fullsized":"2023-11-18T20:59:35.759499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.697210+0000","last_change":"2023-11-18T20:59:27.871929+0000","last_active":"2023-11-18T20:59:35.697210+0000","last_peered":"2023-11-18T20:59:35.697210+0000","last_clean":"2023-11-18T20:59:35.697210+0000","last_became_active":"2023-11-18T20:59:27.871076+0000","last_became_peered":"2023-11-18T20:59:27.871076+0000","last_unstale":"2023-11-18T20:59:35.697210+0000","last_undegraded":"2023-11-18T20:59:35.697210+0000","last_fullsized":"2023-11-18T20:59:35.697210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:24:09.546791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.948997+0000","last_change":"2023-11-18T20:59:35.833547+0000","last_active":"2023-11-18T20:59:37.948997+0000","last_peered":"2023-11-18T20:59:37.948997+0000","last_clean":"2023-11-18T20:59:37.948997+0000","last_became_active":"2023-11-18T20:59:35.833016+0000","last_became_peered":"2023-11-18T20:59:35.833016+0000","last_unstale":"2023-11-18T20:59:37.948997+0000","last_undegraded":"2023-11-18T20:59:37.948997+0000","last_fullsized":"2023-11-18T20:59:37.948997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:58.416590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696332+0000","last_change":"2023-11-18T20:59:27.682005+0000","last_active":"2023-11-18T20:59:35.696332+0000","last_peered":"2023-11-18T20:59:35.696332+0000","last_clean":"2023-11-18T20:59:35.696332+0000","last_became_active":"2023-11-18T20:59:27.681154+0000","last_became_peered":"2023-11-18T20:59:27.681154+0000","last_unstale":"2023-11-18T20:59:35.696332+0000","last_undegraded":"2023-11-18T20:59:35.696332+0000","last_fullsized":"2023-11-18T20:59:35.696332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:10.426499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:09.997710+0000","last_change":"2023-11-18T20:59:25.339269+0000","last_active":"2023-11-18T21:00:09.997710+0000","last_peered":"2023-11-18T21:00:09.997710+0000","last_clean":"2023-11-18T21:00:09.997710+0000","last_became_active":"2023-11-18T20:59:25.338067+0000","last_became_peered":"2023-11-18T20:59:25.338067+0000","last_unstale":"2023-11-18T21:00:09.997710+0000","last_undegraded":"2023-11-18T21:00:09.997710+0000","last_fullsized":"2023-11-18T21:00:09.997710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.310566+0000","last_change":"2023-11-18T20:59:35.776790+0000","last_active":"2023-11-18T20:59:37.310566+0000","last_peered":"2023-11-18T20:59:37.310566+0000","last_clean":"2023-11-18T20:59:37.310566+0000","last_became_active":"2023-11-18T20:59:35.776286+0000","last_became_peered":"2023-11-18T20:59:35.776286+0000","last_unstale":"2023-11-18T20:59:37.310566+0000","last_undegraded":"2023-11-18T20:59:37.310566+0000","last_fullsized":"2023-11-18T20:59:37.310566+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:06.870579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.682428+0000","last_change":"2023-11-18T20:59:27.861550+0000","last_active":"2023-11-18T20:59:35.682428+0000","last_peered":"2023-11-18T20:59:35.682428+0000","last_clean":"2023-11-18T20:59:35.682428+0000","last_became_active":"2023-11-18T20:59:27.861045+0000","last_became_peered":"2023-11-18T20:59:27.861045+0000","last_unstale":"2023-11-18T20:59:35.682428+0000","last_undegraded":"2023-11-18T20:59:35.682428+0000","last_fullsized":"2023-11-18T20:59:35.682428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.820347+0000","last_change":"2023-11-18T20:59:25.458601+0000","last_active":"2023-11-18T20:59:35.820347+0000","last_peered":"2023-11-18T20:59:35.820347+0000","last_clean":"2023-11-18T20:59:35.820347+0000","last_became_active":"2023-11-18T20:59:25.457871+0000","last_became_peered":"2023-11-18T20:59:25.457871+0000","last_unstale":"2023-11-18T20:59:35.820347+0000","last_undegraded":"2023-11-18T20:59:35.820347+0000","last_fullsized":"2023-11-18T20:59:35.820347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:09.387812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.685157+0000","last_change":"2023-11-18T20:59:35.842967+0000","last_active":"2023-11-18T20:59:36.685157+0000","last_peered":"2023-11-18T20:59:36.685157+0000","last_clean":"2023-11-18T20:59:36.685157+0000","last_became_active":"2023-11-18T20:59:35.842583+0000","last_became_peered":"2023-11-18T20:59:35.842583+0000","last_unstale":"2023-11-18T20:59:36.685157+0000","last_undegraded":"2023-11-18T20:59:36.685157+0000","last_fullsized":"2023-11-18T20:59:36.685157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:40.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.824183+0000","last_change":"2023-11-18T20:59:27.688043+0000","last_active":"2023-11-18T20:59:35.824183+0000","last_peered":"2023-11-18T20:59:35.824183+0000","last_clean":"2023-11-18T20:59:35.824183+0000","last_became_active":"2023-11-18T20:59:27.687250+0000","last_became_peered":"2023-11-18T20:59:27.687250+0000","last_unstale":"2023-11-18T20:59:35.824183+0000","last_undegraded":"2023-11-18T20:59:35.824183+0000","last_fullsized":"2023-11-18T20:59:35.824183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:16:48.432607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.823611+0000","last_change":"2023-11-18T20:59:25.351927+0000","last_active":"2023-11-18T20:59:35.823611+0000","last_peered":"2023-11-18T20:59:35.823611+0000","last_clean":"2023-11-18T20:59:35.823611+0000","last_became_active":"2023-11-18T20:59:25.351318+0000","last_became_peered":"2023-11-18T20:59:25.351318+0000","last_unstale":"2023-11-18T20:59:35.823611+0000","last_undegraded":"2023-11-18T20:59:35.823611+0000","last_fullsized":"2023-11-18T20:59:35.823611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:20:38.006315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.785771+0000","last_change":"2023-11-18T20:59:35.835375+0000","last_active":"2023-11-18T20:59:36.785771+0000","last_peered":"2023-11-18T20:59:36.785771+0000","last_clean":"2023-11-18T20:59:36.785771+0000","last_became_active":"2023-11-18T20:59:35.834894+0000","last_became_peered":"2023-11-18T20:59:35.834894+0000","last_unstale":"2023-11-18T20:59:36.785771+0000","last_undegraded":"2023-11-18T20:59:36.785771+0000","last_fullsized":"2023-11-18T20:59:36.785771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:33.448377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.695870+0000","last_change":"2023-11-18T20:59:27.687356+0000","last_active":"2023-11-18T20:59:35.695870+0000","last_peered":"2023-11-18T20:59:35.695870+0000","last_clean":"2023-11-18T20:59:35.695870+0000","last_became_active":"2023-11-18T20:59:27.686692+0000","last_became_peered":"2023-11-18T20:59:27.686692+0000","last_unstale":"2023-11-18T20:59:35.695870+0000","last_undegraded":"2023-11-18T20:59:35.695870+0000","last_fullsized":"2023-11-18T20:59:35.695870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:20:58.633153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.169191+0000","last_change":"2023-11-18T20:59:25.347589+0000","last_active":"2023-11-18T21:00:10.169191+0000","last_peered":"2023-11-18T21:00:10.169191+0000","last_clean":"2023-11-18T21:00:10.169191+0000","last_became_active":"2023-11-18T20:59:25.347022+0000","last_became_peered":"2023-11-18T20:59:25.347022+0000","last_unstale":"2023-11-18T21:00:10.169191+0000","last_undegraded":"2023-11-18T21:00:10.169191+0000","last_fullsized":"2023-11-18T21:00:10.169191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.949612+0000","last_change":"2023-11-18T20:59:35.771398+0000","last_active":"2023-11-18T20:59:37.949612+0000","last_peered":"2023-11-18T20:59:37.949612+0000","last_clean":"2023-11-18T20:59:37.949612+0000","last_became_active":"2023-11-18T20:59:35.770923+0000","last_became_peered":"2023-11-18T20:59:35.770923+0000","last_unstale":"2023-11-18T20:59:37.949612+0000","last_undegraded":"2023-11-18T20:59:37.949612+0000","last_fullsized":"2023-11-18T20:59:37.949612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.824728+0000","last_change":"2023-11-18T20:59:27.689972+0000","last_active":"2023-11-18T20:59:35.824728+0000","last_peered":"2023-11-18T20:59:35.824728+0000","last_clean":"2023-11-18T20:59:35.824728+0000","last_became_active":"2023-11-18T20:59:27.689156+0000","last_became_peered":"2023-11-18T20:59:27.689156+0000","last_unstale":"2023-11-18T20:59:35.824728+0000","last_undegraded":"2023-11-18T20:59:35.824728+0000","last_fullsized":"2023-11-18T20:59:35.824728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:58.264895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:09.999479+0000","last_change":"2023-11-18T20:59:25.348005+0000","last_active":"2023-11-18T21:00:09.999479+0000","last_peered":"2023-11-18T21:00:09.999479+0000","last_clean":"2023-11-18T21:00:09.999479+0000","last_became_active":"2023-11-18T20:59:25.346318+0000","last_became_peered":"2023-11-18T20:59:25.346318+0000","last_unstale":"2023-11-18T21:00:09.999479+0000","last_undegraded":"2023-11-18T21:00:09.999479+0000","last_fullsized":"2023-11-18T21:00:09.999479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:37.045716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947894+0000","last_change":"2023-11-18T20:59:35.833754+0000","last_active":"2023-11-18T20:59:37.947894+0000","last_peered":"2023-11-18T20:59:37.947894+0000","last_clean":"2023-11-18T20:59:37.947894+0000","last_became_active":"2023-11-18T20:59:35.833407+0000","last_became_peered":"2023-11-18T20:59:35.833407+0000","last_unstale":"2023-11-18T20:59:37.947894+0000","last_undegraded":"2023-11-18T20:59:37.947894+0000","last_fullsized":"2023-11-18T20:59:37.947894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:38:06.355389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.827293+0000","last_change":"2023-11-18T20:59:27.863887+0000","last_active":"2023-11-18T20:59:35.827293+0000","last_peered":"2023-11-18T20:59:35.827293+0000","last_clean":"2023-11-18T20:59:35.827293+0000","last_became_active":"2023-11-18T20:59:27.863358+0000","last_became_peered":"2023-11-18T20:59:27.863358+0000","last_unstale":"2023-11-18T20:59:35.827293+0000","last_undegraded":"2023-11-18T20:59:35.827293+0000","last_fullsized":"2023-11-18T20:59:35.827293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:50.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.235441+0000","last_change":"2023-11-18T20:59:25.351394+0000","last_active":"2023-11-18T20:59:36.235441+0000","last_peered":"2023-11-18T20:59:36.235441+0000","last_clean":"2023-11-18T20:59:36.235441+0000","last_became_active":"2023-11-18T20:59:25.350705+0000","last_became_peered":"2023-11-18T20:59:25.350705+0000","last_unstale":"2023-11-18T20:59:36.235441+0000","last_undegraded":"2023-11-18T20:59:36.235441+0000","last_fullsized":"2023-11-18T20:59:36.235441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:01:57.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.687959+0000","last_change":"2023-11-18T20:59:35.840991+0000","last_active":"2023-11-18T20:59:36.687959+0000","last_peered":"2023-11-18T20:59:36.687959+0000","last_clean":"2023-11-18T20:59:36.687959+0000","last_became_active":"2023-11-18T20:59:35.840533+0000","last_became_peered":"2023-11-18T20:59:35.840533+0000","last_unstale":"2023-11-18T20:59:36.687959+0000","last_undegraded":"2023-11-18T20:59:36.687959+0000","last_fullsized":"2023-11-18T20:59:36.687959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:06:47.876845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.821773+0000","last_change":"2023-11-18T20:59:27.869100+0000","last_active":"2023-11-18T20:59:35.821773+0000","last_peered":"2023-11-18T20:59:35.821773+0000","last_clean":"2023-11-18T20:59:35.821773+0000","last_became_active":"2023-11-18T20:59:27.868355+0000","last_became_peered":"2023-11-18T20:59:27.868355+0000","last_unstale":"2023-11-18T20:59:35.821773+0000","last_undegraded":"2023-11-18T20:59:35.821773+0000","last_fullsized":"2023-11-18T20:59:35.821773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:25.235096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311843+0000","last_change":"2023-11-18T20:59:25.350304+0000","last_active":"2023-11-18T20:59:37.311843+0000","last_peered":"2023-11-18T20:59:37.311843+0000","last_clean":"2023-11-18T20:59:37.311843+0000","last_became_active":"2023-11-18T20:59:25.349346+0000","last_became_peered":"2023-11-18T20:59:25.349346+0000","last_unstale":"2023-11-18T20:59:37.311843+0000","last_undegraded":"2023-11-18T20:59:37.311843+0000","last_fullsized":"2023-11-18T20:59:37.311843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:41.179268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.445590+0000","last_change":"2023-11-18T20:59:35.847005+0000","last_active":"2023-11-18T20:59:37.445590+0000","last_peered":"2023-11-18T20:59:37.445590+0000","last_clean":"2023-11-18T20:59:37.445590+0000","last_became_active":"2023-11-18T20:59:35.846458+0000","last_became_peered":"2023-11-18T20:59:35.846458+0000","last_unstale":"2023-11-18T20:59:37.445590+0000","last_undegraded":"2023-11-18T20:59:37.445590+0000","last_fullsized":"2023-11-18T20:59:37.445590+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746436+0000","last_change":"2023-11-18T20:59:27.889369+0000","last_active":"2023-11-18T20:59:35.746436+0000","last_peered":"2023-11-18T20:59:35.746436+0000","last_clean":"2023-11-18T20:59:35.746436+0000","last_became_active":"2023-11-18T20:59:27.887876+0000","last_became_peered":"2023-11-18T20:59:27.887876+0000","last_unstale":"2023-11-18T20:59:35.746436+0000","last_undegraded":"2023-11-18T20:59:35.746436+0000","last_fullsized":"2023-11-18T20:59:35.746436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:38.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770796+0000","last_change":"2023-11-18T20:59:25.459620+0000","last_active":"2023-11-18T20:59:35.770796+0000","last_peered":"2023-11-18T20:59:35.770796+0000","last_clean":"2023-11-18T20:59:35.770796+0000","last_became_active":"2023-11-18T20:59:25.459235+0000","last_became_peered":"2023-11-18T20:59:25.459235+0000","last_unstale":"2023-11-18T20:59:35.770796+0000","last_undegraded":"2023-11-18T20:59:35.770796+0000","last_fullsized":"2023-11-18T20:59:35.770796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:02.325885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.445133+0000","last_change":"2023-11-18T20:59:35.835800+0000","last_active":"2023-11-18T20:59:37.445133+0000","last_peered":"2023-11-18T20:59:37.445133+0000","last_clean":"2023-11-18T20:59:37.445133+0000","last_became_active":"2023-11-18T20:59:35.834275+0000","last_became_peered":"2023-11-18T20:59:35.834275+0000","last_unstale":"2023-11-18T20:59:37.445133+0000","last_undegraded":"2023-11-18T20:59:37.445133+0000","last_fullsized":"2023-11-18T20:59:37.445133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.758369+0000","last_change":"2023-11-18T20:59:27.892676+0000","last_active":"2023-11-18T20:59:35.758369+0000","last_peered":"2023-11-18T20:59:35.758369+0000","last_clean":"2023-11-18T20:59:35.758369+0000","last_became_active":"2023-11-18T20:59:27.892150+0000","last_became_peered":"2023-11-18T20:59:27.892150+0000","last_unstale":"2023-11-18T20:59:35.758369+0000","last_undegraded":"2023-11-18T20:59:35.758369+0000","last_fullsized":"2023-11-18T20:59:35.758369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:04.716391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696607+0000","last_change":"2023-11-18T20:59:25.355096+0000","last_active":"2023-11-18T20:59:35.696607+0000","last_peered":"2023-11-18T20:59:35.696607+0000","last_clean":"2023-11-18T20:59:35.696607+0000","last_became_active":"2023-11-18T20:59:25.354716+0000","last_became_peered":"2023-11-18T20:59:25.354716+0000","last_unstale":"2023-11-18T20:59:35.696607+0000","last_undegraded":"2023-11-18T20:59:35.696607+0000","last_fullsized":"2023-11-18T20:59:35.696607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:51.039181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.446212+0000","last_change":"2023-11-18T20:59:35.839218+0000","last_active":"2023-11-18T20:59:37.446212+0000","last_peered":"2023-11-18T20:59:37.446212+0000","last_clean":"2023-11-18T20:59:37.446212+0000","last_became_active":"2023-11-18T20:59:35.838732+0000","last_became_peered":"2023-11-18T20:59:35.838732+0000","last_unstale":"2023-11-18T20:59:37.446212+0000","last_undegraded":"2023-11-18T20:59:37.446212+0000","last_fullsized":"2023-11-18T20:59:37.446212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:50.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769410+0000","last_change":"2023-11-18T20:59:27.839403+0000","last_active":"2023-11-18T20:59:35.769410+0000","last_peered":"2023-11-18T20:59:35.769410+0000","last_clean":"2023-11-18T20:59:35.769410+0000","last_became_active":"2023-11-18T20:59:27.838664+0000","last_became_peered":"2023-11-18T20:59:27.838664+0000","last_unstale":"2023-11-18T20:59:35.769410+0000","last_undegraded":"2023-11-18T20:59:35.769410+0000","last_fullsized":"2023-11-18T20:59:35.769410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.785228+0000","last_change":"2023-11-18T20:59:25.458840+0000","last_active":"2023-11-18T20:59:36.785228+0000","last_peered":"2023-11-18T20:59:36.785228+0000","last_clean":"2023-11-18T20:59:36.785228+0000","last_became_active":"2023-11-18T20:59:25.458075+0000","last_became_peered":"2023-11-18T20:59:25.458075+0000","last_unstale":"2023-11-18T20:59:36.785228+0000","last_undegraded":"2023-11-18T20:59:36.785228+0000","last_fullsized":"2023-11-18T20:59:36.785228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:48.644992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.446595+0000","last_change":"2023-11-18T20:59:35.833736+0000","last_active":"2023-11-18T20:59:37.446595+0000","last_peered":"2023-11-18T20:59:37.446595+0000","last_clean":"2023-11-18T20:59:37.446595+0000","last_became_active":"2023-11-18T20:59:35.832891+0000","last_became_peered":"2023-11-18T20:59:35.832891+0000","last_unstale":"2023-11-18T20:59:37.446595+0000","last_undegraded":"2023-11-18T20:59:37.446595+0000","last_fullsized":"2023-11-18T20:59:37.446595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:12.929672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819600+0000","last_change":"2023-11-18T20:59:27.889690+0000","last_active":"2023-11-18T20:59:35.819600+0000","last_peered":"2023-11-18T20:59:35.819600+0000","last_clean":"2023-11-18T20:59:35.819600+0000","last_became_active":"2023-11-18T20:59:27.889115+0000","last_became_peered":"2023-11-18T20:59:27.889115+0000","last_unstale":"2023-11-18T20:59:35.819600+0000","last_undegraded":"2023-11-18T20:59:35.819600+0000","last_fullsized":"2023-11-18T20:59:35.819600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:57:08.995074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.310518+0000","last_change":"2023-11-18T20:59:25.460190+0000","last_active":"2023-11-18T20:59:37.310518+0000","last_peered":"2023-11-18T20:59:37.310518+0000","last_clean":"2023-11-18T20:59:37.310518+0000","last_became_active":"2023-11-18T20:59:25.459405+0000","last_became_peered":"2023-11-18T20:59:25.459405+0000","last_unstale":"2023-11-18T20:59:37.310518+0000","last_undegraded":"2023-11-18T20:59:37.310518+0000","last_fullsized":"2023-11-18T20:59:37.310518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947065+0000","last_change":"2023-11-18T20:59:35.842229+0000","last_active":"2023-11-18T20:59:37.947065+0000","last_peered":"2023-11-18T20:59:37.947065+0000","last_clean":"2023-11-18T20:59:37.947065+0000","last_became_active":"2023-11-18T20:59:35.835644+0000","last_became_peered":"2023-11-18T20:59:35.835644+0000","last_unstale":"2023-11-18T20:59:37.947065+0000","last_undegraded":"2023-11-18T20:59:37.947065+0000","last_fullsized":"2023-11-18T20:59:37.947065+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:28.212029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.822632+0000","last_change":"2023-11-18T20:59:27.890885+0000","last_active":"2023-11-18T20:59:35.822632+0000","last_peered":"2023-11-18T20:59:35.822632+0000","last_clean":"2023-11-18T20:59:35.822632+0000","last_became_active":"2023-11-18T20:59:27.890499+0000","last_became_peered":"2023-11-18T20:59:27.890499+0000","last_unstale":"2023-11-18T20:59:35.822632+0000","last_undegraded":"2023-11-18T20:59:35.822632+0000","last_fullsized":"2023-11-18T20:59:35.822632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:33:26.362872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.000719+0000","last_change":"2023-11-18T20:59:25.339255+0000","last_active":"2023-11-18T21:00:10.000719+0000","last_peered":"2023-11-18T21:00:10.000719+0000","last_clean":"2023-11-18T21:00:10.000719+0000","last_became_active":"2023-11-18T20:59:25.338020+0000","last_became_peered":"2023-11-18T20:59:25.338020+0000","last_unstale":"2023-11-18T21:00:10.000719+0000","last_undegraded":"2023-11-18T21:00:10.000719+0000","last_fullsized":"2023-11-18T21:00:10.000719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:07.183625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769201+0000","last_change":"2023-11-18T20:58:44.731742+0000","last_active":"2023-11-18T20:59:35.769201+0000","last_peered":"2023-11-18T20:59:35.769201+0000","last_clean":"2023-11-18T20:59:35.769201+0000","last_became_active":"2023-11-18T20:58:44.731076+0000","last_became_peered":"2023-11-18T20:58:44.731076+0000","last_unstale":"2023-11-18T20:59:35.769201+0000","last_undegraded":"2023-11-18T20:59:35.769201+0000","last_fullsized":"2023-11-18T20:59:35.769201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:58:42.561435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:58:42.561435+0000","last_clean_scrub_stamp":"2023-11-18T20:58:42.561435+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:48:40.458317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311487+0000","last_change":"2023-11-18T20:59:35.771637+0000","last_active":"2023-11-18T20:59:37.311487+0000","last_peered":"2023-11-18T20:59:37.311487+0000","last_clean":"2023-11-18T20:59:37.311487+0000","last_became_active":"2023-11-18T20:59:35.771146+0000","last_became_peered":"2023-11-18T20:59:35.771146+0000","last_unstale":"2023-11-18T20:59:37.311487+0000","last_undegraded":"2023-11-18T20:59:37.311487+0000","last_fullsized":"2023-11-18T20:59:37.311487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:15.290602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.697296+0000","last_change":"2023-11-18T20:59:27.684091+0000","last_active":"2023-11-18T20:59:35.697296+0000","last_peered":"2023-11-18T20:59:35.697296+0000","last_clean":"2023-11-18T20:59:35.697296+0000","last_became_active":"2023-11-18T20:59:27.683316+0000","last_became_peered":"2023-11-18T20:59:27.683316+0000","last_unstale":"2023-11-18T20:59:35.697296+0000","last_undegraded":"2023-11-18T20:59:35.697296+0000","last_fullsized":"2023-11-18T20:59:35.697296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:52:02.757528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.821966+0000","last_change":"2023-11-18T20:59:25.357198+0000","last_active":"2023-11-18T20:59:35.821966+0000","last_peered":"2023-11-18T20:59:35.821966+0000","last_clean":"2023-11-18T20:59:35.821966+0000","last_became_active":"2023-11-18T20:59:25.356883+0000","last_became_peered":"2023-11-18T20:59:25.356883+0000","last_unstale":"2023-11-18T20:59:35.821966+0000","last_undegraded":"2023-11-18T20:59:35.821966+0000","last_fullsized":"2023-11-18T20:59:35.821966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:09.508737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.949273+0000","last_change":"2023-11-18T20:59:35.834266+0000","last_active":"2023-11-18T20:59:37.949273+0000","last_peered":"2023-11-18T20:59:37.949273+0000","last_clean":"2023-11-18T20:59:37.949273+0000","last_became_active":"2023-11-18T20:59:35.833790+0000","last_became_peered":"2023-11-18T20:59:35.833790+0000","last_unstale":"2023-11-18T20:59:37.949273+0000","last_undegraded":"2023-11-18T20:59:37.949273+0000","last_fullsized":"2023-11-18T20:59:37.949273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:08.464650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759162+0000","last_change":"2023-11-18T20:59:27.873828+0000","last_active":"2023-11-18T20:59:35.759162+0000","last_peered":"2023-11-18T20:59:35.759162+0000","last_clean":"2023-11-18T20:59:35.759162+0000","last_became_active":"2023-11-18T20:59:27.872733+0000","last_became_peered":"2023-11-18T20:59:27.872733+0000","last_unstale":"2023-11-18T20:59:35.759162+0000","last_undegraded":"2023-11-18T20:59:35.759162+0000","last_fullsized":"2023-11-18T20:59:35.759162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.771910+0000","last_change":"2023-11-18T20:59:25.497529+0000","last_active":"2023-11-18T20:59:35.771910+0000","last_peered":"2023-11-18T20:59:35.771910+0000","last_clean":"2023-11-18T20:59:35.771910+0000","last_became_active":"2023-11-18T20:59:25.496694+0000","last_became_peered":"2023-11-18T20:59:25.496694+0000","last_unstale":"2023-11-18T20:59:35.771910+0000","last_undegraded":"2023-11-18T20:59:35.771910+0000","last_fullsized":"2023-11-18T20:59:35.771910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947265+0000","last_change":"2023-11-18T20:59:35.829393+0000","last_active":"2023-11-18T20:59:37.947265+0000","last_peered":"2023-11-18T20:59:37.947265+0000","last_clean":"2023-11-18T20:59:37.947265+0000","last_became_active":"2023-11-18T20:59:35.828446+0000","last_became_peered":"2023-11-18T20:59:35.828446+0000","last_unstale":"2023-11-18T20:59:37.947265+0000","last_undegraded":"2023-11-18T20:59:37.947265+0000","last_fullsized":"2023-11-18T20:59:37.947265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:33.544336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759870+0000","last_change":"2023-11-18T20:59:27.875122+0000","last_active":"2023-11-18T20:59:35.759870+0000","last_peered":"2023-11-18T20:59:35.759870+0000","last_clean":"2023-11-18T20:59:35.759870+0000","last_became_active":"2023-11-18T20:59:27.870220+0000","last_became_peered":"2023-11-18T20:59:27.870220+0000","last_unstale":"2023-11-18T20:59:35.759870+0000","last_undegraded":"2023-11-18T20:59:35.759870+0000","last_fullsized":"2023-11-18T20:59:35.759870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:39.557454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.825276+0000","last_change":"2023-11-18T20:59:25.457826+0000","last_active":"2023-11-18T20:59:35.825276+0000","last_peered":"2023-11-18T20:59:35.825276+0000","last_clean":"2023-11-18T20:59:35.825276+0000","last_became_active":"2023-11-18T20:59:25.457392+0000","last_became_peered":"2023-11-18T20:59:25.457392+0000","last_unstale":"2023-11-18T20:59:35.825276+0000","last_undegraded":"2023-11-18T20:59:35.825276+0000","last_fullsized":"2023-11-18T20:59:35.825276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:07:56.724852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.309761+0000","last_change":"2023-11-18T20:59:35.831579+0000","last_active":"2023-11-18T20:59:37.309761+0000","last_peered":"2023-11-18T20:59:37.309761+0000","last_clean":"2023-11-18T20:59:37.309761+0000","last_became_active":"2023-11-18T20:59:35.831147+0000","last_became_peered":"2023-11-18T20:59:35.831147+0000","last_unstale":"2023-11-18T20:59:37.309761+0000","last_undegraded":"2023-11-18T20:59:37.309761+0000","last_fullsized":"2023-11-18T20:59:37.309761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:08.730686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746569+0000","last_change":"2023-11-18T20:59:27.895618+0000","last_active":"2023-11-18T20:59:35.746569+0000","last_peered":"2023-11-18T20:59:35.746569+0000","last_clean":"2023-11-18T20:59:35.746569+0000","last_became_active":"2023-11-18T20:59:27.894931+0000","last_became_peered":"2023-11-18T20:59:27.894931+0000","last_unstale":"2023-11-18T20:59:35.746569+0000","last_undegraded":"2023-11-18T20:59:35.746569+0000","last_fullsized":"2023-11-18T20:59:35.746569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:33.165546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759903+0000","last_change":"2023-11-18T20:59:25.458603+0000","last_active":"2023-11-18T20:59:35.759903+0000","last_peered":"2023-11-18T20:59:35.759903+0000","last_clean":"2023-11-18T20:59:35.759903+0000","last_became_active":"2023-11-18T20:59:25.457932+0000","last_became_peered":"2023-11-18T20:59:25.457932+0000","last_unstale":"2023-11-18T20:59:35.759903+0000","last_undegraded":"2023-11-18T20:59:35.759903+0000","last_fullsized":"2023-11-18T20:59:35.759903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.948121+0000","last_change":"2023-11-18T20:59:35.832209+0000","last_active":"2023-11-18T20:59:37.948121+0000","last_peered":"2023-11-18T20:59:37.948121+0000","last_clean":"2023-11-18T20:59:37.948121+0000","last_became_active":"2023-11-18T20:59:35.831804+0000","last_became_peered":"2023-11-18T20:59:35.831804+0000","last_unstale":"2023-11-18T20:59:37.948121+0000","last_undegraded":"2023-11-18T20:59:37.948121+0000","last_fullsized":"2023-11-18T20:59:37.948121+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:13.050905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.695775+0000","last_change":"2023-11-18T20:59:27.884733+0000","last_active":"2023-11-18T20:59:35.695775+0000","last_peered":"2023-11-18T20:59:35.695775+0000","last_clean":"2023-11-18T20:59:35.695775+0000","last_became_active":"2023-11-18T20:59:27.884143+0000","last_became_peered":"2023-11-18T20:59:27.884143+0000","last_unstale":"2023-11-18T20:59:35.695775+0000","last_undegraded":"2023-11-18T20:59:35.695775+0000","last_fullsized":"2023-11-18T20:59:35.695775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:32.466816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.824405+0000","last_change":"2023-11-18T20:59:25.362761+0000","last_active":"2023-11-18T20:59:35.824405+0000","last_peered":"2023-11-18T20:59:35.824405+0000","last_clean":"2023-11-18T20:59:35.824405+0000","last_became_active":"2023-11-18T20:59:25.362350+0000","last_became_peered":"2023-11-18T20:59:25.362350+0000","last_unstale":"2023-11-18T20:59:35.824405+0000","last_undegraded":"2023-11-18T20:59:35.824405+0000","last_fullsized":"2023-11-18T20:59:35.824405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:32:54.741681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947512+0000","last_change":"2023-11-18T20:59:35.836797+0000","last_active":"2023-11-18T20:59:37.947512+0000","last_peered":"2023-11-18T20:59:37.947512+0000","last_clean":"2023-11-18T20:59:37.947512+0000","last_became_active":"2023-11-18T20:59:35.834153+0000","last_became_peered":"2023-11-18T20:59:35.834153+0000","last_unstale":"2023-11-18T20:59:37.947512+0000","last_undegraded":"2023-11-18T20:59:37.947512+0000","last_fullsized":"2023-11-18T20:59:37.947512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:18.639780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.768765+0000","last_change":"2023-11-18T20:59:27.841401+0000","last_active":"2023-11-18T20:59:35.768765+0000","last_peered":"2023-11-18T20:59:35.768765+0000","last_clean":"2023-11-18T20:59:35.768765+0000","last_became_active":"2023-11-18T20:59:27.840852+0000","last_became_peered":"2023-11-18T20:59:27.840852+0000","last_unstale":"2023-11-18T20:59:35.768765+0000","last_undegraded":"2023-11-18T20:59:35.768765+0000","last_fullsized":"2023-11-18T20:59:35.768765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.757878+0000","last_change":"2023-11-18T20:59:25.351707+0000","last_active":"2023-11-18T20:59:35.757878+0000","last_peered":"2023-11-18T20:59:35.757878+0000","last_clean":"2023-11-18T20:59:35.757878+0000","last_became_active":"2023-11-18T20:59:25.351149+0000","last_became_peered":"2023-11-18T20:59:25.351149+0000","last_unstale":"2023-11-18T20:59:35.757878+0000","last_undegraded":"2023-11-18T20:59:35.757878+0000","last_fullsized":"2023-11-18T20:59:35.757878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:37:55.630369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947503+0000","last_change":"2023-11-18T20:59:35.844046+0000","last_active":"2023-11-18T20:59:37.947503+0000","last_peered":"2023-11-18T20:59:37.947503+0000","last_clean":"2023-11-18T20:59:37.947503+0000","last_became_active":"2023-11-18T20:59:35.843208+0000","last_became_peered":"2023-11-18T20:59:35.843208+0000","last_unstale":"2023-11-18T20:59:37.947503+0000","last_undegraded":"2023-11-18T20:59:37.947503+0000","last_fullsized":"2023-11-18T20:59:37.947503+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:21:06.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696069+0000","last_change":"2023-11-18T20:59:27.866997+0000","last_active":"2023-11-18T20:59:35.696069+0000","last_peered":"2023-11-18T20:59:35.696069+0000","last_clean":"2023-11-18T20:59:35.696069+0000","last_became_active":"2023-11-18T20:59:27.866233+0000","last_became_peered":"2023-11-18T20:59:27.866233+0000","last_unstale":"2023-11-18T20:59:35.696069+0000","last_undegraded":"2023-11-18T20:59:35.696069+0000","last_fullsized":"2023-11-18T20:59:35.696069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:19.998748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:09.999828+0000","last_change":"2023-11-18T20:59:25.362589+0000","last_active":"2023-11-18T21:00:09.999828+0000","last_peered":"2023-11-18T21:00:09.999828+0000","last_clean":"2023-11-18T21:00:09.999828+0000","last_became_active":"2023-11-18T20:59:25.362287+0000","last_became_peered":"2023-11-18T20:59:25.362287+0000","last_unstale":"2023-11-18T21:00:09.999828+0000","last_undegraded":"2023-11-18T21:00:09.999828+0000","last_fullsized":"2023-11-18T21:00:09.999828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:24.791294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.446156+0000","last_change":"2023-11-18T20:59:35.846859+0000","last_active":"2023-11-18T20:59:37.446156+0000","last_peered":"2023-11-18T20:59:37.446156+0000","last_clean":"2023-11-18T20:59:37.446156+0000","last_became_active":"2023-11-18T20:59:35.845378+0000","last_became_peered":"2023-11-18T20:59:35.845378+0000","last_unstale":"2023-11-18T20:59:37.446156+0000","last_undegraded":"2023-11-18T20:59:37.446156+0000","last_fullsized":"2023-11-18T20:59:37.446156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.820183+0000","last_change":"2023-11-18T20:59:27.863967+0000","last_active":"2023-11-18T20:59:35.820183+0000","last_peered":"2023-11-18T20:59:35.820183+0000","last_clean":"2023-11-18T20:59:35.820183+0000","last_became_active":"2023-11-18T20:59:27.863435+0000","last_became_peered":"2023-11-18T20:59:27.863435+0000","last_unstale":"2023-11-18T20:59:35.820183+0000","last_undegraded":"2023-11-18T20:59:35.820183+0000","last_fullsized":"2023-11-18T20:59:35.820183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:04.837624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.225905+0000","last_change":"2023-11-18T20:59:25.361677+0000","last_active":"2023-11-18T21:00:10.225905+0000","last_peered":"2023-11-18T21:00:10.225905+0000","last_clean":"2023-11-18T21:00:10.225905+0000","last_became_active":"2023-11-18T20:59:25.361313+0000","last_became_peered":"2023-11-18T20:59:25.361313+0000","last_unstale":"2023-11-18T21:00:10.225905+0000","last_undegraded":"2023-11-18T21:00:10.225905+0000","last_fullsized":"2023-11-18T21:00:10.225905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311637+0000","last_change":"2023-11-18T20:59:35.832893+0000","last_active":"2023-11-18T20:59:37.311637+0000","last_peered":"2023-11-18T20:59:37.311637+0000","last_clean":"2023-11-18T20:59:37.311637+0000","last_became_active":"2023-11-18T20:59:35.832562+0000","last_became_peered":"2023-11-18T20:59:35.832562+0000","last_unstale":"2023-11-18T20:59:37.311637+0000","last_undegraded":"2023-11-18T20:59:37.311637+0000","last_fullsized":"2023-11-18T20:59:37.311637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:53:05.127511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759692+0000","last_change":"2023-11-18T20:59:27.874128+0000","last_active":"2023-11-18T20:59:35.759692+0000","last_peered":"2023-11-18T20:59:35.759692+0000","last_clean":"2023-11-18T20:59:35.759692+0000","last_became_active":"2023-11-18T20:59:27.865971+0000","last_became_peered":"2023-11-18T20:59:27.865971+0000","last_unstale":"2023-11-18T20:59:35.759692+0000","last_undegraded":"2023-11-18T20:59:35.759692+0000","last_fullsized":"2023-11-18T20:59:35.759692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.005456+0000","last_change":"2023-11-18T20:59:25.350262+0000","last_active":"2023-11-18T21:00:10.005456+0000","last_peered":"2023-11-18T21:00:10.005456+0000","last_clean":"2023-11-18T21:00:10.005456+0000","last_became_active":"2023-11-18T20:59:25.349577+0000","last_became_peered":"2023-11-18T20:59:25.349577+0000","last_unstale":"2023-11-18T21:00:10.005456+0000","last_undegraded":"2023-11-18T21:00:10.005456+0000","last_fullsized":"2023-11-18T21:00:10.005456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.688756+0000","last_change":"2023-11-18T20:59:35.849720+0000","last_active":"2023-11-18T20:59:36.688756+0000","last_peered":"2023-11-18T20:59:36.688756+0000","last_clean":"2023-11-18T20:59:36.688756+0000","last_became_active":"2023-11-18T20:59:35.848000+0000","last_became_peered":"2023-11-18T20:59:35.848000+0000","last_unstale":"2023-11-18T20:59:36.688756+0000","last_undegraded":"2023-11-18T20:59:36.688756+0000","last_fullsized":"2023-11-18T20:59:36.688756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:41:54.553006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696849+0000","last_change":"2023-11-18T20:59:27.891817+0000","last_active":"2023-11-18T20:59:35.696849+0000","last_peered":"2023-11-18T20:59:35.696849+0000","last_clean":"2023-11-18T20:59:35.696849+0000","last_became_active":"2023-11-18T20:59:27.891260+0000","last_became_peered":"2023-11-18T20:59:27.891260+0000","last_unstale":"2023-11-18T20:59:35.696849+0000","last_undegraded":"2023-11-18T20:59:35.696849+0000","last_fullsized":"2023-11-18T20:59:35.696849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:25.331055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.786039+0000","last_change":"2023-11-18T20:59:25.363983+0000","last_active":"2023-11-18T20:59:36.786039+0000","last_peered":"2023-11-18T20:59:36.786039+0000","last_clean":"2023-11-18T20:59:36.786039+0000","last_became_active":"2023-11-18T20:59:25.363289+0000","last_became_peered":"2023-11-18T20:59:25.363289+0000","last_unstale":"2023-11-18T20:59:36.786039+0000","last_undegraded":"2023-11-18T20:59:36.786039+0000","last_fullsized":"2023-11-18T20:59:36.786039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.950378+0000","last_change":"2023-11-18T20:59:35.771712+0000","last_active":"2023-11-18T20:59:37.950378+0000","last_peered":"2023-11-18T20:59:37.950378+0000","last_clean":"2023-11-18T20:59:37.950378+0000","last_became_active":"2023-11-18T20:59:35.771263+0000","last_became_peered":"2023-11-18T20:59:35.771263+0000","last_unstale":"2023-11-18T20:59:37.950378+0000","last_undegraded":"2023-11-18T20:59:37.950378+0000","last_fullsized":"2023-11-18T20:59:37.950378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.772920+0000","last_change":"2023-11-18T20:59:27.834172+0000","last_active":"2023-11-18T20:59:35.772920+0000","last_peered":"2023-11-18T20:59:35.772920+0000","last_clean":"2023-11-18T20:59:35.772920+0000","last_became_active":"2023-11-18T20:59:27.832589+0000","last_became_peered":"2023-11-18T20:59:27.832589+0000","last_unstale":"2023-11-18T20:59:35.772920+0000","last_undegraded":"2023-11-18T20:59:35.772920+0000","last_fullsized":"2023-11-18T20:59:35.772920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.169769+0000","last_change":"2023-11-18T20:59:25.494236+0000","last_active":"2023-11-18T21:00:10.169769+0000","last_peered":"2023-11-18T21:00:10.169769+0000","last_clean":"2023-11-18T21:00:10.169769+0000","last_became_active":"2023-11-18T20:59:25.493373+0000","last_became_peered":"2023-11-18T20:59:25.493373+0000","last_unstale":"2023-11-18T21:00:10.169769+0000","last_undegraded":"2023-11-18T21:00:10.169769+0000","last_fullsized":"2023-11-18T21:00:10.169769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:13.859109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.784645+0000","last_change":"2023-11-18T20:59:35.773319+0000","last_active":"2023-11-18T20:59:36.784645+0000","last_peered":"2023-11-18T20:59:36.784645+0000","last_clean":"2023-11-18T20:59:36.784645+0000","last_became_active":"2023-11-18T20:59:35.772563+0000","last_became_peered":"2023-11-18T20:59:35.772563+0000","last_unstale":"2023-11-18T20:59:36.784645+0000","last_undegraded":"2023-11-18T20:59:36.784645+0000","last_fullsized":"2023-11-18T20:59:36.784645+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:12.287749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746454+0000","last_change":"2023-11-18T20:59:27.892789+0000","last_active":"2023-11-18T20:59:35.746454+0000","last_peered":"2023-11-18T20:59:35.746454+0000","last_clean":"2023-11-18T20:59:35.746454+0000","last_became_active":"2023-11-18T20:59:27.891883+0000","last_became_peered":"2023-11-18T20:59:27.891883+0000","last_unstale":"2023-11-18T20:59:35.746454+0000","last_undegraded":"2023-11-18T20:59:35.746454+0000","last_fullsized":"2023-11-18T20:59:35.746454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:12.020475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.220320+0000","last_change":"2023-11-18T20:59:25.497309+0000","last_active":"2023-11-18T21:00:10.220320+0000","last_peered":"2023-11-18T21:00:10.220320+0000","last_clean":"2023-11-18T21:00:10.220320+0000","last_became_active":"2023-11-18T20:59:25.496680+0000","last_became_peered":"2023-11-18T20:59:25.496680+0000","last_unstale":"2023-11-18T21:00:10.220320+0000","last_undegraded":"2023-11-18T21:00:10.220320+0000","last_fullsized":"2023-11-18T21:00:10.220320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.688376+0000","last_change":"2023-11-18T20:59:35.842258+0000","last_active":"2023-11-18T20:59:36.688376+0000","last_peered":"2023-11-18T20:59:36.688376+0000","last_clean":"2023-11-18T20:59:36.688376+0000","last_became_active":"2023-11-18T20:59:35.838830+0000","last_became_peered":"2023-11-18T20:59:35.838830+0000","last_unstale":"2023-11-18T20:59:36.688376+0000","last_undegraded":"2023-11-18T20:59:36.688376+0000","last_fullsized":"2023-11-18T20:59:36.688376+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:12:39.697374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.689568+0000","last_change":"2023-11-18T20:59:35.839178+0000","last_active":"2023-11-18T20:59:36.689568+0000","last_peered":"2023-11-18T20:59:36.689568+0000","last_clean":"2023-11-18T20:59:36.689568+0000","last_became_active":"2023-11-18T20:59:35.838375+0000","last_became_peered":"2023-11-18T20:59:35.838375+0000","last_unstale":"2023-11-18T20:59:36.689568+0000","last_undegraded":"2023-11-18T20:59:36.689568+0000","last_fullsized":"2023-11-18T20:59:36.689568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:56:09.565932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.823342+0000","last_change":"2023-11-18T20:59:27.689539+0000","last_active":"2023-11-18T20:59:35.823342+0000","last_peered":"2023-11-18T20:59:35.823342+0000","last_clean":"2023-11-18T20:59:35.823342+0000","last_became_active":"2023-11-18T20:59:27.688522+0000","last_became_peered":"2023-11-18T20:59:27.688522+0000","last_unstale":"2023-11-18T20:59:35.823342+0000","last_undegraded":"2023-11-18T20:59:35.823342+0000","last_fullsized":"2023-11-18T20:59:35.823342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:06:48.337696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.310238+0000","last_change":"2023-11-18T20:59:25.494125+0000","last_active":"2023-11-18T20:59:37.310238+0000","last_peered":"2023-11-18T20:59:37.310238+0000","last_clean":"2023-11-18T20:59:37.310238+0000","last_became_active":"2023-11-18T20:59:25.493357+0000","last_became_peered":"2023-11-18T20:59:25.493357+0000","last_unstale":"2023-11-18T20:59:37.310238+0000","last_undegraded":"2023-11-18T20:59:37.310238+0000","last_fullsized":"2023-11-18T20:59:37.310238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311079+0000","last_change":"2023-11-18T20:59:35.776653+0000","last_active":"2023-11-18T20:59:37.311079+0000","last_peered":"2023-11-18T20:59:37.311079+0000","last_clean":"2023-11-18T20:59:37.311079+0000","last_became_active":"2023-11-18T20:59:35.776138+0000","last_became_peered":"2023-11-18T20:59:35.776138+0000","last_unstale":"2023-11-18T20:59:37.311079+0000","last_undegraded":"2023-11-18T20:59:37.311079+0000","last_fullsized":"2023-11-18T20:59:37.311079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:08:25.933599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770015+0000","last_change":"2023-11-18T20:59:27.860987+0000","last_active":"2023-11-18T20:59:35.770015+0000","last_peered":"2023-11-18T20:59:35.770015+0000","last_clean":"2023-11-18T20:59:35.770015+0000","last_became_active":"2023-11-18T20:59:27.860537+0000","last_became_peered":"2023-11-18T20:59:27.860537+0000","last_unstale":"2023-11-18T20:59:35.770015+0000","last_undegraded":"2023-11-18T20:59:35.770015+0000","last_fullsized":"2023-11-18T20:59:35.770015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819761+0000","last_change":"2023-11-18T20:59:25.354967+0000","last_active":"2023-11-18T20:59:35.819761+0000","last_peered":"2023-11-18T20:59:35.819761+0000","last_clean":"2023-11-18T20:59:35.819761+0000","last_became_active":"2023-11-18T20:59:25.354690+0000","last_became_peered":"2023-11-18T20:59:25.354690+0000","last_unstale":"2023-11-18T20:59:35.819761+0000","last_undegraded":"2023-11-18T20:59:35.819761+0000","last_fullsized":"2023-11-18T20:59:35.819761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:50.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696429+0000","last_change":"2023-11-18T20:59:25.346493+0000","last_active":"2023-11-18T20:59:35.696429+0000","last_peered":"2023-11-18T20:59:35.696429+0000","last_clean":"2023-11-18T20:59:35.696429+0000","last_became_active":"2023-11-18T20:59:25.346192+0000","last_became_peered":"2023-11-18T20:59:25.346192+0000","last_unstale":"2023-11-18T20:59:35.696429+0000","last_undegraded":"2023-11-18T20:59:35.696429+0000","last_fullsized":"2023-11-18T20:59:35.696429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:30.162962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819222+0000","last_change":"2023-11-18T20:59:27.868460+0000","last_active":"2023-11-18T20:59:35.819222+0000","last_peered":"2023-11-18T20:59:35.819222+0000","last_clean":"2023-11-18T20:59:35.819222+0000","last_became_active":"2023-11-18T20:59:27.867886+0000","last_became_peered":"2023-11-18T20:59:27.867886+0000","last_unstale":"2023-11-18T20:59:35.819222+0000","last_undegraded":"2023-11-18T20:59:35.819222+0000","last_fullsized":"2023-11-18T20:59:35.819222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:39.647294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.688950+0000","last_change":"2023-11-18T20:59:35.851163+0000","last_active":"2023-11-18T20:59:36.688950+0000","last_peered":"2023-11-18T20:59:36.688950+0000","last_clean":"2023-11-18T20:59:36.688950+0000","last_became_active":"2023-11-18T20:59:35.850427+0000","last_became_peered":"2023-11-18T20:59:35.850427+0000","last_unstale":"2023-11-18T20:59:36.688950+0000","last_undegraded":"2023-11-18T20:59:36.688950+0000","last_fullsized":"2023-11-18T20:59:36.688950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:20.729626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.175066+0000","last_change":"2023-11-18T20:59:25.462276+0000","last_active":"2023-11-18T21:00:10.175066+0000","last_peered":"2023-11-18T21:00:10.175066+0000","last_clean":"2023-11-18T21:00:10.175066+0000","last_became_active":"2023-11-18T20:59:25.460449+0000","last_became_peered":"2023-11-18T20:59:25.460449+0000","last_unstale":"2023-11-18T21:00:10.175066+0000","last_undegraded":"2023-11-18T21:00:10.175066+0000","last_fullsized":"2023-11-18T21:00:10.175066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:25:57.950600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.768671+0000","last_change":"2023-11-18T20:59:27.841332+0000","last_active":"2023-11-18T20:59:35.768671+0000","last_peered":"2023-11-18T20:59:35.768671+0000","last_clean":"2023-11-18T20:59:35.768671+0000","last_became_active":"2023-11-18T20:59:27.840528+0000","last_became_peered":"2023-11-18T20:59:27.840528+0000","last_unstale":"2023-11-18T20:59:35.768671+0000","last_undegraded":"2023-11-18T20:59:35.768671+0000","last_fullsized":"2023-11-18T20:59:35.768671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.785624+0000","last_change":"2023-11-18T20:59:35.776844+0000","last_active":"2023-11-18T20:59:36.785624+0000","last_peered":"2023-11-18T20:59:36.785624+0000","last_clean":"2023-11-18T20:59:36.785624+0000","last_became_active":"2023-11-18T20:59:35.775977+0000","last_became_peered":"2023-11-18T20:59:35.775977+0000","last_unstale":"2023-11-18T20:59:36.785624+0000","last_undegraded":"2023-11-18T20:59:36.785624+0000","last_fullsized":"2023-11-18T20:59:36.785624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:06:00.187752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.745152+0000","last_change":"2023-11-18T20:59:27.888673+0000","last_active":"2023-11-18T20:59:35.745152+0000","last_peered":"2023-11-18T20:59:35.745152+0000","last_clean":"2023-11-18T20:59:35.745152+0000","last_became_active":"2023-11-18T20:59:27.887716+0000","last_became_peered":"2023-11-18T20:59:27.887716+0000","last_unstale":"2023-11-18T20:59:35.745152+0000","last_undegraded":"2023-11-18T20:59:35.745152+0000","last_fullsized":"2023-11-18T20:59:35.745152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.680928+0000","last_change":"2023-11-18T20:59:27.684810+0000","last_active":"2023-11-18T20:59:35.680928+0000","last_peered":"2023-11-18T20:59:35.680928+0000","last_clean":"2023-11-18T20:59:35.680928+0000","last_became_active":"2023-11-18T20:59:27.680712+0000","last_became_peered":"2023-11-18T20:59:27.680712+0000","last_unstale":"2023-11-18T20:59:35.680928+0000","last_undegraded":"2023-11-18T20:59:35.680928+0000","last_fullsized":"2023-11-18T20:59:35.680928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696242+0000","last_change":"2023-11-18T20:59:27.835960+0000","last_active":"2023-11-18T20:59:35.696242+0000","last_peered":"2023-11-18T20:59:35.696242+0000","last_clean":"2023-11-18T20:59:35.696242+0000","last_became_active":"2023-11-18T20:59:27.835120+0000","last_became_peered":"2023-11-18T20:59:27.835120+0000","last_unstale":"2023-11-18T20:59:35.696242+0000","last_undegraded":"2023-11-18T20:59:35.696242+0000","last_fullsized":"2023-11-18T20:59:35.696242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:35:51.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770656+0000","last_change":"2023-11-18T20:59:27.833652+0000","last_active":"2023-11-18T20:59:35.770656+0000","last_peered":"2023-11-18T20:59:35.770656+0000","last_clean":"2023-11-18T20:59:35.770656+0000","last_became_active":"2023-11-18T20:59:27.833049+0000","last_became_peered":"2023-11-18T20:59:27.833049+0000","last_unstale":"2023-11-18T20:59:35.770656+0000","last_undegraded":"2023-11-18T20:59:35.770656+0000","last_fullsized":"2023-11-18T20:59:35.770656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:23.262919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.821721+0000","last_change":"2023-11-18T20:59:27.878824+0000","last_active":"2023-11-18T20:59:35.821721+0000","last_peered":"2023-11-18T20:59:35.821721+0000","last_clean":"2023-11-18T20:59:35.821721+0000","last_became_active":"2023-11-18T20:59:27.878353+0000","last_became_peered":"2023-11-18T20:59:27.878353+0000","last_unstale":"2023-11-18T20:59:35.821721+0000","last_undegraded":"2023-11-18T20:59:35.821721+0000","last_fullsized":"2023-11-18T20:59:35.821721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:04.074467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.820381+0000","last_change":"2023-11-18T20:59:27.866570+0000","last_active":"2023-11-18T20:59:35.820381+0000","last_peered":"2023-11-18T20:59:35.820381+0000","last_clean":"2023-11-18T20:59:35.820381+0000","last_became_active":"2023-11-18T20:59:27.866165+0000","last_became_peered":"2023-11-18T20:59:27.866165+0000","last_unstale":"2023-11-18T20:59:35.820381+0000","last_undegraded":"2023-11-18T20:59:35.820381+0000","last_fullsized":"2023-11-18T20:59:35.820381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:05:51.974471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746338+0000","last_change":"2023-11-18T20:59:27.895340+0000","last_active":"2023-11-18T20:59:35.746338+0000","last_peered":"2023-11-18T20:59:35.746338+0000","last_clean":"2023-11-18T20:59:35.746338+0000","last_became_active":"2023-11-18T20:59:27.893918+0000","last_became_peered":"2023-11-18T20:59:27.893918+0000","last_unstale":"2023-11-18T20:59:35.746338+0000","last_undegraded":"2023-11-18T20:59:35.746338+0000","last_fullsized":"2023-11-18T20:59:35.746338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:11.899550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.772271+0000","last_change":"2023-11-18T20:59:27.839127+0000","last_active":"2023-11-18T20:59:35.772271+0000","last_peered":"2023-11-18T20:59:35.772271+0000","last_clean":"2023-11-18T20:59:35.772271+0000","last_became_active":"2023-11-18T20:59:27.838509+0000","last_became_peered":"2023-11-18T20:59:27.838509+0000","last_unstale":"2023-11-18T20:59:35.772271+0000","last_undegraded":"2023-11-18T20:59:35.772271+0000","last_fullsized":"2023-11-18T20:59:35.772271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696213+0000","last_change":"2023-11-18T20:59:27.836167+0000","last_active":"2023-11-18T20:59:35.696213+0000","last_peered":"2023-11-18T20:59:35.696213+0000","last_clean":"2023-11-18T20:59:35.696213+0000","last_became_active":"2023-11-18T20:59:27.835226+0000","last_became_peered":"2023-11-18T20:59:27.835226+0000","last_unstale":"2023-11-18T20:59:35.696213+0000","last_undegraded":"2023-11-18T20:59:35.696213+0000","last_fullsized":"2023-11-18T20:59:35.696213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:23:46.608216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770190+0000","last_change":"2023-11-18T20:59:27.889937+0000","last_active":"2023-11-18T20:59:35.770190+0000","last_peered":"2023-11-18T20:59:35.770190+0000","last_clean":"2023-11-18T20:59:35.770190+0000","last_became_active":"2023-11-18T20:59:27.889325+0000","last_became_peered":"2023-11-18T20:59:27.889325+0000","last_unstale":"2023-11-18T20:59:35.770190+0000","last_undegraded":"2023-11-18T20:59:35.770190+0000","last_fullsized":"2023-11-18T20:59:35.770190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:39.674424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.768585+0000","last_change":"2023-11-18T20:59:27.867439+0000","last_active":"2023-11-18T20:59:35.768585+0000","last_peered":"2023-11-18T20:59:35.768585+0000","last_clean":"2023-11-18T20:59:35.768585+0000","last_became_active":"2023-11-18T20:59:27.866609+0000","last_became_peered":"2023-11-18T20:59:27.866609+0000","last_unstale":"2023-11-18T20:59:35.768585+0000","last_undegraded":"2023-11-18T20:59:35.768585+0000","last_fullsized":"2023-11-18T20:59:35.768585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:46:49.094141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819017+0000","last_change":"2023-11-18T20:59:27.883416+0000","last_active":"2023-11-18T20:59:35.819017+0000","last_peered":"2023-11-18T20:59:35.819017+0000","last_clean":"2023-11-18T20:59:35.819017+0000","last_became_active":"2023-11-18T20:59:27.882976+0000","last_became_peered":"2023-11-18T20:59:27.882976+0000","last_unstale":"2023-11-18T20:59:35.819017+0000","last_undegraded":"2023-11-18T20:59:35.819017+0000","last_fullsized":"2023-11-18T20:59:35.819017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:12.611142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759028+0000","last_change":"2023-11-18T20:59:27.873520+0000","last_active":"2023-11-18T20:59:35.759028+0000","last_peered":"2023-11-18T20:59:35.759028+0000","last_clean":"2023-11-18T20:59:35.759028+0000","last_became_active":"2023-11-18T20:59:27.872627+0000","last_became_peered":"2023-11-18T20:59:27.872627+0000","last_unstale":"2023-11-18T20:59:35.759028+0000","last_undegraded":"2023-11-18T20:59:35.759028+0000","last_fullsized":"2023-11-18T20:59:35.759028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.697486+0000","last_change":"2023-11-18T20:59:27.687118+0000","last_active":"2023-11-18T20:59:35.697486+0000","last_peered":"2023-11-18T20:59:35.697486+0000","last_clean":"2023-11-18T20:59:35.697486+0000","last_became_active":"2023-11-18T20:59:27.686311+0000","last_became_peered":"2023-11-18T20:59:27.686311+0000","last_unstale":"2023-11-18T20:59:35.697486+0000","last_undegraded":"2023-11-18T20:59:35.697486+0000","last_fullsized":"2023-11-18T20:59:35.697486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:25:27.490214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.681564+0000","last_change":"2023-11-18T20:59:27.892404+0000","last_active":"2023-11-18T20:59:35.681564+0000","last_peered":"2023-11-18T20:59:35.681564+0000","last_clean":"2023-11-18T20:59:35.681564+0000","last_became_active":"2023-11-18T20:59:27.891767+0000","last_became_peered":"2023-11-18T20:59:27.891767+0000","last_unstale":"2023-11-18T20:59:35.681564+0000","last_undegraded":"2023-11-18T20:59:35.681564+0000","last_fullsized":"2023-11-18T20:59:35.681564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.698022+0000","last_change":"2023-11-18T20:59:27.866920+0000","last_active":"2023-11-18T20:59:35.698022+0000","last_peered":"2023-11-18T20:59:35.698022+0000","last_clean":"2023-11-18T20:59:35.698022+0000","last_became_active":"2023-11-18T20:59:27.866153+0000","last_became_peered":"2023-11-18T20:59:27.866153+0000","last_unstale":"2023-11-18T20:59:35.698022+0000","last_undegraded":"2023-11-18T20:59:35.698022+0000","last_fullsized":"2023-11-18T20:59:35.698022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:50:43.894365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696090+0000","last_change":"2023-11-18T20:59:27.890399+0000","last_active":"2023-11-18T20:59:35.696090+0000","last_peered":"2023-11-18T20:59:35.696090+0000","last_clean":"2023-11-18T20:59:35.696090+0000","last_became_active":"2023-11-18T20:59:27.889704+0000","last_became_peered":"2023-11-18T20:59:27.889704+0000","last_unstale":"2023-11-18T20:59:35.696090+0000","last_undegraded":"2023-11-18T20:59:35.696090+0000","last_fullsized":"2023-11-18T20:59:35.696090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:34:37.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769850+0000","last_change":"2023-11-18T20:59:27.871794+0000","last_active":"2023-11-18T20:59:35.769850+0000","last_peered":"2023-11-18T20:59:35.769850+0000","last_clean":"2023-11-18T20:59:35.769850+0000","last_became_active":"2023-11-18T20:59:27.871337+0000","last_became_peered":"2023-11-18T20:59:27.871337+0000","last_unstale":"2023-11-18T20:59:35.769850+0000","last_undegraded":"2023-11-18T20:59:35.769850+0000","last_fullsized":"2023-11-18T20:59:35.769850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:16.370847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819983+0000","last_change":"2023-11-18T20:59:27.867288+0000","last_active":"2023-11-18T20:59:35.819983+0000","last_peered":"2023-11-18T20:59:35.819983+0000","last_clean":"2023-11-18T20:59:35.819983+0000","last_became_active":"2023-11-18T20:59:27.866560+0000","last_became_peered":"2023-11-18T20:59:27.866560+0000","last_unstale":"2023-11-18T20:59:35.819983+0000","last_undegraded":"2023-11-18T20:59:35.819983+0000","last_fullsized":"2023-11-18T20:59:35.819983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.823432+0000","last_change":"2023-11-18T20:59:27.878944+0000","last_active":"2023-11-18T20:59:35.823432+0000","last_peered":"2023-11-18T20:59:35.823432+0000","last_clean":"2023-11-18T20:59:35.823432+0000","last_became_active":"2023-11-18T20:59:27.878485+0000","last_became_peered":"2023-11-18T20:59:27.878485+0000","last_unstale":"2023-11-18T20:59:35.823432+0000","last_undegraded":"2023-11-18T20:59:35.823432+0000","last_fullsized":"2023-11-18T20:59:35.823432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:04.749189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.758902+0000","last_change":"2023-11-18T20:59:27.874019+0000","last_active":"2023-11-18T20:59:35.758902+0000","last_peered":"2023-11-18T20:59:35.758902+0000","last_clean":"2023-11-18T20:59:35.758902+0000","last_became_active":"2023-11-18T20:59:27.873255+0000","last_became_peered":"2023-11-18T20:59:27.873255+0000","last_unstale":"2023-11-18T20:59:35.758902+0000","last_undegraded":"2023-11-18T20:59:35.758902+0000","last_fullsized":"2023-11-18T20:59:35.758902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759661+0000","last_change":"2023-11-18T20:59:27.868086+0000","last_active":"2023-11-18T20:59:35.759661+0000","last_peered":"2023-11-18T20:59:35.759661+0000","last_clean":"2023-11-18T20:59:35.759661+0000","last_became_active":"2023-11-18T20:59:27.866901+0000","last_became_peered":"2023-11-18T20:59:27.866901+0000","last_unstale":"2023-11-18T20:59:35.759661+0000","last_undegraded":"2023-11-18T20:59:35.759661+0000","last_fullsized":"2023-11-18T20:59:35.759661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759791+0000","last_change":"2023-11-18T20:59:27.888617+0000","last_active":"2023-11-18T20:59:35.759791+0000","last_peered":"2023-11-18T20:59:35.759791+0000","last_clean":"2023-11-18T20:59:35.759791+0000","last_became_active":"2023-11-18T20:59:27.888068+0000","last_became_peered":"2023-11-18T20:59:27.888068+0000","last_unstale":"2023-11-18T20:59:35.759791+0000","last_undegraded":"2023-11-18T20:59:35.759791+0000","last_fullsized":"2023-11-18T20:59:35.759791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:53.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769443+0000","last_change":"2023-11-18T20:59:27.684428+0000","last_active":"2023-11-18T20:59:35.769443+0000","last_peered":"2023-11-18T20:59:35.769443+0000","last_clean":"2023-11-18T20:59:35.769443+0000","last_became_active":"2023-11-18T20:59:27.682936+0000","last_became_peered":"2023-11-18T20:59:27.682936+0000","last_unstale":"2023-11-18T20:59:35.769443+0000","last_undegraded":"2023-11-18T20:59:35.769443+0000","last_fullsized":"2023-11-18T20:59:35.769443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:52.955875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769402+0000","last_change":"2023-11-18T20:59:27.865937+0000","last_active":"2023-11-18T20:59:35.769402+0000","last_peered":"2023-11-18T20:59:35.769402+0000","last_clean":"2023-11-18T20:59:35.769402+0000","last_became_active":"2023-11-18T20:59:27.865401+0000","last_became_peered":"2023-11-18T20:59:27.865401+0000","last_unstale":"2023-11-18T20:59:35.769402+0000","last_undegraded":"2023-11-18T20:59:35.769402+0000","last_fullsized":"2023-11-18T20:59:35.769402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:00.251369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.757858+0000","last_change":"2023-11-18T20:59:27.865748+0000","last_active":"2023-11-18T20:59:35.757858+0000","last_peered":"2023-11-18T20:59:35.757858+0000","last_clean":"2023-11-18T20:59:35.757858+0000","last_became_active":"2023-11-18T20:59:27.864956+0000","last_became_peered":"2023-11-18T20:59:27.864956+0000","last_unstale":"2023-11-18T20:59:35.757858+0000","last_undegraded":"2023-11-18T20:59:35.757858+0000","last_fullsized":"2023-11-18T20:59:35.757858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746209+0000","last_change":"2023-11-18T20:59:27.889838+0000","last_active":"2023-11-18T20:59:35.746209+0000","last_peered":"2023-11-18T20:59:35.746209+0000","last_clean":"2023-11-18T20:59:35.746209+0000","last_became_active":"2023-11-18T20:59:27.889307+0000","last_became_peered":"2023-11-18T20:59:27.889307+0000","last_unstale":"2023-11-18T20:59:35.746209+0000","last_undegraded":"2023-11-18T20:59:35.746209+0000","last_fullsized":"2023-11-18T20:59:35.746209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.758577+0000","last_change":"2023-11-18T20:59:27.866394+0000","last_active":"2023-11-18T20:59:35.758577+0000","last_peered":"2023-11-18T20:59:35.758577+0000","last_clean":"2023-11-18T20:59:35.758577+0000","last_became_active":"2023-11-18T20:59:27.865625+0000","last_became_peered":"2023-11-18T20:59:27.865625+0000","last_unstale":"2023-11-18T20:59:35.758577+0000","last_undegraded":"2023-11-18T20:59:35.758577+0000","last_fullsized":"2023-11-18T20:59:35.758577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.745362+0000","last_change":"2023-11-18T20:59:27.892765+0000","last_active":"2023-11-18T20:59:35.745362+0000","last_peered":"2023-11-18T20:59:35.745362+0000","last_clean":"2023-11-18T20:59:35.745362+0000","last_became_active":"2023-11-18T20:59:27.891753+0000","last_became_peered":"2023-11-18T20:59:27.891753+0000","last_unstale":"2023-11-18T20:59:35.745362+0000","last_undegraded":"2023-11-18T20:59:35.745362+0000","last_fullsized":"2023-11-18T20:59:35.745362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:52.955875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770669+0000","last_change":"2023-11-18T20:59:27.837531+0000","last_active":"2023-11-18T20:59:35.770669+0000","last_peered":"2023-11-18T20:59:35.770669+0000","last_clean":"2023-11-18T20:59:35.770669+0000","last_became_active":"2023-11-18T20:59:27.836899+0000","last_became_peered":"2023-11-18T20:59:27.836899+0000","last_unstale":"2023-11-18T20:59:35.770669+0000","last_undegraded":"2023-11-18T20:59:35.770669+0000","last_fullsized":"2023-11-18T20:59:35.770669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:04.716391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.771353+0000","last_change":"2023-11-18T20:59:27.864494+0000","last_active":"2023-11-18T20:59:35.771353+0000","last_peered":"2023-11-18T20:59:35.771353+0000","last_clean":"2023-11-18T20:59:35.771353+0000","last_became_active":"2023-11-18T20:59:27.863732+0000","last_became_peered":"2023-11-18T20:59:27.863732+0000","last_unstale":"2023-11-18T20:59:35.771353+0000","last_undegraded":"2023-11-18T20:59:35.771353+0000","last_fullsized":"2023-11-18T20:59:35.771353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759787+0000","last_change":"2023-11-18T20:59:27.873605+0000","last_active":"2023-11-18T20:59:35.759787+0000","last_peered":"2023-11-18T20:59:35.759787+0000","last_clean":"2023-11-18T20:59:35.759787+0000","last_became_active":"2023-11-18T20:59:27.871167+0000","last_became_peered":"2023-11-18T20:59:27.871167+0000","last_unstale":"2023-11-18T20:59:35.759787+0000","last_undegraded":"2023-11-18T20:59:35.759787+0000","last_fullsized":"2023-11-18T20:59:35.759787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:54:51.212807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5955,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":11328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":123336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.133}]},{"osd":2,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.075},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.92500000000000004}]},{"osd":3,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.052},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.96099999999999997}]},{"osd":4,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.999}]},{"osd":5,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.181},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.032}]},{"osd":6,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.103}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":123252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.077},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.82499999999999996}]},{"osd":1,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.113}]},{"osd":2,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.145},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.86299999999999999}]},{"osd":3,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.98599999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.0389999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.1759999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.2110000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":713712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.86899999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.97099999999999997}]},{"osd":2,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.47099999999999997}]},{"osd":3,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60699999999999998}]},{"osd":4,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.80100000000000005}]},{"osd":6,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.54700000000000004}]},{"osd":7,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.024},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.94099999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":315392,"data_stored":123234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.85999999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.81000000000000005}]},{"osd":4,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.91400000000000003}]},{"osd":5,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.1659999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.046},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":1.091}]},{"osd":7,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.28},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.2190000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":126471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.79700000000000004}]},{"osd":1,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.91700000000000004}]},{"osd":4,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":1.0129999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.109},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.1439999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.1779999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.05}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":909312,"data_stored":713158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.72899999999999998}]},{"osd":3,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.056}]},{"osd":4,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.024},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.133}]},{"osd":5,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.294},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.103}]},{"osd":6,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.246}]},{"osd":7,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.181},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.1599999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":122776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.1779999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.92100000000000004}]},{"osd":3,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.81000000000000005}]},{"osd":4,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.012},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.90500000000000003}]},{"osd":5,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.359},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.0980000000000001}]},{"osd":6,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.0509999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.2410000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.92900000000000005}]},{"osd":1,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.76600000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.88700000000000001},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.67500000000000004}]},{"osd":3,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.80100000000000005}]},{"osd":5,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.1299999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.98699999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.365},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.0900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T21:00:15.258 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-18T21:00:15.258 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-18T21:00:15.258 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-18T21:00:15.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-18T21:00:15.259 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-18T21:00:15.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.424+0000 7f8a11faa640 1 Processor -- start 2023-11-18T21:00:15.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.424+0000 7f8a11faa640 1 -- start start 2023-11-18T21:00:15.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.424+0000 7f8a11faa640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a0c0ce0c0 0x7f8a0c0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:15.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.424+0000 7f8a11faa640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8a0c0cc3c0 0x7f8a0c159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:15.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.424+0000 7f8a11faa640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0c0cd9a0 con 0x7f8a0c0cdb70 2023-11-18T21:00:15.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.424+0000 7f8a11faa640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c0ca550 con 0x7f8a0c0cc3c0 2023-11-18T21:00:15.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.424+0000 7f8a11faa640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0ce9e0 con 0x7f8a0c0ce0c0 2023-11-18T21:00:15.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.428+0000 7f8a0affd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8a0c0cc3c0 0x7f8a0c159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:15.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.428+0000 7f8a0affd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8a0c0cc3c0 0x7f8a0c159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:37698/0 (socket says 172.21.15.49:37698) 2023-11-18T21:00:15.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.428+0000 7f8a0affd640 1 -- 172.21.15.49:0/3071223820 learned_addr learned my addr 172.21.15.49:0/3071223820 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:15.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.436+0000 7f8a0affd640 1 -- 172.21.15.49:0/3071223820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a0c0ce0c0 msgr2=0x7f8a0c0ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:15.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.436+0000 7f8a0affd640 1 --2- 172.21.15.49:0/3071223820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a0c0ce0c0 0x7f8a0c0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:15.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.436+0000 7f8a0affd640 1 -- 172.21.15.49:0/3071223820 >> v1:172.21.15.106:6789/0 conn(0x7f8a0c0cdb70 legacy=0x7f8a0c15cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:15.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.436+0000 7f8a0affd640 1 -- 172.21.15.49:0/3071223820 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c1596c0 con 0x7f8a0c0cc3c0 2023-11-18T21:00:15.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.440+0000 7f8a0affd640 1 --2- 172.21.15.49:0/3071223820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a0c0cc3c0 0x7f8a0c159b70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009870 tx=0x7f8a0001c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f08de6ee2657759 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.456+0000 7f8a0a7fc640 1 -- 172.21.15.49:0/3071223820 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000aa620 con 0x7f8a0c0cc3c0 2023-11-18T21:00:15.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.456+0000 7f8a0a7fc640 1 -- 172.21.15.49:0/3071223820 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a000aa780 con 0x7f8a0c0cc3c0 2023-11-18T21:00:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.456+0000 7f8a0a7fc640 1 -- 172.21.15.49:0/3071223820 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000aab10 con 0x7f8a0c0cc3c0 2023-11-18T21:00:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 -- 172.21.15.49:0/3071223820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a0c0cc3c0 msgr2=0x7f8a0c159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:15.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 --2- 172.21.15.49:0/3071223820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a0c0cc3c0 0x7f8a0c159b70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009870 tx=0x7f8a0001c500 comp rx=0 tx=0).stop 2023-11-18T21:00:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 -- 172.21.15.49:0/3071223820 shutdown_connections 2023-11-18T21:00:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 --2- 172.21.15.49:0/3071223820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a0c0cc3c0 0x7f8a0c159b70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 --2- 172.21.15.49:0/3071223820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a0c0ce0c0 0x7f8a0c0ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 -- 172.21.15.49:0/3071223820 >> 172.21.15.49:0/3071223820 conn(0x7f8a0c0b07c0 msgr2=0x7f8a0c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 -- 172.21.15.49:0/3071223820 shutdown_connections 2023-11-18T21:00:15.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 -- 172.21.15.49:0/3071223820 wait complete. 2023-11-18T21:00:15.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 Processor -- start 2023-11-18T21:00:15.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 -- start start 2023-11-18T21:00:15.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a0c0cc3c0 0x7f8a0c15c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:15.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c0cdb70 0x7f8a0c0c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:15.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a0c0ce0c0 0x7f8a0c0c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:15.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c14b510 con 0x7f8a0c0cdb70 2023-11-18T21:00:15.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c15a710 con 0x7f8a0c0cc3c0 2023-11-18T21:00:15.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a11faa640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c14b740 con 0x7f8a0c0ce0c0 2023-11-18T21:00:15.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a0affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c0cdb70 0x7f8a0c0c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:15.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a0affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c0cdb70 0x7f8a0c0c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49160/0 (socket says 172.21.15.49:49160) 2023-11-18T21:00:15.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.460+0000 7f8a0affd640 1 -- 172.21.15.49:0/2146019411 learned_addr learned my addr 172.21.15.49:0/2146019411 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.464+0000 7f8a0affd640 1 -- 172.21.15.49:0/2146019411 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a0c0ce0c0 msgr2=0x7f8a0c0c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.464+0000 7f8a0affd640 1 --2- 172.21.15.49:0/2146019411 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a0c0ce0c0 0x7f8a0c0c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.464+0000 7f8a0affd640 1 -- 172.21.15.49:0/2146019411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a0c0cc3c0 msgr2=0x7f8a0c15c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.464+0000 7f8a0affd640 1 --2- 172.21.15.49:0/2146019411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a0c0cc3c0 0x7f8a0c15c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:15.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.464+0000 7f8a0affd640 1 -- 172.21.15.49:0/2146019411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a000094d0 con 0x7f8a0c0cdb70 2023-11-18T21:00:15.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.468+0000 7f8a0affd640 1 --2- 172.21.15.49:0/2146019411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c0cdb70 0x7f8a0c0c39d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a000ac040 tx=0x7f8a0001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:15.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.472+0000 7f89f3fff640 1 -- 172.21.15.49:0/2146019411 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000bd3f0 con 0x7f8a0c0cdb70 2023-11-18T21:00:15.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.472+0000 7f89f3fff640 1 -- 172.21.15.49:0/2146019411 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a000bd570 con 0x7f8a0c0cdb70 2023-11-18T21:00:15.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.472+0000 7f89f3fff640 1 -- 172.21.15.49:0/2146019411 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000bd920 con 0x7f8a0c0cdb70 2023-11-18T21:00:15.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.472+0000 7f8a11faa640 1 -- 172.21.15.49:0/2146019411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c14ba20 con 0x7f8a0c0cdb70 2023-11-18T21:00:15.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.472+0000 7f8a11faa640 1 -- 172.21.15.49:0/2146019411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c15ac40 con 0x7f8a0c0cdb70 2023-11-18T21:00:15.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.472+0000 7f8a11faa640 1 -- 172.21.15.49:0/2146019411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c067520 con 0x7f8a0c0cdb70 2023-11-18T21:00:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.492+0000 7f89f3fff640 1 -- 172.21.15.49:0/2146019411 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8a000b33f0 con 0x7f8a0c0cdb70 2023-11-18T21:00:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.492+0000 7f89f3fff640 1 --2- 172.21.15.49:0/2146019411 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f89f80664f0 0x7f89f80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:15.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.492+0000 7f8a0b7fe640 1 --2- 172.21.15.49:0/2146019411 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f89f80664f0 0x7f89f80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:15.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.496+0000 7f8a0b7fe640 1 --2- 172.21.15.49:0/2146019411 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f89f80664f0 0x7f89f80689b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00ab90 tx=0x7f89fc009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:15.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.780+0000 7f89f3fff640 1 -- 172.21.15.49:0/2146019411 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a000efd70 con 0x7f8a0c0cdb70 2023-11-18T21:00:15.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:15.780+0000 7f89f3fff640 1 -- 172.21.15.49:0/2146019411 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a000eb9b0 con 0x7f8a0c0cdb70 2023-11-18T21:00:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.032+0000 7f8a11faa640 1 -- 172.21.15.49:0/2146019411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8a0c148fe0 con 0x7f8a0c0cdb70 2023-11-18T21:00:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.316+0000 7f89f3fff640 1 -- 172.21.15.49:0/2146019411 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164438 (secure 0 0 0) 0x7f8a000eefd0 con 0x7f8a0c0cdb70 2023-11-18T21:00:16.320 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:16.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.320+0000 7f8a11faa640 1 -- 172.21.15.49:0/2146019411 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f89f80664f0 msgr2=0x7f89f80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:16.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.320+0000 7f8a11faa640 1 --2- 172.21.15.49:0/2146019411 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f89f80664f0 0x7f89f80689b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00ab90 tx=0x7f89fc009250 comp rx=0 tx=0).stop 2023-11-18T21:00:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.320+0000 7f8a11faa640 1 -- 172.21.15.49:0/2146019411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c0cdb70 msgr2=0x7f8a0c0c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.320+0000 7f8a11faa640 1 --2- 172.21.15.49:0/2146019411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c0cdb70 0x7f8a0c0c39d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a000ac040 tx=0x7f8a0001ad40 comp rx=0 tx=0).stop 2023-11-18T21:00:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.320+0000 7f8a11faa640 1 -- 172.21.15.49:0/2146019411 shutdown_connections 2023-11-18T21:00:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.320+0000 7f8a11faa640 1 --2- 172.21.15.49:0/2146019411 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f89f80664f0 0x7f89f80689b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.320+0000 7f8a11faa640 1 --2- 172.21.15.49:0/2146019411 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a0c0ce0c0 0x7f8a0c0c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.320+0000 7f8a11faa640 1 --2- 172.21.15.49:0/2146019411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a0c0cdb70 0x7f8a0c0c39d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.320+0000 7f8a11faa640 1 --2- 172.21.15.49:0/2146019411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a0c0cc3c0 0x7f8a0c15c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.320+0000 7f8a11faa640 1 -- 172.21.15.49:0/2146019411 >> 172.21.15.49:0/2146019411 conn(0x7f8a0c0b07c0 msgr2=0x7f8a0c06c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.320+0000 7f8a11faa640 1 -- 172.21.15.49:0/2146019411 shutdown_connections 2023-11-18T21:00:16.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.320+0000 7f8a11faa640 1 -- 172.21.15.49:0/2146019411 wait complete. 2023-11-18T21:00:16.349 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":2832976331},{"type":"v1","addr":"172.21.15.106:6801","nonce":2832976331}]},"active_addr":"172.21.15.106:6801/2832976331","active_change":"2023-11-18T20:58:25.053980+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":1697806469}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":959199377}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3647985803}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":1146316158}]}]} 2023-11-18T21:00:16.353 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-18T21:00:16.353 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-18T21:00:16.353 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T21:00:16.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.480+0000 7f716f8d6640 1 Processor -- start 2023-11-18T21:00:16.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.484+0000 7f716f8d6640 1 -- start start 2023-11-18T21:00:16.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.484+0000 7f716f8d6640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71680cc3c0 0x7f71680ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:16.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.484+0000 7f716f8d6640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f716815a280 0x7f7168163e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:16.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.484+0000 7f716f8d6640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71680cd9a0 con 0x7f71680ce0c0 2023-11-18T21:00:16.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.484+0000 7f716f8d6640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71680ca550 con 0x7f716815a280 2023-11-18T21:00:16.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.484+0000 7f716f8d6640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71680ce9e0 con 0x7f71680cc3c0 2023-11-18T21:00:16.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.484+0000 7f716d672640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f71680ce0c0 0x7f7168159b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34072/0 (socket says 172.21.15.49:34072) 2023-11-18T21:00:16.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.484+0000 7f716d672640 1 -- 172.21.15.49:0/1945868857 learned_addr learned my addr 172.21.15.49:0/1945868857 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:16.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.484+0000 7f716ce71640 1 --2- 172.21.15.49:0/1945868857 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71680cc3c0 0x7f71680ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:16.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.488+0000 7f716de73640 1 --2- 172.21.15.49:0/1945868857 >> v2:172.21.15.106:3300/0 conn(0x7f716815a280 0x7f7168163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:16.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.488+0000 7f715ffff640 1 -- 172.21.15.49:0/1945868857 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183255341 0 0) 0x7f71680cd9a0 con 0x7f71680ce0c0 2023-11-18T21:00:16.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.488+0000 7f715ffff640 1 -- 172.21.15.49:0/1945868857 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7154003530 con 0x7f71680ce0c0 2023-11-18T21:00:16.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.488+0000 7f716ce71640 1 -- 172.21.15.49:0/1945868857 >> v2:172.21.15.106:3300/0 conn(0x7f716815a280 msgr2=0x7f7168163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:16.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.488+0000 7f716ce71640 1 --2- 172.21.15.49:0/1945868857 >> v2:172.21.15.106:3300/0 conn(0x7f716815a280 0x7f7168163e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:16.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.488+0000 7f716ce71640 1 -- 172.21.15.49:0/1945868857 >> v1:172.21.15.49:6789/0 conn(0x7f71680ce0c0 legacy=0x7f7168159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:16.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.488+0000 7f716ce71640 1 -- 172.21.15.49:0/1945868857 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71681596c0 con 0x7f71680cc3c0 2023-11-18T21:00:16.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.492+0000 7f716ce71640 1 --2- 172.21.15.49:0/1945868857 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71680cc3c0 0x7f71680ce4a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71580097c0 tx=0x7f715801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a7f58da5348e216 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:16.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.496+0000 7f715ffff640 1 -- 172.21.15.49:0/1945868857 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71580ab680 con 0x7f71680cc3c0 2023-11-18T21:00:16.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.496+0000 7f715ffff640 1 -- 172.21.15.49:0/1945868857 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71580ab7e0 con 0x7f71680cc3c0 2023-11-18T21:00:16.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.496+0000 7f715ffff640 1 -- 172.21.15.49:0/1945868857 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71580abb70 con 0x7f71680cc3c0 2023-11-18T21:00:16.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 -- 172.21.15.49:0/1945868857 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71680cc3c0 msgr2=0x7f71680ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:16.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 --2- 172.21.15.49:0/1945868857 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71680cc3c0 0x7f71680ce4a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71580097c0 tx=0x7f715801c480 comp rx=0 tx=0).stop 2023-11-18T21:00:16.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 -- 172.21.15.49:0/1945868857 shutdown_connections 2023-11-18T21:00:16.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 --2- 172.21.15.49:0/1945868857 >> v2:172.21.15.106:3300/0 conn(0x7f716815a280 0x7f7168163e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:16.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 --2- 172.21.15.49:0/1945868857 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71680cc3c0 0x7f71680ce4a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:16.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 -- 172.21.15.49:0/1945868857 >> 172.21.15.49:0/1945868857 conn(0x7f71680b07c0 msgr2=0x7f71680b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:16.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 -- 172.21.15.49:0/1945868857 shutdown_connections 2023-11-18T21:00:16.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 -- 172.21.15.49:0/1945868857 wait complete. 2023-11-18T21:00:16.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 Processor -- start 2023-11-18T21:00:16.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 -- start start 2023-11-18T21:00:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71680cc3c0 0x7f71681f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71680ce0c0 0x7f7168157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f716815a280 0x7f7168157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71681594f0 con 0x7f71680ce0c0 2023-11-18T21:00:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71681556c0 con 0x7f716815a280 2023-11-18T21:00:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716f8d6640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7168145830 con 0x7f71680cc3c0 2023-11-18T21:00:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716ce71640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71680ce0c0 0x7f7168157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716d672640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71680cc3c0 0x7f71681f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716de73640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f716815a280 0x7f7168157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716ce71640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71680ce0c0 0x7f7168157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38098/0 (socket says 172.21.15.49:38098) 2023-11-18T21:00:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.500+0000 7f716ce71640 1 -- 172.21.15.49:0/282513056 learned_addr learned my addr 172.21.15.49:0/282513056 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:16.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.504+0000 7f716ce71640 1 -- 172.21.15.49:0/282513056 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71680cc3c0 msgr2=0x7f71681f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:16.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.504+0000 7f716ce71640 1 --2- 172.21.15.49:0/282513056 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71680cc3c0 0x7f71681f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:16.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.504+0000 7f716ce71640 1 -- 172.21.15.49:0/282513056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f716815a280 msgr2=0x7f7168157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:16.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.504+0000 7f716ce71640 1 --2- 172.21.15.49:0/282513056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f716815a280 0x7f7168157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:16.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.504+0000 7f716ce71640 1 -- 172.21.15.49:0/282513056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7158009420 con 0x7f71680ce0c0 2023-11-18T21:00:16.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.508+0000 7f716ce71640 1 --2- 172.21.15.49:0/282513056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71680ce0c0 0x7f7168157800 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f71580ad040 tx=0x7f715801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.512+0000 7f715dffb640 1 -- 172.21.15.49:0/282513056 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71580b5810 con 0x7f71680ce0c0 2023-11-18T21:00:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.512+0000 7f715dffb640 1 -- 172.21.15.49:0/282513056 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71580b5990 con 0x7f71680ce0c0 2023-11-18T21:00:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.512+0000 7f715dffb640 1 -- 172.21.15.49:0/282513056 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71580b5d40 con 0x7f71680ce0c0 2023-11-18T21:00:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.512+0000 7f716f8d6640 1 -- 172.21.15.49:0/282513056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7168155a30 con 0x7f71680ce0c0 2023-11-18T21:00:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.512+0000 7f716f8d6640 1 -- 172.21.15.49:0/282513056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71681f6ac0 con 0x7f71680ce0c0 2023-11-18T21:00:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.512+0000 7f716f8d6640 1 -- 172.21.15.49:0/282513056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7168067520 con 0x7f71680ce0c0 2023-11-18T21:00:16.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.800+0000 7f715dffb640 1 -- 172.21.15.49:0/282513056 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f71580ca3e0 con 0x7f71680ce0c0 2023-11-18T21:00:16.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.804+0000 7f715dffb640 1 --2- 172.21.15.49:0/282513056 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f714c066470 0x7f714c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:16.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.804+0000 7f716d672640 1 --2- 172.21.15.49:0/282513056 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f714c066470 0x7f714c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:16.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.804+0000 7f716d672640 1 --2- 172.21.15.49:0/282513056 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f714c066470 0x7f714c068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7164007fd0 tx=0x7f7164009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:16.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.840+0000 7f715dffb640 1 -- 172.21.15.49:0/282513056 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f71580f02c0 con 0x7f71680ce0c0 2023-11-18T21:00:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:16.840+0000 7f715dffb640 1 -- 172.21.15.49:0/282513056 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71580ec600 con 0x7f71680ce0c0 2023-11-18T21:00:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.016+0000 7f716f8d6640 1 -- 172.21.15.49:0/282513056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71680b4c30 con 0x7f71680ce0c0 2023-11-18T21:00:17.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.068+0000 7f715dffb640 1 -- 172.21.15.49:0/282513056 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18314 (secure 0 0 0) 0x7f71580ab640 con 0x7f71680ce0c0 2023-11-18T21:00:17.067 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:17.067 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":29,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:59:36.521114+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T21:00:17.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.068+0000 7f716f8d6640 1 -- 172.21.15.49:0/282513056 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f714c066470 msgr2=0x7f714c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:17.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.068+0000 7f716f8d6640 1 --2- 172.21.15.49:0/282513056 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f714c066470 0x7f714c068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7164007fd0 tx=0x7f7164009040 comp rx=0 tx=0).stop 2023-11-18T21:00:17.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.068+0000 7f716f8d6640 1 -- 172.21.15.49:0/282513056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71680ce0c0 msgr2=0x7f7168157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:17.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.068+0000 7f716f8d6640 1 --2- 172.21.15.49:0/282513056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71680ce0c0 0x7f7168157800 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f71580ad040 tx=0x7f715801acc0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.068+0000 7f716f8d6640 1 -- 172.21.15.49:0/282513056 shutdown_connections 2023-11-18T21:00:17.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.068+0000 7f716f8d6640 1 --2- 172.21.15.49:0/282513056 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f714c066470 0x7f714c068930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.068+0000 7f716f8d6640 1 --2- 172.21.15.49:0/282513056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f716815a280 0x7f7168157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.068+0000 7f716f8d6640 1 --2- 172.21.15.49:0/282513056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71680ce0c0 0x7f7168157800 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.068+0000 7f716f8d6640 1 --2- 172.21.15.49:0/282513056 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71680cc3c0 0x7f71681f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.068+0000 7f716f8d6640 1 -- 172.21.15.49:0/282513056 >> 172.21.15.49:0/282513056 conn(0x7f71680b07c0 msgr2=0x7f716814ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:17.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.068+0000 7f716f8d6640 1 -- 172.21.15.49:0/282513056 shutdown_connections 2023-11-18T21:00:17.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.068+0000 7f716f8d6640 1 -- 172.21.15.49:0/282513056 wait complete. 2023-11-18T21:00:17.089 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-18T21:00:17.089 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T21:00:17.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.220+0000 7fa00a14e640 1 Processor -- start 2023-11-18T21:00:17.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.220+0000 7fa00a14e640 1 -- start start 2023-11-18T21:00:17.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.224+0000 7fa00a14e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa0040c1ed0 0x7fa00406e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:17.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.224+0000 7fa00a14e640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0040c3b10 con 0x7fa004070ab0 2023-11-18T21:00:17.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.224+0000 7fa00a14e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0040c46b0 con 0x7fa00414f850 2023-11-18T21:00:17.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.224+0000 7fa00a14e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00414fc30 con 0x7fa0040c1ed0 2023-11-18T21:00:17.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.224+0000 7fa003fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa004070ab0 0x7fa004160180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34082/0 (socket says 172.21.15.49:34082) 2023-11-18T21:00:17.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.224+0000 7fa003fff640 1 -- 172.21.15.49:0/3524822757 learned_addr learned my addr 172.21.15.49:0/3524822757 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:17.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.224+0000 7fa002ffd640 1 --2- 172.21.15.49:0/3524822757 >> v2:172.21.15.106:3300/0 conn(0x7fa0040c1ed0 0x7fa00406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:17.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.228+0000 7fa0027fc640 1 -- 172.21.15.49:0/3524822757 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145827434 0 0) 0x7fa0040c3b10 con 0x7fa004070ab0 2023-11-18T21:00:17.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.228+0000 7fa0027fc640 1 -- 172.21.15.49:0/3524822757 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fec003450 con 0x7fa004070ab0 2023-11-18T21:00:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.232+0000 7fa0027fc640 1 -- 172.21.15.49:0/3524822757 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3985027437 0 0) 0x7f9fec003450 con 0x7fa004070ab0 2023-11-18T21:00:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.232+0000 7fa0027fc640 1 -- 172.21.15.49:0/3524822757 >> v2:172.21.15.106:3300/0 conn(0x7fa0040c1ed0 msgr2=0x7fa00406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.232+0000 7fa0027fc640 1 --2- 172.21.15.49:0/3524822757 >> v2:172.21.15.106:3300/0 conn(0x7fa0040c1ed0 0x7fa00406e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.232+0000 7fa0027fc640 1 -- 172.21.15.49:0/3524822757 >> v1:172.21.15.106:6789/0 conn(0x7fa00414f850 legacy=0x7fa0040c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:17.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.232+0000 7fa0027fc640 1 -- 172.21.15.49:0/3524822757 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040c11e0 con 0x7fa004070ab0 2023-11-18T21:00:17.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.232+0000 7fa0027fc640 1 -- 172.21.15.49:0/3524822757 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7f9ffc001680 con 0x7fa004070ab0 2023-11-18T21:00:17.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.232+0000 7fa0027fc640 1 -- 172.21.15.49:0/3524822757 >> v1:172.21.15.49:6789/0 conn(0x7fa004070ab0 legacy=0x7fa004160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:17.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.232+0000 7fa0027fc640 1 --2- 172.21.15.49:0/3524822757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9fec003b30 0x7f9fec003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:17.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.232+0000 7fa0027fc640 1 --2- 172.21.15.49:0/3524822757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9fec0088d0 0x7f9fec00ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:17.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.232+0000 7fa0027fc640 1 --2- 172.21.15.49:0/3524822757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fec00b560 0x7f9fec00da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:17.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.232+0000 7fa0027fc640 1 -- 172.21.15.49:0/3524822757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00414fc30 con 0x7f9fec00b560 2023-11-18T21:00:17.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.232+0000 7fa0027fc640 1 -- 172.21.15.49:0/3524822757 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec00e300 con 0x7f9fec003b30 2023-11-18T21:00:17.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.232+0000 7fa0027fc640 1 -- 172.21.15.49:0/3524822757 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec00e4c0 con 0x7f9fec0088d0 2023-11-18T21:00:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.232+0000 7fa003fff640 1 --2- 172.21.15.49:0/3524822757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fec00b560 0x7f9fec00da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.236+0000 7fa003fff640 1 -- 172.21.15.49:0/3524822757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9fec0088d0 msgr2=0x7f9fec00ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.236+0000 7fa003fff640 1 --2- 172.21.15.49:0/3524822757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9fec0088d0 0x7f9fec00ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.236+0000 7fa003fff640 1 -- 172.21.15.49:0/3524822757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9fec003b30 msgr2=0x7f9fec003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.236+0000 7fa003fff640 1 --2- 172.21.15.49:0/3524822757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9fec003b30 0x7f9fec003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.236+0000 7fa003fff640 1 -- 172.21.15.49:0/3524822757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec003450 con 0x7f9fec00b560 2023-11-18T21:00:17.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.240+0000 7fa003fff640 1 -- 172.21.15.49:0/3524822757 reap_dead start 2023-11-18T21:00:17.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.240+0000 7fa003fff640 1 --2- 172.21.15.49:0/3524822757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fec00b560 0x7f9fec00da20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00c0e0 tx=0x7f9ffc01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53718d0d3a4914 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:17.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa0027fc640 1 -- 172.21.15.49:0/3524822757 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc005ae0 con 0x7f9fec00b560 2023-11-18T21:00:17.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa0027fc640 1 -- 172.21.15.49:0/3524822757 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc005c80 con 0x7f9fec00b560 2023-11-18T21:00:17.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa0027fc640 1 -- 172.21.15.49:0/3524822757 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc0a5860 con 0x7f9fec00b560 2023-11-18T21:00:17.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 -- 172.21.15.49:0/3524822757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fec00b560 msgr2=0x7f9fec00da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 --2- 172.21.15.49:0/3524822757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fec00b560 0x7f9fec00da20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00c0e0 tx=0x7f9ffc01cb60 comp rx=0 tx=0).stop 2023-11-18T21:00:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 -- 172.21.15.49:0/3524822757 shutdown_connections 2023-11-18T21:00:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 --2- 172.21.15.49:0/3524822757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fec00b560 0x7f9fec00da20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 -- 172.21.15.49:0/3524822757 >> 172.21.15.49:0/3524822757 conn(0x7fa00406c6a0 msgr2=0x7fa00406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 -- 172.21.15.49:0/3524822757 shutdown_connections 2023-11-18T21:00:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 -- 172.21.15.49:0/3524822757 wait complete. 2023-11-18T21:00:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 Processor -- start 2023-11-18T21:00:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 -- start start 2023-11-18T21:00:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9fec00b560 0x7fa0041eecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0041569c0 0x7fa004152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa004159680 0x7fa00414b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa004152b70 con 0x7fa0041569c0 2023-11-18T21:00:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa004150700 con 0x7f9fec00b560 2023-11-18T21:00:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa00a14e640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0041500f0 con 0x7fa004159680 2023-11-18T21:00:17.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.248+0000 7fa002ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0041569c0 0x7fa004152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:17.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.252+0000 7fa002ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0041569c0 0x7fa004152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38128/0 (socket says 172.21.15.49:38128) 2023-11-18T21:00:17.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.252+0000 7fa002ffd640 1 -- 172.21.15.49:0/1538788749 learned_addr learned my addr 172.21.15.49:0/1538788749 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:17.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.252+0000 7fa0037fe640 1 --2- 172.21.15.49:0/1538788749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9fec00b560 0x7fa0041eecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:17.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.252+0000 7fa003fff640 1 --2- 172.21.15.49:0/1538788749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa004159680 0x7fa00414b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:17.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.256+0000 7fa002ffd640 1 -- 172.21.15.49:0/1538788749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa004159680 msgr2=0x7fa00414b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:17.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.256+0000 7fa002ffd640 1 --2- 172.21.15.49:0/1538788749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa004159680 0x7fa00414b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.256+0000 7fa002ffd640 1 -- 172.21.15.49:0/1538788749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9fec00b560 msgr2=0x7fa0041eecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:17.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.256+0000 7fa002ffd640 1 --2- 172.21.15.49:0/1538788749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9fec00b560 0x7fa0041eecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.256+0000 7fa002ffd640 1 -- 172.21.15.49:0/1538788749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa004153650 con 0x7fa0041569c0 2023-11-18T21:00:17.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.256+0000 7fa002ffd640 1 --2- 172.21.15.49:0/1538788749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0041569c0 0x7fa004152180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009160 tx=0x7f9ff800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.264+0000 7f9febfff640 1 -- 172.21.15.49:0/1538788749 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800ee40 con 0x7fa0041569c0 2023-11-18T21:00:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.264+0000 7f9febfff640 1 -- 172.21.15.49:0/1538788749 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff800c940 con 0x7fa0041569c0 2023-11-18T21:00:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.264+0000 7f9febfff640 1 -- 172.21.15.49:0/1538788749 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800ccd0 con 0x7fa0041569c0 2023-11-18T21:00:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.264+0000 7fa00a14e640 1 -- 172.21.15.49:0/1538788749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa004153930 con 0x7fa0041569c0 2023-11-18T21:00:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.264+0000 7fa00a14e640 1 -- 172.21.15.49:0/1538788749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0041526c0 con 0x7fa0041569c0 2023-11-18T21:00:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.264+0000 7fa00a14e640 1 -- 172.21.15.49:0/1538788749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa004156630 con 0x7fa0041569c0 2023-11-18T21:00:17.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.580+0000 7f9febfff640 1 -- 172.21.15.49:0/1538788749 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9ff8013470 con 0x7fa0041569c0 2023-11-18T21:00:17.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.580+0000 7f9febfff640 1 --2- 172.21.15.49:0/1538788749 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9ff00664a0 0x7f9ff0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:17.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.580+0000 7fa0037fe640 1 --2- 172.21.15.49:0/1538788749 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9ff00664a0 0x7f9ff0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:17.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.584+0000 7fa0037fe640 1 --2- 172.21.15.49:0/1538788749 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9ff00664a0 0x7f9ff0068960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4001ec0 tx=0x7f9ff4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:17.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.608+0000 7f9febfff640 1 -- 172.21.15.49:0/1538788749 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ff800ce30 con 0x7fa0041569c0 2023-11-18T21:00:17.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.612+0000 7f9febfff640 1 -- 172.21.15.49:0/1538788749 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ff8051b20 con 0x7fa0041569c0 2023-11-18T21:00:17.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.824+0000 7fa00a14e640 1 -- 172.21.15.49:0/1538788749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa004067520 con 0x7fa0041569c0 2023-11-18T21:00:17.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.988+0000 7f9febfff640 1 -- 172.21.15.49:0/1538788749 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18314 (secure 0 0 0) 0x7f9ff8021020 con 0x7fa0041569c0 2023-11-18T21:00:17.990 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:17.990 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":29,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:59:36.521114+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T21:00:17.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.996+0000 7fa00a14e640 1 -- 172.21.15.49:0/1538788749 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9ff00664a0 msgr2=0x7f9ff0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:17.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.996+0000 7fa00a14e640 1 --2- 172.21.15.49:0/1538788749 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9ff00664a0 0x7f9ff0068960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4001ec0 tx=0x7f9ff4009040 comp rx=0 tx=0).stop 2023-11-18T21:00:17.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.996+0000 7fa00a14e640 1 -- 172.21.15.49:0/1538788749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0041569c0 msgr2=0x7fa004152180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:17.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.996+0000 7fa00a14e640 1 --2- 172.21.15.49:0/1538788749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0041569c0 0x7fa004152180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009160 tx=0x7f9ff800ec50 comp rx=0 tx=0).stop 2023-11-18T21:00:17.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.996+0000 7fa00a14e640 1 -- 172.21.15.49:0/1538788749 shutdown_connections 2023-11-18T21:00:17.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.996+0000 7fa00a14e640 1 --2- 172.21.15.49:0/1538788749 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9ff00664a0 0x7f9ff0068960 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.996+0000 7fa00a14e640 1 --2- 172.21.15.49:0/1538788749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa004159680 0x7fa00414b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.996+0000 7fa00a14e640 1 --2- 172.21.15.49:0/1538788749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0041569c0 0x7fa004152180 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.996+0000 7fa00a14e640 1 --2- 172.21.15.49:0/1538788749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9fec00b560 0x7fa0041eecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:17.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.996+0000 7fa00a14e640 1 -- 172.21.15.49:0/1538788749 >> 172.21.15.49:0/1538788749 conn(0x7fa00406c6a0 msgr2=0x7fa00406e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:17.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.996+0000 7fa00a14e640 1 -- 172.21.15.49:0/1538788749 shutdown_connections 2023-11-18T21:00:17.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:17.996+0000 7fa00a14e640 1 -- 172.21.15.49:0/1538788749 wait complete. 2023-11-18T21:00:18.017 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-18T21:00:18.018 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-18T21:00:18.018 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-18T21:00:18.018 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-18T21:00:18.019 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-18T21:00:18.019 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-18T21:00:18.019 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-18T21:00:18.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-18T21:00:18.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.212+0000 7f8066daf640 1 Processor -- start 2023-11-18T21:00:18.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.212+0000 7f8066daf640 1 -- start start 2023-11-18T21:00:18.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.212+0000 7f8ffceac640 1 Processor -- start 2023-11-18T21:00:18.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f6ee0694640 1 Processor -- start 2023-11-18T21:00:18.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8066daf640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8060150070 0x7f80600709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8066daf640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f80600c6de0 0x7f806006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8066daf640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80600c52c0 con 0x7f8060070f10 2023-11-18T21:00:18.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8066daf640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80600c2100 con 0x7f8060150070 2023-11-18T21:00:18.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8066daf640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80600c62d0 con 0x7f80600c6de0 2023-11-18T21:00:18.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f6ee0694640 1 -- start start 2023-11-18T21:00:18.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f6ee0694640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ed814f430 0x7f6ed8155d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f6ee0694640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6ed814f810 0x7f6ed80c4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f6ee0694640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed80c2f60 con 0x7f6ed806e330 2023-11-18T21:00:18.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f6ee0694640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed80c3680 con 0x7f6ed814f810 2023-11-18T21:00:18.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f6ee0694640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80c3960 con 0x7f6ed814f430 2023-11-18T21:00:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f7dbbaab640 1 Processor -- start 2023-11-18T21:00:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f9364936640 1 Processor -- start 2023-11-18T21:00:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f9364936640 1 -- start start 2023-11-18T21:00:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f7dbbaab640 1 -- start start 2023-11-18T21:00:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.212+0000 7f8ffceac640 1 -- start start 2023-11-18T21:00:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8ffceac640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ff8159380 0x7f8ff80c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8ffceac640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ff80c6860 0x7f8ff80c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8ffceac640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff8156110 con 0x7f8ff80c7660 2023-11-18T21:00:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8ffceac640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff8158f60 con 0x7f8ff80c6860 2023-11-18T21:00:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8ffceac640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80c7f80 con 0x7f8ff8159380 2023-11-18T21:00:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8ff7fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ff80c6860 0x7f8ff80c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8064b4b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8060150070 0x7f80600709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f9364936640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93600c2f70 0x7f93600c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f9364936640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f936008a820 0x7f936006ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f9364936640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9360072720 con 0x7f9360072290 2023-11-18T21:00:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f9364936640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936006f3d0 con 0x7f936008a820 2023-11-18T21:00:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f9364936640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93600711f0 con 0x7f93600c2f70 2023-11-18T21:00:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8ff6ffd640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ff8159380 0x7f8ff80c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8ff77fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8ff80c7660 0x7f8ff8155110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:38678/0 (socket says 172.21.15.49:38678) 2023-11-18T21:00:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8ff77fe640 1 -- 172.21.15.49:0/1237499300 learned_addr learned my addr 172.21.15.49:0/1237499300 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f7dbbaab640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7db40c7ee0 0x7f7db4155d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f7dbbaab640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7db40c4720 0x7f7db414f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f7dbbaab640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db40c3680 con 0x7f7db40c4b80 2023-11-18T21:00:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f7dbbaab640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db40c3960 con 0x7f7db40c4720 2023-11-18T21:00:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f7dbbaab640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db40c3c40 con 0x7f7db40c7ee0 2023-11-18T21:00:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8064b4b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8060150070 0x7f80600709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38132/0 (socket says 172.21.15.49:38132) 2023-11-18T21:00:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.216+0000 7f8064b4b640 1 -- 172.21.15.49:0/2888010394 learned_addr learned my addr 172.21.15.49:0/2888010394 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7feea5c97640 1 Processor -- start 2023-11-18T21:00:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7feea5c97640 1 -- start start 2023-11-18T21:00:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7fbff3fff640 1 Processor -- start 2023-11-18T21:00:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7fbff3fff640 1 -- start start 2023-11-18T21:00:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7f935e59c640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93600c2f70 0x7f93600c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7feea5c97640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feea0150220 0x7feea00c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7feea5c97640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feea00c5b70 0x7feea0156050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7feea5c97640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feea015a240 0x7feea006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7feea5c97640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea00c4820 con 0x7feea0150220 2023-11-18T21:00:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7feea5c97640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea00c3b60 con 0x7feea00c5b70 2023-11-18T21:00:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7fbff3fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbff4150280 0x7fbff41574d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7feea5c97640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea0159db0 con 0x7feea015a240 2023-11-18T21:00:18.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7fbff3fff640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff4156d70 con 0x7fbff40c6620 2023-11-18T21:00:18.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7fbff3fff640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff40c2a80 con 0x7fbff40c5cd0 2023-11-18T21:00:18.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7fbff3fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff4072c40 con 0x7fbff4150280 2023-11-18T21:00:18.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7f8ff7fff640 1 -- 172.21.15.49:0/1237499300 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ff8159380 msgr2=0x7f8ff80c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7f8ff7fff640 1 --2- 172.21.15.49:0/1237499300 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ff8159380 0x7f8ff80c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7f8ff7fff640 1 -- 172.21.15.49:0/1237499300 >> v1:172.21.15.106:6789/0 conn(0x7f8ff80c7660 legacy=0x7f8ff8155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.220+0000 7f8ff7fff640 1 -- 172.21.15.49:0/1237499300 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff80c3500 con 0x7f8ff80c6860 2023-11-18T21:00:18.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.224+0000 7f8064b4b640 1 -- 172.21.15.49:0/2888010394 >> v2:172.21.15.106:3300/0 conn(0x7f80600c6de0 msgr2=0x7f806006ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.224+0000 7f8064b4b640 1 --2- 172.21.15.49:0/2888010394 >> v2:172.21.15.106:3300/0 conn(0x7f80600c6de0 0x7f806006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.224+0000 7f8064b4b640 1 -- 172.21.15.49:0/2888010394 >> v1:172.21.15.106:6789/0 conn(0x7f8060070f10 legacy=0x7f806006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.224+0000 7f8064b4b640 1 -- 172.21.15.49:0/2888010394 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806015a0a0 con 0x7f8060150070 2023-11-18T21:00:18.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.224+0000 7f8ff7fff640 1 --2- 172.21.15.49:0/1237499300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff80c6860 0x7f8ff80c2fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0097c0 tx=0x7f8fec01ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d91d8ea2e291345 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.228+0000 7f935e59c640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93600c2f70 0x7f93600c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:46762/0 (socket says 172.21.15.49:46762) 2023-11-18T21:00:18.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.228+0000 7f935e59c640 1 -- 172.21.15.49:0/3460998517 learned_addr learned my addr 172.21.15.49:0/3460998517 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f4666637640 1 Processor -- start 2023-11-18T21:00:18.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f4666637640 1 -- start start 2023-11-18T21:00:18.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f8064b4b640 1 --2- 172.21.15.49:0/2888010394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8060150070 0x7f80600709d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f80600c2620 tx=0x7f805001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e66c14bbe9ed957 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f7db9046640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7db40c4720 0x7f7db414f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f4666637640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4660151460 0x7f46600c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f4666637640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4660157280 0x7f466006f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f4666637640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46600c21d0 con 0x7f46600c9130 2023-11-18T21:00:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f4666637640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466006ec00 con 0x7f4660151460 2023-11-18T21:00:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f4666637640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4660157750 con 0x7f4660157280 2023-11-18T21:00:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f935e59c640 1 -- 172.21.15.49:0/3460998517 >> v2:172.21.15.106:3300/0 conn(0x7f936008a820 msgr2=0x7f936006ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f935e59c640 1 --2- 172.21.15.49:0/3460998517 >> v2:172.21.15.106:3300/0 conn(0x7f936008a820 0x7f936006ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f935e59c640 1 -- 172.21.15.49:0/3460998517 >> v1:172.21.15.106:6789/0 conn(0x7f9360072290 legacy=0x7f93601695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f935e59c640 1 -- 172.21.15.49:0/3460998517 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93600714d0 con 0x7f93600c2f70 2023-11-18T21:00:18.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f7db9046640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7db40c4720 0x7f7db414f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38150/0 (socket says 172.21.15.49:38150) 2023-11-18T21:00:18.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.232+0000 7f7db9046640 1 -- 172.21.15.49:0/4023898368 learned_addr learned my addr 172.21.15.49:0/4023898368 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.236+0000 7feea4c95640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feea0150220 0x7feea00c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.236+0000 7feea4c95640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feea0150220 0x7feea00c2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38158/0 (socket says 172.21.15.49:38158) 2023-11-18T21:00:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.236+0000 7feea4c95640 1 -- 172.21.15.49:0/982495500 learned_addr learned my addr 172.21.15.49:0/982495500 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.236+0000 7f6ede430640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ed814f430 0x7f6ed8155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.240+0000 7f7db9046640 1 -- 172.21.15.49:0/4023898368 >> v2:172.21.15.106:3300/0 conn(0x7f7db40c7ee0 msgr2=0x7f7db4155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.240+0000 7f7db9046640 1 --2- 172.21.15.49:0/4023898368 >> v2:172.21.15.106:3300/0 conn(0x7f7db40c7ee0 0x7f7db4155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.240+0000 7f7db9046640 1 -- 172.21.15.49:0/4023898368 >> v1:172.21.15.49:6789/0 conn(0x7f7db40c4b80 legacy=0x7f7db406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.240+0000 7f7db9046640 1 -- 172.21.15.49:0/4023898368 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db40c3f20 con 0x7f7db40c4720 2023-11-18T21:00:18.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.240+0000 7f6eddc2f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6ed814f810 0x7f6ed80c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.240+0000 7f465ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4660151460 0x7f46600c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.244+0000 7f6eddc2f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6ed814f810 0x7f6ed80c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:35850/0 (socket says 172.21.15.49:35850) 2023-11-18T21:00:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.244+0000 7f6eddc2f640 1 -- 172.21.15.49:0/1917689552 learned_addr learned my addr 172.21.15.49:0/1917689552 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.244+0000 7feea4c95640 1 -- 172.21.15.49:0/982495500 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feea015a240 msgr2=0x7feea006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.244+0000 7feea4c95640 1 --2- 172.21.15.49:0/982495500 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feea015a240 0x7feea006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.244+0000 7feea4c95640 1 -- 172.21.15.49:0/982495500 >> v2:172.21.15.106:3300/0 conn(0x7feea00c5b70 msgr2=0x7feea0156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.244+0000 7feea4c95640 1 --2- 172.21.15.49:0/982495500 >> v2:172.21.15.106:3300/0 conn(0x7feea00c5b70 0x7feea0156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.244+0000 7feea4c95640 1 -- 172.21.15.49:0/982495500 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea00c3310 con 0x7feea0150220 2023-11-18T21:00:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.244+0000 7f935e59c640 1 --2- 172.21.15.49:0/3460998517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93600c2f70 0x7f93600c52c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9358009e50 tx=0x7f935801c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2baefe192c9cee55 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.244+0000 7f465ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4660151460 0x7f46600c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38174/0 (socket says 172.21.15.49:38174) 2023-11-18T21:00:18.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.244+0000 7f465ffff640 1 -- 172.21.15.49:0/1881311169 learned_addr learned my addr 172.21.15.49:0/1881311169 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.244+0000 7f8ff67fc640 1 -- 172.21.15.49:0/1237499300 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0a8970 con 0x7f8ff80c6860 2023-11-18T21:00:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.244+0000 7f8ff67fc640 1 -- 172.21.15.49:0/1237499300 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec0a8ad0 con 0x7f8ff80c6860 2023-11-18T21:00:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.244+0000 7f8ff67fc640 1 -- 172.21.15.49:0/1237499300 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0a8e60 con 0x7f8ff80c6860 2023-11-18T21:00:18.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.244+0000 7fbff2ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbff4150280 0x7fbff41574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 -- 172.21.15.49:0/1237499300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff80c6860 msgr2=0x7f8ff80c2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 --2- 172.21.15.49:0/1237499300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff80c6860 0x7f8ff80c2fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0097c0 tx=0x7f8fec01ecb0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 -- 172.21.15.49:0/1237499300 shutdown_connections 2023-11-18T21:00:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 --2- 172.21.15.49:0/1237499300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff80c6860 0x7f8ff80c2fc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 --2- 172.21.15.49:0/1237499300 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ff8159380 0x7f8ff80c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 -- 172.21.15.49:0/1237499300 >> 172.21.15.49:0/1237499300 conn(0x7f8ff806a560 msgr2=0x7f8ff806a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 -- 172.21.15.49:0/1237499300 shutdown_connections 2023-11-18T21:00:18.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 -- 172.21.15.49:0/1237499300 wait complete. 2023-11-18T21:00:18.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f805f7fe640 1 -- 172.21.15.49:0/2888010394 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500a89f0 con 0x7f8060150070 2023-11-18T21:00:18.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f805f7fe640 1 -- 172.21.15.49:0/2888010394 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80500a8b50 con 0x7f8060150070 2023-11-18T21:00:18.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f805f7fe640 1 -- 172.21.15.49:0/2888010394 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500b0440 con 0x7f8060150070 2023-11-18T21:00:18.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 Processor -- start 2023-11-18T21:00:18.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 -- start start 2023-11-18T21:00:18.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ff80c6860 0x7f8ff80ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff80c7660 0x7f8ff8154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ff8159380 0x7f8ff8154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff814ef00 con 0x7f8ff80c7660 2023-11-18T21:00:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80c9ce0 con 0x7f8ff8159380 2023-11-18T21:00:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8ffceac640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80c8590 con 0x7f8ff80c6860 2023-11-18T21:00:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f465ffff640 1 -- 172.21.15.49:0/1881311169 >> v2:172.21.15.106:3300/0 conn(0x7f4660157280 msgr2=0x7f466006f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f465ffff640 1 --2- 172.21.15.49:0/1881311169 >> v2:172.21.15.106:3300/0 conn(0x7f4660157280 0x7f466006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f465ffff640 1 -- 172.21.15.49:0/1881311169 >> v1:172.21.15.49:6789/0 conn(0x7f46600c9130 legacy=0x7f46600ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f465ffff640 1 -- 172.21.15.49:0/1881311169 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660157a30 con 0x7f4660151460 2023-11-18T21:00:18.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8066daf640 1 -- 172.21.15.49:0/2888010394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8060150070 msgr2=0x7f80600709d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8066daf640 1 --2- 172.21.15.49:0/2888010394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8060150070 0x7f80600709d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f80600c2620 tx=0x7f805001ed10 comp rx=0 tx=0).stop 2023-11-18T21:00:18.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8066daf640 1 -- 172.21.15.49:0/2888010394 shutdown_connections 2023-11-18T21:00:18.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8066daf640 1 --2- 172.21.15.49:0/2888010394 >> v2:172.21.15.106:3300/0 conn(0x7f80600c6de0 0x7f806006ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8066daf640 1 --2- 172.21.15.49:0/2888010394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8060150070 0x7f80600709d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8066daf640 1 -- 172.21.15.49:0/2888010394 >> 172.21.15.49:0/2888010394 conn(0x7f80600c73c0 msgr2=0x7f80600c77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8066daf640 1 -- 172.21.15.49:0/2888010394 shutdown_connections 2023-11-18T21:00:18.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.248+0000 7f8066daf640 1 -- 172.21.15.49:0/2888010394 wait complete. 2023-11-18T21:00:18.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7fbff2ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbff4150280 0x7fbff41574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38162/0 (socket says 172.21.15.49:38162) 2023-11-18T21:00:18.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7fbff2ffd640 1 -- 172.21.15.49:0/2216383081 learned_addr learned my addr 172.21.15.49:0/2216383081 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7f8066daf640 1 Processor -- start 2023-11-18T21:00:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7f8066daf640 1 -- start start 2023-11-18T21:00:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7f6eddc2f640 1 -- 172.21.15.49:0/1917689552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ed814f430 msgr2=0x7f6ed8155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7f6eddc2f640 1 --2- 172.21.15.49:0/1917689552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ed814f430 0x7f6ed8155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7f6eddc2f640 1 -- 172.21.15.49:0/1917689552 >> v1:172.21.15.106:6789/0 conn(0x7f6ed806e330 legacy=0x7f6ed806e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7f6eddc2f640 1 -- 172.21.15.49:0/1917689552 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed80c3c40 con 0x7f6ed814f810 2023-11-18T21:00:18.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7f8066daf640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8060070f10 0x7f80600c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7f8066daf640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80600c6de0 0x7f80601580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7f8066daf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8060150070 0x7f8060158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7f8066daf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80600c8760 con 0x7f8060150070 2023-11-18T21:00:18.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7f8066daf640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80601ef8a0 con 0x7f8060070f10 2023-11-18T21:00:18.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7f8066daf640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80600c8a00 con 0x7f80600c6de0 2023-11-18T21:00:18.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7f7db9046640 1 --2- 172.21.15.49:0/4023898368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7db40c4720 0x7f7db414f1d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7db40c3130 tx=0x7f7db001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55fc9ccb1f42927a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.252+0000 7feea4c95640 1 --2- 172.21.15.49:0/982495500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea0150220 0x7feea00c2dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feea006be90 tx=0x7fee9401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8909da78a7a72871 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.256+0000 7fbff2ffd640 1 -- 172.21.15.49:0/2216383081 >> v1:172.21.15.106:6789/0 conn(0x7fbff40c5cd0 legacy=0x7fbff40cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.256+0000 7fbff2ffd640 1 -- 172.21.15.49:0/2216383081 >> v1:172.21.15.49:6789/0 conn(0x7fbff40c6620 legacy=0x7fbff4160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.256+0000 7fbff2ffd640 1 -- 172.21.15.49:0/2216383081 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff4071da0 con 0x7fbff4150280 2023-11-18T21:00:18.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.260+0000 7f6eddc2f640 1 --2- 172.21.15.49:0/1917689552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ed814f810 0x7f6ed80c4720 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8008870 tx=0x7f6ec8021200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c678fd434c841f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.264+0000 7f8064b4b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8060070f10 0x7f80600c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.264+0000 7f935d59a640 1 -- 172.21.15.49:0/3460998517 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93580a5660 con 0x7f93600c2f70 2023-11-18T21:00:18.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.264+0000 7f935d59a640 1 -- 172.21.15.49:0/3460998517 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93580a57c0 con 0x7f93600c2f70 2023-11-18T21:00:18.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.264+0000 7f935d59a640 1 -- 172.21.15.49:0/3460998517 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93580a5b50 con 0x7f93600c2f70 2023-11-18T21:00:18.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.264+0000 7f9364936640 1 -- 172.21.15.49:0/3460998517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93600c2f70 msgr2=0x7f93600c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.264+0000 7f9364936640 1 --2- 172.21.15.49:0/3460998517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93600c2f70 0x7f93600c52c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9358009e50 tx=0x7f935801c910 comp rx=0 tx=0).stop 2023-11-18T21:00:18.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.264+0000 7f9364936640 1 -- 172.21.15.49:0/3460998517 shutdown_connections 2023-11-18T21:00:18.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.264+0000 7f9364936640 1 --2- 172.21.15.49:0/3460998517 >> v2:172.21.15.106:3300/0 conn(0x7f936008a820 0x7f936006ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.264+0000 7f9364936640 1 --2- 172.21.15.49:0/3460998517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93600c2f70 0x7f93600c52c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.264+0000 7f9364936640 1 -- 172.21.15.49:0/3460998517 >> 172.21.15.49:0/3460998517 conn(0x7f93600c73c0 msgr2=0x7f93600c77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.264+0000 7f9364936640 1 -- 172.21.15.49:0/3460998517 shutdown_connections 2023-11-18T21:00:18.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.264+0000 7f9364936640 1 -- 172.21.15.49:0/3460998517 wait complete. 2023-11-18T21:00:18.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.268+0000 7f8ff77fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ff80c6860 0x7f8ff80ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.268+0000 7f465ffff640 1 --2- 172.21.15.49:0/1881311169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4660151460 0x7f46600c8bf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4650009870 tx=0x7f465001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475eb765193b0200 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.268+0000 7f9364936640 1 Processor -- start 2023-11-18T21:00:18.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.268+0000 7f9364936640 1 -- start start 2023-11-18T21:00:18.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.268+0000 7f9364936640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9360072290 0x7f9360157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.268+0000 7f9364936640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f936008a820 0x7f9360202df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.268+0000 7f9364936640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93600c2f70 0x7f93600c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.268+0000 7f9364936640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9360169aa0 con 0x7f936008a820 2023-11-18T21:00:18.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.268+0000 7f9364936640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936015cdd0 con 0x7f9360072290 2023-11-18T21:00:18.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.268+0000 7f9364936640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936015d670 con 0x7f93600c2f70 2023-11-18T21:00:18.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.268+0000 7f8ff77fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ff80c6860 0x7f8ff80ca220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:46772/0 (socket says 172.21.15.49:46772) 2023-11-18T21:00:18.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.268+0000 7f8ff77fe640 1 -- 172.21.15.49:0/1581782474 learned_addr learned my addr 172.21.15.49:0/1581782474 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.272+0000 7f8064b4b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8060070f10 0x7f80600c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:35906/0 (socket says 172.21.15.49:35906) 2023-11-18T21:00:18.272 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.272+0000 7f8064b4b640 1 -- 172.21.15.49:0/1610106396 learned_addr learned my addr 172.21.15.49:0/1610106396 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.272+0000 7f7db8845640 1 -- 172.21.15.49:0/4023898368 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db00a89b0 con 0x7f7db40c4720 2023-11-18T21:00:18.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.272+0000 7f7db8845640 1 -- 172.21.15.49:0/4023898368 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db00a8b10 con 0x7f7db40c4720 2023-11-18T21:00:18.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.272+0000 7f7db8845640 1 -- 172.21.15.49:0/4023898368 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db00a8ea0 con 0x7f7db40c4720 2023-11-18T21:00:18.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.272+0000 7fbff2ffd640 1 --2- 172.21.15.49:0/2216383081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff4150280 0x7fbff41574d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40098a0 tx=0x7fbfe401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4addb4d817a221d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.272+0000 7f7dbbaab640 1 -- 172.21.15.49:0/4023898368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7db40c4720 msgr2=0x7f7db414f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.272+0000 7f7dbbaab640 1 --2- 172.21.15.49:0/4023898368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7db40c4720 0x7f7db414f1d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7db40c3130 tx=0x7f7db001ecb0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.272+0000 7fee9f7fe640 1 -- 172.21.15.49:0/982495500 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee940a89b0 con 0x7feea0150220 2023-11-18T21:00:18.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.272+0000 7fee9f7fe640 1 -- 172.21.15.49:0/982495500 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee940a8b10 con 0x7feea0150220 2023-11-18T21:00:18.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.272+0000 7fee9f7fe640 1 -- 172.21.15.49:0/982495500 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee940a8ea0 con 0x7feea0150220 2023-11-18T21:00:18.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f7dbbaab640 1 -- 172.21.15.49:0/4023898368 shutdown_connections 2023-11-18T21:00:18.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f7dbbaab640 1 --2- 172.21.15.49:0/4023898368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7db40c4720 0x7f7db414f1d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f7dbbaab640 1 --2- 172.21.15.49:0/4023898368 >> v2:172.21.15.106:3300/0 conn(0x7f7db40c7ee0 0x7f7db4155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f7dbbaab640 1 -- 172.21.15.49:0/4023898368 >> 172.21.15.49:0/4023898368 conn(0x7f7db40c73c0 msgr2=0x7f7db40c77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f7dbbaab640 1 -- 172.21.15.49:0/4023898368 shutdown_connections 2023-11-18T21:00:18.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 -- 172.21.15.49:0/982495500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea0150220 msgr2=0x7feea00c2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 --2- 172.21.15.49:0/982495500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea0150220 0x7feea00c2dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feea006be90 tx=0x7fee9401ecf0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f7dbbaab640 1 -- 172.21.15.49:0/4023898368 wait complete. 2023-11-18T21:00:18.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f8ff6ffd640 1 --2- 172.21.15.49:0/1581782474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff80c7660 0x7f8ff8154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 -- 172.21.15.49:0/982495500 shutdown_connections 2023-11-18T21:00:18.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 --2- 172.21.15.49:0/982495500 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feea015a240 0x7feea006d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 --2- 172.21.15.49:0/982495500 >> v2:172.21.15.106:3300/0 conn(0x7feea00c5b70 0x7feea0156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 --2- 172.21.15.49:0/982495500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea0150220 0x7feea00c2dd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 -- 172.21.15.49:0/982495500 >> 172.21.15.49:0/982495500 conn(0x7feea00cb8d0 msgr2=0x7feea00cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 -- 172.21.15.49:0/982495500 shutdown_connections 2023-11-18T21:00:18.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 -- 172.21.15.49:0/982495500 wait complete. 2023-11-18T21:00:18.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 Processor -- start 2023-11-18T21:00:18.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f7dbbaab640 1 Processor -- start 2023-11-18T21:00:18.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f7dbbaab640 1 -- start start 2023-11-18T21:00:18.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f465f7fe640 1 -- 172.21.15.49:0/1881311169 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500ab600 con 0x7f4660151460 2023-11-18T21:00:18.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f465f7fe640 1 -- 172.21.15.49:0/1881311169 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46500ab760 con 0x7f4660151460 2023-11-18T21:00:18.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f465f7fe640 1 -- 172.21.15.49:0/1881311169 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500abaf0 con 0x7f4660151460 2023-11-18T21:00:18.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 -- start start 2023-11-18T21:00:18.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feea00c5b70 0x7feea0147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feea0150220 0x7feea0147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f7dbbaab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7db40c4720 0x7f7db41f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f7dbbaab640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7db40c4b80 0x7f7db4151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f7dbbaab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7db40c7ee0 0x7f7db413e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f7dbbaab640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db41f79b0 con 0x7f7db40c7ee0 2023-11-18T21:00:18.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f7dbbaab640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db414b9e0 con 0x7f7db40c4720 2023-11-18T21:00:18.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f7dbbaab640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db414bcc0 con 0x7f7db40c4b80 2023-11-18T21:00:18.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea015a240 0x7feea013f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea0142fe0 con 0x7feea015a240 2023-11-18T21:00:18.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea0142a40 con 0x7feea0150220 2023-11-18T21:00:18.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7feea5c97640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea0142d00 con 0x7feea00c5b70 2023-11-18T21:00:18.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f4666637640 1 -- 172.21.15.49:0/1881311169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4660151460 msgr2=0x7f46600c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f4666637640 1 --2- 172.21.15.49:0/1881311169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4660151460 0x7f46600c8bf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4650009870 tx=0x7f465001c400 comp rx=0 tx=0).stop 2023-11-18T21:00:18.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f4666637640 1 -- 172.21.15.49:0/1881311169 shutdown_connections 2023-11-18T21:00:18.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f4666637640 1 --2- 172.21.15.49:0/1881311169 >> v2:172.21.15.106:3300/0 conn(0x7f4660157280 0x7f466006f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f4666637640 1 --2- 172.21.15.49:0/1881311169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4660151460 0x7f46600c8bf0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f4666637640 1 -- 172.21.15.49:0/1881311169 >> 172.21.15.49:0/1881311169 conn(0x7f46600708a0 msgr2=0x7f4660070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f4666637640 1 -- 172.21.15.49:0/1881311169 shutdown_connections 2023-11-18T21:00:18.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.276+0000 7f4666637640 1 -- 172.21.15.49:0/1881311169 wait complete. 2023-11-18T21:00:18.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.280+0000 7f4666637640 1 Processor -- start 2023-11-18T21:00:18.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.280+0000 7f4666637640 1 -- start start 2023-11-18T21:00:18.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.280+0000 7f4666637640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46600c9130 0x7f4660148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.280+0000 7f4666637640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4660151460 0x7f46601472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.280+0000 7f4666637640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4660157280 0x7f4660145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.280+0000 7f4666637640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466014f2d0 con 0x7f46600c9130 2023-11-18T21:00:18.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.280+0000 7f4666637640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4660148740 con 0x7f4660151460 2023-11-18T21:00:18.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.280+0000 7f4666637640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46601477f0 con 0x7f4660157280 2023-11-18T21:00:18.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.280+0000 7f806534c640 1 --2- 172.21.15.49:0/1610106396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8060150070 0x7f8060158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.280+0000 7f8ff77fe640 1 -- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ff8159380 msgr2=0x7f8ff8154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.280+0000 7f8ff77fe640 1 --2- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ff8159380 0x7f8ff8154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.280+0000 7f8ff77fe640 1 -- 172.21.15.49:0/1581782474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff80c7660 msgr2=0x7f8ff8154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.280+0000 7f8ff77fe640 1 --2- 172.21.15.49:0/1581782474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff80c7660 0x7f8ff8154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.280+0000 7f8ff77fe640 1 -- 172.21.15.49:0/1581782474 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec009420 con 0x7f8ff80c6860 2023-11-18T21:00:18.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.284+0000 7f935ed9d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93600c2f70 0x7f93600c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.288+0000 7f935ed9d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93600c2f70 0x7f93600c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:46798/0 (socket says 172.21.15.49:46798) 2023-11-18T21:00:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.288+0000 7f935ed9d640 1 -- 172.21.15.49:0/472956120 learned_addr learned my addr 172.21.15.49:0/472956120 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.288+0000 7f8ff77fe640 1 --2- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ff80c6860 0x7f8ff80ca220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000c7a0 tx=0x7f8ff000cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.292+0000 7f805ffff640 1 --2- 172.21.15.49:0/1610106396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80600c6de0 0x7f80601580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.292+0000 7f806534c640 1 -- 172.21.15.49:0/1610106396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80600c6de0 msgr2=0x7f80601580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.292+0000 7f806534c640 1 --2- 172.21.15.49:0/1610106396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80600c6de0 0x7f80601580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.292+0000 7f806534c640 1 -- 172.21.15.49:0/1610106396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8060070f10 msgr2=0x7f80600c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.292+0000 7f806534c640 1 --2- 172.21.15.49:0/1610106396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8060070f10 0x7f80600c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.292+0000 7f806534c640 1 -- 172.21.15.49:0/1610106396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80500094d0 con 0x7f8060150070 2023-11-18T21:00:18.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.296+0000 7fbff1ffb640 1 -- 172.21.15.49:0/2216383081 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40ab600 con 0x7fbff4150280 2023-11-18T21:00:18.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.296+0000 7fbff1ffb640 1 -- 172.21.15.49:0/2216383081 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe40a7050 con 0x7fbff4150280 2023-11-18T21:00:18.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.296+0000 7fbff1ffb640 1 -- 172.21.15.49:0/2216383081 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40ab980 con 0x7fbff4150280 2023-11-18T21:00:18.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.296+0000 7fbff3fff640 1 -- 172.21.15.49:0/2216383081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff4150280 msgr2=0x7fbff41574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.296+0000 7fbff3fff640 1 --2- 172.21.15.49:0/2216383081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff4150280 0x7fbff41574d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40098a0 tx=0x7fbfe401c410 comp rx=0 tx=0).stop 2023-11-18T21:00:18.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.296+0000 7fbff3fff640 1 -- 172.21.15.49:0/2216383081 shutdown_connections 2023-11-18T21:00:18.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.296+0000 7fbff3fff640 1 --2- 172.21.15.49:0/2216383081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff4150280 0x7fbff41574d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.296+0000 7fbff3fff640 1 -- 172.21.15.49:0/2216383081 >> 172.21.15.49:0/2216383081 conn(0x7fbff406dd80 msgr2=0x7fbff406b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.296+0000 7f935dd9b640 1 --2- 172.21.15.49:0/472956120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f936008a820 0x7f9360202df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.296+0000 7fbff3fff640 1 -- 172.21.15.49:0/2216383081 shutdown_connections 2023-11-18T21:00:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.296+0000 7fbff3fff640 1 -- 172.21.15.49:0/2216383081 wait complete. 2023-11-18T21:00:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7f7dba048640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7db40c7ee0 0x7f7db413e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7fbff3fff640 1 Processor -- start 2023-11-18T21:00:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7fbff3fff640 1 -- start start 2023-11-18T21:00:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7f7dba048640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7db40c7ee0 0x7f7db413e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38210/0 (socket says 172.21.15.49:38210) 2023-11-18T21:00:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7f7dba048640 1 -- 172.21.15.49:0/614731495 learned_addr learned my addr 172.21.15.49:0/614731495 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7fbff3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbff40c5cd0 0x7fbff41f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7fbff3fff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbff40c6620 0x7fbff4150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7fbff3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff4150280 0x7fbff4153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7fbff3fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff41ea380 con 0x7fbff4150280 2023-11-18T21:00:18.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7fbff3fff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff41e9770 con 0x7fbff40c5cd0 2023-11-18T21:00:18.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7fbff3fff640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff41e9a50 con 0x7fbff40c6620 2023-11-18T21:00:18.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7f935ed9d640 1 -- 172.21.15.49:0/472956120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9360072290 msgr2=0x7f9360157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7f935ed9d640 1 --2- 172.21.15.49:0/472956120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9360072290 0x7f9360157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7f935ed9d640 1 -- 172.21.15.49:0/472956120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f936008a820 msgr2=0x7f9360202df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7f935ed9d640 1 --2- 172.21.15.49:0/472956120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f936008a820 0x7f9360202df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.300+0000 7f935ed9d640 1 -- 172.21.15.49:0/472956120 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9358009b30 con 0x7f93600c2f70 2023-11-18T21:00:18.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.308+0000 7f7dba048640 1 -- 172.21.15.49:0/614731495 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7db40c4b80 msgr2=0x7f7db4151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.308+0000 7f7dba048640 1 --2- 172.21.15.49:0/614731495 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7db40c4b80 0x7f7db4151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.308+0000 7f7dba048640 1 -- 172.21.15.49:0/614731495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7db40c4720 msgr2=0x7f7db41f7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.308+0000 7f7dba048640 1 --2- 172.21.15.49:0/614731495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7db40c4720 0x7f7db41f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.308+0000 7f7dba048640 1 -- 172.21.15.49:0/614731495 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db00094d0 con 0x7f7db40c7ee0 2023-11-18T21:00:18.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.312+0000 7f806534c640 1 --2- 172.21.15.49:0/1610106396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8060150070 0x7f8060158630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f805400b3e0 tx=0x7f8054009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.312+0000 7feea5496640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea015a240 0x7feea013f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.312+0000 7f7dba048640 1 --2- 172.21.15.49:0/614731495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7db40c7ee0 0x7f7db413e4f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7da400c410 tx=0x7f7da400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.312+0000 7feea5496640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea015a240 0x7feea013f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38224/0 (socket says 172.21.15.49:38224) 2023-11-18T21:00:18.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.312+0000 7feea5496640 1 -- 172.21.15.49:0/2168531307 learned_addr learned my addr 172.21.15.49:0/2168531307 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.316+0000 7f465ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46600c9130 0x7f4660148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.320+0000 7f465ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46600c9130 0x7f4660148200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38236/0 (socket says 172.21.15.49:38236) 2023-11-18T21:00:18.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.320+0000 7f465ffff640 1 -- 172.21.15.49:0/3580456061 learned_addr learned my addr 172.21.15.49:0/3580456061 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.320+0000 7f935ed9d640 1 --2- 172.21.15.49:0/472956120 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93600c2f70 0x7f93600c86c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f935400c440 tx=0x7f935400c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7f6edd42e640 1 -- 172.21.15.49:0/1917689552 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec80b3410 con 0x7f6ed814f810 2023-11-18T21:00:18.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7f6edd42e640 1 -- 172.21.15.49:0/1917689552 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec80ad030 con 0x7f6ed814f810 2023-11-18T21:00:18.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7f6edd42e640 1 -- 172.21.15.49:0/1917689552 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec80b3790 con 0x7f6ed814f810 2023-11-18T21:00:18.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7feea5496640 1 -- 172.21.15.49:0/2168531307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feea00c5b70 msgr2=0x7feea0147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7feea5496640 1 --2- 172.21.15.49:0/2168531307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feea00c5b70 0x7feea0147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7feea5496640 1 -- 172.21.15.49:0/2168531307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feea0150220 msgr2=0x7feea0147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7feea5496640 1 --2- 172.21.15.49:0/2168531307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feea0150220 0x7feea0147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7feea5496640 1 -- 172.21.15.49:0/2168531307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee940094d0 con 0x7feea015a240 2023-11-18T21:00:18.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7f4657fff640 1 --2- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4660151460 0x7f46601472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7f6ee0694640 1 -- 172.21.15.49:0/1917689552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ed814f810 msgr2=0x7f6ed80c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7f6ee0694640 1 --2- 172.21.15.49:0/1917689552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ed814f810 0x7f6ed80c4720 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8008870 tx=0x7f6ec8021200 comp rx=0 tx=0).stop 2023-11-18T21:00:18.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7f6ee0694640 1 -- 172.21.15.49:0/1917689552 shutdown_connections 2023-11-18T21:00:18.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7f6ee0694640 1 --2- 172.21.15.49:0/1917689552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ed814f810 0x7f6ed80c4720 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7f6ee0694640 1 --2- 172.21.15.49:0/1917689552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ed814f430 0x7f6ed8155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7f6ee0694640 1 -- 172.21.15.49:0/1917689552 >> 172.21.15.49:0/1917689552 conn(0x7f6ed80c73c0 msgr2=0x7f6ed80c77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7f6ee0694640 1 -- 172.21.15.49:0/1917689552 shutdown_connections 2023-11-18T21:00:18.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.324+0000 7f6ee0694640 1 -- 172.21.15.49:0/1917689552 wait complete. 2023-11-18T21:00:18.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f7daa7fc640 1 -- 172.21.15.49:0/614731495 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4003600 con 0x7f7db40c7ee0 2023-11-18T21:00:18.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f7daa7fc640 1 -- 172.21.15.49:0/614731495 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da4003760 con 0x7f7db40c7ee0 2023-11-18T21:00:18.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f7dbbaab640 1 -- 172.21.15.49:0/614731495 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db414f6f0 con 0x7f7db40c7ee0 2023-11-18T21:00:18.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f7daa7fc640 1 -- 172.21.15.49:0/614731495 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4003b50 con 0x7f7db40c7ee0 2023-11-18T21:00:18.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f7dbbaab640 1 -- 172.21.15.49:0/614731495 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db414fcb0 con 0x7f7db40c7ee0 2023-11-18T21:00:18.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f6ee0694640 1 Processor -- start 2023-11-18T21:00:18.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f6ee0694640 1 -- start start 2023-11-18T21:00:18.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f7dbbaab640 1 -- 172.21.15.49:0/614731495 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7db40c3380 con 0x7f7db40c7ee0 2023-11-18T21:00:18.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f6ee0694640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed806e330 0x7f6ed80c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f6ee0694640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ed814f430 0x7f6ed81eef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f6ee0694640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ed8153470 0x7f6ed81ef470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f6ee0694640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed814e360 con 0x7f6ed806e330 2023-11-18T21:00:18.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f6ee0694640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed81eeaa0 con 0x7f6ed814f430 2023-11-18T21:00:18.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f6ee0694640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed81f2920 con 0x7f6ed8153470 2023-11-18T21:00:18.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f805d7fa640 1 -- 172.21.15.49:0/1610106396 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054011830 con 0x7f8060150070 2023-11-18T21:00:18.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7fbff2ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbff40c5cd0 0x7fbff41f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f805d7fa640 1 -- 172.21.15.49:0/1610106396 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8054011990 con 0x7f8060150070 2023-11-18T21:00:18.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f8066daf640 1 -- 172.21.15.49:0/1610106396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80600c8ce0 con 0x7f8060150070 2023-11-18T21:00:18.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f805d7fa640 1 -- 172.21.15.49:0/1610106396 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054011d20 con 0x7f8060150070 2023-11-18T21:00:18.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f8066daf640 1 -- 172.21.15.49:0/1610106396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80601efb80 con 0x7f8060150070 2023-11-18T21:00:18.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.328+0000 7f8066daf640 1 -- 172.21.15.49:0/1610106396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f80600c5ad0 con 0x7f8060150070 2023-11-18T21:00:18.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.332+0000 7fbff27fc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbff40c6620 0x7fbff4150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.332+0000 7f465ffff640 1 -- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4660157280 msgr2=0x7f4660145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.332+0000 7f465ffff640 1 --2- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4660157280 0x7f4660145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.332+0000 7f465ffff640 1 -- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4660151460 msgr2=0x7f46601472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.332+0000 7f465ffff640 1 --2- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4660151460 0x7f46601472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.332+0000 7f465ffff640 1 -- 172.21.15.49:0/3580456061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46500094d0 con 0x7f46600c9130 2023-11-18T21:00:18.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.332+0000 7feea5496640 1 --2- 172.21.15.49:0/2168531307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea015a240 0x7feea013f6f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fee9800b9e0 tx=0x7fee9800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.332+0000 7fbff2ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbff40c5cd0 0x7fbff41f08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:35968/0 (socket says 172.21.15.49:35968) 2023-11-18T21:00:18.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.332+0000 7fbff2ffd640 1 -- 172.21.15.49:0/3634714000 learned_addr learned my addr 172.21.15.49:0/3634714000 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.336+0000 7f465ffff640 1 --2- 172.21.15.49:0/3580456061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46600c9130 0x7f4660148200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f46500ad040 tx=0x7f465001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.336+0000 7fbff37fe640 1 --2- 172.21.15.49:0/3634714000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff4150280 0x7fbff4153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.340+0000 7f8fdffff640 1 -- 172.21.15.49:0/1581782474 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff000a7e0 con 0x7f8ff80c6860 2023-11-18T21:00:18.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.340+0000 7f8fdffff640 1 -- 172.21.15.49:0/1581782474 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff000a940 con 0x7f8ff80c6860 2023-11-18T21:00:18.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.340+0000 7f8ffceac640 1 -- 172.21.15.49:0/1581782474 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff80c8870 con 0x7f8ff80c6860 2023-11-18T21:00:18.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.340+0000 7f8fdffff640 1 -- 172.21.15.49:0/1581782474 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff000acf0 con 0x7f8ff80c6860 2023-11-18T21:00:18.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.340+0000 7f8ffceac640 1 -- 172.21.15.49:0/1581782474 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff8150a10 con 0x7f8ff80c6860 2023-11-18T21:00:18.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.340+0000 7f8ffceac640 1 -- 172.21.15.49:0/1581782474 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ff81588a0 con 0x7f8ff80c6860 2023-11-18T21:00:18.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.344+0000 7f6ede430640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed806e330 0x7f6ed80c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.344+0000 7f6ede430640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed806e330 0x7f6ed80c5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38250/0 (socket says 172.21.15.49:38250) 2023-11-18T21:00:18.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.344+0000 7f6ede430640 1 -- 172.21.15.49:0/223015688 learned_addr learned my addr 172.21.15.49:0/223015688 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.348+0000 7fbff2ffd640 1 -- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbff40c6620 msgr2=0x7fbff4150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.348+0000 7fbff2ffd640 1 --2- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbff40c6620 0x7fbff4150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.348+0000 7fbff2ffd640 1 -- 172.21.15.49:0/3634714000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff4150280 msgr2=0x7fbff4153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.348+0000 7fbff2ffd640 1 --2- 172.21.15.49:0/3634714000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbff4150280 0x7fbff4153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.348+0000 7fbff2ffd640 1 -- 172.21.15.49:0/3634714000 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe40094d0 con 0x7fbff40c5cd0 2023-11-18T21:00:18.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.360+0000 7fbff2ffd640 1 --2- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbff40c5cd0 0x7fbff41f08e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40ae040 tx=0x7fbfe401ac50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.364+0000 7fee9d7fa640 1 -- 172.21.15.49:0/2168531307 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9800caa0 con 0x7feea015a240 2023-11-18T21:00:18.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.364+0000 7fee9d7fa640 1 -- 172.21.15.49:0/2168531307 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9800cc20 con 0x7feea015a240 2023-11-18T21:00:18.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.364+0000 7fee9d7fa640 1 -- 172.21.15.49:0/2168531307 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98014440 con 0x7feea015a240 2023-11-18T21:00:18.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.364+0000 7feea5c97640 1 -- 172.21.15.49:0/2168531307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea01400f0 con 0x7feea015a240 2023-11-18T21:00:18.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.364+0000 7feea5c97640 1 -- 172.21.15.49:0/2168531307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea0140a10 con 0x7feea015a240 2023-11-18T21:00:18.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.364+0000 7feea5c97640 1 -- 172.21.15.49:0/2168531307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feea0159760 con 0x7feea015a240 2023-11-18T21:00:18.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.368+0000 7f6ede430640 1 -- 172.21.15.49:0/223015688 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ed8153470 msgr2=0x7f6ed81ef470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.368+0000 7f6ede430640 1 --2- 172.21.15.49:0/223015688 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ed8153470 0x7f6ed81ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.368+0000 7f6ede430640 1 -- 172.21.15.49:0/223015688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ed814f430 msgr2=0x7f6ed81eef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.368+0000 7f6ede430640 1 --2- 172.21.15.49:0/223015688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ed814f430 0x7f6ed81eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.368+0000 7f6ede430640 1 -- 172.21.15.49:0/223015688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec8008550 con 0x7f6ed806e330 2023-11-18T21:00:18.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.372+0000 7f465d7fa640 1 -- 172.21.15.49:0/3580456061 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500b4800 con 0x7f46600c9130 2023-11-18T21:00:18.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.372+0000 7f465d7fa640 1 -- 172.21.15.49:0/3580456061 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46500b4980 con 0x7f46600c9130 2023-11-18T21:00:18.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.372+0000 7f465d7fa640 1 -- 172.21.15.49:0/3580456061 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500b4d30 con 0x7f46600c9130 2023-11-18T21:00:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.372+0000 7f4666637640 1 -- 172.21.15.49:0/3580456061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466014f570 con 0x7f46600c9130 2023-11-18T21:00:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.372+0000 7f4666637640 1 -- 172.21.15.49:0/3580456061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4660146ab0 con 0x7f46600c9130 2023-11-18T21:00:18.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.372+0000 7f4666637640 1 -- 172.21.15.49:0/3580456061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46600b2380 con 0x7f46600c9130 2023-11-18T21:00:18.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.376+0000 7fbfdbfff640 1 -- 172.21.15.49:0/3634714000 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40b6620 con 0x7fbff40c5cd0 2023-11-18T21:00:18.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.376+0000 7fbfdbfff640 1 -- 172.21.15.49:0/3634714000 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe40b6780 con 0x7fbff40c5cd0 2023-11-18T21:00:18.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.376+0000 7fbfdbfff640 1 -- 172.21.15.49:0/3634714000 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40b6b30 con 0x7fbff40c5cd0 2023-11-18T21:00:18.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.376+0000 7fbff3fff640 1 -- 172.21.15.49:0/3634714000 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff41e9d30 con 0x7fbff40c5cd0 2023-11-18T21:00:18.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.376+0000 7fbff3fff640 1 -- 172.21.15.49:0/3634714000 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff4158900 con 0x7fbff40c5cd0 2023-11-18T21:00:18.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.380+0000 7fbff3fff640 1 -- 172.21.15.49:0/3634714000 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbff40c1300 con 0x7fbff40c5cd0 2023-11-18T21:00:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.396+0000 7f7daa7fc640 1 -- 172.21.15.49:0/614731495 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7da4003cb0 con 0x7f7db40c7ee0 2023-11-18T21:00:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.396+0000 7f7daa7fc640 1 --2- 172.21.15.49:0/614731495 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7d980664a0 0x7f7d98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.396+0000 7f7db9847640 1 --2- 172.21.15.49:0/614731495 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7d980664a0 0x7f7d98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.396+0000 7f7db9847640 1 --2- 172.21.15.49:0/614731495 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7d980664a0 0x7f7d98068960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7dac00ab90 tx=0x7f7dac009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.416+0000 7fee9d7fa640 1 -- 172.21.15.49:0/2168531307 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fee9801d3b0 con 0x7feea015a240 2023-11-18T21:00:18.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.416+0000 7fee9d7fa640 1 --2- 172.21.15.49:0/2168531307 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fee840664c0 0x7fee84068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.416+0000 7feea4c95640 1 --2- 172.21.15.49:0/2168531307 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fee840664c0 0x7fee84068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.416+0000 7feea4c95640 1 --2- 172.21.15.49:0/2168531307 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fee840664c0 0x7fee84068980 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fee940b2000 tx=0x7fee94004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.420+0000 7fee9d7fa640 1 -- 172.21.15.49:0/2168531307 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fee98055ce0 con 0x7feea015a240 2023-11-18T21:00:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.420+0000 7fee9d7fa640 1 --2- 172.21.15.49:0/2168531307 >> [v2:172.21.15.106:6826/283622084,v1:172.21.15.106:6827/283622084] conn(0x7fee8406fa80 0x7fee84071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.420+0000 7fee9d7fa640 1 -- 172.21.15.49:0/2168531307 --> [v2:172.21.15.106:6826/283622084,v1:172.21.15.106:6827/283622084] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee84072590 con 0x7fee8406fa80 2023-11-18T21:00:18.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.420+0000 7fee9d7fa640 1 -- 172.21.15.49:0/2168531307 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee98051920 con 0x7feea015a240 2023-11-18T21:00:18.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.424+0000 7fee9ffff640 1 --2- 172.21.15.49:0/2168531307 >> [v2:172.21.15.106:6826/283622084,v1:172.21.15.106:6827/283622084] conn(0x7fee8406fa80 0x7fee84071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.424+0000 7fee9ffff640 1 --2- 172.21.15.49:0/2168531307 >> [v2:172.21.15.106:6826/283622084,v1:172.21.15.106:6827/283622084] conn(0x7fee8406fa80 0x7fee84071ec0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.424+0000 7fee9d7fa640 1 -- 172.21.15.49:0/2168531307 <== osd.6 v2:172.21.15.106:6826/283622084 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fee84072590 con 0x7fee8406fa80 2023-11-18T21:00:18.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.432+0000 7f7daa7fc640 1 -- 172.21.15.49:0/614731495 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7da40554f0 con 0x7f7db40c7ee0 2023-11-18T21:00:18.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.432+0000 7f7daa7fc640 1 --2- 172.21.15.49:0/614731495 >> [v2:172.21.15.49:6824/2157206456,v1:172.21.15.49:6825/2157206456] conn(0x7f7d9806f960 0x7f7d98071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.432+0000 7f7daa7fc640 1 -- 172.21.15.49:0/614731495 --> [v2:172.21.15.49:6824/2157206456,v1:172.21.15.49:6825/2157206456] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d98072470 con 0x7f7d9806f960 2023-11-18T21:00:18.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.432+0000 7f7daa7fc640 1 -- 172.21.15.49:0/614731495 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7da4051130 con 0x7f7db40c7ee0 2023-11-18T21:00:18.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.432+0000 7f6ede430640 1 --2- 172.21.15.49:0/223015688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed806e330 0x7f6ed80c5a50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400d860 tx=0x7f6ed400dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.432+0000 7f7db9046640 1 --2- 172.21.15.49:0/614731495 >> [v2:172.21.15.49:6824/2157206456,v1:172.21.15.49:6825/2157206456] conn(0x7f7d9806f960 0x7f7d98071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.432+0000 7f7db9046640 1 --2- 172.21.15.49:0/614731495 >> [v2:172.21.15.49:6824/2157206456,v1:172.21.15.49:6825/2157206456] conn(0x7f7d9806f960 0x7f7d98071da0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.432+0000 7f8fdffff640 1 -- 172.21.15.49:0/1581782474 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ff001b3b0 con 0x7f8ff80c6860 2023-11-18T21:00:18.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.432+0000 7f7daa7fc640 1 -- 172.21.15.49:0/614731495 <== osd.3 v2:172.21.15.49:6824/2157206456 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7d98072470 con 0x7f7d9806f960 2023-11-18T21:00:18.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.432+0000 7f8fdffff640 1 --2- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f8fe40664c0 0x7f8fe4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.432+0000 7f8ff6ffd640 1 --2- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f8fe40664c0 0x7f8fe4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.432+0000 7f8ff6ffd640 1 --2- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f8fe40664c0 0x7f8fe4068980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8ff81f2e30 tx=0x7f8fe8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.436+0000 7fbfdbfff640 1 -- 172.21.15.49:0/3634714000 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbfe40b2040 con 0x7fbff40c5cd0 2023-11-18T21:00:18.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.436+0000 7fbfdbfff640 1 --2- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fbfe00664f0 0x7fbfe00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.436+0000 7fbff27fc640 1 --2- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fbfe00664f0 0x7fbfe00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.436+0000 7fbff27fc640 1 --2- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fbfe00664f0 0x7fbfe00689b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbff41f4570 tx=0x7fbfe8009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.440+0000 7f8fdffff640 1 -- 172.21.15.49:0/1581782474 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8ff0054dd0 con 0x7f8ff80c6860 2023-11-18T21:00:18.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.440+0000 7f8fdffff640 1 --2- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:6818/3891839772,v1:172.21.15.106:6819/3891839772] conn(0x7f8fe406fa00 0x7f8fe4071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.440+0000 7f8fdffff640 1 -- 172.21.15.49:0/1581782474 --> [v2:172.21.15.106:6818/3891839772,v1:172.21.15.106:6819/3891839772] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fe4072510 con 0x7f8fe406fa00 2023-11-18T21:00:18.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.440+0000 7f8ff7fff640 1 --2- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:6818/3891839772,v1:172.21.15.106:6819/3891839772] conn(0x7f8fe406fa00 0x7f8fe4071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.440+0000 7f8ff7fff640 1 --2- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:6818/3891839772,v1:172.21.15.106:6819/3891839772] conn(0x7f8fe406fa00 0x7f8fe4071e40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.440+0000 7f8fdffff640 1 -- 172.21.15.49:0/1581782474 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ff00075d0 con 0x7f8ff80c6860 2023-11-18T21:00:18.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.440+0000 7fbfdbfff640 1 -- 172.21.15.49:0/3634714000 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbfe40efc50 con 0x7fbff40c5cd0 2023-11-18T21:00:18.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.440+0000 7fbfdbfff640 1 --2- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:6810/2002613814,v1:172.21.15.106:6811/2002613814] conn(0x7fbfe006fa30 0x7fbfe0071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.440+0000 7fbfdbfff640 1 -- 172.21.15.49:0/3634714000 --> [v2:172.21.15.106:6810/2002613814,v1:172.21.15.106:6811/2002613814] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbfe0072540 con 0x7fbfe006fa30 2023-11-18T21:00:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.444+0000 7fbff37fe640 1 --2- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:6810/2002613814,v1:172.21.15.106:6811/2002613814] conn(0x7fbfe006fa30 0x7fbfe0071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.444+0000 7fbfdbfff640 1 -- 172.21.15.49:0/3634714000 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfe40ebf90 con 0x7fbff40c5cd0 2023-11-18T21:00:18.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.444+0000 7f8fdffff640 1 -- 172.21.15.49:0/1581782474 <== osd.4 v2:172.21.15.106:6818/3891839772 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8fe4072510 con 0x7f8fe406fa00 2023-11-18T21:00:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.444+0000 7f934effd640 1 -- 172.21.15.49:0/472956120 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354003600 con 0x7f93600c2f70 2023-11-18T21:00:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.444+0000 7f934effd640 1 -- 172.21.15.49:0/472956120 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9354003780 con 0x7f93600c2f70 2023-11-18T21:00:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.444+0000 7f9364936640 1 -- 172.21.15.49:0/472956120 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93601582c0 con 0x7f93600c2f70 2023-11-18T21:00:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.444+0000 7f934effd640 1 -- 172.21.15.49:0/472956120 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354003b30 con 0x7f93600c2f70 2023-11-18T21:00:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.444+0000 7f9364936640 1 -- 172.21.15.49:0/472956120 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93602035e0 con 0x7f93600c2f70 2023-11-18T21:00:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.444+0000 7f9364936640 1 -- 172.21.15.49:0/472956120 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93600c2800 con 0x7f93600c2f70 2023-11-18T21:00:18.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.444+0000 7fbff37fe640 1 --2- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:6810/2002613814,v1:172.21.15.106:6811/2002613814] conn(0x7fbfe006fa30 0x7fbfe0071e70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.444+0000 7fbfdbfff640 1 -- 172.21.15.49:0/3634714000 <== osd.7 v2:172.21.15.106:6810/2002613814 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbfe0072540 con 0x7fbfe006fa30 2023-11-18T21:00:18.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.452+0000 7f7dbbaab640 1 -- 172.21.15.49:0/614731495 --> [v2:172.21.15.49:6824/2157206456,v1:172.21.15.49:6825/2157206456] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7db4146f40 con 0x7f7d9806f960 2023-11-18T21:00:18.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.452+0000 7f7daa7fc640 1 -- 172.21.15.49:0/614731495 <== osd.3 v2:172.21.15.49:6824/2157206456 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7db00a88d0 con 0x7f7d9806f960 2023-11-18T21:00:18.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.452+0000 7f7dbbaab640 1 -- 172.21.15.49:0/614731495 >> [v2:172.21.15.49:6824/2157206456,v1:172.21.15.49:6825/2157206456] conn(0x7f7d9806f960 msgr2=0x7f7d98071da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.452+0000 7f7dbbaab640 1 --2- 172.21.15.49:0/614731495 >> [v2:172.21.15.49:6824/2157206456,v1:172.21.15.49:6825/2157206456] conn(0x7f7d9806f960 0x7f7d98071da0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.452+0000 7f7dbbaab640 1 -- 172.21.15.49:0/614731495 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7d980664a0 msgr2=0x7f7d98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.452+0000 7f7dbbaab640 1 --2- 172.21.15.49:0/614731495 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7d980664a0 0x7f7d98068960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7dac00ab90 tx=0x7f7dac009250 comp rx=0 tx=0).stop 2023-11-18T21:00:18.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.452+0000 7f7dbbaab640 1 -- 172.21.15.49:0/614731495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7db40c7ee0 msgr2=0x7f7db413e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.452+0000 7f7dbbaab640 1 --2- 172.21.15.49:0/614731495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7db40c7ee0 0x7f7db413e4f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7da400c410 tx=0x7f7da400c810 comp rx=0 tx=0).stop 2023-11-18T21:00:18.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.452+0000 7f7dba048640 1 -- 172.21.15.49:0/614731495 reap_dead start 2023-11-18T21:00:18.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.452+0000 7f7dbbaab640 1 -- 172.21.15.49:0/614731495 shutdown_connections 2023-11-18T21:00:18.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.452+0000 7f7dbbaab640 1 -- 172.21.15.49:0/614731495 >> 172.21.15.49:0/614731495 conn(0x7f7db40c73c0 msgr2=0x7f7db4072310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.452+0000 7f7dbbaab640 1 -- 172.21.15.49:0/614731495 shutdown_connections 2023-11-18T21:00:18.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.452+0000 7f7dbbaab640 1 -- 172.21.15.49:0/614731495 wait complete. 2023-11-18T21:00:18.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.456+0000 7feea5c97640 1 -- 172.21.15.49:0/2168531307 --> [v2:172.21.15.106:6826/283622084,v1:172.21.15.106:6827/283622084] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feea00c3880 con 0x7fee8406fa80 2023-11-18T21:00:18.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7fee9d7fa640 1 -- 172.21.15.49:0/2168531307 <== osd.6 v2:172.21.15.106:6826/283622084 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fee8c0092a0 con 0x7fee8406fa80 2023-11-18T21:00:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7feea5c97640 1 -- 172.21.15.49:0/2168531307 >> [v2:172.21.15.106:6826/283622084,v1:172.21.15.106:6827/283622084] conn(0x7fee8406fa80 msgr2=0x7fee84071ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7feea5c97640 1 --2- 172.21.15.49:0/2168531307 >> [v2:172.21.15.106:6826/283622084,v1:172.21.15.106:6827/283622084] conn(0x7fee8406fa80 0x7fee84071ec0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7feea5c97640 1 -- 172.21.15.49:0/2168531307 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fee840664c0 msgr2=0x7fee84068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7feea5c97640 1 --2- 172.21.15.49:0/2168531307 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fee840664c0 0x7fee84068980 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fee940b2000 tx=0x7fee94004740 comp rx=0 tx=0).stop 2023-11-18T21:00:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7feea5c97640 1 -- 172.21.15.49:0/2168531307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea015a240 msgr2=0x7feea013f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7feea5c97640 1 --2- 172.21.15.49:0/2168531307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea015a240 0x7feea013f6f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fee9800b9e0 tx=0x7fee9800bea0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7feea5496640 1 -- 172.21.15.49:0/2168531307 reap_dead start 2023-11-18T21:00:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7feea5c97640 1 -- 172.21.15.49:0/2168531307 shutdown_connections 2023-11-18T21:00:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7feea5c97640 1 -- 172.21.15.49:0/2168531307 >> 172.21.15.49:0/2168531307 conn(0x7feea00cb8d0 msgr2=0x7feea01434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7feea5c97640 1 -- 172.21.15.49:0/2168531307 shutdown_connections 2023-11-18T21:00:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7feea5c97640 1 -- 172.21.15.49:0/2168531307 wait complete. 2023-11-18T21:00:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7f465d7fa640 1 -- 172.21.15.49:0/3580456061 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f46500c83e0 con 0x7f46600c9130 2023-11-18T21:00:18.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7f465d7fa640 1 --2- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4640066470 0x7f4640068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7f4657fff640 1 --2- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4640066470 0x7f4640068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.460+0000 7f4657fff640 1 --2- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4640066470 0x7f4640068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4648006fd0 tx=0x7f4648008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.464+0000 7f465d7fa640 1 -- 172.21.15.49:0/3580456061 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f46500efbc0 con 0x7f46600c9130 2023-11-18T21:00:18.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.464+0000 7f465d7fa640 1 --2- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:6802/728068152,v1:172.21.15.106:6803/728068152] conn(0x7f464006f930 0x7f4640071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.464+0000 7f465d7fa640 1 -- 172.21.15.49:0/3580456061 --> [v2:172.21.15.106:6802/728068152,v1:172.21.15.106:6803/728068152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4640072440 con 0x7f464006f930 2023-11-18T21:00:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.464+0000 7f465d7fa640 1 -- 172.21.15.49:0/3580456061 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46500ebf00 con 0x7f46600c9130 2023-11-18T21:00:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.468+0000 7f4664bd4640 1 --2- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:6802/728068152,v1:172.21.15.106:6803/728068152] conn(0x7f464006f930 0x7f4640071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.468+0000 7f4664bd4640 1 --2- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:6802/728068152,v1:172.21.15.106:6803/728068152] conn(0x7f464006f930 0x7f4640071d70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.468+0000 7f465d7fa640 1 -- 172.21.15.49:0/3580456061 <== osd.5 v2:172.21.15.106:6802/728068152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4640072440 con 0x7f464006f930 2023-11-18T21:00:18.475 INFO:teuthology.orchestra.run.smithi049.stdout:64424509464 2023-11-18T21:00:18.475 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-18T21:00:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7f8ffceac640 1 -- 172.21.15.49:0/1581782474 --> [v2:172.21.15.106:6818/3891839772,v1:172.21.15.106:6819/3891839772] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8ff8155e30 con 0x7f8fe406fa00 2023-11-18T21:00:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7fbff3fff640 1 -- 172.21.15.49:0/3634714000 --> [v2:172.21.15.106:6810/2002613814,v1:172.21.15.106:6811/2002613814] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbff40c2d60 con 0x7fbfe006fa30 2023-11-18T21:00:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7f8fdffff640 1 -- 172.21.15.49:0/1581782474 <== osd.4 v2:172.21.15.106:6818/3891839772 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8fec0a88f0 con 0x7f8fe406fa00 2023-11-18T21:00:18.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7f8ffceac640 1 -- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:6818/3891839772,v1:172.21.15.106:6819/3891839772] conn(0x7f8fe406fa00 msgr2=0x7f8fe4071e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7f8ffceac640 1 --2- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:6818/3891839772,v1:172.21.15.106:6819/3891839772] conn(0x7f8fe406fa00 0x7f8fe4071e40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7f8ffceac640 1 -- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f8fe40664c0 msgr2=0x7f8fe4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7f8ffceac640 1 --2- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f8fe40664c0 0x7f8fe4068980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8ff81f2e30 tx=0x7f8fe8009190 comp rx=0 tx=0).stop 2023-11-18T21:00:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7f8ffceac640 1 -- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ff80c6860 msgr2=0x7f8ff80ca220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7f8ffceac640 1 --2- 172.21.15.49:0/1581782474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ff80c6860 0x7f8ff80ca220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000c7a0 tx=0x7f8ff000cc60 comp rx=0 tx=0).stop 2023-11-18T21:00:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7f8ff7fff640 1 -- 172.21.15.49:0/1581782474 reap_dead start 2023-11-18T21:00:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7f8ffceac640 1 -- 172.21.15.49:0/1581782474 shutdown_connections 2023-11-18T21:00:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7f8ffceac640 1 -- 172.21.15.49:0/1581782474 >> 172.21.15.49:0/1581782474 conn(0x7f8ff806a560 msgr2=0x7f8ff814e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7f8ffceac640 1 -- 172.21.15.49:0/1581782474 shutdown_connections 2023-11-18T21:00:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7f8ffceac640 1 -- 172.21.15.49:0/1581782474 wait complete. 2023-11-18T21:00:18.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7fbfdbfff640 1 -- 172.21.15.49:0/3634714000 <== osd.7 v2:172.21.15.106:6810/2002613814 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbfec009bf0 con 0x7fbfe006fa30 2023-11-18T21:00:18.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7fbff3fff640 1 -- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:6810/2002613814,v1:172.21.15.106:6811/2002613814] conn(0x7fbfe006fa30 msgr2=0x7fbfe0071e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7fbff3fff640 1 --2- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:6810/2002613814,v1:172.21.15.106:6811/2002613814] conn(0x7fbfe006fa30 0x7fbfe0071e70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7fbff3fff640 1 -- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fbfe00664f0 msgr2=0x7fbfe00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7fbff3fff640 1 --2- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fbfe00664f0 0x7fbfe00689b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbff41f4570 tx=0x7fbfe8009060 comp rx=0 tx=0).stop 2023-11-18T21:00:18.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7fbff3fff640 1 -- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbff40c5cd0 msgr2=0x7fbff41f08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7fbff3fff640 1 --2- 172.21.15.49:0/3634714000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbff40c5cd0 0x7fbff41f08e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40ae040 tx=0x7fbfe401ac50 comp rx=0 tx=0).stop 2023-11-18T21:00:18.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7fbff37fe640 1 -- 172.21.15.49:0/3634714000 reap_dead start 2023-11-18T21:00:18.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7fbff3fff640 1 -- 172.21.15.49:0/3634714000 shutdown_connections 2023-11-18T21:00:18.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7fbff3fff640 1 -- 172.21.15.49:0/3634714000 >> 172.21.15.49:0/3634714000 conn(0x7fbff406dd80 msgr2=0x7fbff40cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7fbff3fff640 1 -- 172.21.15.49:0/3634714000 shutdown_connections 2023-11-18T21:00:18.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.476+0000 7fbff3fff640 1 -- 172.21.15.49:0/3634714000 wait complete. 2023-11-18T21:00:18.487 INFO:teuthology.orchestra.run.smithi049.stdout:64424509465 2023-11-18T21:00:18.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-18T21:00:18.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.488+0000 7f4666637640 1 -- 172.21.15.49:0/3580456061 --> [v2:172.21.15.106:6802/728068152,v1:172.21.15.106:6803/728068152] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f46600c1ef0 con 0x7f464006f930 2023-11-18T21:00:18.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.488+0000 7f465d7fa640 1 -- 172.21.15.49:0/3580456061 <== osd.5 v2:172.21.15.106:6802/728068152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f465800a720 con 0x7f464006f930 2023-11-18T21:00:18.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.488+0000 7f4666637640 1 -- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:6802/728068152,v1:172.21.15.106:6803/728068152] conn(0x7f464006f930 msgr2=0x7f4640071d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.488+0000 7f4666637640 1 --2- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:6802/728068152,v1:172.21.15.106:6803/728068152] conn(0x7f464006f930 0x7f4640071d70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.488+0000 7f4666637640 1 -- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4640066470 msgr2=0x7f4640068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.488+0000 7f4666637640 1 --2- 172.21.15.49:0/3580456061 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4640066470 0x7f4640068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4648006fd0 tx=0x7f4648008040 comp rx=0 tx=0).stop 2023-11-18T21:00:18.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.488+0000 7f4666637640 1 -- 172.21.15.49:0/3580456061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46600c9130 msgr2=0x7f4660148200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.488+0000 7f4666637640 1 --2- 172.21.15.49:0/3580456061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46600c9130 0x7f4660148200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f46500ad040 tx=0x7f465001ac40 comp rx=0 tx=0).stop 2023-11-18T21:00:18.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.488+0000 7f4664bd4640 1 -- 172.21.15.49:0/3580456061 reap_dead start 2023-11-18T21:00:18.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.488+0000 7f4666637640 1 -- 172.21.15.49:0/3580456061 shutdown_connections 2023-11-18T21:00:18.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.488+0000 7f4666637640 1 -- 172.21.15.49:0/3580456061 >> 172.21.15.49:0/3580456061 conn(0x7f46600708a0 msgr2=0x7f4660070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.488+0000 7f4666637640 1 -- 172.21.15.49:0/3580456061 shutdown_connections 2023-11-18T21:00:18.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.488+0000 7f4666637640 1 -- 172.21.15.49:0/3580456061 wait complete. 2023-11-18T21:00:18.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.488+0000 7f805d7fa640 1 -- 172.21.15.49:0/1610106396 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f805401a400 con 0x7f8060150070 2023-11-18T21:00:18.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.492+0000 7f805d7fa640 1 --2- 172.21.15.49:0/1610106396 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f804c0664f0 0x7f804c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.492+0000 7f8064b4b640 1 --2- 172.21.15.49:0/1610106396 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f804c0664f0 0x7f804c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.492+0000 7f8064b4b640 1 --2- 172.21.15.49:0/1610106396 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f804c0664f0 0x7f804c0689b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f80500097f0 tx=0x7f8050008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.496+0000 7f805d7fa640 1 -- 172.21.15.49:0/1610106396 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8054055e20 con 0x7f8060150070 2023-11-18T21:00:18.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.496+0000 7f805d7fa640 1 --2- 172.21.15.49:0/1610106396 >> [v2:172.21.15.49:6800/53487446,v1:172.21.15.49:6801/53487446] conn(0x7f804c06fab0 0x7f804c071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.496+0000 7f805d7fa640 1 -- 172.21.15.49:0/1610106396 --> [v2:172.21.15.49:6800/53487446,v1:172.21.15.49:6801/53487446] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f804c0725c0 con 0x7f804c06fab0 2023-11-18T21:00:18.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.496+0000 7f805d7fa640 1 -- 172.21.15.49:0/1610106396 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8054011e80 con 0x7f8060150070 2023-11-18T21:00:18.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.496+0000 7f805ffff640 1 --2- 172.21.15.49:0/1610106396 >> [v2:172.21.15.49:6800/53487446,v1:172.21.15.49:6801/53487446] conn(0x7f804c06fab0 0x7f804c071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.500+0000 7f805ffff640 1 --2- 172.21.15.49:0/1610106396 >> [v2:172.21.15.49:6800/53487446,v1:172.21.15.49:6801/53487446] conn(0x7f804c06fab0 0x7f804c071ef0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.500+0000 7f805d7fa640 1 -- 172.21.15.49:0/1610106396 <== osd.0 v2:172.21.15.49:6800/53487446 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f804c0725c0 con 0x7f804c06fab0 2023-11-18T21:00:18.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.496+0000 7f934effd640 1 -- 172.21.15.49:0/472956120 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9354003c90 con 0x7f93600c2f70 2023-11-18T21:00:18.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.496+0000 7f934effd640 1 --2- 172.21.15.49:0/472956120 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f93400664c0 0x7f9340068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.500+0000 7f935e59c640 1 --2- 172.21.15.49:0/472956120 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f93400664c0 0x7f9340068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.500+0000 7f935e59c640 1 --2- 172.21.15.49:0/472956120 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f93400664c0 0x7f9340068980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f93580ae000 tx=0x7f9358004ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.503 INFO:teuthology.orchestra.run.smithi049.stdout:60129542167 2023-11-18T21:00:18.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-18T21:00:18.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.508+0000 7f934effd640 1 -- 172.21.15.49:0/472956120 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9354054cb0 con 0x7f93600c2f70 2023-11-18T21:00:18.509 INFO:teuthology.orchestra.run.smithi049.stdout:64424509465 2023-11-18T21:00:18.509 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-18T21:00:18.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.508+0000 7f934effd640 1 --2- 172.21.15.49:0/472956120 >> [v2:172.21.15.49:6816/3310490448,v1:172.21.15.49:6817/3310490448] conn(0x7f934006fa00 0x7f9340071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.508+0000 7f934effd640 1 -- 172.21.15.49:0/472956120 --> [v2:172.21.15.49:6816/3310490448,v1:172.21.15.49:6817/3310490448] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9340072510 con 0x7f934006fa00 2023-11-18T21:00:18.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.508+0000 7f935dd9b640 1 --2- 172.21.15.49:0/472956120 >> [v2:172.21.15.49:6816/3310490448,v1:172.21.15.49:6817/3310490448] conn(0x7f934006fa00 0x7f9340071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.508+0000 7f934effd640 1 -- 172.21.15.49:0/472956120 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93540010d0 con 0x7f93600c2f70 2023-11-18T21:00:18.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.508+0000 7f935dd9b640 1 --2- 172.21.15.49:0/472956120 >> [v2:172.21.15.49:6816/3310490448,v1:172.21.15.49:6817/3310490448] conn(0x7f934006fa00 0x7f9340071e40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.508+0000 7f934effd640 1 -- 172.21.15.49:0/472956120 <== osd.2 v2:172.21.15.49:6816/3310490448 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9340072510 con 0x7f934006fa00 2023-11-18T21:00:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.512+0000 7f6eceffd640 1 -- 172.21.15.49:0/223015688 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400de50 con 0x7f6ed806e330 2023-11-18T21:00:18.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.512+0000 7f6eceffd640 1 -- 172.21.15.49:0/223015688 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed400b8d0 con 0x7f6ed806e330 2023-11-18T21:00:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.512+0000 7f6eceffd640 1 -- 172.21.15.49:0/223015688 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400bc40 con 0x7f6ed806e330 2023-11-18T21:00:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.520+0000 7f6ee0694640 1 -- 172.21.15.49:0/223015688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed81f2b90 con 0x7f6ed806e330 2023-11-18T21:00:18.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.520+0000 7f6ee0694640 1 -- 172.21.15.49:0/223015688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed8150890 con 0x7f6ed806e330 2023-11-18T21:00:18.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.520+0000 7f6ee0694640 1 -- 172.21.15.49:0/223015688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ed80c3380 con 0x7f6ed806e330 2023-11-18T21:00:18.524 INFO:teuthology.orchestra.run.smithi049.stdout:64424509465 2023-11-18T21:00:18.524 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-18T21:00:18.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.524+0000 7f8066daf640 1 -- 172.21.15.49:0/1610106396 --> [v2:172.21.15.49:6800/53487446,v1:172.21.15.49:6801/53487446] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f80600c57f0 con 0x7f804c06fab0 2023-11-18T21:00:18.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.524+0000 7f805d7fa640 1 -- 172.21.15.49:0/1610106396 <== osd.0 v2:172.21.15.49:6800/53487446 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f80580019a0 con 0x7f804c06fab0 2023-11-18T21:00:18.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.536+0000 7f8066daf640 1 -- 172.21.15.49:0/1610106396 >> [v2:172.21.15.49:6800/53487446,v1:172.21.15.49:6801/53487446] conn(0x7f804c06fab0 msgr2=0x7f804c071ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.536+0000 7f8066daf640 1 --2- 172.21.15.49:0/1610106396 >> [v2:172.21.15.49:6800/53487446,v1:172.21.15.49:6801/53487446] conn(0x7f804c06fab0 0x7f804c071ef0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.536+0000 7f8066daf640 1 -- 172.21.15.49:0/1610106396 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f804c0664f0 msgr2=0x7f804c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.536+0000 7f8066daf640 1 --2- 172.21.15.49:0/1610106396 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f804c0664f0 0x7f804c0689b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f80500097f0 tx=0x7f8050008040 comp rx=0 tx=0).stop 2023-11-18T21:00:18.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.536+0000 7f8066daf640 1 -- 172.21.15.49:0/1610106396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8060150070 msgr2=0x7f8060158630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.536+0000 7f8066daf640 1 --2- 172.21.15.49:0/1610106396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8060150070 0x7f8060158630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f805400b3e0 tx=0x7f8054009f90 comp rx=0 tx=0).stop 2023-11-18T21:00:18.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.536+0000 7f806534c640 1 -- 172.21.15.49:0/1610106396 reap_dead start 2023-11-18T21:00:18.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.536+0000 7f8066daf640 1 -- 172.21.15.49:0/1610106396 shutdown_connections 2023-11-18T21:00:18.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.536+0000 7f8066daf640 1 -- 172.21.15.49:0/1610106396 >> 172.21.15.49:0/1610106396 conn(0x7f80600c73c0 msgr2=0x7f806014bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.536+0000 7f8066daf640 1 -- 172.21.15.49:0/1610106396 shutdown_connections 2023-11-18T21:00:18.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.536+0000 7f8066daf640 1 -- 172.21.15.49:0/1610106396 wait complete. 2023-11-18T21:00:18.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.536+0000 7f9364936640 1 -- 172.21.15.49:0/472956120 --> [v2:172.21.15.49:6816/3310490448,v1:172.21.15.49:6817/3310490448] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f936015d7b0 con 0x7f934006fa00 2023-11-18T21:00:18.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.536+0000 7f934effd640 1 -- 172.21.15.49:0/472956120 <== osd.2 v2:172.21.15.49:6816/3310490448 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f936015d7b0 con 0x7f934006fa00 2023-11-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.540+0000 7f9364936640 1 -- 172.21.15.49:0/472956120 >> [v2:172.21.15.49:6816/3310490448,v1:172.21.15.49:6817/3310490448] conn(0x7f934006fa00 msgr2=0x7f9340071e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.540+0000 7f9364936640 1 --2- 172.21.15.49:0/472956120 >> [v2:172.21.15.49:6816/3310490448,v1:172.21.15.49:6817/3310490448] conn(0x7f934006fa00 0x7f9340071e40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.540+0000 7f9364936640 1 -- 172.21.15.49:0/472956120 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f93400664c0 msgr2=0x7f9340068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.540+0000 7f9364936640 1 --2- 172.21.15.49:0/472956120 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f93400664c0 0x7f9340068980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f93580ae000 tx=0x7f9358004ac0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.540+0000 7f9364936640 1 -- 172.21.15.49:0/472956120 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93600c2f70 msgr2=0x7f93600c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.540+0000 7f9364936640 1 --2- 172.21.15.49:0/472956120 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93600c2f70 0x7f93600c86c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f935400c440 tx=0x7f935400c900 comp rx=0 tx=0).stop 2023-11-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.540+0000 7f935ed9d640 1 -- 172.21.15.49:0/472956120 reap_dead start 2023-11-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.540+0000 7f9364936640 1 -- 172.21.15.49:0/472956120 shutdown_connections 2023-11-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.540+0000 7f9364936640 1 -- 172.21.15.49:0/472956120 >> 172.21.15.49:0/472956120 conn(0x7f93600c73c0 msgr2=0x7f93601686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.548+0000 7f9364936640 1 -- 172.21.15.49:0/472956120 shutdown_connections 2023-11-18T21:00:18.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.548+0000 7f9364936640 1 -- 172.21.15.49:0/472956120 wait complete. 2023-11-18T21:00:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.548+0000 7f6eceffd640 1 -- 172.21.15.49:0/223015688 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ed401e460 con 0x7f6ed806e330 2023-11-18T21:00:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.548+0000 7f6eceffd640 1 --2- 172.21.15.49:0/223015688 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6ebc066470 0x7f6ebc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.548+0000 7f6eddc2f640 1 --2- 172.21.15.49:0/223015688 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6ebc066470 0x7f6ebc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.552+0000 7f6eddc2f640 1 --2- 172.21.15.49:0/223015688 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6ebc066470 0x7f6ebc068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80b5000 tx=0x7f6ec8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.560+0000 7f6eceffd640 1 -- 172.21.15.49:0/223015688 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ed4056730 con 0x7f6ed806e330 2023-11-18T21:00:18.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.560+0000 7f6eceffd640 1 --2- 172.21.15.49:0/223015688 >> [v2:172.21.15.49:6808/2801920874,v1:172.21.15.49:6809/2801920874] conn(0x7f6ebc06f9b0 0x7f6ebc071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.560+0000 7f6eceffd640 1 -- 172.21.15.49:0/223015688 --> [v2:172.21.15.49:6808/2801920874,v1:172.21.15.49:6809/2801920874] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ebc0724c0 con 0x7f6ebc06f9b0 2023-11-18T21:00:18.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.560+0000 7f6eceffd640 1 -- 172.21.15.49:0/223015688 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ed4052370 con 0x7f6ed806e330 2023-11-18T21:00:18.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.560+0000 7f6edec31640 1 --2- 172.21.15.49:0/223015688 >> [v2:172.21.15.49:6808/2801920874,v1:172.21.15.49:6809/2801920874] conn(0x7f6ebc06f9b0 0x7f6ebc071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.560+0000 7f6edec31640 1 --2- 172.21.15.49:0/223015688 >> [v2:172.21.15.49:6808/2801920874,v1:172.21.15.49:6809/2801920874] conn(0x7f6ebc06f9b0 0x7f6ebc071df0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.564+0000 7f6eceffd640 1 -- 172.21.15.49:0/223015688 <== osd.1 v2:172.21.15.49:6808/2801920874 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6ebc0724c0 con 0x7f6ebc06f9b0 2023-11-18T21:00:18.566 INFO:teuthology.orchestra.run.smithi049.stdout:64424509463 2023-11-18T21:00:18.567 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-18T21:00:18.577 INFO:teuthology.orchestra.run.smithi049.stdout:64424509464 2023-11-18T21:00:18.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-18T21:00:18.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.592+0000 7f6ee0694640 1 -- 172.21.15.49:0/223015688 --> [v2:172.21.15.49:6808/2801920874,v1:172.21.15.49:6809/2801920874] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ed80c4200 con 0x7f6ebc06f9b0 2023-11-18T21:00:18.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.592+0000 7f6eceffd640 1 -- 172.21.15.49:0/223015688 <== osd.1 v2:172.21.15.49:6808/2801920874 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6ed0006b20 con 0x7f6ebc06f9b0 2023-11-18T21:00:18.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.596+0000 7f6ee0694640 1 -- 172.21.15.49:0/223015688 >> [v2:172.21.15.49:6808/2801920874,v1:172.21.15.49:6809/2801920874] conn(0x7f6ebc06f9b0 msgr2=0x7f6ebc071df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.596+0000 7f6ee0694640 1 --2- 172.21.15.49:0/223015688 >> [v2:172.21.15.49:6808/2801920874,v1:172.21.15.49:6809/2801920874] conn(0x7f6ebc06f9b0 0x7f6ebc071df0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.596+0000 7f6ee0694640 1 -- 172.21.15.49:0/223015688 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6ebc066470 msgr2=0x7f6ebc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.596+0000 7f6ee0694640 1 --2- 172.21.15.49:0/223015688 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f6ebc066470 0x7f6ebc068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80b5000 tx=0x7f6ec8008040 comp rx=0 tx=0).stop 2023-11-18T21:00:18.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.596+0000 7f6ee0694640 1 -- 172.21.15.49:0/223015688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed806e330 msgr2=0x7f6ed80c5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.596+0000 7f6ee0694640 1 --2- 172.21.15.49:0/223015688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ed806e330 0x7f6ed80c5a50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400d860 tx=0x7f6ed400dd20 comp rx=0 tx=0).stop 2023-11-18T21:00:18.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.596+0000 7f6edec31640 1 -- 172.21.15.49:0/223015688 reap_dead start 2023-11-18T21:00:18.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.596+0000 7f6ee0694640 1 -- 172.21.15.49:0/223015688 shutdown_connections 2023-11-18T21:00:18.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.596+0000 7f6ee0694640 1 -- 172.21.15.49:0/223015688 >> 172.21.15.49:0/223015688 conn(0x7f6ed80c73c0 msgr2=0x7f6ed8071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.596+0000 7f6ee0694640 1 -- 172.21.15.49:0/223015688 shutdown_connections 2023-11-18T21:00:18.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.596+0000 7f6ee0694640 1 -- 172.21.15.49:0/223015688 wait complete. 2023-11-18T21:00:18.630 INFO:teuthology.orchestra.run.smithi049.stdout:64424509463 2023-11-18T21:00:18.630 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-18T21:00:18.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.668+0000 7fd6d1977640 1 Processor -- start 2023-11-18T21:00:18.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.668+0000 7fd6d1977640 1 -- start start 2023-11-18T21:00:18.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.668+0000 7fd6d1977640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6cc0717c0 0x7fd6cc160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.668+0000 7fd6d1977640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6cc072590 con 0x7fd6cc152b80 2023-11-18T21:00:18.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.668+0000 7fd6d1977640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6cc0c68f0 con 0x7fd6cc0c1e60 2023-11-18T21:00:18.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.668+0000 7fd6d1977640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc1591e0 con 0x7fd6cc0717c0 2023-11-18T21:00:18.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.672+0000 7fd6caffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd6cc152b80 0x7fd6cc158ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34136/0 (socket says 172.21.15.49:34136) 2023-11-18T21:00:18.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.672+0000 7fd6caffd640 1 -- 172.21.15.49:0/3225235437 learned_addr learned my addr 172.21.15.49:0/3225235437 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:18.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.672+0000 7fd6cb7fe640 1 --2- 172.21.15.49:0/3225235437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6cc0717c0 0x7fd6cc160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.676+0000 7fd6c9ffb640 1 -- 172.21.15.49:0/3225235437 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586803626 0 0) 0x7fd6cc072590 con 0x7fd6cc152b80 2023-11-18T21:00:18.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.676+0000 7fd6c9ffb640 1 -- 172.21.15.49:0/3225235437 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6b4004640 con 0x7fd6cc152b80 2023-11-18T21:00:18.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.680+0000 7f7923fff640 1 Processor -- start 2023-11-18T21:00:18.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.680+0000 7f7923fff640 1 -- start start 2023-11-18T21:00:18.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.680+0000 7f7923fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f79241633b0 0x7f7924070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.680+0000 7f7923fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f79240c6b00 0x7f79240c7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.680+0000 7f7923fff640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79240c2420 con 0x7f7924163790 2023-11-18T21:00:18.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.680+0000 7f7923fff640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7924165f60 con 0x7f79240c6b00 2023-11-18T21:00:18.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.680+0000 7f7923fff640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7924169f80 con 0x7f79241633b0 2023-11-18T21:00:18.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.684+0000 7f79237fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f79240c6b00 0x7f79240c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.684+0000 7f79237fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f79240c6b00 0x7f79240c7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38258/0 (socket says 172.21.15.49:38258) 2023-11-18T21:00:18.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.684+0000 7f79237fe640 1 -- 172.21.15.49:0/1253885486 learned_addr learned my addr 172.21.15.49:0/1253885486 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.684+0000 7f7922ffd640 1 --2- 172.21.15.49:0/1253885486 >> v2:172.21.15.106:3300/0 conn(0x7f79241633b0 0x7f7924070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.688+0000 7f79237fe640 1 -- 172.21.15.49:0/1253885486 >> v2:172.21.15.106:3300/0 conn(0x7f79241633b0 msgr2=0x7f7924070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.688+0000 7f79237fe640 1 --2- 172.21.15.49:0/1253885486 >> v2:172.21.15.106:3300/0 conn(0x7f79241633b0 0x7f7924070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.688+0000 7f79237fe640 1 -- 172.21.15.49:0/1253885486 >> v1:172.21.15.106:6789/0 conn(0x7f7924163790 legacy=0x7f79241694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.688+0000 7f79237fe640 1 -- 172.21.15.49:0/1253885486 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792416a260 con 0x7f79240c6b00 2023-11-18T21:00:18.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.688+0000 7fd6cb7fe640 1 -- 172.21.15.49:0/3225235437 >> v1:172.21.15.106:6789/0 conn(0x7fd6cc0c1e60 legacy=0x7fd6cc0c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.688+0000 7fd6cb7fe640 1 -- 172.21.15.49:0/3225235437 >> v1:172.21.15.49:6789/0 conn(0x7fd6cc152b80 legacy=0x7fd6cc158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.688+0000 7fd6cb7fe640 1 -- 172.21.15.49:0/3225235437 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc0c6570 con 0x7fd6cc0717c0 2023-11-18T21:00:18.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.692+0000 7f1a89975640 1 Processor -- start 2023-11-18T21:00:18.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.692+0000 7f1a89975640 1 -- start start 2023-11-18T21:00:18.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.696+0000 7fd6cb7fe640 1 --2- 172.21.15.49:0/3225235437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6cc0717c0 0x7fd6cc160e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0097f0 tx=0x7fd6bc01e640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=693db368fea64b8c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.696+0000 7f1a89975640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a84152bf0 0x7f1a84155540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.696+0000 7f1a89975640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1a840c1ed0 0x7f1a840c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.696+0000 7f1a89975640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1a84155a80 0x7f1a840c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.696+0000 7f1a89975640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a840c6580 con 0x7f1a840c1ed0 2023-11-18T21:00:18.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.696+0000 7f1a89975640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a84152fd0 con 0x7f1a84155a80 2023-11-18T21:00:18.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.696+0000 7f1a89975640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a84072a00 con 0x7f1a84152bf0 2023-11-18T21:00:18.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.696+0000 7fa0173f3640 1 Processor -- start 2023-11-18T21:00:18.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.696+0000 7fa0173f3640 1 -- start start 2023-11-18T21:00:18.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.696+0000 7fa0173f3640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa01015a130 0x7fa010161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.696+0000 7fa0173f3640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa010159590 con 0x7fa0100726d0 2023-11-18T21:00:18.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.696+0000 7fa0173f3640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa010156190 con 0x7fa0100722f0 2023-11-18T21:00:18.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.696+0000 7fa0173f3640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa010155fa0 con 0x7fa01015a130 2023-11-18T21:00:18.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.696+0000 7f1a82ffd640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a84152bf0 0x7f1a84155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.700+0000 7ff6bb264640 1 Processor -- start 2023-11-18T21:00:18.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.700+0000 7f1a837fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1a84155a80 0x7f1a840c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.700+0000 7ff6bb264640 1 -- start start 2023-11-18T21:00:18.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.700+0000 7fa01518f640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa0100722f0 0x7fa0100c66d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:38750/0 (socket says 172.21.15.49:38750) 2023-11-18T21:00:18.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.700+0000 7fa01518f640 1 -- 172.21.15.49:0/2885925552 learned_addr learned my addr 172.21.15.49:0/2885925552 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:18.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.700+0000 7ff6bb264640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6ac0d9a20 0x7ff6ac04e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.700+0000 7ff6bb264640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6ac0381f0 0x7ff6ac04d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.700+0000 7ff6bb264640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ac0e34f0 con 0x7ff6ac0e3060 2023-11-18T21:00:18.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.700+0000 7ff6bb264640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ac035150 con 0x7ff6ac0381f0 2023-11-18T21:00:18.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.700+0000 7ff6bb264640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0e4030 con 0x7ff6ac0d9a20 2023-11-18T21:00:18.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.700+0000 7f1a837fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1a84155a80 0x7f1a840c7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:35994/0 (socket says 172.21.15.49:35994) 2023-11-18T21:00:18.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.700+0000 7f1a837fe640 1 -- 172.21.15.49:0/1556529060 learned_addr learned my addr 172.21.15.49:0/1556529060 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.700+0000 7f79237fe640 1 --2- 172.21.15.49:0/1253885486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79240c6b00 0x7f79240c7120 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f79240c7fa0 tx=0x7f7918020f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b536a61858cd53a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.707 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.708+0000 7ff6b9000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6ac0d9a20 0x7ff6ac04e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.708+0000 7f1a837fe640 1 -- 172.21.15.49:0/1556529060 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a84152bf0 msgr2=0x7f1a84155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.708+0000 7f1a837fe640 1 --2- 172.21.15.49:0/1556529060 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a84152bf0 0x7f1a84155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.708+0000 7f1a837fe640 1 -- 172.21.15.49:0/1556529060 >> v2:172.21.15.49:3300/0 conn(0x7f1a840c1ed0 msgr2=0x7f1a840c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.708+0000 7f1a837fe640 1 --2- 172.21.15.49:0/1556529060 >> v2:172.21.15.49:3300/0 conn(0x7f1a840c1ed0 0x7f1a840c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.708+0000 7f1a837fe640 1 -- 172.21.15.49:0/1556529060 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840c5fc0 con 0x7f1a84155a80 2023-11-18T21:00:18.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.708+0000 7ff6b9000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6ac0d9a20 0x7ff6ac04e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:46878/0 (socket says 172.21.15.49:46878) 2023-11-18T21:00:18.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.708+0000 7ff6b9000640 1 -- 172.21.15.49:0/2227707279 learned_addr learned my addr 172.21.15.49:0/2227707279 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.716+0000 7f1a837fe640 1 --2- 172.21.15.49:0/1556529060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a84155a80 0x7f1a840c7f50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a840c8880 tx=0x7f1a7c01cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34815d756038dd9f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.724+0000 7fd6c9ffb640 1 -- 172.21.15.49:0/3225235437 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0ab400 con 0x7fd6cc0717c0 2023-11-18T21:00:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.724+0000 7fd6c9ffb640 1 -- 172.21.15.49:0/3225235437 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc0ab560 con 0x7fd6cc0717c0 2023-11-18T21:00:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.724+0000 7fd6c9ffb640 1 -- 172.21.15.49:0/3225235437 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0ab8f0 con 0x7fd6cc0717c0 2023-11-18T21:00:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.724+0000 7fd6d1977640 1 -- 172.21.15.49:0/3225235437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6cc0717c0 msgr2=0x7fd6cc160e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.724+0000 7fd6d1977640 1 --2- 172.21.15.49:0/3225235437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6cc0717c0 0x7fd6cc160e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0097f0 tx=0x7fd6bc01e640 comp rx=0 tx=0).stop 2023-11-18T21:00:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.724+0000 7fd6d1977640 1 -- 172.21.15.49:0/3225235437 shutdown_connections 2023-11-18T21:00:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.724+0000 7fd6d1977640 1 --2- 172.21.15.49:0/3225235437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6cc0717c0 0x7fd6cc160e10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.724+0000 7fd6d1977640 1 -- 172.21.15.49:0/3225235437 >> 172.21.15.49:0/3225235437 conn(0x7fd6cc06a560 msgr2=0x7fd6cc06a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.724+0000 7fd6d1977640 1 -- 172.21.15.49:0/3225235437 shutdown_connections 2023-11-18T21:00:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.724+0000 7fd6d1977640 1 -- 172.21.15.49:0/3225235437 wait complete. 2023-11-18T21:00:18.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.724+0000 7fd6d1977640 1 Processor -- start 2023-11-18T21:00:18.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.724+0000 7fd6d1977640 1 -- start start 2023-11-18T21:00:18.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.728+0000 7fd6d1977640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6cc0717c0 0x7fd6cc150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.728+0000 7fd6d1977640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6cc0c1e60 0x7fd6cc151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.728+0000 7fd6d1977640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6cc152b80 0x7fd6cc0c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.728+0000 7fd6d1977640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc141170 con 0x7fd6cc0c1e60 2023-11-18T21:00:18.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.728+0000 7fd6d1977640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc1eeb30 con 0x7fd6cc152b80 2023-11-18T21:00:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.728+0000 7fd6d1977640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc1ef060 con 0x7fd6cc0717c0 2023-11-18T21:00:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.728+0000 7ff6b9000640 1 -- 172.21.15.49:0/2227707279 >> v2:172.21.15.49:3300/0 conn(0x7ff6ac0381f0 msgr2=0x7ff6ac04d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.728+0000 7ff6b9000640 1 --2- 172.21.15.49:0/2227707279 >> v2:172.21.15.49:3300/0 conn(0x7ff6ac0381f0 0x7ff6ac04d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.728+0000 7ff6b9000640 1 -- 172.21.15.49:0/2227707279 >> v1:172.21.15.106:6789/0 conn(0x7ff6ac0e3060 legacy=0x7ff6ac04ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.728+0000 7ff6b9000640 1 -- 172.21.15.49:0/2227707279 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac0e3790 con 0x7ff6ac0d9a20 2023-11-18T21:00:18.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7fd6cb7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6cc152b80 0x7fd6cc0c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7f1a827fc640 1 -- 172.21.15.49:0/1556529060 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0a5cd0 con 0x7f1a84155a80 2023-11-18T21:00:18.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7f1a827fc640 1 -- 172.21.15.49:0/1556529060 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c0a5e30 con 0x7f1a84155a80 2023-11-18T21:00:18.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7f1a827fc640 1 -- 172.21.15.49:0/1556529060 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0092f0 con 0x7f1a84155a80 2023-11-18T21:00:18.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7fd6cb7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6cc152b80 0x7fd6cc0c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:35998/0 (socket says 172.21.15.49:35998) 2023-11-18T21:00:18.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7fd6cb7fe640 1 -- 172.21.15.49:0/467217816 learned_addr learned my addr 172.21.15.49:0/467217816 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7f1a89975640 1 -- 172.21.15.49:0/1556529060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a84155a80 msgr2=0x7f1a840c7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7f1a89975640 1 --2- 172.21.15.49:0/1556529060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a84155a80 0x7f1a840c7f50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a840c8880 tx=0x7f1a7c01cc40 comp rx=0 tx=0).stop 2023-11-18T21:00:18.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7f1a89975640 1 -- 172.21.15.49:0/1556529060 shutdown_connections 2023-11-18T21:00:18.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7f1a89975640 1 --2- 172.21.15.49:0/1556529060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a84155a80 0x7f1a840c7f50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7f1a89975640 1 --2- 172.21.15.49:0/1556529060 >> v2:172.21.15.49:3300/0 conn(0x7f1a840c1ed0 0x7f1a840c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7f1a89975640 1 --2- 172.21.15.49:0/1556529060 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a84152bf0 0x7f1a84155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7f1a89975640 1 -- 172.21.15.49:0/1556529060 >> 172.21.15.49:0/1556529060 conn(0x7f1a8406c6a0 msgr2=0x7f1a8406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7f1a89975640 1 -- 172.21.15.49:0/1556529060 shutdown_connections 2023-11-18T21:00:18.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.732+0000 7f1a89975640 1 -- 172.21.15.49:0/1556529060 wait complete. 2023-11-18T21:00:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.736+0000 7f1a89975640 1 Processor -- start 2023-11-18T21:00:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.736+0000 7f1a89975640 1 -- start start 2023-11-18T21:00:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.736+0000 7f1a89975640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a840c1ed0 0x7f1a8414acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.736+0000 7f1a89975640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a84152bf0 0x7f1a84144200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.736+0000 7f1a89975640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a84155a80 0x7f1a84154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.736+0000 7f1a89975640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a841f6640 con 0x7f1a840c1ed0 2023-11-18T21:00:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.736+0000 7f1a89975640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a841f5a00 con 0x7f1a84152bf0 2023-11-18T21:00:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.736+0000 7f1a89975640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a841f5ca0 con 0x7f1a84155a80 2023-11-18T21:00:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.736+0000 7ff6b9000640 1 --2- 172.21.15.49:0/2227707279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6ac0d9a20 0x7ff6ac04e370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009870 tx=0x7ff6a801ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b6407fddb0209a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.744+0000 7fd6caffd640 1 --2- 172.21.15.49:0/467217816 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6cc0717c0 0x7fd6cc150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.744+0000 7f691f40f640 1 Processor -- start 2023-11-18T21:00:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.744+0000 7fd6cb7fe640 1 -- 172.21.15.49:0/467217816 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6cc0717c0 msgr2=0x7fd6cc150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.744+0000 7fd6cb7fe640 1 --2- 172.21.15.49:0/467217816 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6cc0717c0 0x7fd6cc150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.744+0000 7fd6cb7fe640 1 -- 172.21.15.49:0/467217816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6cc0c1e60 msgr2=0x7fd6cc151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.744+0000 7fd6cb7fe640 1 --2- 172.21.15.49:0/467217816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6cc0c1e60 0x7fd6cc151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.744+0000 7fd6cb7fe640 1 -- 172.21.15.49:0/467217816 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc009420 con 0x7fd6cc152b80 2023-11-18T21:00:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.744+0000 7f691f40f640 1 -- start start 2023-11-18T21:00:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.744+0000 7f691f40f640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69180c3260 0x7f69180c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.748+0000 7f691f40f640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6918156f60 con 0x7f69180c4ce0 2023-11-18T21:00:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.748+0000 7f691f40f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6918150750 con 0x7f6918159870 2023-11-18T21:00:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.748+0000 7f691f40f640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691806bd30 con 0x7f69180c3260 2023-11-18T21:00:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.748+0000 7ff0da867640 1 Processor -- start 2023-11-18T21:00:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.748+0000 7ff0da867640 1 -- start start 2023-11-18T21:00:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.748+0000 7ff0da867640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff0d41533e0 0x7ff0d40cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.748+0000 7ff0da867640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff0d415d300 0x7ff0d40cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.748+0000 7ff0da867640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d415a300 con 0x7ff0d4072780 2023-11-18T21:00:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.748+0000 7ff0da867640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d41537c0 con 0x7ff0d41533e0 2023-11-18T21:00:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.748+0000 7ff0da867640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d4159430 con 0x7ff0d415d300 2023-11-18T21:00:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.748+0000 7f1a837fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a84155a80 0x7f1a84154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7ff6b37fe640 1 -- 172.21.15.49:0/2227707279 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80a89b0 con 0x7ff6ac0d9a20 2023-11-18T21:00:18.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7ff6b37fe640 1 -- 172.21.15.49:0/2227707279 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a80a8b10 con 0x7ff6ac0d9a20 2023-11-18T21:00:18.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7ff6b37fe640 1 -- 172.21.15.49:0/2227707279 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80a8ea0 con 0x7ff6ac0d9a20 2023-11-18T21:00:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7f1a837fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a84155a80 0x7f1a84154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:46902/0 (socket says 172.21.15.49:46902) 2023-11-18T21:00:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7f1a837fe640 1 -- 172.21.15.49:0/2906834454 learned_addr learned my addr 172.21.15.49:0/2906834454 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7ff6bb264640 1 -- 172.21.15.49:0/2227707279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6ac0d9a20 msgr2=0x7ff6ac04e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7ff6bb264640 1 --2- 172.21.15.49:0/2227707279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6ac0d9a20 0x7ff6ac04e370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009870 tx=0x7ff6a801ecf0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7ff6bb264640 1 -- 172.21.15.49:0/2227707279 shutdown_connections 2023-11-18T21:00:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7ff6bb264640 1 --2- 172.21.15.49:0/2227707279 >> v2:172.21.15.49:3300/0 conn(0x7ff6ac0381f0 0x7ff6ac04d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7ff6bb264640 1 --2- 172.21.15.49:0/2227707279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6ac0d9a20 0x7ff6ac04e370 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7ff6bb264640 1 -- 172.21.15.49:0/2227707279 >> 172.21.15.49:0/2227707279 conn(0x7ff6ac00e0a0 msgr2=0x7ff6ac00e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7ff6bb264640 1 -- 172.21.15.49:0/2227707279 shutdown_connections 2023-11-18T21:00:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7ff6bb264640 1 -- 172.21.15.49:0/2227707279 wait complete. 2023-11-18T21:00:18.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7ff6bb264640 1 Processor -- start 2023-11-18T21:00:18.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.752+0000 7ff6bb264640 1 -- start start 2023-11-18T21:00:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.756+0000 7ff6bb264640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6ac0381f0 0x7ff6ac1792f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.756+0000 7ff6bb264640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6ac0d9a20 0x7ff6ac179830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.756+0000 7ff6bb264640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ac0e4220 0x7ff6ac00a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.756+0000 7ff6bb264640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac009400 con 0x7ff6ac0e4220 2023-11-18T21:00:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.756+0000 7ff6bb264640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0088a0 con 0x7ff6ac0d9a20 2023-11-18T21:00:18.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.756+0000 7ff6bb264640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac008b60 con 0x7ff6ac0381f0 2023-11-18T21:00:18.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.760+0000 7f1a7bfff640 1 --2- 172.21.15.49:0/2906834454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a84152bf0 0x7f1a84144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.764+0000 7fd6cb7fe640 1 --2- 172.21.15.49:0/467217816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6cc152b80 0x7fd6cc0c9100 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc01c270 tx=0x7fd6bc01ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.764+0000 7f1a837fe640 1 -- 172.21.15.49:0/2906834454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a84152bf0 msgr2=0x7f1a84144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.764+0000 7f1a837fe640 1 --2- 172.21.15.49:0/2906834454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a84152bf0 0x7f1a84144200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.764+0000 7f1a837fe640 1 -- 172.21.15.49:0/2906834454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a840c1ed0 msgr2=0x7f1a8414acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.764+0000 7f1a837fe640 1 --2- 172.21.15.49:0/2906834454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a840c1ed0 0x7f1a8414acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.764+0000 7f1a837fe640 1 -- 172.21.15.49:0/2906834454 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c0072a0 con 0x7f1a84155a80 2023-11-18T21:00:18.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.776+0000 7f1a837fe640 1 --2- 172.21.15.49:0/2906834454 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a84155a80 0x7f1a84154670 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c01d4e0 tx=0x7f1a7c0199e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.780+0000 7f691c9aa640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69180c3260 0x7f69180c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.784+0000 7fa015990640 1 --2- 172.21.15.49:0/2885925552 >> v2:172.21.15.49:3300/0 conn(0x7fa01015a130 0x7fa010161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.784+0000 7f691c9aa640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69180c3260 0x7f69180c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:46914/0 (socket says 172.21.15.49:46914) 2023-11-18T21:00:18.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.784+0000 7f691c9aa640 1 -- 172.21.15.49:0/4224433195 learned_addr learned my addr 172.21.15.49:0/4224433195 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.784+0000 7ff6b9000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6ac0381f0 0x7ff6ac1792f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.788+0000 7fb676449640 1 Processor -- start 2023-11-18T21:00:18.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.788+0000 7fb676449640 1 -- start start 2023-11-18T21:00:18.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.792+0000 7ff6b9000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6ac0381f0 0x7ff6ac1792f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:46926/0 (socket says 172.21.15.49:46926) 2023-11-18T21:00:18.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.792+0000 7ff6b9000640 1 -- 172.21.15.49:0/2571630545 learned_addr learned my addr 172.21.15.49:0/2571630545 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.792+0000 7fb676449640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb67014ff30 0x7fb67015a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.792+0000 7fb676449640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb67015d1f0 0x7fb67015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.792+0000 7fb676449640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67006b4c0 con 0x7fb6700cb290 2023-11-18T21:00:18.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.792+0000 7fb676449640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67015cd60 con 0x7fb67014ff30 2023-11-18T21:00:18.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.792+0000 7fb676449640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67006bcd0 con 0x7fb67015d1f0 2023-11-18T21:00:18.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.792+0000 7fa015990640 1 -- 172.21.15.49:0/2885925552 >> v1:172.21.15.106:6789/0 conn(0x7fa0100722f0 legacy=0x7fa0100c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.792+0000 7fa015990640 1 -- 172.21.15.49:0/2885925552 >> v1:172.21.15.49:6789/0 conn(0x7fa0100726d0 legacy=0x7fa010159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.792+0000 7fa015990640 1 -- 172.21.15.49:0/2885925552 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa010156470 con 0x7fa01015a130 2023-11-18T21:00:18.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.796+0000 7ff0d3fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff0d41533e0 0x7ff0d40cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.796+0000 7fa015990640 1 --2- 172.21.15.49:0/2885925552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa01015a130 0x7fa010161930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa008009d90 tx=0x7fa00801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf9e0904829b89 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7921ffb640 1 -- 172.21.15.49:0/1253885486 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79180aab60 con 0x7f79240c6b00 2023-11-18T21:00:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7921ffb640 1 -- 172.21.15.49:0/1253885486 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79180aacc0 con 0x7f79240c6b00 2023-11-18T21:00:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7921ffb640 1 -- 172.21.15.49:0/1253885486 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79180b2610 con 0x7f79240c6b00 2023-11-18T21:00:18.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7ff0d3fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff0d41533e0 0x7ff0d40cc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38296/0 (socket says 172.21.15.49:38296) 2023-11-18T21:00:18.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7ff0d3fff640 1 -- 172.21.15.49:0/2558619067 learned_addr learned my addr 172.21.15.49:0/2558619067 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 -- 172.21.15.49:0/1253885486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79240c6b00 msgr2=0x7f79240c7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 --2- 172.21.15.49:0/1253885486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79240c6b00 0x7f79240c7120 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f79240c7fa0 tx=0x7f7918020f50 comp rx=0 tx=0).stop 2023-11-18T21:00:18.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 -- 172.21.15.49:0/1253885486 shutdown_connections 2023-11-18T21:00:18.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 --2- 172.21.15.49:0/1253885486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79240c6b00 0x7f79240c7120 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 --2- 172.21.15.49:0/1253885486 >> v2:172.21.15.106:3300/0 conn(0x7f79241633b0 0x7f7924070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 -- 172.21.15.49:0/1253885486 >> 172.21.15.49:0/1253885486 conn(0x7f792406a560 msgr2=0x7f792406a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 -- 172.21.15.49:0/1253885486 shutdown_connections 2023-11-18T21:00:18.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 -- 172.21.15.49:0/1253885486 wait complete. 2023-11-18T21:00:18.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 Processor -- start 2023-11-18T21:00:18.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 -- start start 2023-11-18T21:00:18.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79240c6b00 0x7f79241f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79241633b0 0x7f7924200e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7924163790 0x7f7924161f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79242004a0 con 0x7f79241633b0 2023-11-18T21:00:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7924200990 con 0x7f79240c6b00 2023-11-18T21:00:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.800+0000 7f7923fff640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7924162490 con 0x7f7924163790 2023-11-18T21:00:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.804+0000 7ff0d3fff640 1 -- 172.21.15.49:0/2558619067 >> v2:172.21.15.106:3300/0 conn(0x7ff0d415d300 msgr2=0x7ff0d40cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.804+0000 7ff0d3fff640 1 --2- 172.21.15.49:0/2558619067 >> v2:172.21.15.106:3300/0 conn(0x7ff0d415d300 0x7ff0d40cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.804+0000 7ff0d3fff640 1 -- 172.21.15.49:0/2558619067 >> v1:172.21.15.49:6789/0 conn(0x7ff0d4072780 legacy=0x7ff0d415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.804+0000 7ff0d3fff640 1 -- 172.21.15.49:0/2558619067 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d41596f0 con 0x7ff0d41533e0 2023-11-18T21:00:18.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.808+0000 7fb66ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb67014ff30 0x7fb67015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.808+0000 7ff0d3fff640 1 --2- 172.21.15.49:0/2558619067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0d41533e0 0x7ff0d40cc000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff0d406f140 tx=0x7ff0c401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b5010607dbc65b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.808+0000 7fb66ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb67014ff30 0x7fb67015a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38316/0 (socket says 172.21.15.49:38316) 2023-11-18T21:00:18.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.808+0000 7fb66ffff640 1 -- 172.21.15.49:0/420987743 learned_addr learned my addr 172.21.15.49:0/420987743 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.808+0000 7ff6b9801640 1 --2- 172.21.15.49:0/2571630545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ac0e4220 0x7ff6ac00a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.812+0000 7fb66ffff640 1 -- 172.21.15.49:0/420987743 >> v2:172.21.15.106:3300/0 conn(0x7fb67015d1f0 msgr2=0x7fb67015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.812+0000 7fb66ffff640 1 --2- 172.21.15.49:0/420987743 >> v2:172.21.15.106:3300/0 conn(0x7fb67015d1f0 0x7fb67015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.812+0000 7fb66ffff640 1 -- 172.21.15.49:0/420987743 >> v1:172.21.15.106:6789/0 conn(0x7fb6700cb290 legacy=0x7fb6700c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.812+0000 7fb66ffff640 1 -- 172.21.15.49:0/420987743 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67006ab30 con 0x7fb67014ff30 2023-11-18T21:00:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.820+0000 7ff6b9801640 1 -- 172.21.15.49:0/2571630545 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6ac0381f0 msgr2=0x7ff6ac1792f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.820+0000 7ff6b9801640 1 --2- 172.21.15.49:0/2571630545 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6ac0381f0 0x7ff6ac1792f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.820+0000 7ff6b9801640 1 -- 172.21.15.49:0/2571630545 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6ac0d9a20 msgr2=0x7ff6ac179830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.820+0000 7ff6b9801640 1 --2- 172.21.15.49:0/2571630545 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6ac0d9a20 0x7ff6ac179830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.820+0000 7ff6b9801640 1 -- 172.21.15.49:0/2571630545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a80094d0 con 0x7ff6ac0e4220 2023-11-18T21:00:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.820+0000 7ff6b9801640 1 --2- 172.21.15.49:0/2571630545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ac0e4220 0x7ff6ac00a040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4063f10 tx=0x7ff6b4068000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.824+0000 7fb66ffff640 1 --2- 172.21.15.49:0/420987743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67014ff30 0x7fb67015a050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb67006a660 tx=0x7fb66001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899efda823c4a345 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.828+0000 7f79227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79241633b0 0x7f7924200e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.828+0000 7f79227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79241633b0 0x7f7924200e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38332/0 (socket says 172.21.15.49:38332) 2023-11-18T21:00:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.828+0000 7f79227fc640 1 -- 172.21.15.49:0/190380021 learned_addr learned my addr 172.21.15.49:0/190380021 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.832+0000 7f79227fc640 1 -- 172.21.15.49:0/190380021 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7924163790 msgr2=0x7f7924161f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.832+0000 7f79227fc640 1 --2- 172.21.15.49:0/190380021 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7924163790 0x7f7924161f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.832+0000 7f79227fc640 1 -- 172.21.15.49:0/190380021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79240c6b00 msgr2=0x7f79241f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.832+0000 7f79227fc640 1 --2- 172.21.15.49:0/190380021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79240c6b00 0x7f79241f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.832+0000 7f79227fc640 1 -- 172.21.15.49:0/190380021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791800d040 con 0x7f79241633b0 2023-11-18T21:00:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7fa007fff640 1 -- 172.21.15.49:0/2885925552 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080a5910 con 0x7fa01015a130 2023-11-18T21:00:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7fa007fff640 1 -- 172.21.15.49:0/2885925552 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0080a5a70 con 0x7fa01015a130 2023-11-18T21:00:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7fa007fff640 1 -- 172.21.15.49:0/2885925552 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080a5e00 con 0x7fa01015a130 2023-11-18T21:00:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7fa0173f3640 1 -- 172.21.15.49:0/2885925552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa01015a130 msgr2=0x7fa010161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7fa0173f3640 1 --2- 172.21.15.49:0/2885925552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa01015a130 0x7fa010161930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa008009d90 tx=0x7fa00801c850 comp rx=0 tx=0).stop 2023-11-18T21:00:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7fa0173f3640 1 -- 172.21.15.49:0/2885925552 shutdown_connections 2023-11-18T21:00:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7fa0173f3640 1 --2- 172.21.15.49:0/2885925552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa01015a130 0x7fa010161930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7fa0173f3640 1 -- 172.21.15.49:0/2885925552 >> 172.21.15.49:0/2885925552 conn(0x7fa01006b670 msgr2=0x7fa01006ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7fa0173f3640 1 -- 172.21.15.49:0/2885925552 shutdown_connections 2023-11-18T21:00:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7fa0173f3640 1 -- 172.21.15.49:0/2885925552 wait complete. 2023-11-18T21:00:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7ff0d37fe640 1 -- 172.21.15.49:0/2558619067 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c40ac410 con 0x7ff0d41533e0 2023-11-18T21:00:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7fa0173f3640 1 Processor -- start 2023-11-18T21:00:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7ff0d37fe640 1 -- 172.21.15.49:0/2558619067 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c40ac570 con 0x7ff0d41533e0 2023-11-18T21:00:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7f690bfff640 1 -- 172.21.15.49:0/4224433195 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995975316 0 0) 0x7f6918156f60 con 0x7f69180c4ce0 2023-11-18T21:00:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7f690bfff640 1 -- 172.21.15.49:0/4224433195 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6904003530 con 0x7f69180c4ce0 2023-11-18T21:00:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.836+0000 7fa0173f3640 1 -- start start 2023-11-18T21:00:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0d37fe640 1 -- 172.21.15.49:0/2558619067 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c40ac900 con 0x7ff0d41533e0 2023-11-18T21:00:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7fa0173f3640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0100722f0 0x7fa010141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7fa0173f3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0100726d0 0x7fa010155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7fa0173f3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa01015a130 0x7fa010145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7fa0173f3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0101efcc0 con 0x7fa01015a130 2023-11-18T21:00:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7fa0173f3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010155e20 con 0x7fa0100726d0 2023-11-18T21:00:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7fa0173f3640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0101f0aa0 con 0x7fa0100722f0 2023-11-18T21:00:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 -- 172.21.15.49:0/2558619067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0d41533e0 msgr2=0x7ff0d40cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 --2- 172.21.15.49:0/2558619067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0d41533e0 0x7ff0d40cc000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff0d406f140 tx=0x7ff0c401c4c0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 -- 172.21.15.49:0/2558619067 shutdown_connections 2023-11-18T21:00:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 --2- 172.21.15.49:0/2558619067 >> v2:172.21.15.106:3300/0 conn(0x7ff0d415d300 0x7ff0d40cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 --2- 172.21.15.49:0/2558619067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0d41533e0 0x7ff0d40cc000 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 -- 172.21.15.49:0/2558619067 >> 172.21.15.49:0/2558619067 conn(0x7ff0d406b670 msgr2=0x7ff0d406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 -- 172.21.15.49:0/2558619067 shutdown_connections 2023-11-18T21:00:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 -- 172.21.15.49:0/2558619067 wait complete. 2023-11-18T21:00:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 Processor -- start 2023-11-18T21:00:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 -- start start 2023-11-18T21:00:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff6b17fa640 1 -- 172.21.15.49:0/2571630545 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40935f0 con 0x7ff6ac0e4220 2023-11-18T21:00:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff6b17fa640 1 -- 172.21.15.49:0/2571630545 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b4093750 con 0x7ff6ac0e4220 2023-11-18T21:00:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff6bb264640 1 -- 172.21.15.49:0/2571630545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ac008e40 con 0x7ff6ac0e4220 2023-11-18T21:00:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff6b17fa640 1 -- 172.21.15.49:0/2571630545 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4093b80 con 0x7ff6ac0e4220 2023-11-18T21:00:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff6bb264640 1 -- 172.21.15.49:0/2571630545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac178dd0 con 0x7ff6ac0e4220 2023-11-18T21:00:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0d4072780 0x7ff0d4147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0d41533e0 0x7ff0d4146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff0d415d300 0x7ff0d415a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d41f61a0 con 0x7ff0d41533e0 2023-11-18T21:00:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4146900 con 0x7ff0d4072780 2023-11-18T21:00:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff0da867640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d41f5520 con 0x7ff0d415d300 2023-11-18T21:00:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.840+0000 7ff6bb264640 1 -- 172.21.15.49:0/2571630545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ac178fc0 con 0x7ff6ac0e4220 2023-11-18T21:00:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.844+0000 7f79227fc640 1 --2- 172.21.15.49:0/190380021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79241633b0 0x7f7924200e90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f791400c410 tx=0x7f791400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.880+0000 7fd6b3fff640 1 -- 172.21.15.49:0/467217816 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0b3800 con 0x7fd6cc152b80 2023-11-18T21:00:18.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.880+0000 7fd6b3fff640 1 -- 172.21.15.49:0/467217816 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc0b3960 con 0x7fd6cc152b80 2023-11-18T21:00:18.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.880+0000 7fd6b3fff640 1 -- 172.21.15.49:0/467217816 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0b3cf0 con 0x7fd6cc152b80 2023-11-18T21:00:18.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.880+0000 7fd6d1977640 1 -- 172.21.15.49:0/467217816 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc1507e0 con 0x7fd6cc152b80 2023-11-18T21:00:18.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.880+0000 7fd6d1977640 1 -- 172.21.15.49:0/467217816 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6cc0c8900 con 0x7fd6cc152b80 2023-11-18T21:00:18.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.880+0000 7fd6d1977640 1 -- 172.21.15.49:0/467217816 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6cc067520 con 0x7fd6cc152b80 2023-11-18T21:00:18.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.908+0000 7f691c9aa640 1 -- 172.21.15.49:0/4224433195 >> v1:172.21.15.106:6789/0 conn(0x7f6918159870 legacy=0x7f6918159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:18.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.908+0000 7f691c9aa640 1 -- 172.21.15.49:0/4224433195 >> v1:172.21.15.49:6789/0 conn(0x7f69180c4ce0 legacy=0x7f691806b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.908+0000 7f691c9aa640 1 -- 172.21.15.49:0/4224433195 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69180c3680 con 0x7f69180c3260 2023-11-18T21:00:18.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.916+0000 7fa01518f640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0100722f0 0x7fa010141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.916+0000 7f691c9aa640 1 --2- 172.21.15.49:0/4224433195 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69180c3260 0x7f69180c50c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f690c0098a0 tx=0x7f690c01ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae2dea65583a71b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.920+0000 7fa01518f640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0100722f0 0x7fa010141760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:46948/0 (socket says 172.21.15.49:46948) 2023-11-18T21:00:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.920+0000 7fa01518f640 1 -- 172.21.15.49:0/2610823187 learned_addr learned my addr 172.21.15.49:0/2610823187 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.924+0000 7f1a80ff9640 1 -- 172.21.15.49:0/2906834454 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c009ab0 con 0x7f1a84155a80 2023-11-18T21:00:18.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.924+0000 7f1a80ff9640 1 -- 172.21.15.49:0/2906834454 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c0b8440 con 0x7f1a84155a80 2023-11-18T21:00:18.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.924+0000 7f1a80ff9640 1 -- 172.21.15.49:0/2906834454 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0b87d0 con 0x7f1a84155a80 2023-11-18T21:00:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.924+0000 7ff0d8e04640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff0d415d300 0x7ff0d415a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.924+0000 7f1a89975640 1 -- 172.21.15.49:0/2906834454 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a841f5f80 con 0x7f1a84155a80 2023-11-18T21:00:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.924+0000 7f1a89975640 1 -- 172.21.15.49:0/2906834454 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8414b550 con 0x7f1a84155a80 2023-11-18T21:00:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.928+0000 7f1a89975640 1 -- 172.21.15.49:0/2906834454 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a840c9b90 con 0x7f1a84155a80 2023-11-18T21:00:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.928+0000 7ff0d8e04640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff0d415d300 0x7ff0d415a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:46958/0 (socket says 172.21.15.49:46958) 2023-11-18T21:00:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.928+0000 7ff0d8e04640 1 -- 172.21.15.49:0/4259919654 learned_addr learned my addr 172.21.15.49:0/4259919654 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:18.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.936+0000 7fa01518f640 1 -- 172.21.15.49:0/2610823187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0100726d0 msgr2=0x7fa010155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.936+0000 7fa01518f640 1 --2- 172.21.15.49:0/2610823187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0100726d0 0x7fa010155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.936+0000 7fa01518f640 1 -- 172.21.15.49:0/2610823187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa01015a130 msgr2=0x7fa010145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.936+0000 7fa01518f640 1 --2- 172.21.15.49:0/2610823187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa01015a130 0x7fa010145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.936+0000 7fa01518f640 1 -- 172.21.15.49:0/2610823187 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa008009a70 con 0x7fa0100722f0 2023-11-18T21:00:18.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.960+0000 7fa01518f640 1 --2- 172.21.15.49:0/2610823187 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0100722f0 0x7fa010141760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00c430 tx=0x7fa00c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:18.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.972+0000 7ff0d8e04640 1 -- 172.21.15.49:0/4259919654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0d4072780 msgr2=0x7ff0d4147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.972+0000 7ff0d8e04640 1 --2- 172.21.15.49:0/4259919654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0d4072780 0x7ff0d4147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.972+0000 7ff0d8e04640 1 -- 172.21.15.49:0/4259919654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0d41533e0 msgr2=0x7ff0d4146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:18.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.972+0000 7ff0d8e04640 1 --2- 172.21.15.49:0/4259919654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0d41533e0 0x7ff0d4146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:18.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.972+0000 7ff0d8e04640 1 -- 172.21.15.49:0/4259919654 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c40094d0 con 0x7ff0d415d300 2023-11-18T21:00:18.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.980+0000 7fa005ffb640 1 -- 172.21.15.49:0/2610823187 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c005cf0 con 0x7fa0100722f0 2023-11-18T21:00:18.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.980+0000 7fa005ffb640 1 -- 172.21.15.49:0/2610823187 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c005e50 con 0x7fa0100722f0 2023-11-18T21:00:18.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.980+0000 7fa005ffb640 1 -- 172.21.15.49:0/2610823187 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c0072d0 con 0x7fa0100722f0 2023-11-18T21:00:18.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.980+0000 7fa0173f3640 1 -- 172.21.15.49:0/2610823187 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0101efed0 con 0x7fa0100722f0 2023-11-18T21:00:18.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.980+0000 7fa0173f3640 1 -- 172.21.15.49:0/2610823187 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0101f0170 con 0x7fa0100722f0 2023-11-18T21:00:18.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.984+0000 7fa0173f3640 1 -- 172.21.15.49:0/2610823187 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa010061d40 con 0x7fa0100722f0 2023-11-18T21:00:18.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:18.984+0000 7ff0d8e04640 1 --2- 172.21.15.49:0/4259919654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff0d415d300 0x7ff0d415a740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00b9a0 tx=0x7ff0cc00be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:19.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.116+0000 7fb66f7fe640 1 -- 172.21.15.49:0/420987743 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6600ac410 con 0x7fb67014ff30 2023-11-18T21:00:19.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.116+0000 7fb66f7fe640 1 -- 172.21.15.49:0/420987743 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6600ac570 con 0x7fb67014ff30 2023-11-18T21:00:19.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.116+0000 7fb66f7fe640 1 -- 172.21.15.49:0/420987743 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6600ac900 con 0x7fb67014ff30 2023-11-18T21:00:19.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.116+0000 7ff6b17fa640 1 -- 172.21.15.49:0/2571630545 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff6b40a03e0 con 0x7ff6ac0e4220 2023-11-18T21:00:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 -- 172.21.15.49:0/420987743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67014ff30 msgr2=0x7fb67015a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 --2- 172.21.15.49:0/420987743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67014ff30 0x7fb67015a050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb67006a660 tx=0x7fb66001c4c0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 -- 172.21.15.49:0/420987743 shutdown_connections 2023-11-18T21:00:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 --2- 172.21.15.49:0/420987743 >> v2:172.21.15.106:3300/0 conn(0x7fb67015d1f0 0x7fb67015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 --2- 172.21.15.49:0/420987743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67014ff30 0x7fb67015a050 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 -- 172.21.15.49:0/420987743 >> 172.21.15.49:0/420987743 conn(0x7fb67006d220 msgr2=0x7fb67006d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:19.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 -- 172.21.15.49:0/420987743 shutdown_connections 2023-11-18T21:00:19.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 -- 172.21.15.49:0/420987743 wait complete. 2023-11-18T21:00:19.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7ff6b17fa640 1 --2- 172.21.15.49:0/2571630545 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff6980664a0 0x7ff698068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:19.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7ff6b9000640 1 --2- 172.21.15.49:0/2571630545 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff6980664a0 0x7ff698068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:19.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7ff6b9000640 1 --2- 172.21.15.49:0/2571630545 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff6980664a0 0x7ff698068960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009870 tx=0x7ff6a80aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:19.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 Processor -- start 2023-11-18T21:00:19.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 -- start start 2023-11-18T21:00:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb6700cb290 0x7fb6701f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67014ff30 0x7fb67014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb67015d1f0 0x7fb67014d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb670142bb0 con 0x7fb67014ff30 2023-11-18T21:00:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb670159560 con 0x7fb67015d1f0 2023-11-18T21:00:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.120+0000 7fb676449640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb670159840 con 0x7fb6700cb290 2023-11-18T21:00:19.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.136+0000 7ff6b17fa640 1 -- 172.21.15.49:0/2571630545 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff6b40cfc30 con 0x7ff6ac0e4220 2023-11-18T21:00:19.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.140+0000 7ff6b17fa640 1 -- 172.21.15.49:0/2571630545 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6b40cb870 con 0x7ff6ac0e4220 2023-11-18T21:00:19.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.148+0000 7f790b7fe640 1 -- 172.21.15.49:0/190380021 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914011790 con 0x7f79241633b0 2023-11-18T21:00:19.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.148+0000 7f790b7fe640 1 -- 172.21.15.49:0/190380021 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79140118f0 con 0x7f79241633b0 2023-11-18T21:00:19.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.148+0000 7f7923fff640 1 -- 172.21.15.49:0/190380021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79241f2260 con 0x7f79241633b0 2023-11-18T21:00:19.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.148+0000 7f790b7fe640 1 -- 172.21.15.49:0/190380021 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914011ca0 con 0x7f79241633b0 2023-11-18T21:00:19.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.152+0000 7f7923fff640 1 -- 172.21.15.49:0/190380021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79241f2500 con 0x7f79241633b0 2023-11-18T21:00:19.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.152+0000 7f7923fff640 1 -- 172.21.15.49:0/190380021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79240c1e10 con 0x7f79241633b0 2023-11-18T21:00:19.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.156+0000 7fb6677fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67014ff30 0x7fb67014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:19.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.156+0000 7fb6677fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67014ff30 0x7fb67014ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38360/0 (socket says 172.21.15.49:38360) 2023-11-18T21:00:19.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.156+0000 7fb6677fe640 1 -- 172.21.15.49:0/3604474437 learned_addr learned my addr 172.21.15.49:0/3604474437 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.160+0000 7fb6677fe640 1 -- 172.21.15.49:0/3604474437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb6700cb290 msgr2=0x7fb6701f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.160+0000 7fb6677fe640 1 --2- 172.21.15.49:0/3604474437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb6700cb290 0x7fb6701f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.160+0000 7fb6677fe640 1 -- 172.21.15.49:0/3604474437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb67015d1f0 msgr2=0x7fb67014d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.160+0000 7fb6677fe640 1 --2- 172.21.15.49:0/3604474437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb67015d1f0 0x7fb67014d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.160+0000 7fb6677fe640 1 -- 172.21.15.49:0/3604474437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6600094d0 con 0x7fb67014ff30 2023-11-18T21:00:19.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.164+0000 7fd6b3fff640 1 -- 172.21.15.49:0/467217816 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd6bc0c73f0 con 0x7fd6cc152b80 2023-11-18T21:00:19.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.168+0000 7fd6b3fff640 1 --2- 172.21.15.49:0/467217816 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd6b80664c0 0x7fd6b8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:19.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.168+0000 7fd6caffd640 1 --2- 172.21.15.49:0/467217816 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd6b80664c0 0x7fd6b8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:19.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.168+0000 7fd6caffd640 1 --2- 172.21.15.49:0/467217816 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd6b80664c0 0x7fd6b8068980 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd6c00011f0 tx=0x7fd6c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.168+0000 7fd6b3fff640 1 -- 172.21.15.49:0/467217816 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd6bc0f25e0 con 0x7fd6cc152b80 2023-11-18T21:00:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.180+0000 7fd6b3fff640 1 -- 172.21.15.49:0/467217816 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd6bc0ee220 con 0x7fd6cc152b80 2023-11-18T21:00:19.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.192+0000 7f690bfff640 1 -- 172.21.15.49:0/4224433195 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c0a8a10 con 0x7f69180c3260 2023-11-18T21:00:19.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.276+0000 7f690bfff640 1 -- 172.21.15.49:0/4224433195 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690c0a8b70 con 0x7f69180c3260 2023-11-18T21:00:19.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.276+0000 7f690bfff640 1 -- 172.21.15.49:0/4224433195 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c0b0440 con 0x7f69180c3260 2023-11-18T21:00:19.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.276+0000 7f691f40f640 1 -- 172.21.15.49:0/4224433195 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69180c3260 msgr2=0x7f69180c50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:19.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.276+0000 7f691f40f640 1 --2- 172.21.15.49:0/4224433195 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69180c3260 0x7f69180c50c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f690c0098a0 tx=0x7f690c01ed10 comp rx=0 tx=0).stop 2023-11-18T21:00:19.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.276+0000 7f691f40f640 1 -- 172.21.15.49:0/4224433195 shutdown_connections 2023-11-18T21:00:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.276+0000 7f691f40f640 1 --2- 172.21.15.49:0/4224433195 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69180c3260 0x7f69180c50c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.276+0000 7f691f40f640 1 -- 172.21.15.49:0/4224433195 >> 172.21.15.49:0/4224433195 conn(0x7f69180713a0 msgr2=0x7f69180717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.276+0000 7f691f40f640 1 -- 172.21.15.49:0/4224433195 shutdown_connections 2023-11-18T21:00:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.276+0000 7f691f40f640 1 -- 172.21.15.49:0/4224433195 wait complete. 2023-11-18T21:00:19.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.280+0000 7f691f40f640 1 Processor -- start 2023-11-18T21:00:19.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.280+0000 7f691f40f640 1 -- start start 2023-11-18T21:00:19.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.280+0000 7f691f40f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69180c3260 0x7f691814e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:19.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.280+0000 7f691f40f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69180c4ce0 0x7f69180c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:19.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.280+0000 7f691f40f640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6918159870 0x7f6918148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:19.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.280+0000 7f691f40f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6918149940 con 0x7f69180c4ce0 2023-11-18T21:00:19.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.280+0000 7f691f40f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6918147da0 con 0x7f69180c3260 2023-11-18T21:00:19.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.280+0000 7f691f40f640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6918153d00 con 0x7f6918159870 2023-11-18T21:00:19.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.280+0000 7f691d1ab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69180c3260 0x7f691814e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:19.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.280+0000 7f691d1ab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69180c3260 0x7f691814e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:36050/0 (socket says 172.21.15.49:36050) 2023-11-18T21:00:19.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.280+0000 7f691d1ab640 1 -- 172.21.15.49:0/2812523846 learned_addr learned my addr 172.21.15.49:0/2812523846 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.296+0000 7f691d1ab640 1 -- 172.21.15.49:0/2812523846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6918159870 msgr2=0x7f6918148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.296+0000 7f691d1ab640 1 --2- 172.21.15.49:0/2812523846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6918159870 0x7f6918148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.296+0000 7f691d1ab640 1 -- 172.21.15.49:0/2812523846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69180c4ce0 msgr2=0x7f69180c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.296+0000 7f691d1ab640 1 --2- 172.21.15.49:0/2812523846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69180c4ce0 0x7f69180c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.296+0000 7f691d1ab640 1 -- 172.21.15.49:0/2812523846 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c0094d0 con 0x7f69180c3260 2023-11-18T21:00:19.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.304+0000 7ff6bb264640 1 -- 172.21.15.49:0/2571630545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff6ac0057c0 con 0x7ff6ac0e4220 2023-11-18T21:00:19.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.304+0000 7f691d1ab640 1 --2- 172.21.15.49:0/2812523846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69180c3260 0x7f691814e790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f691400c4c0 tx=0x7f691400c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:19.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.316+0000 7f6909ffb640 1 -- 172.21.15.49:0/2812523846 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140052d0 con 0x7f69180c3260 2023-11-18T21:00:19.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.316+0000 7f6909ffb640 1 -- 172.21.15.49:0/2812523846 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6914005430 con 0x7f69180c3260 2023-11-18T21:00:19.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.316+0000 7f6909ffb640 1 -- 172.21.15.49:0/2812523846 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914012870 con 0x7f69180c3260 2023-11-18T21:00:19.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.316+0000 7f691f40f640 1 -- 172.21.15.49:0/2812523846 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6918153fc0 con 0x7f69180c3260 2023-11-18T21:00:19.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.316+0000 7f691f40f640 1 -- 172.21.15.49:0/2812523846 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6918154580 con 0x7f69180c3260 2023-11-18T21:00:19.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.316+0000 7f691f40f640 1 -- 172.21.15.49:0/2812523846 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6918156610 con 0x7f69180c3260 2023-11-18T21:00:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.328+0000 7fa005ffb640 1 -- 172.21.15.49:0/2610823187 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa00c007430 con 0x7fa0100722f0 2023-11-18T21:00:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.328+0000 7fa005ffb640 1 --2- 172.21.15.49:0/2610823187 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9ff40664a0 0x7f9ff4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:19.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.328+0000 7fa01498e640 1 --2- 172.21.15.49:0/2610823187 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9ff40664a0 0x7f9ff4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:19.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.332+0000 7fa01498e640 1 --2- 172.21.15.49:0/2610823187 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9ff40664a0 0x7f9ff4068960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa000007fd0 tx=0x7fa0000079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:19.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.340+0000 7fa005ffb640 1 -- 172.21.15.49:0/2610823187 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa00c0549a0 con 0x7fa0100722f0 2023-11-18T21:00:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.368+0000 7fa005ffb640 1 -- 172.21.15.49:0/2610823187 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa00c050ce0 con 0x7fa0100722f0 2023-11-18T21:00:19.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.388+0000 7ff0d17fa640 1 -- 172.21.15.49:0/4259919654 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00cba0 con 0x7ff0d415d300 2023-11-18T21:00:19.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.388+0000 7ff0d17fa640 1 -- 172.21.15.49:0/4259919654 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc00cd20 con 0x7ff0d415d300 2023-11-18T21:00:19.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.388+0000 7ff0da867640 1 -- 172.21.15.49:0/4259919654 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d41f5800 con 0x7ff0d415d300 2023-11-18T21:00:19.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.388+0000 7ff0d17fa640 1 -- 172.21.15.49:0/4259919654 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc014680 con 0x7ff0d415d300 2023-11-18T21:00:19.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.388+0000 7ff0da867640 1 -- 172.21.15.49:0/4259919654 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d41f5dc0 con 0x7ff0d415d300 2023-11-18T21:00:19.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.388+0000 7ff0da867640 1 -- 172.21.15.49:0/4259919654 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d41f5f80 con 0x7ff0d415d300 2023-11-18T21:00:19.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.420+0000 7fd6d1977640 1 -- 172.21.15.49:0/467217816 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd6cc0c6af0 con 0x7fd6cc152b80 2023-11-18T21:00:19.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.524+0000 7fb6677fe640 1 --2- 172.21.15.49:0/3604474437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67014ff30 0x7fb67014ce40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb65800b410 tx=0x7fb65800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:19.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.536+0000 7fa0173f3640 1 -- 172.21.15.49:0/2610823187 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa010067d90 con 0x7fa0100722f0 2023-11-18T21:00:19.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.572+0000 7f790b7fe640 1 -- 172.21.15.49:0/190380021 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f791401c460 con 0x7f79241633b0 2023-11-18T21:00:19.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.572+0000 7f790b7fe640 1 --2- 172.21.15.49:0/190380021 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f79100664f0 0x7f79100689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:19.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.572+0000 7f7922ffd640 1 --2- 172.21.15.49:0/190380021 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f79100664f0 0x7f79100689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:19.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.576+0000 7f7922ffd640 1 --2- 172.21.15.49:0/190380021 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f79100664f0 0x7f79100689b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f791c007e60 tx=0x7f791c007390 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:19.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.604+0000 7f790b7fe640 1 -- 172.21.15.49:0/190380021 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7914055980 con 0x7f79241633b0 2023-11-18T21:00:19.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.604+0000 7f790b7fe640 1 -- 172.21.15.49:0/190380021 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7914051cc0 con 0x7f79241633b0 2023-11-18T21:00:19.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.624+0000 7ff6b17fa640 1 -- 172.21.15.49:0/2571630545 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff6b40cee90 con 0x7ff6ac0e4220 2023-11-18T21:00:19.625 INFO:teuthology.orchestra.run.smithi049.stdout:60129542166 2023-11-18T21:00:19.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.628+0000 7ff6bb264640 1 -- 172.21.15.49:0/2571630545 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff6980664a0 msgr2=0x7ff698068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:19.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.628+0000 7ff6bb264640 1 --2- 172.21.15.49:0/2571630545 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff6980664a0 0x7ff698068960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009870 tx=0x7ff6a80aa070 comp rx=0 tx=0).stop 2023-11-18T21:00:19.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.628+0000 7ff6bb264640 1 -- 172.21.15.49:0/2571630545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ac0e4220 msgr2=0x7ff6ac00a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:19.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.628+0000 7ff6bb264640 1 --2- 172.21.15.49:0/2571630545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ac0e4220 0x7ff6ac00a040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4063f10 tx=0x7ff6b4068000 comp rx=0 tx=0).stop 2023-11-18T21:00:19.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.628+0000 7ff6bb264640 1 -- 172.21.15.49:0/2571630545 shutdown_connections 2023-11-18T21:00:19.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.628+0000 7ff6bb264640 1 --2- 172.21.15.49:0/2571630545 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff6980664a0 0x7ff698068960 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.628+0000 7ff6bb264640 1 --2- 172.21.15.49:0/2571630545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6ac0e4220 0x7ff6ac00a040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.628+0000 7ff6bb264640 1 --2- 172.21.15.49:0/2571630545 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6ac0d9a20 0x7ff6ac179830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.628+0000 7ff6bb264640 1 --2- 172.21.15.49:0/2571630545 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6ac0381f0 0x7ff6ac1792f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.628+0000 7ff6bb264640 1 -- 172.21.15.49:0/2571630545 >> 172.21.15.49:0/2571630545 conn(0x7ff6ac00e0a0 msgr2=0x7ff6ac048b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:19.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.628+0000 7ff6bb264640 1 -- 172.21.15.49:0/2571630545 shutdown_connections 2023-11-18T21:00:19.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.628+0000 7ff6bb264640 1 -- 172.21.15.49:0/2571630545 wait complete. 2023-11-18T21:00:19.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542167 got 60129542166 for osd.4 2023-11-18T21:00:19.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.656+0000 7f6909ffb640 1 -- 172.21.15.49:0/2812523846 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69140129d0 con 0x7f69180c3260 2023-11-18T21:00:19.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.656+0000 7f6909ffb640 1 --2- 172.21.15.49:0/2812523846 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f68fc0664c0 0x7f68fc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:19.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.660+0000 7f691c9aa640 1 --2- 172.21.15.49:0/2812523846 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f68fc0664c0 0x7f68fc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:19.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.660+0000 7f691c9aa640 1 --2- 172.21.15.49:0/2812523846 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f68fc0664c0 0x7f68fc068980 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f690c0b2000 tx=0x7f690c004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:19.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.668+0000 7f6909ffb640 1 -- 172.21.15.49:0/2812523846 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6914055bd0 con 0x7f69180c3260 2023-11-18T21:00:19.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.672+0000 7fd6b3fff640 1 -- 172.21.15.49:0/467217816 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd6bc0a8020 con 0x7fd6cc152b80 2023-11-18T21:00:19.671 INFO:teuthology.orchestra.run.smithi049.stdout:64424509463 2023-11-18T21:00:19.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.672+0000 7fd6d1977640 1 -- 172.21.15.49:0/467217816 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd6b80664c0 msgr2=0x7fd6b8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:19.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.672+0000 7fd6d1977640 1 --2- 172.21.15.49:0/467217816 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd6b80664c0 0x7fd6b8068980 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd6c00011f0 tx=0x7fd6c0009040 comp rx=0 tx=0).stop 2023-11-18T21:00:19.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.672+0000 7fd6d1977640 1 -- 172.21.15.49:0/467217816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6cc152b80 msgr2=0x7fd6cc0c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:19.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.672+0000 7fd6d1977640 1 --2- 172.21.15.49:0/467217816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6cc152b80 0x7fd6cc0c9100 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc01c270 tx=0x7fd6bc01ce80 comp rx=0 tx=0).stop 2023-11-18T21:00:19.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.672+0000 7fd6d1977640 1 -- 172.21.15.49:0/467217816 shutdown_connections 2023-11-18T21:00:19.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.672+0000 7fd6d1977640 1 --2- 172.21.15.49:0/467217816 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd6b80664c0 0x7fd6b8068980 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.672+0000 7fd6d1977640 1 --2- 172.21.15.49:0/467217816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6cc152b80 0x7fd6cc0c9100 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.672+0000 7fd6d1977640 1 --2- 172.21.15.49:0/467217816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6cc0c1e60 0x7fd6cc151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.672+0000 7fd6d1977640 1 --2- 172.21.15.49:0/467217816 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6cc0717c0 0x7fd6cc150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.672+0000 7fd6d1977640 1 -- 172.21.15.49:0/467217816 >> 172.21.15.49:0/467217816 conn(0x7fd6cc06a560 msgr2=0x7fd6cc0735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:19.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.672+0000 7fd6d1977640 1 -- 172.21.15.49:0/467217816 shutdown_connections 2023-11-18T21:00:19.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.672+0000 7fd6d1977640 1 -- 172.21.15.49:0/467217816 wait complete. 2023-11-18T21:00:19.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.680+0000 7fb66d7fa640 1 -- 172.21.15.49:0/3604474437 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658011830 con 0x7fb67014ff30 2023-11-18T21:00:19.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.680+0000 7fb66d7fa640 1 -- 172.21.15.49:0/3604474437 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb658011990 con 0x7fb67014ff30 2023-11-18T21:00:19.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.680+0000 7fb66d7fa640 1 -- 172.21.15.49:0/3604474437 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658011d40 con 0x7fb67014ff30 2023-11-18T21:00:19.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.680+0000 7fb676449640 1 -- 172.21.15.49:0/3604474437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb670159b20 con 0x7fb67014ff30 2023-11-18T21:00:19.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.680+0000 7fb676449640 1 -- 172.21.15.49:0/3604474437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67015a0e0 con 0x7fb67014ff30 2023-11-18T21:00:19.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.684+0000 7fb676449640 1 -- 172.21.15.49:0/3604474437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb670153b60 con 0x7fb67014ff30 2023-11-18T21:00:19.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509464 got 64424509463 for osd.3 2023-11-18T21:00:19.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.704+0000 7f6909ffb640 1 -- 172.21.15.49:0/2812523846 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6914051810 con 0x7f69180c3260 2023-11-18T21:00:19.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.780+0000 7f7923fff640 1 -- 172.21.15.49:0/190380021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7924061b30 con 0x7f79241633b0 2023-11-18T21:00:19.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.892+0000 7f691f40f640 1 -- 172.21.15.49:0/2812523846 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6918156610 con 0x7f69180c3260 2023-11-18T21:00:19.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.896+0000 7f6909ffb640 1 -- 172.21.15.49:0/2812523846 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6918156610 con 0x7f69180c3260 2023-11-18T21:00:19.896 INFO:teuthology.orchestra.run.smithi049.stdout:64424509462 2023-11-18T21:00:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.896+0000 7f691f40f640 1 -- 172.21.15.49:0/2812523846 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f68fc0664c0 msgr2=0x7f68fc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.896+0000 7f691f40f640 1 --2- 172.21.15.49:0/2812523846 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f68fc0664c0 0x7f68fc068980 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f690c0b2000 tx=0x7f690c004740 comp rx=0 tx=0).stop 2023-11-18T21:00:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.896+0000 7f691f40f640 1 -- 172.21.15.49:0/2812523846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69180c3260 msgr2=0x7f691814e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.896+0000 7f691f40f640 1 --2- 172.21.15.49:0/2812523846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69180c3260 0x7f691814e790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f691400c4c0 tx=0x7f691400c980 comp rx=0 tx=0).stop 2023-11-18T21:00:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.896+0000 7f691f40f640 1 -- 172.21.15.49:0/2812523846 shutdown_connections 2023-11-18T21:00:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.896+0000 7f691f40f640 1 --2- 172.21.15.49:0/2812523846 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f68fc0664c0 0x7f68fc068980 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.896+0000 7f691f40f640 1 --2- 172.21.15.49:0/2812523846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6918159870 0x7f6918148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.896+0000 7f691f40f640 1 --2- 172.21.15.49:0/2812523846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69180c4ce0 0x7f69180c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.896+0000 7f691f40f640 1 --2- 172.21.15.49:0/2812523846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69180c3260 0x7f691814e790 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.896+0000 7f691f40f640 1 -- 172.21.15.49:0/2812523846 >> 172.21.15.49:0/2812523846 conn(0x7f69180713a0 msgr2=0x7f69180c9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:19.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.896+0000 7f691f40f640 1 -- 172.21.15.49:0/2812523846 shutdown_connections 2023-11-18T21:00:19.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.900+0000 7f691f40f640 1 -- 172.21.15.49:0/2812523846 wait complete. 2023-11-18T21:00:19.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509462 for osd.0 2023-11-18T21:00:19.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.968+0000 7f1a80ff9640 1 -- 172.21.15.49:0/2906834454 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1a7c0b8930 con 0x7f1a84155a80 2023-11-18T21:00:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.968+0000 7f1a80ff9640 1 --2- 172.21.15.49:0/2906834454 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1a640664a0 0x7f1a64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:19.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.968+0000 7f1a82ffd640 1 --2- 172.21.15.49:0/2906834454 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1a640664a0 0x7f1a64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:19.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:19.972+0000 7f1a82ffd640 1 --2- 172.21.15.49:0/2906834454 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1a640664a0 0x7f1a64068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1a74006aa0 tx=0x7f1a74006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:20.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.000+0000 7f1a80ff9640 1 -- 172.21.15.49:0/2906834454 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a7c0f0c40 con 0x7f1a84155a80 2023-11-18T21:00:20.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.020+0000 7f1a80ff9640 1 -- 172.21.15.49:0/2906834454 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a7c0ec880 con 0x7f1a84155a80 2023-11-18T21:00:20.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.040+0000 7ff0d17fa640 1 -- 172.21.15.49:0/4259919654 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff0cc01d3b0 con 0x7ff0d415d300 2023-11-18T21:00:20.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.040+0000 7ff0d17fa640 1 --2- 172.21.15.49:0/4259919654 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff0b40664f0 0x7ff0b40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:20.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.040+0000 7ff0d3fff640 1 --2- 172.21.15.49:0/4259919654 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff0b40664f0 0x7ff0b40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:20.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.044+0000 7ff0d3fff640 1 --2- 172.21.15.49:0/4259919654 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff0b40664f0 0x7ff0b40689b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40ae000 tx=0x7ff0c4004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:20.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.044+0000 7ff0d17fa640 1 -- 172.21.15.49:0/4259919654 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff0cc055a90 con 0x7ff0d415d300 2023-11-18T21:00:20.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.056+0000 7ff0d17fa640 1 -- 172.21.15.49:0/4259919654 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0cc0516d0 con 0x7ff0d415d300 2023-11-18T21:00:20.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.160+0000 7fb66d7fa640 1 -- 172.21.15.49:0/3604474437 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb65801a400 con 0x7fb67014ff30 2023-11-18T21:00:20.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.160+0000 7fb66d7fa640 1 --2- 172.21.15.49:0/3604474437 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb6500664c0 0x7fb650068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:20.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.160+0000 7fb66ffff640 1 --2- 172.21.15.49:0/3604474437 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb6500664c0 0x7fb650068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:20.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.164+0000 7fb66ffff640 1 --2- 172.21.15.49:0/3604474437 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb6500664c0 0x7fb650068980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb6600ae000 tx=0x7fb660004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:20.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.164+0000 7fa005ffb640 1 -- 172.21.15.49:0/2610823187 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa00c017020 con 0x7fa0100722f0 2023-11-18T21:00:20.166 INFO:teuthology.orchestra.run.smithi049.stdout:64424509464 2023-11-18T21:00:20.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.168+0000 7fa0173f3640 1 -- 172.21.15.49:0/2610823187 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9ff40664a0 msgr2=0x7f9ff4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.168+0000 7fa0173f3640 1 --2- 172.21.15.49:0/2610823187 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9ff40664a0 0x7f9ff4068960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa000007fd0 tx=0x7fa0000079a0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.168+0000 7fa0173f3640 1 -- 172.21.15.49:0/2610823187 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0100722f0 msgr2=0x7fa010141760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.168+0000 7fa0173f3640 1 --2- 172.21.15.49:0/2610823187 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0100722f0 0x7fa010141760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00c430 tx=0x7fa00c00c8f0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.168+0000 7fa0173f3640 1 -- 172.21.15.49:0/2610823187 shutdown_connections 2023-11-18T21:00:20.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.168+0000 7fa0173f3640 1 --2- 172.21.15.49:0/2610823187 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9ff40664a0 0x7f9ff4068960 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.168+0000 7fa0173f3640 1 --2- 172.21.15.49:0/2610823187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa01015a130 0x7fa010145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.168+0000 7fa0173f3640 1 --2- 172.21.15.49:0/2610823187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0100726d0 0x7fa010155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.168+0000 7fa0173f3640 1 --2- 172.21.15.49:0/2610823187 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa0100722f0 0x7fa010141760 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.168+0000 7fa0173f3640 1 -- 172.21.15.49:0/2610823187 >> 172.21.15.49:0/2610823187 conn(0x7fa01006b670 msgr2=0x7fa0100c5220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:20.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.168+0000 7fa0173f3640 1 -- 172.21.15.49:0/2610823187 shutdown_connections 2023-11-18T21:00:20.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.168+0000 7fa0173f3640 1 -- 172.21.15.49:0/2610823187 wait complete. 2023-11-18T21:00:20.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509465 got 64424509464 for osd.7 2023-11-18T21:00:20.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.200+0000 7fb66d7fa640 1 -- 172.21.15.49:0/3604474437 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb658055e00 con 0x7fb67014ff30 2023-11-18T21:00:20.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.200+0000 7fb66d7fa640 1 -- 172.21.15.49:0/3604474437 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb658051a40 con 0x7fb67014ff30 2023-11-18T21:00:20.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.212+0000 7f1a89975640 1 -- 172.21.15.49:0/2906834454 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1a841f6780 con 0x7f1a84155a80 2023-11-18T21:00:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.220+0000 7f1a80ff9640 1 -- 172.21.15.49:0/2906834454 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a841f6780 con 0x7f1a84155a80 2023-11-18T21:00:20.220 INFO:teuthology.orchestra.run.smithi049.stdout:64424509464 2023-11-18T21:00:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.220+0000 7f1a89975640 1 -- 172.21.15.49:0/2906834454 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1a640664a0 msgr2=0x7f1a64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.220+0000 7f1a89975640 1 --2- 172.21.15.49:0/2906834454 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1a640664a0 0x7f1a64068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1a74006aa0 tx=0x7f1a74006a30 comp rx=0 tx=0).stop 2023-11-18T21:00:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.220+0000 7f1a89975640 1 -- 172.21.15.49:0/2906834454 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a84155a80 msgr2=0x7f1a84154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.220+0000 7f1a89975640 1 --2- 172.21.15.49:0/2906834454 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a84155a80 0x7f1a84154670 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c01d4e0 tx=0x7f1a7c0199e0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.220+0000 7f1a89975640 1 -- 172.21.15.49:0/2906834454 shutdown_connections 2023-11-18T21:00:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.220+0000 7f1a89975640 1 --2- 172.21.15.49:0/2906834454 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1a640664a0 0x7f1a64068960 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.220+0000 7f1a89975640 1 --2- 172.21.15.49:0/2906834454 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a84155a80 0x7f1a84154670 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.220+0000 7f1a89975640 1 --2- 172.21.15.49:0/2906834454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a84152bf0 0x7f1a84144200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.220+0000 7f1a89975640 1 --2- 172.21.15.49:0/2906834454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a840c1ed0 0x7f1a8414acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.220+0000 7f1a89975640 1 -- 172.21.15.49:0/2906834454 >> 172.21.15.49:0/2906834454 conn(0x7f1a8406c6a0 msgr2=0x7f1a840c7870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.220+0000 7f1a89975640 1 -- 172.21.15.49:0/2906834454 shutdown_connections 2023-11-18T21:00:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.220+0000 7f1a89975640 1 -- 172.21.15.49:0/2906834454 wait complete. 2023-11-18T21:00:20.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509465 got 64424509464 for osd.5 2023-11-18T21:00:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.240+0000 7f790b7fe640 1 -- 172.21.15.49:0/190380021 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f79140552e0 con 0x7f79241633b0 2023-11-18T21:00:20.242 INFO:teuthology.orchestra.run.smithi049.stdout:64424509464 2023-11-18T21:00:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.244+0000 7f7923fff640 1 -- 172.21.15.49:0/190380021 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f79100664f0 msgr2=0x7f79100689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.244+0000 7f7923fff640 1 --2- 172.21.15.49:0/190380021 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f79100664f0 0x7f79100689b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f791c007e60 tx=0x7f791c007390 comp rx=0 tx=0).stop 2023-11-18T21:00:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.244+0000 7f7923fff640 1 -- 172.21.15.49:0/190380021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79241633b0 msgr2=0x7f7924200e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.244+0000 7f7923fff640 1 --2- 172.21.15.49:0/190380021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79241633b0 0x7f7924200e90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f791400c410 tx=0x7f791400c8d0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.244+0000 7f7923fff640 1 -- 172.21.15.49:0/190380021 shutdown_connections 2023-11-18T21:00:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.244+0000 7f7923fff640 1 --2- 172.21.15.49:0/190380021 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f79100664f0 0x7f79100689b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.244+0000 7f7923fff640 1 --2- 172.21.15.49:0/190380021 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7924163790 0x7f7924161f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.244+0000 7f7923fff640 1 --2- 172.21.15.49:0/190380021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79241633b0 0x7f7924200e90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.244+0000 7f7923fff640 1 --2- 172.21.15.49:0/190380021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79240c6b00 0x7f79241f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.244+0000 7f7923fff640 1 -- 172.21.15.49:0/190380021 >> 172.21.15.49:0/190380021 conn(0x7f792406a560 msgr2=0x7f7924165610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.244+0000 7f7923fff640 1 -- 172.21.15.49:0/190380021 shutdown_connections 2023-11-18T21:00:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.244+0000 7f7923fff640 1 -- 172.21.15.49:0/190380021 wait complete. 2023-11-18T21:00:20.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509465 got 64424509464 for osd.6 2023-11-18T21:00:20.265 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.264+0000 7ff0da867640 1 -- 172.21.15.49:0/4259919654 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff0d4073e70 con 0x7ff0d415d300 2023-11-18T21:00:20.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.272+0000 7ff0d17fa640 1 -- 172.21.15.49:0/4259919654 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff0cc019070 con 0x7ff0d415d300 2023-11-18T21:00:20.275 INFO:teuthology.orchestra.run.smithi049.stdout:64424509463 2023-11-18T21:00:20.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.276+0000 7ff0da867640 1 -- 172.21.15.49:0/4259919654 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff0b40664f0 msgr2=0x7ff0b40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.276+0000 7ff0da867640 1 --2- 172.21.15.49:0/4259919654 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff0b40664f0 0x7ff0b40689b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40ae000 tx=0x7ff0c4004740 comp rx=0 tx=0).stop 2023-11-18T21:00:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.276+0000 7ff0da867640 1 -- 172.21.15.49:0/4259919654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff0d415d300 msgr2=0x7ff0d415a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.276+0000 7ff0da867640 1 --2- 172.21.15.49:0/4259919654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff0d415d300 0x7ff0d415a740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00b9a0 tx=0x7ff0cc00be60 comp rx=0 tx=0).stop 2023-11-18T21:00:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.276+0000 7ff0da867640 1 -- 172.21.15.49:0/4259919654 shutdown_connections 2023-11-18T21:00:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.276+0000 7ff0da867640 1 --2- 172.21.15.49:0/4259919654 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff0b40664f0 0x7ff0b40689b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.276+0000 7ff0da867640 1 --2- 172.21.15.49:0/4259919654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff0d415d300 0x7ff0d415a740 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.276+0000 7ff0da867640 1 --2- 172.21.15.49:0/4259919654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0d41533e0 0x7ff0d4146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.276+0000 7ff0da867640 1 --2- 172.21.15.49:0/4259919654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0d4072780 0x7ff0d4147850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.276+0000 7ff0da867640 1 -- 172.21.15.49:0/4259919654 >> 172.21.15.49:0/4259919654 conn(0x7ff0d406b670 msgr2=0x7ff0d4156f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:20.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.276+0000 7ff0da867640 1 -- 172.21.15.49:0/4259919654 shutdown_connections 2023-11-18T21:00:20.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.276+0000 7ff0da867640 1 -- 172.21.15.49:0/4259919654 wait complete. 2023-11-18T21:00:20.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509464 got 64424509463 for osd.2 2023-11-18T21:00:20.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.368+0000 7fb676449640 1 -- 172.21.15.49:0/3604474437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb670073e70 con 0x7fb67014ff30 2023-11-18T21:00:20.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.376+0000 7fb66d7fa640 1 -- 172.21.15.49:0/3604474437 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb658015070 con 0x7fb67014ff30 2023-11-18T21:00:20.378 INFO:teuthology.orchestra.run.smithi049.stdout:64424509462 2023-11-18T21:00:20.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.380+0000 7fb676449640 1 -- 172.21.15.49:0/3604474437 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb6500664c0 msgr2=0x7fb650068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.380+0000 7fb676449640 1 --2- 172.21.15.49:0/3604474437 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb6500664c0 0x7fb650068980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb6600ae000 tx=0x7fb660004740 comp rx=0 tx=0).stop 2023-11-18T21:00:20.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.380+0000 7fb676449640 1 -- 172.21.15.49:0/3604474437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67014ff30 msgr2=0x7fb67014ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.380+0000 7fb676449640 1 --2- 172.21.15.49:0/3604474437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67014ff30 0x7fb67014ce40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb65800b410 tx=0x7fb65800b8d0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.380+0000 7fb676449640 1 -- 172.21.15.49:0/3604474437 shutdown_connections 2023-11-18T21:00:20.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.380+0000 7fb676449640 1 --2- 172.21.15.49:0/3604474437 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb6500664c0 0x7fb650068980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.380+0000 7fb676449640 1 --2- 172.21.15.49:0/3604474437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb67015d1f0 0x7fb67014d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.380+0000 7fb676449640 1 --2- 172.21.15.49:0/3604474437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb67014ff30 0x7fb67014ce40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.380+0000 7fb676449640 1 --2- 172.21.15.49:0/3604474437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb6700cb290 0x7fb6701f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.380+0000 7fb676449640 1 -- 172.21.15.49:0/3604474437 >> 172.21.15.49:0/3604474437 conn(0x7fb67006d220 msgr2=0x7fb6700c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:20.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.380+0000 7fb676449640 1 -- 172.21.15.49:0/3604474437 shutdown_connections 2023-11-18T21:00:20.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.380+0000 7fb676449640 1 -- 172.21.15.49:0/3604474437 wait complete. 2023-11-18T21:00:20.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509462 for osd.1 2023-11-18T21:00:20.646 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-18T21:00:20.692 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-18T21:00:20.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.784+0000 7f1c74717640 1 Processor -- start 2023-11-18T21:00:20.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.784+0000 7f1c74717640 1 -- start start 2023-11-18T21:00:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.784+0000 7f1c74717640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1c6c0c5560 0x7f1c6c156f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.784+0000 7f1c74717640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c0c6820 con 0x7f1c6c0c5180 2023-11-18T21:00:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.784+0000 7f1c74717640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c156af0 con 0x7f1c6c0c7440 2023-11-18T21:00:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.784+0000 7f1c74717640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c0c4370 con 0x7f1c6c0c5560 2023-11-18T21:00:20.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.824+0000 7f1c724b3640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1c6c0c5180 0x7f1c6c06b800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34182/0 (socket says 172.21.15.49:34182) 2023-11-18T21:00:20.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.824+0000 7f1c724b3640 1 -- 172.21.15.49:0/3818494256 learned_addr learned my addr 172.21.15.49:0/3818494256 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:20.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.836+0000 7f1c71cb2640 1 --2- 172.21.15.49:0/3818494256 >> v2:172.21.15.49:3300/0 conn(0x7f1c6c0c5560 0x7f1c6c156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.840+0000 7f1c71cb2640 1 -- 172.21.15.49:0/3818494256 >> v1:172.21.15.106:6789/0 conn(0x7f1c6c0c7440 legacy=0x7f1c6c14ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.840+0000 7f1c71cb2640 1 -- 172.21.15.49:0/3818494256 >> v1:172.21.15.49:6789/0 conn(0x7f1c6c0c5180 legacy=0x7f1c6c06b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.840+0000 7f1c71cb2640 1 -- 172.21.15.49:0/3818494256 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c0c6260 con 0x7f1c6c0c5560 2023-11-18T21:00:20.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.848+0000 7f1c71cb2640 1 --2- 172.21.15.49:0/3818494256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c6c0c5560 0x7f1c6c156f80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1c680097f0 tx=0x7f1c6801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b233c8ca02d6e50 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:20.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f3e13deb640 1 Processor -- start 2023-11-18T21:00:20.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f3e13deb640 1 -- start start 2023-11-18T21:00:20.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f1c714b1640 1 -- 172.21.15.49:0/3818494256 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c680ab600 con 0x7f1c6c0c5560 2023-11-18T21:00:20.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f1c714b1640 1 -- 172.21.15.49:0/3818494256 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c680a7050 con 0x7f1c6c0c5560 2023-11-18T21:00:20.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f1c714b1640 1 -- 172.21.15.49:0/3818494256 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c680ab980 con 0x7f1c6c0c5560 2023-11-18T21:00:20.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f1c74717640 1 -- 172.21.15.49:0/3818494256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c6c0c5560 msgr2=0x7f1c6c156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f1c74717640 1 --2- 172.21.15.49:0/3818494256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c6c0c5560 0x7f1c6c156f80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1c680097f0 tx=0x7f1c6801c410 comp rx=0 tx=0).stop 2023-11-18T21:00:20.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f1c74717640 1 -- 172.21.15.49:0/3818494256 shutdown_connections 2023-11-18T21:00:20.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f1c74717640 1 --2- 172.21.15.49:0/3818494256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c6c0c5560 0x7f1c6c156f80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f1c74717640 1 -- 172.21.15.49:0/3818494256 >> 172.21.15.49:0/3818494256 conn(0x7f1c6c06d220 msgr2=0x7f1c6c06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:20.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f1c74717640 1 -- 172.21.15.49:0/3818494256 shutdown_connections 2023-11-18T21:00:20.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f1c74717640 1 -- 172.21.15.49:0/3818494256 wait complete. 2023-11-18T21:00:20.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f3e13deb640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3e0c1512c0 0x7f3e0c06ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:20.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f3e13deb640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3e0c0cb8a0 0x7f3e0c0c5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:20.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f3e13deb640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e0c158130 con 0x7f3e0c0c6370 2023-11-18T21:00:20.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f3e13deb640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0c06b260 con 0x7f3e0c0cb8a0 2023-11-18T21:00:20.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f3e13deb640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0c157590 con 0x7f3e0c1512c0 2023-11-18T21:00:20.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f1c74717640 1 Processor -- start 2023-11-18T21:00:20.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.852+0000 7f1c74717640 1 -- start start 2023-11-18T21:00:20.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.856+0000 7f1c74717640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c6c0c5180 0x7f1c6c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:20.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.856+0000 7f1c74717640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c6c0c5560 0x7f1c6c13f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:20.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.856+0000 7f1c74717640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c6c0c7440 0x7f1c6c142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:20.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.856+0000 7f1c74717640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c1f6a60 con 0x7f1c6c0c5180 2023-11-18T21:00:20.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.856+0000 7f1c74717640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c149490 con 0x7f1c6c0c5560 2023-11-18T21:00:20.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.856+0000 7f1c74717640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0ca4b0 con 0x7f1c6c0c7440 2023-11-18T21:00:20.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.856+0000 7f3e11b87640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3e0c1512c0 0x7f3e0c06ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:20.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.856+0000 7f3e11b87640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3e0c1512c0 0x7f3e0c06ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:36052/0 (socket says 172.21.15.49:36052) 2023-11-18T21:00:20.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.856+0000 7f3e11b87640 1 -- 172.21.15.49:0/1105093259 learned_addr learned my addr 172.21.15.49:0/1105093259 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:20.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.856+0000 7f1c71cb2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c6c0c5560 0x7f1c6c13f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:20.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.856+0000 7f1c71cb2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c6c0c5560 0x7f1c6c13f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:36060/0 (socket says 172.21.15.49:36060) 2023-11-18T21:00:20.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.856+0000 7f1c71cb2640 1 -- 172.21.15.49:0/3349905095 learned_addr learned my addr 172.21.15.49:0/3349905095 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:20.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.856+0000 7f3e12388640 1 --2- 172.21.15.49:0/1105093259 >> v2:172.21.15.49:3300/0 conn(0x7f3e0c0cb8a0 0x7f3e0c0c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:20.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.856+0000 7f1c724b3640 1 --2- 172.21.15.49:0/3349905095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c6c0c5180 0x7f1c6c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:20.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.860+0000 7f3e11b87640 1 -- 172.21.15.49:0/1105093259 >> v2:172.21.15.49:3300/0 conn(0x7f3e0c0cb8a0 msgr2=0x7f3e0c0c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:20.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.860+0000 7f3e11b87640 1 --2- 172.21.15.49:0/1105093259 >> v2:172.21.15.49:3300/0 conn(0x7f3e0c0cb8a0 0x7f3e0c0c5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.860+0000 7f3e11b87640 1 -- 172.21.15.49:0/1105093259 >> v1:172.21.15.49:6789/0 conn(0x7f3e0c0c6370 legacy=0x7f3e0c157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.860+0000 7f3e11b87640 1 -- 172.21.15.49:0/1105093259 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c0c7090 con 0x7f3e0c1512c0 2023-11-18T21:00:20.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.864+0000 7f1c71cb2640 1 -- 172.21.15.49:0/3349905095 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c6c0c7440 msgr2=0x7f1c6c142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.864+0000 7f1c71cb2640 1 --2- 172.21.15.49:0/3349905095 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c6c0c7440 0x7f1c6c142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.864+0000 7f1c71cb2640 1 -- 172.21.15.49:0/3349905095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c6c0c5180 msgr2=0x7f1c6c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.864+0000 7f1c71cb2640 1 --2- 172.21.15.49:0/3349905095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c6c0c5180 0x7f1c6c0c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.864+0000 7f1c71cb2640 1 -- 172.21.15.49:0/3349905095 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c68009420 con 0x7f1c6c0c5560 2023-11-18T21:00:20.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.868+0000 7f3e11b87640 1 --2- 172.21.15.49:0/1105093259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e0c1512c0 0x7f3e0c06ad20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0c5b30 tx=0x7f3dfc01f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19c2cbc720965a3f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:20.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.872+0000 7f1c71cb2640 1 --2- 172.21.15.49:0/3349905095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c6c0c5560 0x7f1c6c13f680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1c6801aac0 tx=0x7f1c680191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:20.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.876+0000 7f3e10b85640 1 -- 172.21.15.49:0/1105093259 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0af400 con 0x7f3e0c1512c0 2023-11-18T21:00:20.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.876+0000 7f3e10b85640 1 -- 172.21.15.49:0/1105093259 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc0ab050 con 0x7f3e0c1512c0 2023-11-18T21:00:20.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.876+0000 7f3e10b85640 1 -- 172.21.15.49:0/1105093259 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0af780 con 0x7f3e0c1512c0 2023-11-18T21:00:20.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 -- 172.21.15.49:0/1105093259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e0c1512c0 msgr2=0x7f3e0c06ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 --2- 172.21.15.49:0/1105093259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e0c1512c0 0x7f3e0c06ad20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0c5b30 tx=0x7f3dfc01f1c0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 -- 172.21.15.49:0/1105093259 shutdown_connections 2023-11-18T21:00:20.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 --2- 172.21.15.49:0/1105093259 >> v2:172.21.15.49:3300/0 conn(0x7f3e0c0cb8a0 0x7f3e0c0c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 --2- 172.21.15.49:0/1105093259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e0c1512c0 0x7f3e0c06ad20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 -- 172.21.15.49:0/1105093259 >> 172.21.15.49:0/1105093259 conn(0x7f3e0c06b670 msgr2=0x7f3e0c06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 -- 172.21.15.49:0/1105093259 shutdown_connections 2023-11-18T21:00:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 -- 172.21.15.49:0/1105093259 wait complete. 2023-11-18T21:00:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 Processor -- start 2023-11-18T21:00:20.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 -- start start 2023-11-18T21:00:20.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f1c62ffd640 1 -- 172.21.15.49:0/3349905095 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c680b4610 con 0x7f1c6c0c5560 2023-11-18T21:00:20.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f1c62ffd640 1 -- 172.21.15.49:0/3349905095 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c680b4770 con 0x7f1c6c0c5560 2023-11-18T21:00:20.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f1c62ffd640 1 -- 172.21.15.49:0/3349905095 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c680b4b20 con 0x7f1c6c0c5560 2023-11-18T21:00:20.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f1c74717640 1 -- 172.21.15.49:0/3349905095 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c1f64e0 con 0x7f1c6c0c5560 2023-11-18T21:00:20.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f1c74717640 1 -- 172.21.15.49:0/3349905095 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c1f6780 con 0x7f1c6c0c5560 2023-11-18T21:00:20.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e0c0c6370 0x7f3e0c155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:20.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e0c0cb8a0 0x7f3e0c0c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:20.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e0c1512c0 0x7f3e0c0c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:20.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c1ef880 con 0x7f3e0c0c6370 2023-11-18T21:00:20.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c1efdb0 con 0x7f3e0c1512c0 2023-11-18T21:00:20.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e13deb640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c1efad0 con 0x7f3e0c0cb8a0 2023-11-18T21:00:20.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e11386640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e0c0cb8a0 0x7f3e0c0c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:20.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f1c74717640 1 -- 172.21.15.49:0/3349905095 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c073e70 con 0x7f1c6c0c5560 2023-11-18T21:00:20.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e11386640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e0c0cb8a0 0x7f3e0c0c3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:46990/0 (socket says 172.21.15.49:46990) 2023-11-18T21:00:20.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.880+0000 7f3e11386640 1 -- 172.21.15.49:0/3467555465 learned_addr learned my addr 172.21.15.49:0/3467555465 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:20.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.888+0000 7f3e12388640 1 --2- 172.21.15.49:0/3467555465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e0c1512c0 0x7f3e0c0c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:20.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.888+0000 7f3e11386640 1 -- 172.21.15.49:0/3467555465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e0c1512c0 msgr2=0x7f3e0c0c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.888+0000 7f3e11386640 1 --2- 172.21.15.49:0/3467555465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e0c1512c0 0x7f3e0c0c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.888+0000 7f3e11386640 1 -- 172.21.15.49:0/3467555465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e0c0c6370 msgr2=0x7f3e0c155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:20.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.888+0000 7f3e11386640 1 --2- 172.21.15.49:0/3467555465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e0c0c6370 0x7f3e0c155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:20.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.888+0000 7f3e11386640 1 -- 172.21.15.49:0/3467555465 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc009b30 con 0x7f3e0c0cb8a0 2023-11-18T21:00:20.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.892+0000 7f3e11386640 1 --2- 172.21.15.49:0/3467555465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e0c0cb8a0 0x7f3e0c0c3a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000c370 tx=0x7f3e0000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:20.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.900+0000 7f3e0a7fc640 1 -- 172.21.15.49:0/3467555465 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e000052d0 con 0x7f3e0c0cb8a0 2023-11-18T21:00:20.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.900+0000 7f3e0a7fc640 1 -- 172.21.15.49:0/3467555465 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e00005430 con 0x7f3e0c0cb8a0 2023-11-18T21:00:20.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.900+0000 7f3e0a7fc640 1 -- 172.21.15.49:0/3467555465 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e00007260 con 0x7f3e0c0cb8a0 2023-11-18T21:00:20.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.900+0000 7f3e13deb640 1 -- 172.21.15.49:0/3467555465 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0c0c2fa0 con 0x7f3e0c0cb8a0 2023-11-18T21:00:20.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.900+0000 7f3e13deb640 1 -- 172.21.15.49:0/3467555465 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0c0c3560 con 0x7f3e0c0cb8a0 2023-11-18T21:00:20.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:20.900+0000 7f3e13deb640 1 -- 172.21.15.49:0/3467555465 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0c073e70 con 0x7f3e0c0cb8a0 2023-11-18T21:00:20.916 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-18T21:00:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.036+0000 7f4ffde84640 1 Processor -- start 2023-11-18T21:00:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.036+0000 7f4ffde84640 1 -- start start 2023-11-18T21:00:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.036+0000 7f4ffde84640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ff8151720 0x7f4ff806ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.036+0000 7f4ffde84640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ff80c40e0 0x7f4ff80c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.036+0000 7f4ffde84640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff806f4a0 con 0x7f4ff8151340 2023-11-18T21:00:21.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.036+0000 7f4ffde84640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff8072570 con 0x7f4ff80c40e0 2023-11-18T21:00:21.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.036+0000 7f4ffde84640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff8070be0 con 0x7f4ff8151720 2023-11-18T21:00:21.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.036+0000 7f4ff7fff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ff80c40e0 0x7f4ff80c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.036+0000 7f4ff77fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4ff8151340 0x7f4ff8157c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34198/0 (socket says 172.21.15.49:34198) 2023-11-18T21:00:21.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.036+0000 7f4ff77fe640 1 -- 172.21.15.49:0/4149391134 learned_addr learned my addr 172.21.15.49:0/4149391134 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.040+0000 7f4ff7fff640 1 -- 172.21.15.49:0/4149391134 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ff8151720 msgr2=0x7f4ff806ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.040+0000 7f4ff7fff640 1 --2- 172.21.15.49:0/4149391134 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ff8151720 0x7f4ff806ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.040+0000 7f4ff7fff640 1 -- 172.21.15.49:0/4149391134 >> v1:172.21.15.49:6789/0 conn(0x7f4ff8151340 legacy=0x7f4ff8157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.040+0000 7f4ff7fff640 1 -- 172.21.15.49:0/4149391134 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff8070e80 con 0x7f4ff80c40e0 2023-11-18T21:00:21.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.044+0000 7f4ff7fff640 1 --2- 172.21.15.49:0/4149391134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff80c40e0 0x7f4ff80c4590 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009d90 tx=0x7f4fe801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306be5c9b5c73db6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.048+0000 7f4ff67fc640 1 -- 172.21.15.49:0/4149391134 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80a59e0 con 0x7f4ff80c40e0 2023-11-18T21:00:21.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.048+0000 7f4ff67fc640 1 -- 172.21.15.49:0/4149391134 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe80a5b40 con 0x7f4ff80c40e0 2023-11-18T21:00:21.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.048+0000 7f4ff67fc640 1 -- 172.21.15.49:0/4149391134 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80ad440 con 0x7f4ff80c40e0 2023-11-18T21:00:21.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.048+0000 7f4ffde84640 1 -- 172.21.15.49:0/4149391134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff80c40e0 msgr2=0x7f4ff80c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.048+0000 7f4ffde84640 1 --2- 172.21.15.49:0/4149391134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff80c40e0 0x7f4ff80c4590 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009d90 tx=0x7f4fe801c920 comp rx=0 tx=0).stop 2023-11-18T21:00:21.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.048+0000 7f4ffde84640 1 -- 172.21.15.49:0/4149391134 shutdown_connections 2023-11-18T21:00:21.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.048+0000 7f4ffde84640 1 --2- 172.21.15.49:0/4149391134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff80c40e0 0x7f4ff80c4590 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.048+0000 7f4ffde84640 1 --2- 172.21.15.49:0/4149391134 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ff8151720 0x7f4ff806ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.048+0000 7f4ffde84640 1 -- 172.21.15.49:0/4149391134 >> 172.21.15.49:0/4149391134 conn(0x7f4ff806c6a0 msgr2=0x7f4ff806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:21.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.048+0000 7f4ffde84640 1 -- 172.21.15.49:0/4149391134 shutdown_connections 2023-11-18T21:00:21.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.048+0000 7f4ffde84640 1 -- 172.21.15.49:0/4149391134 wait complete. 2023-11-18T21:00:21.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.052+0000 7f4ffde84640 1 Processor -- start 2023-11-18T21:00:21.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.052+0000 7f4ffde84640 1 -- start start 2023-11-18T21:00:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.052+0000 7f4ffde84640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ff80c40e0 0x7f4ff8149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.052+0000 7f4ffde84640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff8151340 0x7f4ff814b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.052+0000 7f4ffde84640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ff8151720 0x7f4ff814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.052+0000 7f4ffde84640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff81f33f0 con 0x7f4ff8151340 2023-11-18T21:00:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.052+0000 7f4ffde84640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff81508b0 con 0x7f4ff8151720 2023-11-18T21:00:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.052+0000 7f4ffde84640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff814d070 con 0x7f4ff80c40e0 2023-11-18T21:00:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.052+0000 7f4ff6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff8151340 0x7f4ff814b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.052+0000 7f4ff6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff8151340 0x7f4ff814b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38424/0 (socket says 172.21.15.49:38424) 2023-11-18T21:00:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.052+0000 7f4ff6ffd640 1 -- 172.21.15.49:0/1496501906 learned_addr learned my addr 172.21.15.49:0/1496501906 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:21.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.056+0000 7f4ff6ffd640 1 -- 172.21.15.49:0/1496501906 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ff80c40e0 msgr2=0x7f4ff8149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.056+0000 7f4ff6ffd640 1 --2- 172.21.15.49:0/1496501906 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ff80c40e0 0x7f4ff8149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.056+0000 7f4ff6ffd640 1 -- 172.21.15.49:0/1496501906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ff8151720 msgr2=0x7f4ff814bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.056+0000 7f4ff6ffd640 1 --2- 172.21.15.49:0/1496501906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ff8151720 0x7f4ff814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.056+0000 7f4ff6ffd640 1 -- 172.21.15.49:0/1496501906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe8009a70 con 0x7f4ff8151340 2023-11-18T21:00:21.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.060+0000 7f4ff6ffd640 1 --2- 172.21.15.49:0/1496501906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff8151340 0x7f4ff814b880 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000b580 tx=0x7f4fe000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.064+0000 7f4feffff640 1 -- 172.21.15.49:0/1496501906 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0011890 con 0x7f4ff8151340 2023-11-18T21:00:21.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.064+0000 7f4feffff640 1 -- 172.21.15.49:0/1496501906 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe0011a10 con 0x7f4ff8151340 2023-11-18T21:00:21.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.064+0000 7f4feffff640 1 -- 172.21.15.49:0/1496501906 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0011dc0 con 0x7f4ff8151340 2023-11-18T21:00:21.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.064+0000 7f4ffde84640 1 -- 172.21.15.49:0/1496501906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff814d350 con 0x7f4ff8151340 2023-11-18T21:00:21.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.064+0000 7f4ffde84640 1 -- 172.21.15.49:0/1496501906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff814d910 con 0x7f4ff8151340 2023-11-18T21:00:21.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.064+0000 7f4ffde84640 1 -- 172.21.15.49:0/1496501906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff81f35c0 con 0x7f4ff8151340 2023-11-18T21:00:21.189 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-18T21:00:21.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.208+0000 7f3e0a7fc640 1 -- 172.21.15.49:0/3467555465 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e000073c0 con 0x7f3e0c0cb8a0 2023-11-18T21:00:21.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.212+0000 7f3e0a7fc640 1 --2- 172.21.15.49:0/3467555465 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3df80664c0 0x7f3df8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.212+0000 7f3e11b87640 1 --2- 172.21.15.49:0/3467555465 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3df80664c0 0x7f3df8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.212+0000 7f3e11b87640 1 --2- 172.21.15.49:0/3467555465 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3df80664c0 0x7f3df8068980 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0b1000 tx=0x7f3dfc004ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.220+0000 7f3e0a7fc640 1 -- 172.21.15.49:0/3467555465 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e00007670 con 0x7f3e0c0cb8a0 2023-11-18T21:00:21.240 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-18T21:00:21.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.252+0000 7f1c62ffd640 1 -- 172.21.15.49:0/3349905095 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1c680b2040 con 0x7f1c6c0c5560 2023-11-18T21:00:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.252+0000 7f1c62ffd640 1 --2- 172.21.15.49:0/3349905095 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1c500664c0 0x7f1c50068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.252+0000 7f1c724b3640 1 --2- 172.21.15.49:0/3349905095 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1c500664c0 0x7f1c50068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.256+0000 7f1c724b3640 1 --2- 172.21.15.49:0/3349905095 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1c500664c0 0x7f1c50068980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c005890 tx=0x7f1c5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-18T21:00:21.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.264+0000 7f1c62ffd640 1 -- 172.21.15.49:0/3349905095 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1c680f0100 con 0x7f1c6c0c5560 2023-11-18T21:00:21.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.292+0000 7f1c62ffd640 1 -- 172.21.15.49:0/3349905095 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c680ebd40 con 0x7f1c6c0c5560 2023-11-18T21:00:21.295 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-18T21:00:21.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.300+0000 7f3e0a7fc640 1 -- 172.21.15.49:0/3467555465 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3e00050a30 con 0x7f3e0c0cb8a0 2023-11-18T21:00:21.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.332+0000 7fb15e05b640 1 Processor -- start 2023-11-18T21:00:21.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.332+0000 7fb15e05b640 1 -- start start 2023-11-18T21:00:21.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.332+0000 7fb15e05b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb1580c88c0 0x7fb1580c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.332+0000 7fb15e05b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb1580c8ca0 0x7fb15806ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.332+0000 7fb15e05b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1581575c0 con 0x7fb158070290 2023-11-18T21:00:21.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.332+0000 7fb15e05b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1581578a0 con 0x7fb1580c88c0 2023-11-18T21:00:21.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.332+0000 7fb15e05b640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb158157b80 con 0x7fb1580c8ca0 2023-11-18T21:00:21.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.332+0000 7fb157fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb1580c8ca0 0x7fb15806ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.332+0000 7fb157fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb1580c8ca0 0x7fb15806ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:36080/0 (socket says 172.21.15.49:36080) 2023-11-18T21:00:21.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.332+0000 7fb157fff640 1 -- 172.21.15.49:0/2329630184 learned_addr learned my addr 172.21.15.49:0/2329630184 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:21.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.344+0000 7fb157fff640 1 -- 172.21.15.49:0/2329630184 >> v2:172.21.15.49:3300/0 conn(0x7fb1580c88c0 msgr2=0x7fb1580c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:21.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.344+0000 7fb157fff640 1 --2- 172.21.15.49:0/2329630184 >> v2:172.21.15.49:3300/0 conn(0x7fb1580c88c0 0x7fb1580c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.344+0000 7fb157fff640 1 -- 172.21.15.49:0/2329630184 >> v1:172.21.15.106:6789/0 conn(0x7fb158070290 legacy=0x7fb158151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.344+0000 7fb157fff640 1 -- 172.21.15.49:0/2329630184 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb158157e60 con 0x7fb1580c8ca0 2023-11-18T21:00:21.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.352+0000 7fb157fff640 1 --2- 172.21.15.49:0/2329630184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1580c8ca0 0x7fb15806ed00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb15815ba50 tx=0x7fb15001c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f179be00996ef779 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.364+0000 7fb156ffd640 1 -- 172.21.15.49:0/2329630184 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1500a57d0 con 0x7fb1580c8ca0 2023-11-18T21:00:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.364+0000 7fb156ffd640 1 -- 172.21.15.49:0/2329630184 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1500a5930 con 0x7fb1580c8ca0 2023-11-18T21:00:21.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.364+0000 7fb156ffd640 1 -- 172.21.15.49:0/2329630184 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1500a5d00 con 0x7fb1580c8ca0 2023-11-18T21:00:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.364+0000 7fb15e05b640 1 -- 172.21.15.49:0/2329630184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1580c8ca0 msgr2=0x7fb15806ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.364+0000 7fb15e05b640 1 --2- 172.21.15.49:0/2329630184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1580c8ca0 0x7fb15806ed00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb15815ba50 tx=0x7fb15001c9f0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.364+0000 7fb15e05b640 1 -- 172.21.15.49:0/2329630184 shutdown_connections 2023-11-18T21:00:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.364+0000 7fb15e05b640 1 --2- 172.21.15.49:0/2329630184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1580c8ca0 0x7fb15806ed00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.364+0000 7fb15e05b640 1 --2- 172.21.15.49:0/2329630184 >> v2:172.21.15.49:3300/0 conn(0x7fb1580c88c0 0x7fb1580c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.364+0000 7fb15e05b640 1 -- 172.21.15.49:0/2329630184 >> 172.21.15.49:0/2329630184 conn(0x7fb158070900 msgr2=0x7fb158070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.364+0000 7fb15e05b640 1 -- 172.21.15.49:0/2329630184 shutdown_connections 2023-11-18T21:00:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.368+0000 7fb15e05b640 1 -- 172.21.15.49:0/2329630184 wait complete. 2023-11-18T21:00:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.368+0000 7fb15e05b640 1 Processor -- start 2023-11-18T21:00:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.368+0000 7fb15e05b640 1 -- start start 2023-11-18T21:00:21.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.368+0000 7fb15e05b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb158070290 0x7fb15806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.368+0000 7fb15e05b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1580c88c0 0x7fb158153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.368+0000 7fb15e05b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1580c8ca0 0x7fb1581541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.368+0000 7fb15e05b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb158153890 con 0x7fb1580c88c0 2023-11-18T21:00:21.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.372+0000 7fb15e05b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb158141370 con 0x7fb158070290 2023-11-18T21:00:21.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.372+0000 7fb15e05b640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb158152c10 con 0x7fb1580c8ca0 2023-11-18T21:00:21.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.372+0000 7fb1577fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb158070290 0x7fb15806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.372+0000 7fb157fff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1580c8ca0 0x7fb1581541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.372+0000 7fb1577fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb158070290 0x7fb15806bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:36088/0 (socket says 172.21.15.49:36088) 2023-11-18T21:00:21.373 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.372+0000 7fb1577fe640 1 -- 172.21.15.49:0/1046591804 learned_addr learned my addr 172.21.15.49:0/1046591804 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.384+0000 7fb157fff640 1 -- 172.21.15.49:0/1046591804 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb158070290 msgr2=0x7fb15806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.384+0000 7fb157fff640 1 --2- 172.21.15.49:0/1046591804 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb158070290 0x7fb15806bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.384+0000 7fb157fff640 1 -- 172.21.15.49:0/1046591804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1580c88c0 msgr2=0x7fb158153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.384+0000 7fb157fff640 1 --2- 172.21.15.49:0/1046591804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1580c88c0 0x7fb158153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.384+0000 7fb157fff640 1 -- 172.21.15.49:0/1046591804 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb150009b30 con 0x7fb1580c8ca0 2023-11-18T21:00:21.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.392+0000 7fb157fff640 1 --2- 172.21.15.49:0/1046591804 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1580c8ca0 0x7fb1581541f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1500ab000 tx=0x7fb150019790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.392+0000 7f974c8d2640 1 Processor -- start 2023-11-18T21:00:21.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.392+0000 7f974c8d2640 1 -- start start 2023-11-18T21:00:21.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.396+0000 7f974c8d2640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f974814fc10 0x7f97481559e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.396+0000 7f974c8d2640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974806afb0 con 0x7f97480c6960 2023-11-18T21:00:21.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.396+0000 7f974c8d2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97480c6ed0 con 0x7f97480c6540 2023-11-18T21:00:21.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.396+0000 7f974c8d2640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97480c7170 con 0x7f974814fc10 2023-11-18T21:00:21.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.396+0000 7f9745d9b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f97480c6540 0x7f97480cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:38794/0 (socket says 172.21.15.49:38794) 2023-11-18T21:00:21.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.396+0000 7f9745d9b640 1 -- 172.21.15.49:0/611797079 learned_addr learned my addr 172.21.15.49:0/611797079 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:21.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-18T21:00:21.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.400+0000 7f974659c640 1 --2- 172.21.15.49:0/611797079 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f974814fc10 0x7f97481559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.400+0000 7fb154ff9640 1 -- 172.21.15.49:0/1046591804 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1500bd070 con 0x7fb1580c8ca0 2023-11-18T21:00:21.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.404+0000 7fb154ff9640 1 -- 172.21.15.49:0/1046591804 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1500b8680 con 0x7fb1580c8ca0 2023-11-18T21:00:21.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.404+0000 7fb15e05b640 1 -- 172.21.15.49:0/1046591804 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1581428e0 con 0x7fb1580c8ca0 2023-11-18T21:00:21.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.404+0000 7fb15e05b640 1 -- 172.21.15.49:0/1046591804 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1581fa9f0 con 0x7fb1580c8ca0 2023-11-18T21:00:21.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.404+0000 7fb154ff9640 1 -- 172.21.15.49:0/1046591804 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1500a57d0 con 0x7fb1580c8ca0 2023-11-18T21:00:21.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.404+0000 7fb15e05b640 1 -- 172.21.15.49:0/1046591804 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13c005260 con 0x7fb1580c8ca0 2023-11-18T21:00:21.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.404+0000 7f69fbbac640 1 Processor -- start 2023-11-18T21:00:21.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.404+0000 7f974559a640 1 -- 172.21.15.49:0/611797079 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847986435 0 0) 0x7f97480c6ed0 con 0x7f97480c6540 2023-11-18T21:00:21.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.404+0000 7f974559a640 1 -- 172.21.15.49:0/611797079 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9730004640 con 0x7f97480c6540 2023-11-18T21:00:21.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.404+0000 7f69fbbac640 1 -- start start 2023-11-18T21:00:21.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.404+0000 7f69fbbac640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f69f40c1e60 0x7f69f40c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.404+0000 7f69fbbac640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f4072590 con 0x7f69f40717c0 2023-11-18T21:00:21.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.404+0000 7f69fbbac640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f40c68f0 con 0x7f69f4152b80 2023-11-18T21:00:21.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.404+0000 7f69fbbac640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f41591e0 con 0x7f69f40c1e60 2023-11-18T21:00:21.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.404+0000 7f4feffff640 1 -- 172.21.15.49:0/1496501906 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4fe001a400 con 0x7f4ff8151340 2023-11-18T21:00:21.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.408+0000 7f4feffff640 1 --2- 172.21.15.49:0/1496501906 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4fd80664c0 0x7f4fd8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.408+0000 7f4ff77fe640 1 --2- 172.21.15.49:0/1496501906 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4fd80664c0 0x7f4fd8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.408+0000 7f4ff77fe640 1 --2- 172.21.15.49:0/1496501906 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4fd80664c0 0x7f4fd8068980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0000f70 tx=0x7f4ff0007a90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f974559a640 1 -- 172.21.15.49:0/611797079 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2446553935 0 0) 0x7f9730004640 con 0x7f97480c6540 2023-11-18T21:00:21.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f974559a640 1 -- 172.21.15.49:0/611797079 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f974814fc10 msgr2=0x7f97481559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:21.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f974559a640 1 --2- 172.21.15.49:0/611797079 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f974814fc10 0x7f97481559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f974559a640 1 -- 172.21.15.49:0/611797079 >> v1:172.21.15.49:6789/0 conn(0x7f97480c6960 legacy=0x7f9748160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:21.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f974559a640 1 -- 172.21.15.49:0/611797079 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97480c28d0 con 0x7f97480c6540 2023-11-18T21:00:21.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f974559a640 1 -- 172.21.15.49:0/611797079 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7f973c001680 con 0x7f97480c6540 2023-11-18T21:00:21.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f974559a640 1 -- 172.21.15.49:0/611797079 >> v1:172.21.15.106:6789/0 conn(0x7f97480c6540 legacy=0x7f97480cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f974559a640 1 --2- 172.21.15.49:0/611797079 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f974814fc10 0x7f9730004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f974559a640 1 --2- 172.21.15.49:0/611797079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9730005040 0x7f97300058e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f974559a640 1 --2- 172.21.15.49:0/611797079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9730005e20 0x7f97300062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f974559a640 1 -- 172.21.15.49:0/611797079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97480c7170 con 0x7f9730005040 2023-11-18T21:00:21.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f974559a640 1 -- 172.21.15.49:0/611797079 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9730003450 con 0x7f9730005e20 2023-11-18T21:00:21.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f974559a640 1 -- 172.21.15.49:0/611797079 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9730003610 con 0x7f974814fc10 2023-11-18T21:00:21.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f69f9147640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f69f40c1e60 0x7f69f40c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f69f9147640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f69f40c1e60 0x7f69f40c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:36104/0 (socket says 172.21.15.49:36104) 2023-11-18T21:00:21.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.416+0000 7f69f9147640 1 -- 172.21.15.49:0/2591427177 learned_addr learned my addr 172.21.15.49:0/2591427177 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:21.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.428+0000 7f9746d9d640 1 --2- 172.21.15.49:0/611797079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9730005e20 0x7f97300062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.432+0000 7f9746d9d640 1 -- 172.21.15.49:0/611797079 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f974814fc10 msgr2=0x7f9730004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:21.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.432+0000 7f9746d9d640 1 --2- 172.21.15.49:0/611797079 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f974814fc10 0x7f9730004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.432+0000 7f9746d9d640 1 -- 172.21.15.49:0/611797079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9730005040 msgr2=0x7f97300058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:21.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.432+0000 7f9746d9d640 1 --2- 172.21.15.49:0/611797079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9730005040 0x7f97300058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.432+0000 7f9746d9d640 1 -- 172.21.15.49:0/611797079 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9730004640 con 0x7f9730005e20 2023-11-18T21:00:21.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.440+0000 7f69f9147640 1 -- 172.21.15.49:0/2591427177 >> v1:172.21.15.106:6789/0 conn(0x7f69f4152b80 legacy=0x7f69f4158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:21.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.440+0000 7f69f9147640 1 -- 172.21.15.49:0/2591427177 >> v1:172.21.15.49:6789/0 conn(0x7f69f40717c0 legacy=0x7f69f415fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:21.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.440+0000 7f69f9147640 1 -- 172.21.15.49:0/2591427177 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f40c6570 con 0x7f69f40c1e60 2023-11-18T21:00:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.444+0000 7f9746d9d640 1 --2- 172.21.15.49:0/611797079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9730005e20 0x7f97300062a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9740001d50 tx=0x7f974001c660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3c73d1a8bdf9278 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.448+0000 7f4feffff640 1 -- 172.21.15.49:0/1496501906 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4fe0021300 con 0x7f4ff8151340 2023-11-18T21:00:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.448+0000 7f5303228640 1 Processor -- start 2023-11-18T21:00:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.448+0000 7f5303228640 1 -- start start 2023-11-18T21:00:21.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.448+0000 7f4feffff640 1 -- 172.21.15.49:0/1496501906 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fe0051ae0 con 0x7f4ff8151340 2023-11-18T21:00:21.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.448+0000 7f69f9147640 1 --2- 172.21.15.49:0/2591427177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69f40c1e60 0x7f69f40c77e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009bd0 tx=0x7f69e401dea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a391c65ae0a71fa server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.448+0000 7f5303228640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f52fc13d0c0 0x7f52fc15a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.448+0000 7f5303228640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f52fc15ae80 0x7f52fc0cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.448+0000 7f5303228640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52fc13d4a0 con 0x7f52fc06a5f0 2023-11-18T21:00:21.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.448+0000 7f5303228640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52fc157350 con 0x7f52fc15ae80 2023-11-18T21:00:21.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.448+0000 7f5303228640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc158320 con 0x7f52fc13d0c0 2023-11-18T21:00:21.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.464+0000 7f974559a640 1 -- 172.21.15.49:0/611797079 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740003ba0 con 0x7f9730005e20 2023-11-18T21:00:21.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.464+0000 7f974559a640 1 -- 172.21.15.49:0/611797079 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9740003d00 con 0x7f9730005e20 2023-11-18T21:00:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.464+0000 7f974559a640 1 -- 172.21.15.49:0/611797079 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97400052b0 con 0x7f9730005e20 2023-11-18T21:00:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.464+0000 7f974c8d2640 1 -- 172.21.15.49:0/611797079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9730005e20 msgr2=0x7f97300062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.464+0000 7f974c8d2640 1 --2- 172.21.15.49:0/611797079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9730005e20 0x7f97300062a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9740001d50 tx=0x7f974001c660 comp rx=0 tx=0).stop 2023-11-18T21:00:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.464+0000 7f9746d9d640 1 -- 172.21.15.49:0/611797079 reap_dead start 2023-11-18T21:00:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.464+0000 7f974c8d2640 1 -- 172.21.15.49:0/611797079 shutdown_connections 2023-11-18T21:00:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.464+0000 7f974c8d2640 1 -- 172.21.15.49:0/611797079 >> 172.21.15.49:0/611797079 conn(0x7f974806d220 msgr2=0x7f974806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.464+0000 7f974c8d2640 1 -- 172.21.15.49:0/611797079 shutdown_connections 2023-11-18T21:00:21.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.464+0000 7f974c8d2640 1 -- 172.21.15.49:0/611797079 wait complete. 2023-11-18T21:00:21.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.464+0000 7f974c8d2640 1 Processor -- start 2023-11-18T21:00:21.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.464+0000 7f974c8d2640 1 -- start start 2023-11-18T21:00:21.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.468+0000 7f53017c5640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f52fc15ae80 0x7f52fc0cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.468+0000 7f974c8d2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9730005e20 0x7f9748149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.468+0000 7f974c8d2640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9748155ab0 0x7f9748153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.468+0000 7f974c8d2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9748153850 0x7f9748159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.468+0000 7f974c8d2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974814a410 con 0x7f9730005e20 2023-11-18T21:00:21.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.468+0000 7f974c8d2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748154530 con 0x7f9748153850 2023-11-18T21:00:21.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.468+0000 7f974c8d2640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97481eabe0 con 0x7f9748155ab0 2023-11-18T21:00:21.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.472+0000 7f53017c5640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f52fc15ae80 0x7f52fc0cb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:36118/0 (socket says 172.21.15.49:36118) 2023-11-18T21:00:21.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.472+0000 7f53017c5640 1 -- 172.21.15.49:0/2909818287 learned_addr learned my addr 172.21.15.49:0/2909818287 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:21.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.480+0000 7f53017c5640 1 -- 172.21.15.49:0/2909818287 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f52fc13d0c0 msgr2=0x7f52fc15a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:21.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.480+0000 7f53017c5640 1 --2- 172.21.15.49:0/2909818287 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f52fc13d0c0 0x7f52fc15a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.480+0000 7f53017c5640 1 -- 172.21.15.49:0/2909818287 >> v1:172.21.15.106:6789/0 conn(0x7f52fc06a5f0 legacy=0x7f52fc0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:21.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.480+0000 7f53017c5640 1 -- 172.21.15.49:0/2909818287 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0cbf50 con 0x7f52fc15ae80 2023-11-18T21:00:21.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.484+0000 7f1c74717640 1 -- 172.21.15.49:0/3349905095 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1c6c1f2560 con 0x7f1c6c0c5560 2023-11-18T21:00:21.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.488+0000 7f974659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9730005e20 0x7f9748149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.488+0000 7f69f8946640 1 -- 172.21.15.49:0/2591427177 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e40a6c50 con 0x7f69f40c1e60 2023-11-18T21:00:21.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.488+0000 7f69f8946640 1 -- 172.21.15.49:0/2591427177 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e40a6db0 con 0x7f69f40c1e60 2023-11-18T21:00:21.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.488+0000 7f69f8946640 1 -- 172.21.15.49:0/2591427177 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e40ae610 con 0x7f69f40c1e60 2023-11-18T21:00:21.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.488+0000 7f974659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9730005e20 0x7f9748149ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38460/0 (socket says 172.21.15.49:38460) 2023-11-18T21:00:21.490 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.488+0000 7f974659c640 1 -- 172.21.15.49:0/515760880 learned_addr learned my addr 172.21.15.49:0/515760880 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:21.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 -- 172.21.15.49:0/2591427177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69f40c1e60 msgr2=0x7f69f40c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 --2- 172.21.15.49:0/2591427177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69f40c1e60 0x7f69f40c77e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009bd0 tx=0x7f69e401dea0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 -- 172.21.15.49:0/2591427177 shutdown_connections 2023-11-18T21:00:21.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 --2- 172.21.15.49:0/2591427177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69f40c1e60 0x7f69f40c77e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 -- 172.21.15.49:0/2591427177 >> 172.21.15.49:0/2591427177 conn(0x7f69f406a560 msgr2=0x7f69f406a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:21.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f53017c5640 1 --2- 172.21.15.49:0/2909818287 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52fc15ae80 0x7f52fc0cb2c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009e50 tx=0x7f52f401c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=643406fc969ee984 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 -- 172.21.15.49:0/2591427177 shutdown_connections 2023-11-18T21:00:21.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 -- 172.21.15.49:0/2591427177 wait complete. 2023-11-18T21:00:21.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 Processor -- start 2023-11-18T21:00:21.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 -- start start 2023-11-18T21:00:21.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69f40717c0 0x7f69f40ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69f40c1e60 0x7f69f40c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69f4152b80 0x7f69f4148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f4158f10 con 0x7f69f4152b80 2023-11-18T21:00:21.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f4150070 con 0x7f69f40c1e60 2023-11-18T21:00:21.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.492+0000 7f69fbbac640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f4158670 con 0x7f69f40717c0 2023-11-18T21:00:21.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.496+0000 7f974659c640 1 -- 172.21.15.49:0/515760880 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9748155ab0 msgr2=0x7f9748153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.496+0000 7f974659c640 1 --2- 172.21.15.49:0/515760880 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9748155ab0 0x7f9748153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.496+0000 7f974659c640 1 -- 172.21.15.49:0/515760880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9748153850 msgr2=0x7f9748159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.496+0000 7f974659c640 1 --2- 172.21.15.49:0/515760880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9748153850 0x7f9748159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.497 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.496+0000 7f974659c640 1 -- 172.21.15.49:0/515760880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97481eaec0 con 0x7f9730005e20 2023-11-18T21:00:21.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.504+0000 7f974659c640 1 --2- 172.21.15.49:0/515760880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9730005e20 0x7f9748149ed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f973800e7c0 tx=0x7f973800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.508+0000 7f69f9147640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69f40c1e60 0x7f69f40c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.508+0000 7f69f9147640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69f40c1e60 0x7f69f40c9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:36136/0 (socket says 172.21.15.49:36136) 2023-11-18T21:00:21.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.508+0000 7f69f9147640 1 -- 172.21.15.49:0/3624889198 learned_addr learned my addr 172.21.15.49:0/3624889198 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:21.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.508+0000 7f69fa149640 1 --2- 172.21.15.49:0/3624889198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69f4152b80 0x7f69f4148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f9736ffd640 1 -- 172.21.15.49:0/515760880 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800eed0 con 0x7f9730005e20 2023-11-18T21:00:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f9736ffd640 1 -- 172.21.15.49:0/515760880 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973800c8c0 con 0x7f9730005e20 2023-11-18T21:00:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f9736ffd640 1 -- 172.21.15.49:0/515760880 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800cc50 con 0x7f9730005e20 2023-11-18T21:00:21.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f974c8d2640 1 -- 172.21.15.49:0/515760880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97481eb1a0 con 0x7f9730005e20 2023-11-18T21:00:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f52fb7fe640 1 -- 172.21.15.49:0/2909818287 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40a5820 con 0x7f52fc15ae80 2023-11-18T21:00:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f52fb7fe640 1 -- 172.21.15.49:0/2909818287 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f40a5980 con 0x7f52fc15ae80 2023-11-18T21:00:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f52fb7fe640 1 -- 172.21.15.49:0/2909818287 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40a5d10 con 0x7f52fc15ae80 2023-11-18T21:00:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f974c8d2640 1 -- 172.21.15.49:0/515760880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97481eb760 con 0x7f9730005e20 2023-11-18T21:00:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f974c8d2640 1 -- 172.21.15.49:0/515760880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9748073e70 con 0x7f9730005e20 2023-11-18T21:00:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f5303228640 1 -- 172.21.15.49:0/2909818287 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52fc15ae80 msgr2=0x7f52fc0cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f5303228640 1 --2- 172.21.15.49:0/2909818287 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52fc15ae80 0x7f52fc0cb2c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009e50 tx=0x7f52f401c9a0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f5303228640 1 -- 172.21.15.49:0/2909818287 shutdown_connections 2023-11-18T21:00:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f5303228640 1 --2- 172.21.15.49:0/2909818287 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52fc15ae80 0x7f52fc0cb2c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f5303228640 1 --2- 172.21.15.49:0/2909818287 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f52fc13d0c0 0x7f52fc15a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f5303228640 1 -- 172.21.15.49:0/2909818287 >> 172.21.15.49:0/2909818287 conn(0x7f52fc06d200 msgr2=0x7f52fc06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f5303228640 1 -- 172.21.15.49:0/2909818287 shutdown_connections 2023-11-18T21:00:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.512+0000 7f5303228640 1 -- 172.21.15.49:0/2909818287 wait complete. 2023-11-18T21:00:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.516+0000 7f5303228640 1 Processor -- start 2023-11-18T21:00:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.516+0000 7f5303228640 1 -- start start 2023-11-18T21:00:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.516+0000 7f69fa149640 1 -- 172.21.15.49:0/3624889198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69f40717c0 msgr2=0x7f69f40ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.516+0000 7f69fa149640 1 --2- 172.21.15.49:0/3624889198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69f40717c0 0x7f69f40ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.516+0000 7f69fa149640 1 -- 172.21.15.49:0/3624889198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69f40c1e60 msgr2=0x7f69f40c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.516+0000 7f69fa149640 1 --2- 172.21.15.49:0/3624889198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69f40c1e60 0x7f69f40c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.516+0000 7f69fa149640 1 -- 172.21.15.49:0/3624889198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e4009830 con 0x7f69f4152b80 2023-11-18T21:00:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.516+0000 7f5303228640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52fc06a5f0 0x7f52fc13b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.516+0000 7f5303228640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f52fc13d0c0 0x7f52fc1f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.516+0000 7f5303228640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52fc15ae80 0x7f52fc159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.516+0000 7f5303228640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0c3830 con 0x7f52fc06a5f0 2023-11-18T21:00:21.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.516+0000 7f5303228640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc1f5c70 con 0x7f52fc15ae80 2023-11-18T21:00:21.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.516+0000 7f5303228640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0ca3d0 con 0x7f52fc13d0c0 2023-11-18T21:00:21.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.532+0000 7fd7359b2640 1 Processor -- start 2023-11-18T21:00:21.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.532+0000 7fd7359b2640 1 -- start start 2023-11-18T21:00:21.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.532+0000 7fd7359b2640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7300cbd50 0x7fd7300c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.532+0000 7fd7359b2640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd7300cc130 0x7fd730156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.532+0000 7fd7359b2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7300c1570 con 0x7fd7300c0ee0 2023-11-18T21:00:21.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.532+0000 7fd7359b2640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7300c1370 con 0x7fd7300cc130 2023-11-18T21:00:21.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.532+0000 7fd7359b2640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7300c1810 con 0x7fd7300cbd50 2023-11-18T21:00:21.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.536+0000 7f1c62ffd640 1 -- 172.21.15.49:0/3349905095 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c680b0070 con 0x7f1c6c0c5560 2023-11-18T21:00:21.535 INFO:teuthology.orchestra.run.smithi049.stdout:60129542167 2023-11-18T21:00:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.536+0000 7f1c74717640 1 -- 172.21.15.49:0/3349905095 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1c500664c0 msgr2=0x7f1c50068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.536+0000 7f1c74717640 1 --2- 172.21.15.49:0/3349905095 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1c500664c0 0x7f1c50068980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c005890 tx=0x7f1c5c009040 comp rx=0 tx=0).stop 2023-11-18T21:00:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.536+0000 7f1c74717640 1 -- 172.21.15.49:0/3349905095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c6c0c5560 msgr2=0x7f1c6c13f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.536+0000 7f1c74717640 1 --2- 172.21.15.49:0/3349905095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c6c0c5560 0x7f1c6c13f680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1c6801aac0 tx=0x7f1c680191b0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.536+0000 7f1c74717640 1 -- 172.21.15.49:0/3349905095 shutdown_connections 2023-11-18T21:00:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.536+0000 7f1c74717640 1 --2- 172.21.15.49:0/3349905095 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1c500664c0 0x7f1c50068980 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.536+0000 7f1c74717640 1 --2- 172.21.15.49:0/3349905095 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c6c0c7440 0x7f1c6c142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.536+0000 7f1c74717640 1 --2- 172.21.15.49:0/3349905095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c6c0c5560 0x7f1c6c13f680 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.536+0000 7f1c74717640 1 --2- 172.21.15.49:0/3349905095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c6c0c5180 0x7f1c6c0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.536+0000 7f1c74717640 1 -- 172.21.15.49:0/3349905095 >> 172.21.15.49:0/3349905095 conn(0x7f1c6c06d220 msgr2=0x7f1c6c14e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.536+0000 7f1c74717640 1 -- 172.21.15.49:0/3349905095 shutdown_connections 2023-11-18T21:00:21.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.536+0000 7f1c74717640 1 -- 172.21.15.49:0/3349905095 wait complete. 2023-11-18T21:00:21.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.540+0000 7f53017c5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52fc15ae80 0x7f52fc159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.540+0000 7f53017c5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52fc15ae80 0x7f52fc159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:36144/0 (socket says 172.21.15.49:36144) 2023-11-18T21:00:21.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.540+0000 7f53017c5640 1 -- 172.21.15.49:0/4173752235 learned_addr learned my addr 172.21.15.49:0/4173752235 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:21.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.552+0000 7f53017c5640 1 -- 172.21.15.49:0/4173752235 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f52fc13d0c0 msgr2=0x7f52fc1f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.552+0000 7f53017c5640 1 --2- 172.21.15.49:0/4173752235 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f52fc13d0c0 0x7f52fc1f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.552+0000 7f53017c5640 1 -- 172.21.15.49:0/4173752235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52fc06a5f0 msgr2=0x7f52fc13b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.552+0000 7f53017c5640 1 --2- 172.21.15.49:0/4173752235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52fc06a5f0 0x7f52fc13b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.552+0000 7f53017c5640 1 -- 172.21.15.49:0/4173752235 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f4009b30 con 0x7f52fc15ae80 2023-11-18T21:00:21.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542167 got 60129542167 for osd.4 2023-11-18T21:00:21.555 DEBUG:teuthology.parallel:result is None 2023-11-18T21:00:21.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.556+0000 7f3e13deb640 1 -- 172.21.15.49:0/3467555465 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3e0c158130 con 0x7f3e0c0cb8a0 2023-11-18T21:00:21.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.556+0000 7f53017c5640 1 --2- 172.21.15.49:0/4173752235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52fc15ae80 0x7f52fc159770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f52f40af040 tx=0x7f52f4019740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.564+0000 7fd72f7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd7300c0ee0 0x7fd7300c6820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:38826/0 (socket says 172.21.15.49:38826) 2023-11-18T21:00:21.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.564+0000 7fd72f7fe640 1 -- 172.21.15.49:0/34569121 learned_addr learned my addr 172.21.15.49:0/34569121 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:21.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.568+0000 7f52f97fa640 1 -- 172.21.15.49:0/4173752235 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40b8880 con 0x7f52fc15ae80 2023-11-18T21:00:21.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.568+0000 7f52f97fa640 1 -- 172.21.15.49:0/4173752235 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f40b89e0 con 0x7f52fc15ae80 2023-11-18T21:00:21.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.568+0000 7f52f97fa640 1 -- 172.21.15.49:0/4173752235 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40b8d90 con 0x7f52fc15ae80 2023-11-18T21:00:21.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.568+0000 7f5303228640 1 -- 172.21.15.49:0/4173752235 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52fc0ca690 con 0x7f52fc15ae80 2023-11-18T21:00:21.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.568+0000 7f5303228640 1 -- 172.21.15.49:0/4173752235 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52fc0cac50 con 0x7f52fc15ae80 2023-11-18T21:00:21.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.568+0000 7fd72e7fc640 1 -- 172.21.15.49:0/34569121 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801756684 0 0) 0x7fd7300c1570 con 0x7fd7300c0ee0 2023-11-18T21:00:21.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.572+0000 7fd72e7fc640 1 -- 172.21.15.49:0/34569121 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd71c003530 con 0x7fd7300c0ee0 2023-11-18T21:00:21.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.572+0000 7f5303228640 1 -- 172.21.15.49:0/4173752235 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52fc073e70 con 0x7f52fc15ae80 2023-11-18T21:00:21.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.620+0000 7f4ffde84640 1 -- 172.21.15.49:0/1496501906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4ff814cdc0 con 0x7f4ff8151340 2023-11-18T21:00:21.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.704+0000 7fb154ff9640 1 -- 172.21.15.49:0/1046591804 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1500b8a30 con 0x7fb1580c8ca0 2023-11-18T21:00:21.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.704+0000 7fb154ff9640 1 --2- 172.21.15.49:0/1046591804 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb138066470 0x7fb138068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.704+0000 7fb1577fe640 1 --2- 172.21.15.49:0/1046591804 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb138066470 0x7fb138068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.704+0000 7fb1577fe640 1 --2- 172.21.15.49:0/1046591804 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb138066470 0x7fb138068930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb148009a50 tx=0x7fb148009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.708+0000 7fb154ff9640 1 -- 172.21.15.49:0/1046591804 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb1500f0a70 con 0x7fb1580c8ca0 2023-11-18T21:00:21.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.720+0000 7fb154ff9640 1 -- 172.21.15.49:0/1046591804 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1500f0140 con 0x7fb1580c8ca0 2023-11-18T21:00:21.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.724+0000 7fd72effd640 1 --2- 172.21.15.49:0/34569121 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7300cbd50 0x7fd7300c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.736+0000 7fd72effd640 1 -- 172.21.15.49:0/34569121 >> v2:172.21.15.49:3300/0 conn(0x7fd7300cc130 msgr2=0x7fd730156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:21.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.736+0000 7fd72effd640 1 --2- 172.21.15.49:0/34569121 >> v2:172.21.15.49:3300/0 conn(0x7fd7300cc130 0x7fd730156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.736+0000 7fd72effd640 1 -- 172.21.15.49:0/34569121 >> v1:172.21.15.106:6789/0 conn(0x7fd7300c0ee0 legacy=0x7fd7300c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.736+0000 7fd72effd640 1 -- 172.21.15.49:0/34569121 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7300c1af0 con 0x7fd7300cbd50 2023-11-18T21:00:21.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.736+0000 7f3e0a7fc640 1 -- 172.21.15.49:0/3467555465 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e0c158130 con 0x7f3e0c0cb8a0 2023-11-18T21:00:21.737 INFO:teuthology.orchestra.run.smithi049.stdout:64424509464 2023-11-18T21:00:21.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.740+0000 7f3e13deb640 1 -- 172.21.15.49:0/3467555465 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3df80664c0 msgr2=0x7f3df8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.740+0000 7f3e13deb640 1 --2- 172.21.15.49:0/3467555465 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3df80664c0 0x7f3df8068980 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0b1000 tx=0x7f3dfc004ac0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.740+0000 7f3e13deb640 1 -- 172.21.15.49:0/3467555465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e0c0cb8a0 msgr2=0x7f3e0c0c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.740+0000 7f3e13deb640 1 --2- 172.21.15.49:0/3467555465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e0c0cb8a0 0x7f3e0c0c3a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000c370 tx=0x7f3e0000c830 comp rx=0 tx=0).stop 2023-11-18T21:00:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.740+0000 7f3e13deb640 1 -- 172.21.15.49:0/3467555465 shutdown_connections 2023-11-18T21:00:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.740+0000 7f3e13deb640 1 --2- 172.21.15.49:0/3467555465 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3df80664c0 0x7f3df8068980 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.740+0000 7f3e13deb640 1 --2- 172.21.15.49:0/3467555465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e0c1512c0 0x7f3e0c0c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.740+0000 7f3e13deb640 1 --2- 172.21.15.49:0/3467555465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e0c0cb8a0 0x7f3e0c0c3a80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.740+0000 7f3e13deb640 1 --2- 172.21.15.49:0/3467555465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e0c0c6370 0x7f3e0c155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.740+0000 7f3e13deb640 1 -- 172.21.15.49:0/3467555465 >> 172.21.15.49:0/3467555465 conn(0x7f3e0c06b670 msgr2=0x7f3e0c06ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.740+0000 7f3e13deb640 1 -- 172.21.15.49:0/3467555465 shutdown_connections 2023-11-18T21:00:21.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.740+0000 7f3e13deb640 1 -- 172.21.15.49:0/3467555465 wait complete. 2023-11-18T21:00:21.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.740+0000 7fd72effd640 1 --2- 172.21.15.49:0/34569121 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7300cbd50 0x7fd7300c8490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7200097c0 tx=0x7fd72001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5fdb05ccc980e49 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.748+0000 7fd72e7fc640 1 -- 172.21.15.49:0/34569121 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7200ab600 con 0x7fd7300cbd50 2023-11-18T21:00:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.748+0000 7fd72e7fc640 1 -- 172.21.15.49:0/34569121 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7200a7050 con 0x7fd7300cbd50 2023-11-18T21:00:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.748+0000 7fd72e7fc640 1 -- 172.21.15.49:0/34569121 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7200ab980 con 0x7fd7300cbd50 2023-11-18T21:00:21.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.748+0000 7fd7359b2640 1 -- 172.21.15.49:0/34569121 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7300cbd50 msgr2=0x7fd7300c8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.748+0000 7fd7359b2640 1 --2- 172.21.15.49:0/34569121 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7300cbd50 0x7fd7300c8490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7200097c0 tx=0x7fd72001c3f0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.748+0000 7fd7359b2640 1 -- 172.21.15.49:0/34569121 shutdown_connections 2023-11-18T21:00:21.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.748+0000 7fd7359b2640 1 --2- 172.21.15.49:0/34569121 >> v2:172.21.15.49:3300/0 conn(0x7fd7300cc130 0x7fd730156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.748+0000 7fd7359b2640 1 --2- 172.21.15.49:0/34569121 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7300cbd50 0x7fd7300c8490 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.748+0000 7fd7359b2640 1 -- 172.21.15.49:0/34569121 >> 172.21.15.49:0/34569121 conn(0x7fd730070160 msgr2=0x7fd73006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:21.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.748+0000 7fd7359b2640 1 -- 172.21.15.49:0/34569121 shutdown_connections 2023-11-18T21:00:21.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.748+0000 7fd7359b2640 1 -- 172.21.15.49:0/34569121 wait complete. 2023-11-18T21:00:21.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.748+0000 7fd7359b2640 1 Processor -- start 2023-11-18T21:00:21.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.752+0000 7fd7359b2640 1 -- start start 2023-11-18T21:00:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.752+0000 7fd7359b2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7300c0ee0 0x7fd730145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.752+0000 7fd7359b2640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7300cbd50 0x7fd73015ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.752+0000 7fd7359b2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7300cc130 0x7fd7301f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.752+0000 7fd7359b2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7300c5150 con 0x7fd7300cc130 2023-11-18T21:00:21.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.752+0000 7fd7359b2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7301461a0 con 0x7fd7300c0ee0 2023-11-18T21:00:21.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.752+0000 7fd7359b2640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7301f9e30 con 0x7fd7300cbd50 2023-11-18T21:00:21.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.752+0000 7fd727fff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7300cbd50 0x7fd73015ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.752+0000 7fd727fff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7300cbd50 0x7fd73015ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:47110/0 (socket says 172.21.15.49:47110) 2023-11-18T21:00:21.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.752+0000 7fd727fff640 1 -- 172.21.15.49:0/547932325 learned_addr learned my addr 172.21.15.49:0/547932325 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:21.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.756+0000 7fd727fff640 1 -- 172.21.15.49:0/547932325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7300c0ee0 msgr2=0x7fd730145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.756+0000 7fd727fff640 1 --2- 172.21.15.49:0/547932325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7300c0ee0 0x7fd730145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.756+0000 7fd727fff640 1 -- 172.21.15.49:0/547932325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7300cc130 msgr2=0x7fd7301f5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.756+0000 7fd727fff640 1 --2- 172.21.15.49:0/547932325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7300cc130 0x7fd7301f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.756+0000 7fd727fff640 1 -- 172.21.15.49:0/547932325 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd720009420 con 0x7fd7300cbd50 2023-11-18T21:00:21.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.760+0000 7fd727fff640 1 --2- 172.21.15.49:0/547932325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7300cbd50 0x7fd73015ffa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd71800b420 tx=0x7fd71800b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509464 got 64424509464 for osd.3 2023-11-18T21:00:21.766 DEBUG:teuthology.parallel:result is None 2023-11-18T21:00:21.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.764+0000 7fd72cff9640 1 -- 172.21.15.49:0/547932325 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718011830 con 0x7fd7300cbd50 2023-11-18T21:00:21.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.768+0000 7fd7359b2640 1 -- 172.21.15.49:0/547932325 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd730144c80 con 0x7fd7300cbd50 2023-11-18T21:00:21.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.768+0000 7fd7359b2640 1 -- 172.21.15.49:0/547932325 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7301f97e0 con 0x7fd7300cbd50 2023-11-18T21:00:21.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.768+0000 7fd72cff9640 1 -- 172.21.15.49:0/547932325 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7180119b0 con 0x7fd7300cbd50 2023-11-18T21:00:21.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.768+0000 7fd72cff9640 1 -- 172.21.15.49:0/547932325 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718011d60 con 0x7fd7300cbd50 2023-11-18T21:00:21.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.768+0000 7fd7359b2640 1 -- 172.21.15.49:0/547932325 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd714005260 con 0x7fd7300cbd50 2023-11-18T21:00:21.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.816+0000 7f9736ffd640 1 -- 172.21.15.49:0/515760880 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9738013470 con 0x7f9730005e20 2023-11-18T21:00:21.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.816+0000 7f9736ffd640 1 --2- 172.21.15.49:0/515760880 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f97280664f0 0x7f97280689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.816+0000 7f9745d9b640 1 --2- 172.21.15.49:0/515760880 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f97280664f0 0x7f97280689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.816+0000 7f9745d9b640 1 --2- 172.21.15.49:0/515760880 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f97280664f0 0x7f97280689b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97480cbd00 tx=0x7f973c001590 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.832+0000 7f9736ffd640 1 -- 172.21.15.49:0/515760880 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9738055f20 con 0x7f9730005e20 2023-11-18T21:00:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.832+0000 7f9736ffd640 1 -- 172.21.15.49:0/515760880 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9738051b60 con 0x7f9730005e20 2023-11-18T21:00:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.832+0000 7f69fa149640 1 --2- 172.21.15.49:0/3624889198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69f4152b80 0x7f69f4148cf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00c410 tx=0x7f69ec00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.880+0000 7f52f97fa640 1 -- 172.21.15.49:0/4173752235 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52f40ca430 con 0x7f52fc15ae80 2023-11-18T21:00:21.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.880+0000 7f52f97fa640 1 --2- 172.21.15.49:0/4173752235 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f52e00664c0 0x7f52e0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.880+0000 7f5300fc4640 1 --2- 172.21.15.49:0/4173752235 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f52e00664c0 0x7f52e0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.880+0000 7f5300fc4640 1 --2- 172.21.15.49:0/4173752235 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f52e00664c0 0x7f52e0068980 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009730 tx=0x7f52f0006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.884+0000 7f52f97fa640 1 -- 172.21.15.49:0/4173752235 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f52f40f0dd0 con 0x7f52fc15ae80 2023-11-18T21:00:21.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.884+0000 7f4feffff640 1 -- 172.21.15.49:0/1496501906 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4fe0015020 con 0x7f4ff8151340 2023-11-18T21:00:21.886 INFO:teuthology.orchestra.run.smithi049.stdout:64424509463 2023-11-18T21:00:21.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.888+0000 7f4ffde84640 1 -- 172.21.15.49:0/1496501906 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4fd80664c0 msgr2=0x7f4fd8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.888+0000 7f4ffde84640 1 --2- 172.21.15.49:0/1496501906 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4fd80664c0 0x7f4fd8068980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0000f70 tx=0x7f4ff0007a90 comp rx=0 tx=0).stop 2023-11-18T21:00:21.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.888+0000 7f4ffde84640 1 -- 172.21.15.49:0/1496501906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff8151340 msgr2=0x7f4ff814b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:21.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.888+0000 7f4ffde84640 1 --2- 172.21.15.49:0/1496501906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff8151340 0x7f4ff814b880 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000b580 tx=0x7f4fe000ba40 comp rx=0 tx=0).stop 2023-11-18T21:00:21.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.888+0000 7f4ffde84640 1 -- 172.21.15.49:0/1496501906 shutdown_connections 2023-11-18T21:00:21.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.888+0000 7f4ffde84640 1 --2- 172.21.15.49:0/1496501906 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4fd80664c0 0x7f4fd8068980 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.888+0000 7f4ffde84640 1 --2- 172.21.15.49:0/1496501906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ff8151720 0x7f4ff814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.888+0000 7f4ffde84640 1 --2- 172.21.15.49:0/1496501906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff8151340 0x7f4ff814b880 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.888+0000 7f4ffde84640 1 --2- 172.21.15.49:0/1496501906 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ff80c40e0 0x7f4ff8149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:21.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.888+0000 7f4ffde84640 1 -- 172.21.15.49:0/1496501906 >> 172.21.15.49:0/1496501906 conn(0x7f4ff806c6a0 msgr2=0x7f4ff80c7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:21.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.888+0000 7f4ffde84640 1 -- 172.21.15.49:0/1496501906 shutdown_connections 2023-11-18T21:00:21.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.888+0000 7f4ffde84640 1 -- 172.21.15.49:0/1496501906 wait complete. 2023-11-18T21:00:21.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.896+0000 7f52f97fa640 1 -- 172.21.15.49:0/4173752235 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52f40ed110 con 0x7f52fc15ae80 2023-11-18T21:00:21.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509463 for osd.0 2023-11-18T21:00:21.907 DEBUG:teuthology.parallel:result is None 2023-11-18T21:00:21.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.912+0000 7fb15e05b640 1 -- 172.21.15.49:0/1046591804 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb13c0057e0 con 0x7fb1580c8ca0 2023-11-18T21:00:21.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.916+0000 7f69f27fc640 1 -- 172.21.15.49:0/3624889198 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec003600 con 0x7f69f4152b80 2023-11-18T21:00:21.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.916+0000 7f69f27fc640 1 -- 172.21.15.49:0/3624889198 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec003760 con 0x7f69f4152b80 2023-11-18T21:00:21.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.916+0000 7f69fbbac640 1 -- 172.21.15.49:0/3624889198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f4158950 con 0x7f69f4152b80 2023-11-18T21:00:21.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.916+0000 7f69f27fc640 1 -- 172.21.15.49:0/3624889198 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec003b50 con 0x7f69f4152b80 2023-11-18T21:00:21.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.916+0000 7f69fbbac640 1 -- 172.21.15.49:0/3624889198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f40c8890 con 0x7f69f4152b80 2023-11-18T21:00:21.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.916+0000 7f69fbbac640 1 -- 172.21.15.49:0/3624889198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d4005260 con 0x7f69f4152b80 2023-11-18T21:00:21.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.936+0000 7f69f27fc640 1 -- 172.21.15.49:0/3624889198 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69ec003cb0 con 0x7f69f4152b80 2023-11-18T21:00:21.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.936+0000 7f69f27fc640 1 --2- 172.21.15.49:0/3624889198 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f69e0066470 0x7f69e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:21.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.936+0000 7f69f9948640 1 --2- 172.21.15.49:0/3624889198 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f69e0066470 0x7f69e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:21.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:21.940+0000 7f69f9948640 1 --2- 172.21.15.49:0/3624889198 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f69e0066470 0x7f69e0068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009650 tx=0x7f69e8006bb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:21.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.000+0000 7f974c8d2640 1 -- 172.21.15.49:0/515760880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f974814a580 con 0x7f9730005e20 2023-11-18T21:00:22.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.060+0000 7f5303228640 1 -- 172.21.15.49:0/4173752235 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f52fc13a480 con 0x7f52fc15ae80 2023-11-18T21:00:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.068+0000 7f52f97fa640 1 -- 172.21.15.49:0/4173752235 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f52f40bc090 con 0x7f52fc15ae80 2023-11-18T21:00:22.070 INFO:teuthology.orchestra.run.smithi049.stdout:64424509464 2023-11-18T21:00:22.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7f5303228640 1 -- 172.21.15.49:0/4173752235 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f52e00664c0 msgr2=0x7f52e0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7f5303228640 1 --2- 172.21.15.49:0/4173752235 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f52e00664c0 0x7f52e0068980 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009730 tx=0x7f52f0006ca0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7f5303228640 1 -- 172.21.15.49:0/4173752235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52fc15ae80 msgr2=0x7f52fc159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7f5303228640 1 --2- 172.21.15.49:0/4173752235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52fc15ae80 0x7f52fc159770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f52f40af040 tx=0x7f52f4019740 comp rx=0 tx=0).stop 2023-11-18T21:00:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7f5303228640 1 -- 172.21.15.49:0/4173752235 shutdown_connections 2023-11-18T21:00:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7f5303228640 1 --2- 172.21.15.49:0/4173752235 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f52e00664c0 0x7f52e0068980 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7f5303228640 1 --2- 172.21.15.49:0/4173752235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52fc15ae80 0x7f52fc159770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7f5303228640 1 --2- 172.21.15.49:0/4173752235 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f52fc13d0c0 0x7f52fc1f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7f5303228640 1 --2- 172.21.15.49:0/4173752235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52fc06a5f0 0x7f52fc13b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7f5303228640 1 -- 172.21.15.49:0/4173752235 >> 172.21.15.49:0/4173752235 conn(0x7f52fc06d200 msgr2=0x7f52fc154f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7f5303228640 1 -- 172.21.15.49:0/4173752235 shutdown_connections 2023-11-18T21:00:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7f5303228640 1 -- 172.21.15.49:0/4173752235 wait complete. 2023-11-18T21:00:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7fd72cff9640 1 -- 172.21.15.49:0/547932325 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd71801b460 con 0x7fd7300cbd50 2023-11-18T21:00:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7fd72cff9640 1 --2- 172.21.15.49:0/547932325 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd7100664c0 0x7fd710068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.072+0000 7fd72effd640 1 --2- 172.21.15.49:0/547932325 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd7100664c0 0x7fd710068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:22.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.076+0000 7fd72effd640 1 --2- 172.21.15.49:0/547932325 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd7100664c0 0x7fd710068980 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd7200ad000 tx=0x7fd720008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:22.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.084+0000 7fd72cff9640 1 -- 172.21.15.49:0/547932325 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd718055f50 con 0x7fd7300cbd50 2023-11-18T21:00:22.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509464 got 64424509464 for osd.2 2023-11-18T21:00:22.088 DEBUG:teuthology.parallel:result is None 2023-11-18T21:00:22.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.116+0000 7fd72cff9640 1 -- 172.21.15.49:0/547932325 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd718051b90 con 0x7fd7300cbd50 2023-11-18T21:00:22.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.124+0000 7fb154ff9640 1 -- 172.21.15.49:0/1046591804 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb1500efcd0 con 0x7fb1580c8ca0 2023-11-18T21:00:22.125 INFO:teuthology.orchestra.run.smithi049.stdout:64424509465 2023-11-18T21:00:22.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.128+0000 7fb15e05b640 1 -- 172.21.15.49:0/1046591804 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb138066470 msgr2=0x7fb138068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:22.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.128+0000 7fb15e05b640 1 --2- 172.21.15.49:0/1046591804 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb138066470 0x7fb138068930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb148009a50 tx=0x7fb148009210 comp rx=0 tx=0).stop 2023-11-18T21:00:22.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.128+0000 7fb15e05b640 1 -- 172.21.15.49:0/1046591804 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1580c8ca0 msgr2=0x7fb1581541f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:22.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.128+0000 7fb15e05b640 1 --2- 172.21.15.49:0/1046591804 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1580c8ca0 0x7fb1581541f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1500ab000 tx=0x7fb150019790 comp rx=0 tx=0).stop 2023-11-18T21:00:22.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.128+0000 7fb15e05b640 1 -- 172.21.15.49:0/1046591804 shutdown_connections 2023-11-18T21:00:22.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.128+0000 7fb15e05b640 1 --2- 172.21.15.49:0/1046591804 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb138066470 0x7fb138068930 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.128+0000 7fb15e05b640 1 --2- 172.21.15.49:0/1046591804 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1580c8ca0 0x7fb1581541f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.128+0000 7fb15e05b640 1 --2- 172.21.15.49:0/1046591804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1580c88c0 0x7fb158153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.128+0000 7fb15e05b640 1 --2- 172.21.15.49:0/1046591804 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb158070290 0x7fb15806bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.128+0000 7fb15e05b640 1 -- 172.21.15.49:0/1046591804 >> 172.21.15.49:0/1046591804 conn(0x7fb158070900 msgr2=0x7fb1580b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:22.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.128+0000 7fb15e05b640 1 -- 172.21.15.49:0/1046591804 shutdown_connections 2023-11-18T21:00:22.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.128+0000 7fb15e05b640 1 -- 172.21.15.49:0/1046591804 wait complete. 2023-11-18T21:00:22.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509465 got 64424509465 for osd.7 2023-11-18T21:00:22.142 DEBUG:teuthology.parallel:result is None 2023-11-18T21:00:22.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.188+0000 7f69f27fc640 1 -- 172.21.15.49:0/3624889198 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f69ec054a00 con 0x7f69f4152b80 2023-11-18T21:00:22.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.188+0000 7f69f27fc640 1 -- 172.21.15.49:0/3624889198 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69ec050d40 con 0x7f69f4152b80 2023-11-18T21:00:22.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.296+0000 7f9736ffd640 1 -- 172.21.15.49:0/515760880 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9738021090 con 0x7f9730005e20 2023-11-18T21:00:22.299 INFO:teuthology.orchestra.run.smithi049.stdout:64424509465 2023-11-18T21:00:22.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.300+0000 7f974c8d2640 1 -- 172.21.15.49:0/515760880 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f97280664f0 msgr2=0x7f97280689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:22.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.300+0000 7f974c8d2640 1 --2- 172.21.15.49:0/515760880 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f97280664f0 0x7f97280689b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97480cbd00 tx=0x7f973c001590 comp rx=0 tx=0).stop 2023-11-18T21:00:22.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.300+0000 7f974c8d2640 1 -- 172.21.15.49:0/515760880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9730005e20 msgr2=0x7f9748149ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:22.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.300+0000 7f974c8d2640 1 --2- 172.21.15.49:0/515760880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9730005e20 0x7f9748149ed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f973800e7c0 tx=0x7f973800ec80 comp rx=0 tx=0).stop 2023-11-18T21:00:22.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.300+0000 7f974c8d2640 1 -- 172.21.15.49:0/515760880 shutdown_connections 2023-11-18T21:00:22.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.300+0000 7f974c8d2640 1 --2- 172.21.15.49:0/515760880 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f97280664f0 0x7f97280689b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.300+0000 7f974c8d2640 1 --2- 172.21.15.49:0/515760880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9748153850 0x7f9748159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.300+0000 7f974c8d2640 1 --2- 172.21.15.49:0/515760880 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9748155ab0 0x7f9748153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.300+0000 7f974c8d2640 1 --2- 172.21.15.49:0/515760880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9730005e20 0x7f9748149ed0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.300+0000 7f974c8d2640 1 -- 172.21.15.49:0/515760880 >> 172.21.15.49:0/515760880 conn(0x7f974806d220 msgr2=0x7f97480c5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:22.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.300+0000 7f974c8d2640 1 -- 172.21.15.49:0/515760880 shutdown_connections 2023-11-18T21:00:22.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.300+0000 7f974c8d2640 1 -- 172.21.15.49:0/515760880 wait complete. 2023-11-18T21:00:22.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509465 got 64424509465 for osd.5 2023-11-18T21:00:22.320 DEBUG:teuthology.parallel:result is None 2023-11-18T21:00:22.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.332+0000 7fd7359b2640 1 -- 172.21.15.49:0/547932325 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd7140057e0 con 0x7fd7300cbd50 2023-11-18T21:00:22.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.392+0000 7f69fbbac640 1 -- 172.21.15.49:0/3624889198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f69d40057e0 con 0x7f69f4152b80 2023-11-18T21:00:22.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.400+0000 7f69f27fc640 1 -- 172.21.15.49:0/3624889198 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69ec017070 con 0x7f69f4152b80 2023-11-18T21:00:22.401 INFO:teuthology.orchestra.run.smithi049.stdout:64424509465 2023-11-18T21:00:22.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.404+0000 7f69fbbac640 1 -- 172.21.15.49:0/3624889198 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f69e0066470 msgr2=0x7f69e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:22.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.404+0000 7f69fbbac640 1 --2- 172.21.15.49:0/3624889198 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f69e0066470 0x7f69e0068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009650 tx=0x7f69e8006bb0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.404+0000 7f69fbbac640 1 -- 172.21.15.49:0/3624889198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69f4152b80 msgr2=0x7f69f4148cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:22.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.404+0000 7f69fbbac640 1 --2- 172.21.15.49:0/3624889198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69f4152b80 0x7f69f4148cf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00c410 tx=0x7f69ec00c8d0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.404+0000 7f69fbbac640 1 -- 172.21.15.49:0/3624889198 shutdown_connections 2023-11-18T21:00:22.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.404+0000 7f69fbbac640 1 --2- 172.21.15.49:0/3624889198 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f69e0066470 0x7f69e0068930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.404+0000 7f69fbbac640 1 --2- 172.21.15.49:0/3624889198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69f4152b80 0x7f69f4148cf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.404+0000 7f69fbbac640 1 --2- 172.21.15.49:0/3624889198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69f40c1e60 0x7f69f40c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.404+0000 7f69fbbac640 1 --2- 172.21.15.49:0/3624889198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69f40717c0 0x7f69f40ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.404+0000 7f69fbbac640 1 -- 172.21.15.49:0/3624889198 >> 172.21.15.49:0/3624889198 conn(0x7f69f406a560 msgr2=0x7f69f41556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:22.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.404+0000 7f69fbbac640 1 -- 172.21.15.49:0/3624889198 shutdown_connections 2023-11-18T21:00:22.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.404+0000 7f69fbbac640 1 -- 172.21.15.49:0/3624889198 wait complete. 2023-11-18T21:00:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.420+0000 7fd72cff9640 1 -- 172.21.15.49:0/547932325 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd718009200 con 0x7fd7300cbd50 2023-11-18T21:00:22.419 INFO:teuthology.orchestra.run.smithi049.stdout:64424509463 2023-11-18T21:00:22.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509465 got 64424509465 for osd.6 2023-11-18T21:00:22.422 DEBUG:teuthology.parallel:result is None 2023-11-18T21:00:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.420+0000 7fd7359b2640 1 -- 172.21.15.49:0/547932325 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd7100664c0 msgr2=0x7fd710068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.420+0000 7fd7359b2640 1 --2- 172.21.15.49:0/547932325 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd7100664c0 0x7fd710068980 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd7200ad000 tx=0x7fd720008040 comp rx=0 tx=0).stop 2023-11-18T21:00:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.420+0000 7fd7359b2640 1 -- 172.21.15.49:0/547932325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7300cbd50 msgr2=0x7fd73015ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.420+0000 7fd7359b2640 1 --2- 172.21.15.49:0/547932325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7300cbd50 0x7fd73015ffa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd71800b420 tx=0x7fd71800b8e0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.420+0000 7fd7359b2640 1 -- 172.21.15.49:0/547932325 shutdown_connections 2023-11-18T21:00:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.420+0000 7fd7359b2640 1 --2- 172.21.15.49:0/547932325 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd7100664c0 0x7fd710068980 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.420+0000 7fd7359b2640 1 --2- 172.21.15.49:0/547932325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7300cc130 0x7fd7301f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.420+0000 7fd7359b2640 1 --2- 172.21.15.49:0/547932325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7300cbd50 0x7fd73015ffa0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.420+0000 7fd7359b2640 1 --2- 172.21.15.49:0/547932325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7300c0ee0 0x7fd730145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.420+0000 7fd7359b2640 1 -- 172.21.15.49:0/547932325 >> 172.21.15.49:0/547932325 conn(0x7fd730070160 msgr2=0x7fd73014a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.420+0000 7fd7359b2640 1 -- 172.21.15.49:0/547932325 shutdown_connections 2023-11-18T21:00:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.420+0000 7fd7359b2640 1 -- 172.21.15.49:0/547932325 wait complete. 2023-11-18T21:00:22.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509463 for osd.1 2023-11-18T21:00:22.441 DEBUG:teuthology.parallel:result is None 2023-11-18T21:00:22.441 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-18T21:00:22.441 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T21:00:22.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.604+0000 7f3b58920640 1 Processor -- start 2023-11-18T21:00:22.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.604+0000 7f3b58920640 1 -- start start 2023-11-18T21:00:22.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.604+0000 7f3b58920640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3b5413d230 0x7f3b540c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:22.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.604+0000 7f3b58920640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b5415aff0 0x7f3b5406aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:22.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.604+0000 7f3b58920640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5406bdf0 con 0x7f3b540c4f80 2023-11-18T21:00:22.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.604+0000 7f3b58920640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b540c7700 con 0x7f3b5413d230 2023-11-18T21:00:22.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.604+0000 7f3b58920640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5406a880 con 0x7f3b5415aff0 2023-11-18T21:00:22.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.604+0000 7f3b5259c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3b5413d230 0x7f3b540c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:22.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.608+0000 7f3b5259c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3b5413d230 0x7f3b540c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:36162/0 (socket says 172.21.15.49:36162) 2023-11-18T21:00:22.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.608+0000 7f3b5259c640 1 -- 172.21.15.49:0/2172814913 learned_addr learned my addr 172.21.15.49:0/2172814913 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:22.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.612+0000 7f3b52d9d640 1 --2- 172.21.15.49:0/2172814913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b5415aff0 0x7f3b5406aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:22.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.612+0000 7f3b5259c640 1 -- 172.21.15.49:0/2172814913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b5415aff0 msgr2=0x7f3b5406aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:22.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.612+0000 7f3b5259c640 1 --2- 172.21.15.49:0/2172814913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b5415aff0 0x7f3b5406aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.612+0000 7f3b5259c640 1 -- 172.21.15.49:0/2172814913 >> v1:172.21.15.106:6789/0 conn(0x7f3b540c4f80 legacy=0x7f3b5415a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:22.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.612+0000 7f3b5259c640 1 -- 172.21.15.49:0/2172814913 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b54157390 con 0x7f3b5413d230 2023-11-18T21:00:22.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.624+0000 7f3b5259c640 1 --2- 172.21.15.49:0/2172814913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b5413d230 0x7f3b540c4a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009870 tx=0x7f3b3c01ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=200ac1f0445a838a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:22.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b5159a640 1 -- 172.21.15.49:0/2172814913 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0a8a30 con 0x7f3b5413d230 2023-11-18T21:00:22.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b5159a640 1 -- 172.21.15.49:0/2172814913 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c0a8b90 con 0x7f3b5413d230 2023-11-18T21:00:22.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b5159a640 1 -- 172.21.15.49:0/2172814913 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0b0440 con 0x7f3b5413d230 2023-11-18T21:00:22.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 -- 172.21.15.49:0/2172814913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b5413d230 msgr2=0x7f3b540c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:22.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 --2- 172.21.15.49:0/2172814913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b5413d230 0x7f3b540c4a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009870 tx=0x7f3b3c01ed30 comp rx=0 tx=0).stop 2023-11-18T21:00:22.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 -- 172.21.15.49:0/2172814913 shutdown_connections 2023-11-18T21:00:22.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 --2- 172.21.15.49:0/2172814913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b5415aff0 0x7f3b5406aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 --2- 172.21.15.49:0/2172814913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b5413d230 0x7f3b540c4a40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 -- 172.21.15.49:0/2172814913 >> 172.21.15.49:0/2172814913 conn(0x7f3b5406d200 msgr2=0x7f3b5406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:22.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 -- 172.21.15.49:0/2172814913 shutdown_connections 2023-11-18T21:00:22.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 -- 172.21.15.49:0/2172814913 wait complete. 2023-11-18T21:00:22.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 Processor -- start 2023-11-18T21:00:22.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 -- start start 2023-11-18T21:00:22.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b540c4f80 0x7f3b54134140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:22.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b5413d230 0x7f3b54150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:22.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b5415aff0 0x7f3b54139ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:22.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b54133580 con 0x7f3b540c4f80 2023-11-18T21:00:22.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540c2830 con 0x7f3b5415aff0 2023-11-18T21:00:22.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.632+0000 7f3b58920640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540c2ad0 con 0x7f3b5413d230 2023-11-18T21:00:22.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.636+0000 7f3b5259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b540c4f80 0x7f3b54134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:22.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.636+0000 7f3b5259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b540c4f80 0x7f3b54134140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38506/0 (socket says 172.21.15.49:38506) 2023-11-18T21:00:22.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.636+0000 7f3b5259c640 1 -- 172.21.15.49:0/157750420 learned_addr learned my addr 172.21.15.49:0/157750420 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:22.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.636+0000 7f3b51d9b640 1 --2- 172.21.15.49:0/157750420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b5413d230 0x7f3b54150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:22.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.636+0000 7f3b52d9d640 1 --2- 172.21.15.49:0/157750420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b5415aff0 0x7f3b54139ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:22.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.640+0000 7f3b5259c640 1 -- 172.21.15.49:0/157750420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b5413d230 msgr2=0x7f3b54150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:22.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.640+0000 7f3b5259c640 1 --2- 172.21.15.49:0/157750420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b5413d230 0x7f3b54150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.640+0000 7f3b5259c640 1 -- 172.21.15.49:0/157750420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b5415aff0 msgr2=0x7f3b54139ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:22.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.640+0000 7f3b5259c640 1 --2- 172.21.15.49:0/157750420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b5415aff0 0x7f3b54139ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:22.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.640+0000 7f3b5259c640 1 -- 172.21.15.49:0/157750420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c0094d0 con 0x7f3b540c4f80 2023-11-18T21:00:22.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.640+0000 7f3b5259c640 1 --2- 172.21.15.49:0/157750420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b540c4f80 0x7f3b54134140 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0b3040 tx=0x7f3b3c01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:22.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.644+0000 7f3b4affd640 1 -- 172.21.15.49:0/157750420 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0be070 con 0x7f3b540c4f80 2023-11-18T21:00:22.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.644+0000 7f3b58920640 1 -- 172.21.15.49:0/157750420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b54132970 con 0x7f3b540c4f80 2023-11-18T21:00:22.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.644+0000 7f3b58920640 1 -- 172.21.15.49:0/157750420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b54132f30 con 0x7f3b540c4f80 2023-11-18T21:00:22.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.644+0000 7f3b58920640 1 -- 172.21.15.49:0/157750420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b54067520 con 0x7f3b540c4f80 2023-11-18T21:00:22.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.644+0000 7f3b4affd640 1 -- 172.21.15.49:0/157750420 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c0c3410 con 0x7f3b540c4f80 2023-11-18T21:00:22.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.644+0000 7f3b4affd640 1 -- 172.21.15.49:0/157750420 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0c3780 con 0x7f3b540c4f80 2023-11-18T21:00:22.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.940+0000 7f3b4affd640 1 -- 172.21.15.49:0/157750420 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b3c0c38e0 con 0x7f3b540c4f80 2023-11-18T21:00:22.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.944+0000 7f3b4affd640 1 --2- 172.21.15.49:0/157750420 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b34066470 0x7f3b34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:22.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.944+0000 7f3b51d9b640 1 --2- 172.21.15.49:0/157750420 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b34066470 0x7f3b34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:22.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.944+0000 7f3b51d9b640 1 --2- 172.21.15.49:0/157750420 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b34066470 0x7f3b34068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3b5406db90 tx=0x7f3b44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:22.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.980+0000 7f3b4affd640 1 -- 172.21.15.49:0/157750420 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b3c0f3d50 con 0x7f3b540c4f80 2023-11-18T21:00:22.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:22.980+0000 7f3b4affd640 1 -- 172.21.15.49:0/157750420 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b3c0f0090 con 0x7f3b540c4f80 2023-11-18T21:00:23.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.132+0000 7f3b58920640 1 -- 172.21.15.49:0/157750420 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b54073770 con 0x7f3b34066470 2023-11-18T21:00:23.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.160+0000 7f3b4affd640 1 -- 172.21.15.49:0/157750420 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368480 (secure 0 0 0) 0x7f3b54073770 con 0x7f3b34066470 2023-11-18T21:00:23.161 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-18T21:00:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.164+0000 7f3b58920640 1 -- 172.21.15.49:0/157750420 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b34066470 msgr2=0x7f3b34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.164+0000 7f3b58920640 1 --2- 172.21.15.49:0/157750420 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b34066470 0x7f3b34068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3b5406db90 tx=0x7f3b44009040 comp rx=0 tx=0).stop 2023-11-18T21:00:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.164+0000 7f3b58920640 1 -- 172.21.15.49:0/157750420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b540c4f80 msgr2=0x7f3b54134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.164+0000 7f3b58920640 1 --2- 172.21.15.49:0/157750420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b540c4f80 0x7f3b54134140 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0b3040 tx=0x7f3b3c01bad0 comp rx=0 tx=0).stop 2023-11-18T21:00:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.164+0000 7f3b58920640 1 -- 172.21.15.49:0/157750420 shutdown_connections 2023-11-18T21:00:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.164+0000 7f3b58920640 1 --2- 172.21.15.49:0/157750420 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b34066470 0x7f3b34068930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.164+0000 7f3b58920640 1 --2- 172.21.15.49:0/157750420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b5415aff0 0x7f3b54139ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.164+0000 7f3b58920640 1 --2- 172.21.15.49:0/157750420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b5413d230 0x7f3b54150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.164+0000 7f3b58920640 1 --2- 172.21.15.49:0/157750420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b540c4f80 0x7f3b54134140 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:23.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.164+0000 7f3b58920640 1 -- 172.21.15.49:0/157750420 >> 172.21.15.49:0/157750420 conn(0x7f3b5406d200 msgr2=0x7f3b54138110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:23.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.164+0000 7f3b58920640 1 -- 172.21.15.49:0/157750420 shutdown_connections 2023-11-18T21:00:23.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.164+0000 7f3b58920640 1 -- 172.21.15.49:0/157750420 wait complete. 2023-11-18T21:00:23.182 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-11-18T21:00:21.798907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597819,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":287,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236484,"kb_used_data":3716,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738236,"statfs":{"total":773094113280,"available":772851953664,"internally_reserved":0,"allocated":3805184,"data_stored":2176090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005558"},"pg_stats":[{"pgid":"2.1f","version":"29'9","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.538941+0000","last_change":"2023-11-18T20:59:25.350113+0000","last_active":"2023-11-18T21:00:17.538941+0000","last_peered":"2023-11-18T21:00:17.538941+0000","last_clean":"2023-11-18T21:00:17.538941+0000","last_became_active":"2023-11-18T20:59:25.349869+0000","last_became_peered":"2023-11-18T20:59:25.349869+0000","last_unstale":"2023-11-18T21:00:17.538941+0000","last_undegraded":"2023-11-18T21:00:17.538941+0000","last_fullsized":"2023-11-18T21:00:17.538941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:56:07.719325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.771586+0000","last_change":"2023-11-18T20:59:27.895973+0000","last_active":"2023-11-18T20:59:35.771586+0000","last_peered":"2023-11-18T20:59:35.771586+0000","last_clean":"2023-11-18T20:59:35.771586+0000","last_became_active":"2023-11-18T20:59:27.895678+0000","last_became_peered":"2023-11-18T20:59:27.895678+0000","last_unstale":"2023-11-18T20:59:35.771586+0000","last_undegraded":"2023-11-18T20:59:35.771586+0000","last_fullsized":"2023-11-18T20:59:35.771586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.784993+0000","last_change":"2023-11-18T20:59:35.848621+0000","last_active":"2023-11-18T20:59:36.784993+0000","last_peered":"2023-11-18T20:59:36.784993+0000","last_clean":"2023-11-18T20:59:36.784993+0000","last_became_active":"2023-11-18T20:59:35.848140+0000","last_became_peered":"2023-11-18T20:59:35.848140+0000","last_unstale":"2023-11-18T20:59:36.784993+0000","last_undegraded":"2023-11-18T20:59:36.784993+0000","last_fullsized":"2023-11-18T20:59:36.784993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:12.962470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947695+0000","last_change":"2023-11-18T20:59:25.463657+0000","last_active":"2023-11-18T20:59:37.947695+0000","last_peered":"2023-11-18T20:59:37.947695+0000","last_clean":"2023-11-18T20:59:37.947695+0000","last_became_active":"2023-11-18T20:59:25.463001+0000","last_became_peered":"2023-11-18T20:59:25.463001+0000","last_unstale":"2023-11-18T20:59:37.947695+0000","last_undegraded":"2023-11-18T20:59:37.947695+0000","last_fullsized":"2023-11-18T20:59:37.947695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.772550+0000","last_change":"2023-11-18T20:59:27.837801+0000","last_active":"2023-11-18T20:59:35.772550+0000","last_peered":"2023-11-18T20:59:35.772550+0000","last_clean":"2023-11-18T20:59:35.772550+0000","last_became_active":"2023-11-18T20:59:27.836937+0000","last_became_peered":"2023-11-18T20:59:27.836937+0000","last_unstale":"2023-11-18T20:59:35.772550+0000","last_undegraded":"2023-11-18T20:59:35.772550+0000","last_fullsized":"2023-11-18T20:59:35.772550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947102+0000","last_change":"2023-11-18T20:59:35.843015+0000","last_active":"2023-11-18T20:59:37.947102+0000","last_peered":"2023-11-18T20:59:37.947102+0000","last_clean":"2023-11-18T20:59:37.947102+0000","last_became_active":"2023-11-18T20:59:35.842552+0000","last_became_peered":"2023-11-18T20:59:35.842552+0000","last_unstale":"2023-11-18T20:59:37.947102+0000","last_undegraded":"2023-11-18T20:59:37.947102+0000","last_fullsized":"2023-11-18T20:59:37.947102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:17.222664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.699998+0000","last_change":"2023-11-18T20:59:25.497907+0000","last_active":"2023-11-18T21:00:17.699998+0000","last_peered":"2023-11-18T21:00:17.699998+0000","last_clean":"2023-11-18T21:00:17.699998+0000","last_became_active":"2023-11-18T20:59:25.497070+0000","last_became_peered":"2023-11-18T20:59:25.497070+0000","last_unstale":"2023-11-18T21:00:17.699998+0000","last_undegraded":"2023-11-18T21:00:17.699998+0000","last_fullsized":"2023-11-18T21:00:17.699998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769239+0000","last_change":"2023-11-18T20:59:27.868161+0000","last_active":"2023-11-18T20:59:35.769239+0000","last_peered":"2023-11-18T20:59:35.769239+0000","last_clean":"2023-11-18T20:59:35.769239+0000","last_became_active":"2023-11-18T20:59:27.867021+0000","last_became_peered":"2023-11-18T20:59:27.867021+0000","last_unstale":"2023-11-18T20:59:35.769239+0000","last_undegraded":"2023-11-18T20:59:35.769239+0000","last_fullsized":"2023-11-18T20:59:35.769239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.950153+0000","last_change":"2023-11-18T20:59:35.830210+0000","last_active":"2023-11-18T20:59:37.950153+0000","last_peered":"2023-11-18T20:59:37.950153+0000","last_clean":"2023-11-18T20:59:37.950153+0000","last_became_active":"2023-11-18T20:59:35.829636+0000","last_became_peered":"2023-11-18T20:59:35.829636+0000","last_unstale":"2023-11-18T20:59:37.950153+0000","last_undegraded":"2023-11-18T20:59:37.950153+0000","last_fullsized":"2023-11-18T20:59:37.950153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759499+0000","last_change":"2023-11-18T20:59:25.493859+0000","last_active":"2023-11-18T20:59:35.759499+0000","last_peered":"2023-11-18T20:59:35.759499+0000","last_clean":"2023-11-18T20:59:35.759499+0000","last_became_active":"2023-11-18T20:59:25.493087+0000","last_became_peered":"2023-11-18T20:59:25.493087+0000","last_unstale":"2023-11-18T20:59:35.759499+0000","last_undegraded":"2023-11-18T20:59:35.759499+0000","last_fullsized":"2023-11-18T20:59:35.759499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.697210+0000","last_change":"2023-11-18T20:59:27.871929+0000","last_active":"2023-11-18T20:59:35.697210+0000","last_peered":"2023-11-18T20:59:35.697210+0000","last_clean":"2023-11-18T20:59:35.697210+0000","last_became_active":"2023-11-18T20:59:27.871076+0000","last_became_peered":"2023-11-18T20:59:27.871076+0000","last_unstale":"2023-11-18T20:59:35.697210+0000","last_undegraded":"2023-11-18T20:59:35.697210+0000","last_fullsized":"2023-11-18T20:59:35.697210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:24:09.546791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.948997+0000","last_change":"2023-11-18T20:59:35.833547+0000","last_active":"2023-11-18T20:59:37.948997+0000","last_peered":"2023-11-18T20:59:37.948997+0000","last_clean":"2023-11-18T20:59:37.948997+0000","last_became_active":"2023-11-18T20:59:35.833016+0000","last_became_peered":"2023-11-18T20:59:35.833016+0000","last_unstale":"2023-11-18T20:59:37.948997+0000","last_undegraded":"2023-11-18T20:59:37.948997+0000","last_fullsized":"2023-11-18T20:59:37.948997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:58.416590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696332+0000","last_change":"2023-11-18T20:59:27.682005+0000","last_active":"2023-11-18T20:59:35.696332+0000","last_peered":"2023-11-18T20:59:35.696332+0000","last_clean":"2023-11-18T20:59:35.696332+0000","last_became_active":"2023-11-18T20:59:27.681154+0000","last_became_peered":"2023-11-18T20:59:27.681154+0000","last_unstale":"2023-11-18T20:59:35.696332+0000","last_undegraded":"2023-11-18T20:59:35.696332+0000","last_fullsized":"2023-11-18T20:59:35.696332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:10.426499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:09.997710+0000","last_change":"2023-11-18T20:59:25.339269+0000","last_active":"2023-11-18T21:00:09.997710+0000","last_peered":"2023-11-18T21:00:09.997710+0000","last_clean":"2023-11-18T21:00:09.997710+0000","last_became_active":"2023-11-18T20:59:25.338067+0000","last_became_peered":"2023-11-18T20:59:25.338067+0000","last_unstale":"2023-11-18T21:00:09.997710+0000","last_undegraded":"2023-11-18T21:00:09.997710+0000","last_fullsized":"2023-11-18T21:00:09.997710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.310566+0000","last_change":"2023-11-18T20:59:35.776790+0000","last_active":"2023-11-18T20:59:37.310566+0000","last_peered":"2023-11-18T20:59:37.310566+0000","last_clean":"2023-11-18T20:59:37.310566+0000","last_became_active":"2023-11-18T20:59:35.776286+0000","last_became_peered":"2023-11-18T20:59:35.776286+0000","last_unstale":"2023-11-18T20:59:37.310566+0000","last_undegraded":"2023-11-18T20:59:37.310566+0000","last_fullsized":"2023-11-18T20:59:37.310566+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:06.870579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.682428+0000","last_change":"2023-11-18T20:59:27.861550+0000","last_active":"2023-11-18T20:59:35.682428+0000","last_peered":"2023-11-18T20:59:35.682428+0000","last_clean":"2023-11-18T20:59:35.682428+0000","last_became_active":"2023-11-18T20:59:27.861045+0000","last_became_peered":"2023-11-18T20:59:27.861045+0000","last_unstale":"2023-11-18T20:59:35.682428+0000","last_undegraded":"2023-11-18T20:59:35.682428+0000","last_fullsized":"2023-11-18T20:59:35.682428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.445613+0000","last_change":"2023-11-18T20:59:25.458601+0000","last_active":"2023-11-18T20:59:37.445613+0000","last_peered":"2023-11-18T20:59:37.445613+0000","last_clean":"2023-11-18T20:59:37.445613+0000","last_became_active":"2023-11-18T20:59:25.457871+0000","last_became_peered":"2023-11-18T20:59:25.457871+0000","last_unstale":"2023-11-18T20:59:37.445613+0000","last_undegraded":"2023-11-18T20:59:37.445613+0000","last_fullsized":"2023-11-18T20:59:37.445613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:09.387812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.685157+0000","last_change":"2023-11-18T20:59:35.842967+0000","last_active":"2023-11-18T20:59:36.685157+0000","last_peered":"2023-11-18T20:59:36.685157+0000","last_clean":"2023-11-18T20:59:36.685157+0000","last_became_active":"2023-11-18T20:59:35.842583+0000","last_became_peered":"2023-11-18T20:59:35.842583+0000","last_unstale":"2023-11-18T20:59:36.685157+0000","last_undegraded":"2023-11-18T20:59:36.685157+0000","last_fullsized":"2023-11-18T20:59:36.685157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:40.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.824183+0000","last_change":"2023-11-18T20:59:27.688043+0000","last_active":"2023-11-18T20:59:35.824183+0000","last_peered":"2023-11-18T20:59:35.824183+0000","last_clean":"2023-11-18T20:59:35.824183+0000","last_became_active":"2023-11-18T20:59:27.687250+0000","last_became_peered":"2023-11-18T20:59:27.687250+0000","last_unstale":"2023-11-18T20:59:35.824183+0000","last_undegraded":"2023-11-18T20:59:35.824183+0000","last_fullsized":"2023-11-18T20:59:35.824183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:16:48.432607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.225926+0000","last_change":"2023-11-18T20:59:25.351927+0000","last_active":"2023-11-18T21:00:10.225926+0000","last_peered":"2023-11-18T21:00:10.225926+0000","last_clean":"2023-11-18T21:00:10.225926+0000","last_became_active":"2023-11-18T20:59:25.351318+0000","last_became_peered":"2023-11-18T20:59:25.351318+0000","last_unstale":"2023-11-18T21:00:10.225926+0000","last_undegraded":"2023-11-18T21:00:10.225926+0000","last_fullsized":"2023-11-18T21:00:10.225926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:20:38.006315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.785771+0000","last_change":"2023-11-18T20:59:35.835375+0000","last_active":"2023-11-18T20:59:36.785771+0000","last_peered":"2023-11-18T20:59:36.785771+0000","last_clean":"2023-11-18T20:59:36.785771+0000","last_became_active":"2023-11-18T20:59:35.834894+0000","last_became_peered":"2023-11-18T20:59:35.834894+0000","last_unstale":"2023-11-18T20:59:36.785771+0000","last_undegraded":"2023-11-18T20:59:36.785771+0000","last_fullsized":"2023-11-18T20:59:36.785771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:33.448377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.695870+0000","last_change":"2023-11-18T20:59:27.687356+0000","last_active":"2023-11-18T20:59:35.695870+0000","last_peered":"2023-11-18T20:59:35.695870+0000","last_clean":"2023-11-18T20:59:35.695870+0000","last_became_active":"2023-11-18T20:59:27.686692+0000","last_became_peered":"2023-11-18T20:59:27.686692+0000","last_unstale":"2023-11-18T20:59:35.695870+0000","last_undegraded":"2023-11-18T20:59:35.695870+0000","last_fullsized":"2023-11-18T20:59:35.695870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:20:58.633153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.169191+0000","last_change":"2023-11-18T20:59:25.347589+0000","last_active":"2023-11-18T21:00:10.169191+0000","last_peered":"2023-11-18T21:00:10.169191+0000","last_clean":"2023-11-18T21:00:10.169191+0000","last_became_active":"2023-11-18T20:59:25.347022+0000","last_became_peered":"2023-11-18T20:59:25.347022+0000","last_unstale":"2023-11-18T21:00:10.169191+0000","last_undegraded":"2023-11-18T21:00:10.169191+0000","last_fullsized":"2023-11-18T21:00:10.169191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.949612+0000","last_change":"2023-11-18T20:59:35.771398+0000","last_active":"2023-11-18T20:59:37.949612+0000","last_peered":"2023-11-18T20:59:37.949612+0000","last_clean":"2023-11-18T20:59:37.949612+0000","last_became_active":"2023-11-18T20:59:35.770923+0000","last_became_peered":"2023-11-18T20:59:35.770923+0000","last_unstale":"2023-11-18T20:59:37.949612+0000","last_undegraded":"2023-11-18T20:59:37.949612+0000","last_fullsized":"2023-11-18T20:59:37.949612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.824728+0000","last_change":"2023-11-18T20:59:27.689972+0000","last_active":"2023-11-18T20:59:35.824728+0000","last_peered":"2023-11-18T20:59:35.824728+0000","last_clean":"2023-11-18T20:59:35.824728+0000","last_became_active":"2023-11-18T20:59:27.689156+0000","last_became_peered":"2023-11-18T20:59:27.689156+0000","last_unstale":"2023-11-18T20:59:35.824728+0000","last_undegraded":"2023-11-18T20:59:35.824728+0000","last_fullsized":"2023-11-18T20:59:35.824728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:58.264895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:09.999479+0000","last_change":"2023-11-18T20:59:25.348005+0000","last_active":"2023-11-18T21:00:09.999479+0000","last_peered":"2023-11-18T21:00:09.999479+0000","last_clean":"2023-11-18T21:00:09.999479+0000","last_became_active":"2023-11-18T20:59:25.346318+0000","last_became_peered":"2023-11-18T20:59:25.346318+0000","last_unstale":"2023-11-18T21:00:09.999479+0000","last_undegraded":"2023-11-18T21:00:09.999479+0000","last_fullsized":"2023-11-18T21:00:09.999479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:37.045716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947894+0000","last_change":"2023-11-18T20:59:35.833754+0000","last_active":"2023-11-18T20:59:37.947894+0000","last_peered":"2023-11-18T20:59:37.947894+0000","last_clean":"2023-11-18T20:59:37.947894+0000","last_became_active":"2023-11-18T20:59:35.833407+0000","last_became_peered":"2023-11-18T20:59:35.833407+0000","last_unstale":"2023-11-18T20:59:37.947894+0000","last_undegraded":"2023-11-18T20:59:37.947894+0000","last_fullsized":"2023-11-18T20:59:37.947894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:38:06.355389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.827293+0000","last_change":"2023-11-18T20:59:27.863887+0000","last_active":"2023-11-18T20:59:35.827293+0000","last_peered":"2023-11-18T20:59:35.827293+0000","last_clean":"2023-11-18T20:59:35.827293+0000","last_became_active":"2023-11-18T20:59:27.863358+0000","last_became_peered":"2023-11-18T20:59:27.863358+0000","last_unstale":"2023-11-18T20:59:35.827293+0000","last_undegraded":"2023-11-18T20:59:35.827293+0000","last_fullsized":"2023-11-18T20:59:35.827293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:50.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.534249+0000","last_change":"2023-11-18T20:59:25.351394+0000","last_active":"2023-11-18T21:00:17.534249+0000","last_peered":"2023-11-18T21:00:17.534249+0000","last_clean":"2023-11-18T21:00:17.534249+0000","last_became_active":"2023-11-18T20:59:25.350705+0000","last_became_peered":"2023-11-18T20:59:25.350705+0000","last_unstale":"2023-11-18T21:00:17.534249+0000","last_undegraded":"2023-11-18T21:00:17.534249+0000","last_fullsized":"2023-11-18T21:00:17.534249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:01:57.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.687959+0000","last_change":"2023-11-18T20:59:35.840991+0000","last_active":"2023-11-18T20:59:36.687959+0000","last_peered":"2023-11-18T20:59:36.687959+0000","last_clean":"2023-11-18T20:59:36.687959+0000","last_became_active":"2023-11-18T20:59:35.840533+0000","last_became_peered":"2023-11-18T20:59:35.840533+0000","last_unstale":"2023-11-18T20:59:36.687959+0000","last_undegraded":"2023-11-18T20:59:36.687959+0000","last_fullsized":"2023-11-18T20:59:36.687959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:06:47.876845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.821773+0000","last_change":"2023-11-18T20:59:27.869100+0000","last_active":"2023-11-18T20:59:35.821773+0000","last_peered":"2023-11-18T20:59:35.821773+0000","last_clean":"2023-11-18T20:59:35.821773+0000","last_became_active":"2023-11-18T20:59:27.868355+0000","last_became_peered":"2023-11-18T20:59:27.868355+0000","last_unstale":"2023-11-18T20:59:35.821773+0000","last_undegraded":"2023-11-18T20:59:35.821773+0000","last_fullsized":"2023-11-18T20:59:35.821773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:25.235096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311843+0000","last_change":"2023-11-18T20:59:25.350304+0000","last_active":"2023-11-18T20:59:37.311843+0000","last_peered":"2023-11-18T20:59:37.311843+0000","last_clean":"2023-11-18T20:59:37.311843+0000","last_became_active":"2023-11-18T20:59:25.349346+0000","last_became_peered":"2023-11-18T20:59:25.349346+0000","last_unstale":"2023-11-18T20:59:37.311843+0000","last_undegraded":"2023-11-18T20:59:37.311843+0000","last_fullsized":"2023-11-18T20:59:37.311843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:41.179268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.445590+0000","last_change":"2023-11-18T20:59:35.847005+0000","last_active":"2023-11-18T20:59:37.445590+0000","last_peered":"2023-11-18T20:59:37.445590+0000","last_clean":"2023-11-18T20:59:37.445590+0000","last_became_active":"2023-11-18T20:59:35.846458+0000","last_became_peered":"2023-11-18T20:59:35.846458+0000","last_unstale":"2023-11-18T20:59:37.445590+0000","last_undegraded":"2023-11-18T20:59:37.445590+0000","last_fullsized":"2023-11-18T20:59:37.445590+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746436+0000","last_change":"2023-11-18T20:59:27.889369+0000","last_active":"2023-11-18T20:59:35.746436+0000","last_peered":"2023-11-18T20:59:35.746436+0000","last_clean":"2023-11-18T20:59:35.746436+0000","last_became_active":"2023-11-18T20:59:27.887876+0000","last_became_peered":"2023-11-18T20:59:27.887876+0000","last_unstale":"2023-11-18T20:59:35.746436+0000","last_undegraded":"2023-11-18T20:59:35.746436+0000","last_fullsized":"2023-11-18T20:59:35.746436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:38.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770796+0000","last_change":"2023-11-18T20:59:25.459620+0000","last_active":"2023-11-18T20:59:35.770796+0000","last_peered":"2023-11-18T20:59:35.770796+0000","last_clean":"2023-11-18T20:59:35.770796+0000","last_became_active":"2023-11-18T20:59:25.459235+0000","last_became_peered":"2023-11-18T20:59:25.459235+0000","last_unstale":"2023-11-18T20:59:35.770796+0000","last_undegraded":"2023-11-18T20:59:35.770796+0000","last_fullsized":"2023-11-18T20:59:35.770796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:02.325885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.445133+0000","last_change":"2023-11-18T20:59:35.835800+0000","last_active":"2023-11-18T20:59:37.445133+0000","last_peered":"2023-11-18T20:59:37.445133+0000","last_clean":"2023-11-18T20:59:37.445133+0000","last_became_active":"2023-11-18T20:59:35.834275+0000","last_became_peered":"2023-11-18T20:59:35.834275+0000","last_unstale":"2023-11-18T20:59:37.445133+0000","last_undegraded":"2023-11-18T20:59:37.445133+0000","last_fullsized":"2023-11-18T20:59:37.445133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.758369+0000","last_change":"2023-11-18T20:59:27.892676+0000","last_active":"2023-11-18T20:59:35.758369+0000","last_peered":"2023-11-18T20:59:35.758369+0000","last_clean":"2023-11-18T20:59:35.758369+0000","last_became_active":"2023-11-18T20:59:27.892150+0000","last_became_peered":"2023-11-18T20:59:27.892150+0000","last_unstale":"2023-11-18T20:59:35.758369+0000","last_undegraded":"2023-11-18T20:59:35.758369+0000","last_fullsized":"2023-11-18T20:59:35.758369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:04.716391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311063+0000","last_change":"2023-11-18T20:59:25.355096+0000","last_active":"2023-11-18T20:59:37.311063+0000","last_peered":"2023-11-18T20:59:37.311063+0000","last_clean":"2023-11-18T20:59:37.311063+0000","last_became_active":"2023-11-18T20:59:25.354716+0000","last_became_peered":"2023-11-18T20:59:25.354716+0000","last_unstale":"2023-11-18T20:59:37.311063+0000","last_undegraded":"2023-11-18T20:59:37.311063+0000","last_fullsized":"2023-11-18T20:59:37.311063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:51.039181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.446212+0000","last_change":"2023-11-18T20:59:35.839218+0000","last_active":"2023-11-18T20:59:37.446212+0000","last_peered":"2023-11-18T20:59:37.446212+0000","last_clean":"2023-11-18T20:59:37.446212+0000","last_became_active":"2023-11-18T20:59:35.838732+0000","last_became_peered":"2023-11-18T20:59:35.838732+0000","last_unstale":"2023-11-18T20:59:37.446212+0000","last_undegraded":"2023-11-18T20:59:37.446212+0000","last_fullsized":"2023-11-18T20:59:37.446212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:50.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769410+0000","last_change":"2023-11-18T20:59:27.839403+0000","last_active":"2023-11-18T20:59:35.769410+0000","last_peered":"2023-11-18T20:59:35.769410+0000","last_clean":"2023-11-18T20:59:35.769410+0000","last_became_active":"2023-11-18T20:59:27.838664+0000","last_became_peered":"2023-11-18T20:59:27.838664+0000","last_unstale":"2023-11-18T20:59:35.769410+0000","last_undegraded":"2023-11-18T20:59:35.769410+0000","last_fullsized":"2023-11-18T20:59:35.769410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.446537+0000","last_change":"2023-11-18T20:59:25.458840+0000","last_active":"2023-11-18T21:00:17.446537+0000","last_peered":"2023-11-18T21:00:17.446537+0000","last_clean":"2023-11-18T21:00:17.446537+0000","last_became_active":"2023-11-18T20:59:25.458075+0000","last_became_peered":"2023-11-18T20:59:25.458075+0000","last_unstale":"2023-11-18T21:00:17.446537+0000","last_undegraded":"2023-11-18T21:00:17.446537+0000","last_fullsized":"2023-11-18T21:00:17.446537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:48.644992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.446595+0000","last_change":"2023-11-18T20:59:35.833736+0000","last_active":"2023-11-18T20:59:37.446595+0000","last_peered":"2023-11-18T20:59:37.446595+0000","last_clean":"2023-11-18T20:59:37.446595+0000","last_became_active":"2023-11-18T20:59:35.832891+0000","last_became_peered":"2023-11-18T20:59:35.832891+0000","last_unstale":"2023-11-18T20:59:37.446595+0000","last_undegraded":"2023-11-18T20:59:37.446595+0000","last_fullsized":"2023-11-18T20:59:37.446595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:12.929672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819600+0000","last_change":"2023-11-18T20:59:27.889690+0000","last_active":"2023-11-18T20:59:35.819600+0000","last_peered":"2023-11-18T20:59:35.819600+0000","last_clean":"2023-11-18T20:59:35.819600+0000","last_became_active":"2023-11-18T20:59:27.889115+0000","last_became_peered":"2023-11-18T20:59:27.889115+0000","last_unstale":"2023-11-18T20:59:35.819600+0000","last_undegraded":"2023-11-18T20:59:35.819600+0000","last_fullsized":"2023-11-18T20:59:35.819600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:57:08.995074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.515002+0000","last_change":"2023-11-18T20:59:25.460190+0000","last_active":"2023-11-18T21:00:17.515002+0000","last_peered":"2023-11-18T21:00:17.515002+0000","last_clean":"2023-11-18T21:00:17.515002+0000","last_became_active":"2023-11-18T20:59:25.459405+0000","last_became_peered":"2023-11-18T20:59:25.459405+0000","last_unstale":"2023-11-18T21:00:17.515002+0000","last_undegraded":"2023-11-18T21:00:17.515002+0000","last_fullsized":"2023-11-18T21:00:17.515002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947065+0000","last_change":"2023-11-18T20:59:35.842229+0000","last_active":"2023-11-18T20:59:37.947065+0000","last_peered":"2023-11-18T20:59:37.947065+0000","last_clean":"2023-11-18T20:59:37.947065+0000","last_became_active":"2023-11-18T20:59:35.835644+0000","last_became_peered":"2023-11-18T20:59:35.835644+0000","last_unstale":"2023-11-18T20:59:37.947065+0000","last_undegraded":"2023-11-18T20:59:37.947065+0000","last_fullsized":"2023-11-18T20:59:37.947065+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:28.212029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.822632+0000","last_change":"2023-11-18T20:59:27.890885+0000","last_active":"2023-11-18T20:59:35.822632+0000","last_peered":"2023-11-18T20:59:35.822632+0000","last_clean":"2023-11-18T20:59:35.822632+0000","last_became_active":"2023-11-18T20:59:27.890499+0000","last_became_peered":"2023-11-18T20:59:27.890499+0000","last_unstale":"2023-11-18T20:59:35.822632+0000","last_undegraded":"2023-11-18T20:59:35.822632+0000","last_fullsized":"2023-11-18T20:59:35.822632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:33:26.362872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.000953+0000","last_change":"2023-11-18T20:59:25.339255+0000","last_active":"2023-11-18T21:00:10.000953+0000","last_peered":"2023-11-18T21:00:10.000953+0000","last_clean":"2023-11-18T21:00:10.000953+0000","last_became_active":"2023-11-18T20:59:25.338020+0000","last_became_peered":"2023-11-18T20:59:25.338020+0000","last_unstale":"2023-11-18T21:00:10.000953+0000","last_undegraded":"2023-11-18T21:00:10.000953+0000","last_fullsized":"2023-11-18T21:00:10.000953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:07.183625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769201+0000","last_change":"2023-11-18T20:58:44.731742+0000","last_active":"2023-11-18T20:59:35.769201+0000","last_peered":"2023-11-18T20:59:35.769201+0000","last_clean":"2023-11-18T20:59:35.769201+0000","last_became_active":"2023-11-18T20:58:44.731076+0000","last_became_peered":"2023-11-18T20:58:44.731076+0000","last_unstale":"2023-11-18T20:59:35.769201+0000","last_undegraded":"2023-11-18T20:59:35.769201+0000","last_fullsized":"2023-11-18T20:59:35.769201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:58:42.561435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:58:42.561435+0000","last_clean_scrub_stamp":"2023-11-18T20:58:42.561435+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:48:40.458317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311487+0000","last_change":"2023-11-18T20:59:35.771637+0000","last_active":"2023-11-18T20:59:37.311487+0000","last_peered":"2023-11-18T20:59:37.311487+0000","last_clean":"2023-11-18T20:59:37.311487+0000","last_became_active":"2023-11-18T20:59:35.771146+0000","last_became_peered":"2023-11-18T20:59:35.771146+0000","last_unstale":"2023-11-18T20:59:37.311487+0000","last_undegraded":"2023-11-18T20:59:37.311487+0000","last_fullsized":"2023-11-18T20:59:37.311487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:15.290602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.697296+0000","last_change":"2023-11-18T20:59:27.684091+0000","last_active":"2023-11-18T20:59:35.697296+0000","last_peered":"2023-11-18T20:59:35.697296+0000","last_clean":"2023-11-18T20:59:35.697296+0000","last_became_active":"2023-11-18T20:59:27.683316+0000","last_became_peered":"2023-11-18T20:59:27.683316+0000","last_unstale":"2023-11-18T20:59:35.697296+0000","last_undegraded":"2023-11-18T20:59:35.697296+0000","last_fullsized":"2023-11-18T20:59:35.697296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:52:02.757528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.420841+0000","last_change":"2023-11-18T20:59:25.357198+0000","last_active":"2023-11-18T21:00:17.420841+0000","last_peered":"2023-11-18T21:00:17.420841+0000","last_clean":"2023-11-18T21:00:17.420841+0000","last_became_active":"2023-11-18T20:59:25.356883+0000","last_became_peered":"2023-11-18T20:59:25.356883+0000","last_unstale":"2023-11-18T21:00:17.420841+0000","last_undegraded":"2023-11-18T21:00:17.420841+0000","last_fullsized":"2023-11-18T21:00:17.420841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:09.508737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.949273+0000","last_change":"2023-11-18T20:59:35.834266+0000","last_active":"2023-11-18T20:59:37.949273+0000","last_peered":"2023-11-18T20:59:37.949273+0000","last_clean":"2023-11-18T20:59:37.949273+0000","last_became_active":"2023-11-18T20:59:35.833790+0000","last_became_peered":"2023-11-18T20:59:35.833790+0000","last_unstale":"2023-11-18T20:59:37.949273+0000","last_undegraded":"2023-11-18T20:59:37.949273+0000","last_fullsized":"2023-11-18T20:59:37.949273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:08.464650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759162+0000","last_change":"2023-11-18T20:59:27.873828+0000","last_active":"2023-11-18T20:59:35.759162+0000","last_peered":"2023-11-18T20:59:35.759162+0000","last_clean":"2023-11-18T20:59:35.759162+0000","last_became_active":"2023-11-18T20:59:27.872733+0000","last_became_peered":"2023-11-18T20:59:27.872733+0000","last_unstale":"2023-11-18T20:59:35.759162+0000","last_undegraded":"2023-11-18T20:59:35.759162+0000","last_fullsized":"2023-11-18T20:59:35.759162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.771910+0000","last_change":"2023-11-18T20:59:25.497529+0000","last_active":"2023-11-18T20:59:35.771910+0000","last_peered":"2023-11-18T20:59:35.771910+0000","last_clean":"2023-11-18T20:59:35.771910+0000","last_became_active":"2023-11-18T20:59:25.496694+0000","last_became_peered":"2023-11-18T20:59:25.496694+0000","last_unstale":"2023-11-18T20:59:35.771910+0000","last_undegraded":"2023-11-18T20:59:35.771910+0000","last_fullsized":"2023-11-18T20:59:35.771910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947265+0000","last_change":"2023-11-18T20:59:35.829393+0000","last_active":"2023-11-18T20:59:37.947265+0000","last_peered":"2023-11-18T20:59:37.947265+0000","last_clean":"2023-11-18T20:59:37.947265+0000","last_became_active":"2023-11-18T20:59:35.828446+0000","last_became_peered":"2023-11-18T20:59:35.828446+0000","last_unstale":"2023-11-18T20:59:37.947265+0000","last_undegraded":"2023-11-18T20:59:37.947265+0000","last_fullsized":"2023-11-18T20:59:37.947265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:33.544336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759870+0000","last_change":"2023-11-18T20:59:27.875122+0000","last_active":"2023-11-18T20:59:35.759870+0000","last_peered":"2023-11-18T20:59:35.759870+0000","last_clean":"2023-11-18T20:59:35.759870+0000","last_became_active":"2023-11-18T20:59:27.870220+0000","last_became_peered":"2023-11-18T20:59:27.870220+0000","last_unstale":"2023-11-18T20:59:35.759870+0000","last_undegraded":"2023-11-18T20:59:35.759870+0000","last_fullsized":"2023-11-18T20:59:35.759870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:39.557454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.825276+0000","last_change":"2023-11-18T20:59:25.457826+0000","last_active":"2023-11-18T20:59:35.825276+0000","last_peered":"2023-11-18T20:59:35.825276+0000","last_clean":"2023-11-18T20:59:35.825276+0000","last_became_active":"2023-11-18T20:59:25.457392+0000","last_became_peered":"2023-11-18T20:59:25.457392+0000","last_unstale":"2023-11-18T20:59:35.825276+0000","last_undegraded":"2023-11-18T20:59:35.825276+0000","last_fullsized":"2023-11-18T20:59:35.825276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:07:56.724852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.309761+0000","last_change":"2023-11-18T20:59:35.831579+0000","last_active":"2023-11-18T20:59:37.309761+0000","last_peered":"2023-11-18T20:59:37.309761+0000","last_clean":"2023-11-18T20:59:37.309761+0000","last_became_active":"2023-11-18T20:59:35.831147+0000","last_became_peered":"2023-11-18T20:59:35.831147+0000","last_unstale":"2023-11-18T20:59:37.309761+0000","last_undegraded":"2023-11-18T20:59:37.309761+0000","last_fullsized":"2023-11-18T20:59:37.309761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:08.730686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746569+0000","last_change":"2023-11-18T20:59:27.895618+0000","last_active":"2023-11-18T20:59:35.746569+0000","last_peered":"2023-11-18T20:59:35.746569+0000","last_clean":"2023-11-18T20:59:35.746569+0000","last_became_active":"2023-11-18T20:59:27.894931+0000","last_became_peered":"2023-11-18T20:59:27.894931+0000","last_unstale":"2023-11-18T20:59:35.746569+0000","last_undegraded":"2023-11-18T20:59:35.746569+0000","last_fullsized":"2023-11-18T20:59:35.746569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:33.165546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759903+0000","last_change":"2023-11-18T20:59:25.458603+0000","last_active":"2023-11-18T20:59:35.759903+0000","last_peered":"2023-11-18T20:59:35.759903+0000","last_clean":"2023-11-18T20:59:35.759903+0000","last_became_active":"2023-11-18T20:59:25.457932+0000","last_became_peered":"2023-11-18T20:59:25.457932+0000","last_unstale":"2023-11-18T20:59:35.759903+0000","last_undegraded":"2023-11-18T20:59:35.759903+0000","last_fullsized":"2023-11-18T20:59:35.759903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.948121+0000","last_change":"2023-11-18T20:59:35.832209+0000","last_active":"2023-11-18T20:59:37.948121+0000","last_peered":"2023-11-18T20:59:37.948121+0000","last_clean":"2023-11-18T20:59:37.948121+0000","last_became_active":"2023-11-18T20:59:35.831804+0000","last_became_peered":"2023-11-18T20:59:35.831804+0000","last_unstale":"2023-11-18T20:59:37.948121+0000","last_undegraded":"2023-11-18T20:59:37.948121+0000","last_fullsized":"2023-11-18T20:59:37.948121+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:13.050905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.695775+0000","last_change":"2023-11-18T20:59:27.884733+0000","last_active":"2023-11-18T20:59:35.695775+0000","last_peered":"2023-11-18T20:59:35.695775+0000","last_clean":"2023-11-18T20:59:35.695775+0000","last_became_active":"2023-11-18T20:59:27.884143+0000","last_became_peered":"2023-11-18T20:59:27.884143+0000","last_unstale":"2023-11-18T20:59:35.695775+0000","last_undegraded":"2023-11-18T20:59:35.695775+0000","last_fullsized":"2023-11-18T20:59:35.695775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:32.466816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'15","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.539089+0000","last_change":"2023-11-18T20:59:25.362761+0000","last_active":"2023-11-18T21:00:17.539089+0000","last_peered":"2023-11-18T21:00:17.539089+0000","last_clean":"2023-11-18T21:00:17.539089+0000","last_became_active":"2023-11-18T20:59:25.362350+0000","last_became_peered":"2023-11-18T20:59:25.362350+0000","last_unstale":"2023-11-18T21:00:17.539089+0000","last_undegraded":"2023-11-18T21:00:17.539089+0000","last_fullsized":"2023-11-18T21:00:17.539089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:32:54.741681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947512+0000","last_change":"2023-11-18T20:59:35.836797+0000","last_active":"2023-11-18T20:59:37.947512+0000","last_peered":"2023-11-18T20:59:37.947512+0000","last_clean":"2023-11-18T20:59:37.947512+0000","last_became_active":"2023-11-18T20:59:35.834153+0000","last_became_peered":"2023-11-18T20:59:35.834153+0000","last_unstale":"2023-11-18T20:59:37.947512+0000","last_undegraded":"2023-11-18T20:59:37.947512+0000","last_fullsized":"2023-11-18T20:59:37.947512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:18.639780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.768765+0000","last_change":"2023-11-18T20:59:27.841401+0000","last_active":"2023-11-18T20:59:35.768765+0000","last_peered":"2023-11-18T20:59:35.768765+0000","last_clean":"2023-11-18T20:59:35.768765+0000","last_became_active":"2023-11-18T20:59:27.840852+0000","last_became_peered":"2023-11-18T20:59:27.840852+0000","last_unstale":"2023-11-18T20:59:35.768765+0000","last_undegraded":"2023-11-18T20:59:35.768765+0000","last_fullsized":"2023-11-18T20:59:35.768765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.729412+0000","last_change":"2023-11-18T20:59:25.351707+0000","last_active":"2023-11-18T21:00:17.729412+0000","last_peered":"2023-11-18T21:00:17.729412+0000","last_clean":"2023-11-18T21:00:17.729412+0000","last_became_active":"2023-11-18T20:59:25.351149+0000","last_became_peered":"2023-11-18T20:59:25.351149+0000","last_unstale":"2023-11-18T21:00:17.729412+0000","last_undegraded":"2023-11-18T21:00:17.729412+0000","last_fullsized":"2023-11-18T21:00:17.729412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:37:55.630369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947503+0000","last_change":"2023-11-18T20:59:35.844046+0000","last_active":"2023-11-18T20:59:37.947503+0000","last_peered":"2023-11-18T20:59:37.947503+0000","last_clean":"2023-11-18T20:59:37.947503+0000","last_became_active":"2023-11-18T20:59:35.843208+0000","last_became_peered":"2023-11-18T20:59:35.843208+0000","last_unstale":"2023-11-18T20:59:37.947503+0000","last_undegraded":"2023-11-18T20:59:37.947503+0000","last_fullsized":"2023-11-18T20:59:37.947503+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:21:06.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696069+0000","last_change":"2023-11-18T20:59:27.866997+0000","last_active":"2023-11-18T20:59:35.696069+0000","last_peered":"2023-11-18T20:59:35.696069+0000","last_clean":"2023-11-18T20:59:35.696069+0000","last_became_active":"2023-11-18T20:59:27.866233+0000","last_became_peered":"2023-11-18T20:59:27.866233+0000","last_unstale":"2023-11-18T20:59:35.696069+0000","last_undegraded":"2023-11-18T20:59:35.696069+0000","last_fullsized":"2023-11-18T20:59:35.696069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:19.998748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:09.999828+0000","last_change":"2023-11-18T20:59:25.362589+0000","last_active":"2023-11-18T21:00:09.999828+0000","last_peered":"2023-11-18T21:00:09.999828+0000","last_clean":"2023-11-18T21:00:09.999828+0000","last_became_active":"2023-11-18T20:59:25.362287+0000","last_became_peered":"2023-11-18T20:59:25.362287+0000","last_unstale":"2023-11-18T21:00:09.999828+0000","last_undegraded":"2023-11-18T21:00:09.999828+0000","last_fullsized":"2023-11-18T21:00:09.999828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:24.791294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.446156+0000","last_change":"2023-11-18T20:59:35.846859+0000","last_active":"2023-11-18T20:59:37.446156+0000","last_peered":"2023-11-18T20:59:37.446156+0000","last_clean":"2023-11-18T20:59:37.446156+0000","last_became_active":"2023-11-18T20:59:35.845378+0000","last_became_peered":"2023-11-18T20:59:35.845378+0000","last_unstale":"2023-11-18T20:59:37.446156+0000","last_undegraded":"2023-11-18T20:59:37.446156+0000","last_fullsized":"2023-11-18T20:59:37.446156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.820183+0000","last_change":"2023-11-18T20:59:27.863967+0000","last_active":"2023-11-18T20:59:35.820183+0000","last_peered":"2023-11-18T20:59:35.820183+0000","last_clean":"2023-11-18T20:59:35.820183+0000","last_became_active":"2023-11-18T20:59:27.863435+0000","last_became_peered":"2023-11-18T20:59:27.863435+0000","last_unstale":"2023-11-18T20:59:35.820183+0000","last_undegraded":"2023-11-18T20:59:35.820183+0000","last_fullsized":"2023-11-18T20:59:35.820183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:04.837624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.442928+0000","last_change":"2023-11-18T20:59:25.361677+0000","last_active":"2023-11-18T21:00:17.442928+0000","last_peered":"2023-11-18T21:00:17.442928+0000","last_clean":"2023-11-18T21:00:17.442928+0000","last_became_active":"2023-11-18T20:59:25.361313+0000","last_became_peered":"2023-11-18T20:59:25.361313+0000","last_unstale":"2023-11-18T21:00:17.442928+0000","last_undegraded":"2023-11-18T21:00:17.442928+0000","last_fullsized":"2023-11-18T21:00:17.442928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311637+0000","last_change":"2023-11-18T20:59:35.832893+0000","last_active":"2023-11-18T20:59:37.311637+0000","last_peered":"2023-11-18T20:59:37.311637+0000","last_clean":"2023-11-18T20:59:37.311637+0000","last_became_active":"2023-11-18T20:59:35.832562+0000","last_became_peered":"2023-11-18T20:59:35.832562+0000","last_unstale":"2023-11-18T20:59:37.311637+0000","last_undegraded":"2023-11-18T20:59:37.311637+0000","last_fullsized":"2023-11-18T20:59:37.311637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:53:05.127511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759692+0000","last_change":"2023-11-18T20:59:27.874128+0000","last_active":"2023-11-18T20:59:35.759692+0000","last_peered":"2023-11-18T20:59:35.759692+0000","last_clean":"2023-11-18T20:59:35.759692+0000","last_became_active":"2023-11-18T20:59:27.865971+0000","last_became_peered":"2023-11-18T20:59:27.865971+0000","last_unstale":"2023-11-18T20:59:35.759692+0000","last_undegraded":"2023-11-18T20:59:35.759692+0000","last_fullsized":"2023-11-18T20:59:35.759692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.005456+0000","last_change":"2023-11-18T20:59:25.350262+0000","last_active":"2023-11-18T21:00:10.005456+0000","last_peered":"2023-11-18T21:00:10.005456+0000","last_clean":"2023-11-18T21:00:10.005456+0000","last_became_active":"2023-11-18T20:59:25.349577+0000","last_became_peered":"2023-11-18T20:59:25.349577+0000","last_unstale":"2023-11-18T21:00:10.005456+0000","last_undegraded":"2023-11-18T21:00:10.005456+0000","last_fullsized":"2023-11-18T21:00:10.005456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.688756+0000","last_change":"2023-11-18T20:59:35.849720+0000","last_active":"2023-11-18T20:59:36.688756+0000","last_peered":"2023-11-18T20:59:36.688756+0000","last_clean":"2023-11-18T20:59:36.688756+0000","last_became_active":"2023-11-18T20:59:35.848000+0000","last_became_peered":"2023-11-18T20:59:35.848000+0000","last_unstale":"2023-11-18T20:59:36.688756+0000","last_undegraded":"2023-11-18T20:59:36.688756+0000","last_fullsized":"2023-11-18T20:59:36.688756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:41:54.553006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696849+0000","last_change":"2023-11-18T20:59:27.891817+0000","last_active":"2023-11-18T20:59:35.696849+0000","last_peered":"2023-11-18T20:59:35.696849+0000","last_clean":"2023-11-18T20:59:35.696849+0000","last_became_active":"2023-11-18T20:59:27.891260+0000","last_became_peered":"2023-11-18T20:59:27.891260+0000","last_unstale":"2023-11-18T20:59:35.696849+0000","last_undegraded":"2023-11-18T20:59:35.696849+0000","last_fullsized":"2023-11-18T20:59:35.696849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:25.331055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.786039+0000","last_change":"2023-11-18T20:59:25.363983+0000","last_active":"2023-11-18T20:59:36.786039+0000","last_peered":"2023-11-18T20:59:36.786039+0000","last_clean":"2023-11-18T20:59:36.786039+0000","last_became_active":"2023-11-18T20:59:25.363289+0000","last_became_peered":"2023-11-18T20:59:25.363289+0000","last_unstale":"2023-11-18T20:59:36.786039+0000","last_undegraded":"2023-11-18T20:59:36.786039+0000","last_fullsized":"2023-11-18T20:59:36.786039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.950378+0000","last_change":"2023-11-18T20:59:35.771712+0000","last_active":"2023-11-18T20:59:37.950378+0000","last_peered":"2023-11-18T20:59:37.950378+0000","last_clean":"2023-11-18T20:59:37.950378+0000","last_became_active":"2023-11-18T20:59:35.771263+0000","last_became_peered":"2023-11-18T20:59:35.771263+0000","last_unstale":"2023-11-18T20:59:37.950378+0000","last_undegraded":"2023-11-18T20:59:37.950378+0000","last_fullsized":"2023-11-18T20:59:37.950378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.772920+0000","last_change":"2023-11-18T20:59:27.834172+0000","last_active":"2023-11-18T20:59:35.772920+0000","last_peered":"2023-11-18T20:59:35.772920+0000","last_clean":"2023-11-18T20:59:35.772920+0000","last_became_active":"2023-11-18T20:59:27.832589+0000","last_became_peered":"2023-11-18T20:59:27.832589+0000","last_unstale":"2023-11-18T20:59:35.772920+0000","last_undegraded":"2023-11-18T20:59:35.772920+0000","last_fullsized":"2023-11-18T20:59:35.772920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.169769+0000","last_change":"2023-11-18T20:59:25.494236+0000","last_active":"2023-11-18T21:00:10.169769+0000","last_peered":"2023-11-18T21:00:10.169769+0000","last_clean":"2023-11-18T21:00:10.169769+0000","last_became_active":"2023-11-18T20:59:25.493373+0000","last_became_peered":"2023-11-18T20:59:25.493373+0000","last_unstale":"2023-11-18T21:00:10.169769+0000","last_undegraded":"2023-11-18T21:00:10.169769+0000","last_fullsized":"2023-11-18T21:00:10.169769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:13.859109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.784645+0000","last_change":"2023-11-18T20:59:35.773319+0000","last_active":"2023-11-18T20:59:36.784645+0000","last_peered":"2023-11-18T20:59:36.784645+0000","last_clean":"2023-11-18T20:59:36.784645+0000","last_became_active":"2023-11-18T20:59:35.772563+0000","last_became_peered":"2023-11-18T20:59:35.772563+0000","last_unstale":"2023-11-18T20:59:36.784645+0000","last_undegraded":"2023-11-18T20:59:36.784645+0000","last_fullsized":"2023-11-18T20:59:36.784645+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:12.287749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746454+0000","last_change":"2023-11-18T20:59:27.892789+0000","last_active":"2023-11-18T20:59:35.746454+0000","last_peered":"2023-11-18T20:59:35.746454+0000","last_clean":"2023-11-18T20:59:35.746454+0000","last_became_active":"2023-11-18T20:59:27.891883+0000","last_became_peered":"2023-11-18T20:59:27.891883+0000","last_unstale":"2023-11-18T20:59:35.746454+0000","last_undegraded":"2023-11-18T20:59:35.746454+0000","last_fullsized":"2023-11-18T20:59:35.746454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:12.020475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.220320+0000","last_change":"2023-11-18T20:59:25.497309+0000","last_active":"2023-11-18T21:00:10.220320+0000","last_peered":"2023-11-18T21:00:10.220320+0000","last_clean":"2023-11-18T21:00:10.220320+0000","last_became_active":"2023-11-18T20:59:25.496680+0000","last_became_peered":"2023-11-18T20:59:25.496680+0000","last_unstale":"2023-11-18T21:00:10.220320+0000","last_undegraded":"2023-11-18T21:00:10.220320+0000","last_fullsized":"2023-11-18T21:00:10.220320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.688376+0000","last_change":"2023-11-18T20:59:35.842258+0000","last_active":"2023-11-18T20:59:36.688376+0000","last_peered":"2023-11-18T20:59:36.688376+0000","last_clean":"2023-11-18T20:59:36.688376+0000","last_became_active":"2023-11-18T20:59:35.838830+0000","last_became_peered":"2023-11-18T20:59:35.838830+0000","last_unstale":"2023-11-18T20:59:36.688376+0000","last_undegraded":"2023-11-18T20:59:36.688376+0000","last_fullsized":"2023-11-18T20:59:36.688376+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:12:39.697374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.689568+0000","last_change":"2023-11-18T20:59:35.839178+0000","last_active":"2023-11-18T20:59:36.689568+0000","last_peered":"2023-11-18T20:59:36.689568+0000","last_clean":"2023-11-18T20:59:36.689568+0000","last_became_active":"2023-11-18T20:59:35.838375+0000","last_became_peered":"2023-11-18T20:59:35.838375+0000","last_unstale":"2023-11-18T20:59:36.689568+0000","last_undegraded":"2023-11-18T20:59:36.689568+0000","last_fullsized":"2023-11-18T20:59:36.689568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:56:09.565932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.823342+0000","last_change":"2023-11-18T20:59:27.689539+0000","last_active":"2023-11-18T20:59:35.823342+0000","last_peered":"2023-11-18T20:59:35.823342+0000","last_clean":"2023-11-18T20:59:35.823342+0000","last_became_active":"2023-11-18T20:59:27.688522+0000","last_became_peered":"2023-11-18T20:59:27.688522+0000","last_unstale":"2023-11-18T20:59:35.823342+0000","last_undegraded":"2023-11-18T20:59:35.823342+0000","last_fullsized":"2023-11-18T20:59:35.823342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:06:48.337696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.310238+0000","last_change":"2023-11-18T20:59:25.494125+0000","last_active":"2023-11-18T20:59:37.310238+0000","last_peered":"2023-11-18T20:59:37.310238+0000","last_clean":"2023-11-18T20:59:37.310238+0000","last_became_active":"2023-11-18T20:59:25.493357+0000","last_became_peered":"2023-11-18T20:59:25.493357+0000","last_unstale":"2023-11-18T20:59:37.310238+0000","last_undegraded":"2023-11-18T20:59:37.310238+0000","last_fullsized":"2023-11-18T20:59:37.310238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311079+0000","last_change":"2023-11-18T20:59:35.776653+0000","last_active":"2023-11-18T20:59:37.311079+0000","last_peered":"2023-11-18T20:59:37.311079+0000","last_clean":"2023-11-18T20:59:37.311079+0000","last_became_active":"2023-11-18T20:59:35.776138+0000","last_became_peered":"2023-11-18T20:59:35.776138+0000","last_unstale":"2023-11-18T20:59:37.311079+0000","last_undegraded":"2023-11-18T20:59:37.311079+0000","last_fullsized":"2023-11-18T20:59:37.311079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:08:25.933599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770015+0000","last_change":"2023-11-18T20:59:27.860987+0000","last_active":"2023-11-18T20:59:35.770015+0000","last_peered":"2023-11-18T20:59:35.770015+0000","last_clean":"2023-11-18T20:59:35.770015+0000","last_became_active":"2023-11-18T20:59:27.860537+0000","last_became_peered":"2023-11-18T20:59:27.860537+0000","last_unstale":"2023-11-18T20:59:35.770015+0000","last_undegraded":"2023-11-18T20:59:35.770015+0000","last_fullsized":"2023-11-18T20:59:35.770015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.418543+0000","last_change":"2023-11-18T20:59:25.354967+0000","last_active":"2023-11-18T21:00:17.418543+0000","last_peered":"2023-11-18T21:00:17.418543+0000","last_clean":"2023-11-18T21:00:17.418543+0000","last_became_active":"2023-11-18T20:59:25.354690+0000","last_became_peered":"2023-11-18T20:59:25.354690+0000","last_unstale":"2023-11-18T21:00:17.418543+0000","last_undegraded":"2023-11-18T21:00:17.418543+0000","last_fullsized":"2023-11-18T21:00:17.418543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:50.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.514781+0000","last_change":"2023-11-18T20:59:25.346493+0000","last_active":"2023-11-18T21:00:17.514781+0000","last_peered":"2023-11-18T21:00:17.514781+0000","last_clean":"2023-11-18T21:00:17.514781+0000","last_became_active":"2023-11-18T20:59:25.346192+0000","last_became_peered":"2023-11-18T20:59:25.346192+0000","last_unstale":"2023-11-18T21:00:17.514781+0000","last_undegraded":"2023-11-18T21:00:17.514781+0000","last_fullsized":"2023-11-18T21:00:17.514781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:30.162962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819222+0000","last_change":"2023-11-18T20:59:27.868460+0000","last_active":"2023-11-18T20:59:35.819222+0000","last_peered":"2023-11-18T20:59:35.819222+0000","last_clean":"2023-11-18T20:59:35.819222+0000","last_became_active":"2023-11-18T20:59:27.867886+0000","last_became_peered":"2023-11-18T20:59:27.867886+0000","last_unstale":"2023-11-18T20:59:35.819222+0000","last_undegraded":"2023-11-18T20:59:35.819222+0000","last_fullsized":"2023-11-18T20:59:35.819222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:39.647294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.688950+0000","last_change":"2023-11-18T20:59:35.851163+0000","last_active":"2023-11-18T20:59:36.688950+0000","last_peered":"2023-11-18T20:59:36.688950+0000","last_clean":"2023-11-18T20:59:36.688950+0000","last_became_active":"2023-11-18T20:59:35.850427+0000","last_became_peered":"2023-11-18T20:59:35.850427+0000","last_unstale":"2023-11-18T20:59:36.688950+0000","last_undegraded":"2023-11-18T20:59:36.688950+0000","last_fullsized":"2023-11-18T20:59:36.688950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:20.729626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.175066+0000","last_change":"2023-11-18T20:59:25.462276+0000","last_active":"2023-11-18T21:00:10.175066+0000","last_peered":"2023-11-18T21:00:10.175066+0000","last_clean":"2023-11-18T21:00:10.175066+0000","last_became_active":"2023-11-18T20:59:25.460449+0000","last_became_peered":"2023-11-18T20:59:25.460449+0000","last_unstale":"2023-11-18T21:00:10.175066+0000","last_undegraded":"2023-11-18T21:00:10.175066+0000","last_fullsized":"2023-11-18T21:00:10.175066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:25:57.950600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.768671+0000","last_change":"2023-11-18T20:59:27.841332+0000","last_active":"2023-11-18T20:59:35.768671+0000","last_peered":"2023-11-18T20:59:35.768671+0000","last_clean":"2023-11-18T20:59:35.768671+0000","last_became_active":"2023-11-18T20:59:27.840528+0000","last_became_peered":"2023-11-18T20:59:27.840528+0000","last_unstale":"2023-11-18T20:59:35.768671+0000","last_undegraded":"2023-11-18T20:59:35.768671+0000","last_fullsized":"2023-11-18T20:59:35.768671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.785624+0000","last_change":"2023-11-18T20:59:35.776844+0000","last_active":"2023-11-18T20:59:36.785624+0000","last_peered":"2023-11-18T20:59:36.785624+0000","last_clean":"2023-11-18T20:59:36.785624+0000","last_became_active":"2023-11-18T20:59:35.775977+0000","last_became_peered":"2023-11-18T20:59:35.775977+0000","last_unstale":"2023-11-18T20:59:36.785624+0000","last_undegraded":"2023-11-18T20:59:36.785624+0000","last_fullsized":"2023-11-18T20:59:36.785624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:06:00.187752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.745152+0000","last_change":"2023-11-18T20:59:27.888673+0000","last_active":"2023-11-18T20:59:35.745152+0000","last_peered":"2023-11-18T20:59:35.745152+0000","last_clean":"2023-11-18T20:59:35.745152+0000","last_became_active":"2023-11-18T20:59:27.887716+0000","last_became_peered":"2023-11-18T20:59:27.887716+0000","last_unstale":"2023-11-18T20:59:35.745152+0000","last_undegraded":"2023-11-18T20:59:35.745152+0000","last_fullsized":"2023-11-18T20:59:35.745152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.680928+0000","last_change":"2023-11-18T20:59:27.684810+0000","last_active":"2023-11-18T20:59:35.680928+0000","last_peered":"2023-11-18T20:59:35.680928+0000","last_clean":"2023-11-18T20:59:35.680928+0000","last_became_active":"2023-11-18T20:59:27.680712+0000","last_became_peered":"2023-11-18T20:59:27.680712+0000","last_unstale":"2023-11-18T20:59:35.680928+0000","last_undegraded":"2023-11-18T20:59:35.680928+0000","last_fullsized":"2023-11-18T20:59:35.680928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696242+0000","last_change":"2023-11-18T20:59:27.835960+0000","last_active":"2023-11-18T20:59:35.696242+0000","last_peered":"2023-11-18T20:59:35.696242+0000","last_clean":"2023-11-18T20:59:35.696242+0000","last_became_active":"2023-11-18T20:59:27.835120+0000","last_became_peered":"2023-11-18T20:59:27.835120+0000","last_unstale":"2023-11-18T20:59:35.696242+0000","last_undegraded":"2023-11-18T20:59:35.696242+0000","last_fullsized":"2023-11-18T20:59:35.696242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:35:51.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770656+0000","last_change":"2023-11-18T20:59:27.833652+0000","last_active":"2023-11-18T20:59:35.770656+0000","last_peered":"2023-11-18T20:59:35.770656+0000","last_clean":"2023-11-18T20:59:35.770656+0000","last_became_active":"2023-11-18T20:59:27.833049+0000","last_became_peered":"2023-11-18T20:59:27.833049+0000","last_unstale":"2023-11-18T20:59:35.770656+0000","last_undegraded":"2023-11-18T20:59:35.770656+0000","last_fullsized":"2023-11-18T20:59:35.770656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:23.262919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.821721+0000","last_change":"2023-11-18T20:59:27.878824+0000","last_active":"2023-11-18T20:59:35.821721+0000","last_peered":"2023-11-18T20:59:35.821721+0000","last_clean":"2023-11-18T20:59:35.821721+0000","last_became_active":"2023-11-18T20:59:27.878353+0000","last_became_peered":"2023-11-18T20:59:27.878353+0000","last_unstale":"2023-11-18T20:59:35.821721+0000","last_undegraded":"2023-11-18T20:59:35.821721+0000","last_fullsized":"2023-11-18T20:59:35.821721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:04.074467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.820381+0000","last_change":"2023-11-18T20:59:27.866570+0000","last_active":"2023-11-18T20:59:35.820381+0000","last_peered":"2023-11-18T20:59:35.820381+0000","last_clean":"2023-11-18T20:59:35.820381+0000","last_became_active":"2023-11-18T20:59:27.866165+0000","last_became_peered":"2023-11-18T20:59:27.866165+0000","last_unstale":"2023-11-18T20:59:35.820381+0000","last_undegraded":"2023-11-18T20:59:35.820381+0000","last_fullsized":"2023-11-18T20:59:35.820381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:05:51.974471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746338+0000","last_change":"2023-11-18T20:59:27.895340+0000","last_active":"2023-11-18T20:59:35.746338+0000","last_peered":"2023-11-18T20:59:35.746338+0000","last_clean":"2023-11-18T20:59:35.746338+0000","last_became_active":"2023-11-18T20:59:27.893918+0000","last_became_peered":"2023-11-18T20:59:27.893918+0000","last_unstale":"2023-11-18T20:59:35.746338+0000","last_undegraded":"2023-11-18T20:59:35.746338+0000","last_fullsized":"2023-11-18T20:59:35.746338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:11.899550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.772271+0000","last_change":"2023-11-18T20:59:27.839127+0000","last_active":"2023-11-18T20:59:35.772271+0000","last_peered":"2023-11-18T20:59:35.772271+0000","last_clean":"2023-11-18T20:59:35.772271+0000","last_became_active":"2023-11-18T20:59:27.838509+0000","last_became_peered":"2023-11-18T20:59:27.838509+0000","last_unstale":"2023-11-18T20:59:35.772271+0000","last_undegraded":"2023-11-18T20:59:35.772271+0000","last_fullsized":"2023-11-18T20:59:35.772271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696213+0000","last_change":"2023-11-18T20:59:27.836167+0000","last_active":"2023-11-18T20:59:35.696213+0000","last_peered":"2023-11-18T20:59:35.696213+0000","last_clean":"2023-11-18T20:59:35.696213+0000","last_became_active":"2023-11-18T20:59:27.835226+0000","last_became_peered":"2023-11-18T20:59:27.835226+0000","last_unstale":"2023-11-18T20:59:35.696213+0000","last_undegraded":"2023-11-18T20:59:35.696213+0000","last_fullsized":"2023-11-18T20:59:35.696213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:23:46.608216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770190+0000","last_change":"2023-11-18T20:59:27.889937+0000","last_active":"2023-11-18T20:59:35.770190+0000","last_peered":"2023-11-18T20:59:35.770190+0000","last_clean":"2023-11-18T20:59:35.770190+0000","last_became_active":"2023-11-18T20:59:27.889325+0000","last_became_peered":"2023-11-18T20:59:27.889325+0000","last_unstale":"2023-11-18T20:59:35.770190+0000","last_undegraded":"2023-11-18T20:59:35.770190+0000","last_fullsized":"2023-11-18T20:59:35.770190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:39.674424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.768585+0000","last_change":"2023-11-18T20:59:27.867439+0000","last_active":"2023-11-18T20:59:35.768585+0000","last_peered":"2023-11-18T20:59:35.768585+0000","last_clean":"2023-11-18T20:59:35.768585+0000","last_became_active":"2023-11-18T20:59:27.866609+0000","last_became_peered":"2023-11-18T20:59:27.866609+0000","last_unstale":"2023-11-18T20:59:35.768585+0000","last_undegraded":"2023-11-18T20:59:35.768585+0000","last_fullsized":"2023-11-18T20:59:35.768585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:46:49.094141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819017+0000","last_change":"2023-11-18T20:59:27.883416+0000","last_active":"2023-11-18T20:59:35.819017+0000","last_peered":"2023-11-18T20:59:35.819017+0000","last_clean":"2023-11-18T20:59:35.819017+0000","last_became_active":"2023-11-18T20:59:27.882976+0000","last_became_peered":"2023-11-18T20:59:27.882976+0000","last_unstale":"2023-11-18T20:59:35.819017+0000","last_undegraded":"2023-11-18T20:59:35.819017+0000","last_fullsized":"2023-11-18T20:59:35.819017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:12.611142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759028+0000","last_change":"2023-11-18T20:59:27.873520+0000","last_active":"2023-11-18T20:59:35.759028+0000","last_peered":"2023-11-18T20:59:35.759028+0000","last_clean":"2023-11-18T20:59:35.759028+0000","last_became_active":"2023-11-18T20:59:27.872627+0000","last_became_peered":"2023-11-18T20:59:27.872627+0000","last_unstale":"2023-11-18T20:59:35.759028+0000","last_undegraded":"2023-11-18T20:59:35.759028+0000","last_fullsized":"2023-11-18T20:59:35.759028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.697486+0000","last_change":"2023-11-18T20:59:27.687118+0000","last_active":"2023-11-18T20:59:35.697486+0000","last_peered":"2023-11-18T20:59:35.697486+0000","last_clean":"2023-11-18T20:59:35.697486+0000","last_became_active":"2023-11-18T20:59:27.686311+0000","last_became_peered":"2023-11-18T20:59:27.686311+0000","last_unstale":"2023-11-18T20:59:35.697486+0000","last_undegraded":"2023-11-18T20:59:35.697486+0000","last_fullsized":"2023-11-18T20:59:35.697486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:25:27.490214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.681564+0000","last_change":"2023-11-18T20:59:27.892404+0000","last_active":"2023-11-18T20:59:35.681564+0000","last_peered":"2023-11-18T20:59:35.681564+0000","last_clean":"2023-11-18T20:59:35.681564+0000","last_became_active":"2023-11-18T20:59:27.891767+0000","last_became_peered":"2023-11-18T20:59:27.891767+0000","last_unstale":"2023-11-18T20:59:35.681564+0000","last_undegraded":"2023-11-18T20:59:35.681564+0000","last_fullsized":"2023-11-18T20:59:35.681564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.698022+0000","last_change":"2023-11-18T20:59:27.866920+0000","last_active":"2023-11-18T20:59:35.698022+0000","last_peered":"2023-11-18T20:59:35.698022+0000","last_clean":"2023-11-18T20:59:35.698022+0000","last_became_active":"2023-11-18T20:59:27.866153+0000","last_became_peered":"2023-11-18T20:59:27.866153+0000","last_unstale":"2023-11-18T20:59:35.698022+0000","last_undegraded":"2023-11-18T20:59:35.698022+0000","last_fullsized":"2023-11-18T20:59:35.698022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:50:43.894365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696090+0000","last_change":"2023-11-18T20:59:27.890399+0000","last_active":"2023-11-18T20:59:35.696090+0000","last_peered":"2023-11-18T20:59:35.696090+0000","last_clean":"2023-11-18T20:59:35.696090+0000","last_became_active":"2023-11-18T20:59:27.889704+0000","last_became_peered":"2023-11-18T20:59:27.889704+0000","last_unstale":"2023-11-18T20:59:35.696090+0000","last_undegraded":"2023-11-18T20:59:35.696090+0000","last_fullsized":"2023-11-18T20:59:35.696090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:34:37.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769850+0000","last_change":"2023-11-18T20:59:27.871794+0000","last_active":"2023-11-18T20:59:35.769850+0000","last_peered":"2023-11-18T20:59:35.769850+0000","last_clean":"2023-11-18T20:59:35.769850+0000","last_became_active":"2023-11-18T20:59:27.871337+0000","last_became_peered":"2023-11-18T20:59:27.871337+0000","last_unstale":"2023-11-18T20:59:35.769850+0000","last_undegraded":"2023-11-18T20:59:35.769850+0000","last_fullsized":"2023-11-18T20:59:35.769850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:16.370847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819983+0000","last_change":"2023-11-18T20:59:27.867288+0000","last_active":"2023-11-18T20:59:35.819983+0000","last_peered":"2023-11-18T20:59:35.819983+0000","last_clean":"2023-11-18T20:59:35.819983+0000","last_became_active":"2023-11-18T20:59:27.866560+0000","last_became_peered":"2023-11-18T20:59:27.866560+0000","last_unstale":"2023-11-18T20:59:35.819983+0000","last_undegraded":"2023-11-18T20:59:35.819983+0000","last_fullsized":"2023-11-18T20:59:35.819983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.823432+0000","last_change":"2023-11-18T20:59:27.878944+0000","last_active":"2023-11-18T20:59:35.823432+0000","last_peered":"2023-11-18T20:59:35.823432+0000","last_clean":"2023-11-18T20:59:35.823432+0000","last_became_active":"2023-11-18T20:59:27.878485+0000","last_became_peered":"2023-11-18T20:59:27.878485+0000","last_unstale":"2023-11-18T20:59:35.823432+0000","last_undegraded":"2023-11-18T20:59:35.823432+0000","last_fullsized":"2023-11-18T20:59:35.823432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:04.749189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.758902+0000","last_change":"2023-11-18T20:59:27.874019+0000","last_active":"2023-11-18T20:59:35.758902+0000","last_peered":"2023-11-18T20:59:35.758902+0000","last_clean":"2023-11-18T20:59:35.758902+0000","last_became_active":"2023-11-18T20:59:27.873255+0000","last_became_peered":"2023-11-18T20:59:27.873255+0000","last_unstale":"2023-11-18T20:59:35.758902+0000","last_undegraded":"2023-11-18T20:59:35.758902+0000","last_fullsized":"2023-11-18T20:59:35.758902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759661+0000","last_change":"2023-11-18T20:59:27.868086+0000","last_active":"2023-11-18T20:59:35.759661+0000","last_peered":"2023-11-18T20:59:35.759661+0000","last_clean":"2023-11-18T20:59:35.759661+0000","last_became_active":"2023-11-18T20:59:27.866901+0000","last_became_peered":"2023-11-18T20:59:27.866901+0000","last_unstale":"2023-11-18T20:59:35.759661+0000","last_undegraded":"2023-11-18T20:59:35.759661+0000","last_fullsized":"2023-11-18T20:59:35.759661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759791+0000","last_change":"2023-11-18T20:59:27.888617+0000","last_active":"2023-11-18T20:59:35.759791+0000","last_peered":"2023-11-18T20:59:35.759791+0000","last_clean":"2023-11-18T20:59:35.759791+0000","last_became_active":"2023-11-18T20:59:27.888068+0000","last_became_peered":"2023-11-18T20:59:27.888068+0000","last_unstale":"2023-11-18T20:59:35.759791+0000","last_undegraded":"2023-11-18T20:59:35.759791+0000","last_fullsized":"2023-11-18T20:59:35.759791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:53.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769443+0000","last_change":"2023-11-18T20:59:27.684428+0000","last_active":"2023-11-18T20:59:35.769443+0000","last_peered":"2023-11-18T20:59:35.769443+0000","last_clean":"2023-11-18T20:59:35.769443+0000","last_became_active":"2023-11-18T20:59:27.682936+0000","last_became_peered":"2023-11-18T20:59:27.682936+0000","last_unstale":"2023-11-18T20:59:35.769443+0000","last_undegraded":"2023-11-18T20:59:35.769443+0000","last_fullsized":"2023-11-18T20:59:35.769443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:52.955875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769402+0000","last_change":"2023-11-18T20:59:27.865937+0000","last_active":"2023-11-18T20:59:35.769402+0000","last_peered":"2023-11-18T20:59:35.769402+0000","last_clean":"2023-11-18T20:59:35.769402+0000","last_became_active":"2023-11-18T20:59:27.865401+0000","last_became_peered":"2023-11-18T20:59:27.865401+0000","last_unstale":"2023-11-18T20:59:35.769402+0000","last_undegraded":"2023-11-18T20:59:35.769402+0000","last_fullsized":"2023-11-18T20:59:35.769402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:00.251369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.757858+0000","last_change":"2023-11-18T20:59:27.865748+0000","last_active":"2023-11-18T20:59:35.757858+0000","last_peered":"2023-11-18T20:59:35.757858+0000","last_clean":"2023-11-18T20:59:35.757858+0000","last_became_active":"2023-11-18T20:59:27.864956+0000","last_became_peered":"2023-11-18T20:59:27.864956+0000","last_unstale":"2023-11-18T20:59:35.757858+0000","last_undegraded":"2023-11-18T20:59:35.757858+0000","last_fullsized":"2023-11-18T20:59:35.757858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746209+0000","last_change":"2023-11-18T20:59:27.889838+0000","last_active":"2023-11-18T20:59:35.746209+0000","last_peered":"2023-11-18T20:59:35.746209+0000","last_clean":"2023-11-18T20:59:35.746209+0000","last_became_active":"2023-11-18T20:59:27.889307+0000","last_became_peered":"2023-11-18T20:59:27.889307+0000","last_unstale":"2023-11-18T20:59:35.746209+0000","last_undegraded":"2023-11-18T20:59:35.746209+0000","last_fullsized":"2023-11-18T20:59:35.746209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.758577+0000","last_change":"2023-11-18T20:59:27.866394+0000","last_active":"2023-11-18T20:59:35.758577+0000","last_peered":"2023-11-18T20:59:35.758577+0000","last_clean":"2023-11-18T20:59:35.758577+0000","last_became_active":"2023-11-18T20:59:27.865625+0000","last_became_peered":"2023-11-18T20:59:27.865625+0000","last_unstale":"2023-11-18T20:59:35.758577+0000","last_undegraded":"2023-11-18T20:59:35.758577+0000","last_fullsized":"2023-11-18T20:59:35.758577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.745362+0000","last_change":"2023-11-18T20:59:27.892765+0000","last_active":"2023-11-18T20:59:35.745362+0000","last_peered":"2023-11-18T20:59:35.745362+0000","last_clean":"2023-11-18T20:59:35.745362+0000","last_became_active":"2023-11-18T20:59:27.891753+0000","last_became_peered":"2023-11-18T20:59:27.891753+0000","last_unstale":"2023-11-18T20:59:35.745362+0000","last_undegraded":"2023-11-18T20:59:35.745362+0000","last_fullsized":"2023-11-18T20:59:35.745362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:52.955875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770669+0000","last_change":"2023-11-18T20:59:27.837531+0000","last_active":"2023-11-18T20:59:35.770669+0000","last_peered":"2023-11-18T20:59:35.770669+0000","last_clean":"2023-11-18T20:59:35.770669+0000","last_became_active":"2023-11-18T20:59:27.836899+0000","last_became_peered":"2023-11-18T20:59:27.836899+0000","last_unstale":"2023-11-18T20:59:35.770669+0000","last_undegraded":"2023-11-18T20:59:35.770669+0000","last_fullsized":"2023-11-18T20:59:35.770669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:04.716391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.771353+0000","last_change":"2023-11-18T20:59:27.864494+0000","last_active":"2023-11-18T20:59:35.771353+0000","last_peered":"2023-11-18T20:59:35.771353+0000","last_clean":"2023-11-18T20:59:35.771353+0000","last_became_active":"2023-11-18T20:59:27.863732+0000","last_became_peered":"2023-11-18T20:59:27.863732+0000","last_unstale":"2023-11-18T20:59:35.771353+0000","last_undegraded":"2023-11-18T20:59:35.771353+0000","last_fullsized":"2023-11-18T20:59:35.771353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759787+0000","last_change":"2023-11-18T20:59:27.873605+0000","last_active":"2023-11-18T20:59:35.759787+0000","last_peered":"2023-11-18T20:59:35.759787+0000","last_clean":"2023-11-18T20:59:35.759787+0000","last_became_active":"2023-11-18T20:59:27.871167+0000","last_became_peered":"2023-11-18T20:59:27.871167+0000","last_unstale":"2023-11-18T20:59:35.759787+0000","last_undegraded":"2023-11-18T20:59:35.759787+0000","last_fullsized":"2023-11-18T20:59:35.759787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:54:51.212807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7451,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":123538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.625}]},{"osd":1,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.046},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.84599999999999997}]},{"osd":2,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.89400000000000002}]},{"osd":3,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.97099999999999997}]},{"osd":4,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.93000000000000005}]},{"osd":5,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.175},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.80500000000000005}]},{"osd":6,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.21}]}]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":123834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.0840000000000001}]},{"osd":1,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.748}]},{"osd":2,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.89300000000000002}]},{"osd":3,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.208},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.91600000000000004}]},{"osd":4,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":1.002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.94899999999999995}]},{"osd":5,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.1180000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.71799999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":713802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.376},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.498}]},{"osd":3,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.48599999999999999}]},{"osd":4,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.46000000000000002}]},{"osd":6,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.317},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.44400000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.52000000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":123268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.52300000000000002}]},{"osd":1,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.57399999999999995}]},{"osd":4,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.77500000000000002}]},{"osd":5,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.95699999999999996}]},{"osd":6,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.92500000000000004}]},{"osd":7,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.67300000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":126505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.879},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.69399999999999995}]},{"osd":1,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.92800000000000005}]},{"osd":3,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":1.109}]},{"osd":4,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.159},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":1.173}]},{"osd":5,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.071},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.135}]},{"osd":6,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.0169999999999999}]},{"osd":7,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.048}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":909312,"data_stored":713158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.874},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.442}]},{"osd":2,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.91300000000000003}]},{"osd":3,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.47899999999999998}]},{"osd":4,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.97699999999999998}]},{"osd":5,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.73199999999999998}]},{"osd":6,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.76800000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":327680,"data_stored":123946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.35299999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.39600000000000002}]},{"osd":3,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.623}]},{"osd":4,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.752}]},{"osd":5,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.82199999999999995}]},{"osd":7,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.71099999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":128039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.60699999999999998}]},{"osd":1,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.69999999999999996}]},{"osd":2,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.67100000000000004},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.93999999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.81200000000000006}]},{"osd":5,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.153},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.083}]},{"osd":6,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.405}]},{"osd":7,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.2450000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T21:00:23.188 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T21:00:23.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.404+0000 7fe7a3117640 1 Processor -- start 2023-11-18T21:00:23.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.404+0000 7fe7a3117640 1 -- start start 2023-11-18T21:00:23.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.404+0000 7fe7a3117640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe79c151340 0x7fe79c06ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:23.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.404+0000 7fe7a3117640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe79c0c40e0 0x7fe79c0c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:23.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.404+0000 7fe7a3117640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c06f4a0 con 0x7fe79c151720 2023-11-18T21:00:23.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.404+0000 7fe7a3117640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c072570 con 0x7fe79c0c40e0 2023-11-18T21:00:23.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.404+0000 7fe7a3117640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c070be0 con 0x7fe79c151340 2023-11-18T21:00:23.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.404+0000 7fe7a0eb3640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe79c151340 0x7fe79c06ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:23.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.404+0000 7fe7a0eb3640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe79c151340 0x7fe79c06ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:47142/0 (socket says 172.21.15.49:47142) 2023-11-18T21:00:23.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.408+0000 7fe7a0eb3640 1 -- 172.21.15.49:0/1019142372 learned_addr learned my addr 172.21.15.49:0/1019142372 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:23.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.424+0000 7fe7a0eb3640 1 -- 172.21.15.49:0/1019142372 >> v2:172.21.15.106:3300/0 conn(0x7fe79c0c40e0 msgr2=0x7fe79c0c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:23.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.424+0000 7fe7a0eb3640 1 --2- 172.21.15.49:0/1019142372 >> v2:172.21.15.106:3300/0 conn(0x7fe79c0c40e0 0x7fe79c0c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:23.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.424+0000 7fe7a0eb3640 1 -- 172.21.15.49:0/1019142372 >> v1:172.21.15.106:6789/0 conn(0x7fe79c151720 legacy=0x7fe79c157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:23.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.424+0000 7fe7a0eb3640 1 -- 172.21.15.49:0/1019142372 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c070e80 con 0x7fe79c151340 2023-11-18T21:00:23.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.568+0000 7fe7a0eb3640 1 --2- 172.21.15.49:0/1019142372 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe79c151340 0x7fe79c06ee10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe798009870 tx=0x7fe79801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=351bff862dda6a28 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.580+0000 7fe7937fe640 1 -- 172.21.15.49:0/1019142372 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7980aa5f0 con 0x7fe79c151340 2023-11-18T21:00:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.580+0000 7fe7937fe640 1 -- 172.21.15.49:0/1019142372 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7980aa750 con 0x7fe79c151340 2023-11-18T21:00:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.580+0000 7fe7937fe640 1 -- 172.21.15.49:0/1019142372 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7980aaae0 con 0x7fe79c151340 2023-11-18T21:00:23.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.580+0000 7fe7a3117640 1 -- 172.21.15.49:0/1019142372 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe79c151340 msgr2=0x7fe79c06ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:23.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.580+0000 7fe7a3117640 1 --2- 172.21.15.49:0/1019142372 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe79c151340 0x7fe79c06ee10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe798009870 tx=0x7fe79801c4d0 comp rx=0 tx=0).stop 2023-11-18T21:00:23.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.580+0000 7fe7a3117640 1 -- 172.21.15.49:0/1019142372 shutdown_connections 2023-11-18T21:00:23.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.580+0000 7fe7a3117640 1 --2- 172.21.15.49:0/1019142372 >> v2:172.21.15.106:3300/0 conn(0x7fe79c0c40e0 0x7fe79c0c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:23.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.580+0000 7fe7a3117640 1 --2- 172.21.15.49:0/1019142372 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe79c151340 0x7fe79c06ee10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:23.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.580+0000 7fe7a3117640 1 -- 172.21.15.49:0/1019142372 >> 172.21.15.49:0/1019142372 conn(0x7fe79c06c6a0 msgr2=0x7fe79c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.580+0000 7fe7a3117640 1 -- 172.21.15.49:0/1019142372 shutdown_connections 2023-11-18T21:00:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.580+0000 7fe7a3117640 1 -- 172.21.15.49:0/1019142372 wait complete. 2023-11-18T21:00:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.584+0000 7fe7a3117640 1 Processor -- start 2023-11-18T21:00:23.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.584+0000 7fe7a3117640 1 -- start start 2023-11-18T21:00:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.584+0000 7fe7a3117640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe79c0c40e0 0x7fe79c14ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.584+0000 7fe7a3117640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe79c151340 0x7fe79c156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.584+0000 7fe7a3117640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe79c151720 0x7fe79c156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.584+0000 7fe7a3117640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c1f5ac0 con 0x7fe79c151340 2023-11-18T21:00:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.584+0000 7fe7a3117640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c1f5ff0 con 0x7fe79c151720 2023-11-18T21:00:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.584+0000 7fe7a3117640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c14f9b0 con 0x7fe79c0c40e0 2023-11-18T21:00:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.588+0000 7fe7a16b4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe79c151720 0x7fe79c156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.588+0000 7fe7a0eb3640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe79c0c40e0 0x7fe79c14ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:23.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.588+0000 7fe7a16b4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe79c151720 0x7fe79c156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:36190/0 (socket says 172.21.15.49:36190) 2023-11-18T21:00:23.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.588+0000 7fe7a16b4640 1 -- 172.21.15.49:0/3295960531 learned_addr learned my addr 172.21.15.49:0/3295960531 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.592+0000 7fe7a16b4640 1 -- 172.21.15.49:0/3295960531 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe79c0c40e0 msgr2=0x7fe79c14ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:23.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.592+0000 7fe7a16b4640 1 --2- 172.21.15.49:0/3295960531 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe79c0c40e0 0x7fe79c14ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:23.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.592+0000 7fe7a16b4640 1 -- 172.21.15.49:0/3295960531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe79c151340 msgr2=0x7fe79c156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:23.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.592+0000 7fe7a16b4640 1 --2- 172.21.15.49:0/3295960531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe79c151340 0x7fe79c156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:23.593 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.592+0000 7fe7a16b4640 1 -- 172.21.15.49:0/3295960531 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7980094d0 con 0x7fe79c151720 2023-11-18T21:00:23.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.596+0000 7fe7a16b4640 1 --2- 172.21.15.49:0/3295960531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe79c151720 0x7fe79c156f90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe79400b970 tx=0x7fe79400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:23.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.600+0000 7fe7917fa640 1 -- 172.21.15.49:0/3295960531 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400cb40 con 0x7fe79c151720 2023-11-18T21:00:23.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.600+0000 7fe7a3117640 1 -- 172.21.15.49:0/3295960531 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c1f5d10 con 0x7fe79c151720 2023-11-18T21:00:23.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.600+0000 7fe7a3117640 1 -- 172.21.15.49:0/3295960531 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c155040 con 0x7fe79c151720 2023-11-18T21:00:23.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.600+0000 7fe7917fa640 1 -- 172.21.15.49:0/3295960531 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79400cca0 con 0x7fe79c151720 2023-11-18T21:00:23.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.600+0000 7fe7917fa640 1 -- 172.21.15.49:0/3295960531 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79401e640 con 0x7fe79c151720 2023-11-18T21:00:23.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.604+0000 7fe7a3117640 1 -- 172.21.15.49:0/3295960531 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c005260 con 0x7fe79c151720 2023-11-18T21:00:23.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.632+0000 7fe7917fa640 1 -- 172.21.15.49:0/3295960531 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe79401e7a0 con 0x7fe79c151720 2023-11-18T21:00:23.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.632+0000 7fe7917fa640 1 --2- 172.21.15.49:0/3295960531 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe788066470 0x7fe788068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:23.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.636+0000 7fe7a0eb3640 1 --2- 172.21.15.49:0/3295960531 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe788066470 0x7fe788068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:23.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.636+0000 7fe7a0eb3640 1 --2- 172.21.15.49:0/3295960531 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe788066470 0x7fe788068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe7980ae000 tx=0x7fe7980b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:23.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.636+0000 7fe7917fa640 1 -- 172.21.15.49:0/3295960531 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe794055720 con 0x7fe79c151720 2023-11-18T21:00:23.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:23.976+0000 7fe7917fa640 1 -- 172.21.15.49:0/3295960531 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe794051a60 con 0x7fe79c151720 2023-11-18T21:00:24.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.144+0000 7fe7a3117640 1 -- 172.21.15.49:0/3295960531 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe77c000bd0 con 0x7fe788066470 2023-11-18T21:00:24.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.172+0000 7fe7917fa640 1 -- 172.21.15.49:0/3295960531 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368475 (secure 0 0 0) 0x7fe77c000bd0 con 0x7fe788066470 2023-11-18T21:00:24.176 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:24.180 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-18T21:00:24.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.180+0000 7fe7a3117640 1 -- 172.21.15.49:0/3295960531 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe788066470 msgr2=0x7fe788068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:24.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.180+0000 7fe7a3117640 1 --2- 172.21.15.49:0/3295960531 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe788066470 0x7fe788068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe7980ae000 tx=0x7fe7980b5040 comp rx=0 tx=0).stop 2023-11-18T21:00:24.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.180+0000 7fe7a3117640 1 -- 172.21.15.49:0/3295960531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe79c151720 msgr2=0x7fe79c156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:24.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.180+0000 7fe7a3117640 1 --2- 172.21.15.49:0/3295960531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe79c151720 0x7fe79c156f90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe79400b970 tx=0x7fe79400be30 comp rx=0 tx=0).stop 2023-11-18T21:00:24.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.180+0000 7fe7a3117640 1 -- 172.21.15.49:0/3295960531 shutdown_connections 2023-11-18T21:00:24.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.180+0000 7fe7a3117640 1 --2- 172.21.15.49:0/3295960531 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe788066470 0x7fe788068930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:24.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.180+0000 7fe7a3117640 1 --2- 172.21.15.49:0/3295960531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe79c151720 0x7fe79c156f90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:24.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.180+0000 7fe7a3117640 1 --2- 172.21.15.49:0/3295960531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe79c151340 0x7fe79c156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:24.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.180+0000 7fe7a3117640 1 --2- 172.21.15.49:0/3295960531 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe79c0c40e0 0x7fe79c14ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:24.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.180+0000 7fe7a3117640 1 -- 172.21.15.49:0/3295960531 >> 172.21.15.49:0/3295960531 conn(0x7fe79c06c6a0 msgr2=0x7fe79c0c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:24.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.180+0000 7fe7a3117640 1 -- 172.21.15.49:0/3295960531 shutdown_connections 2023-11-18T21:00:24.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.180+0000 7fe7a3117640 1 -- 172.21.15.49:0/3295960531 wait complete. 2023-11-18T21:00:24.201 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-11-18T21:00:23.799403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599225,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":315,"num_write_kb":2471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":254,"ondisk_log_size":254,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236496,"kb_used_data":3728,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738224,"statfs":{"total":773094113280,"available":772851941376,"internally_reserved":0,"allocated":3817472,"data_stored":2177356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4218,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005273"},"pg_stats":[{"pgid":"2.1f","version":"29'9","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.538941+0000","last_change":"2023-11-18T20:59:25.350113+0000","last_active":"2023-11-18T21:00:17.538941+0000","last_peered":"2023-11-18T21:00:17.538941+0000","last_clean":"2023-11-18T21:00:17.538941+0000","last_became_active":"2023-11-18T20:59:25.349869+0000","last_became_peered":"2023-11-18T20:59:25.349869+0000","last_unstale":"2023-11-18T21:00:17.538941+0000","last_undegraded":"2023-11-18T21:00:17.538941+0000","last_fullsized":"2023-11-18T21:00:17.538941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:56:07.719325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.771586+0000","last_change":"2023-11-18T20:59:27.895973+0000","last_active":"2023-11-18T20:59:35.771586+0000","last_peered":"2023-11-18T20:59:35.771586+0000","last_clean":"2023-11-18T20:59:35.771586+0000","last_became_active":"2023-11-18T20:59:27.895678+0000","last_became_peered":"2023-11-18T20:59:27.895678+0000","last_unstale":"2023-11-18T20:59:35.771586+0000","last_undegraded":"2023-11-18T20:59:35.771586+0000","last_fullsized":"2023-11-18T20:59:35.771586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.784993+0000","last_change":"2023-11-18T20:59:35.848621+0000","last_active":"2023-11-18T20:59:36.784993+0000","last_peered":"2023-11-18T20:59:36.784993+0000","last_clean":"2023-11-18T20:59:36.784993+0000","last_became_active":"2023-11-18T20:59:35.848140+0000","last_became_peered":"2023-11-18T20:59:35.848140+0000","last_unstale":"2023-11-18T20:59:36.784993+0000","last_undegraded":"2023-11-18T20:59:36.784993+0000","last_fullsized":"2023-11-18T20:59:36.784993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:12.962470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947695+0000","last_change":"2023-11-18T20:59:25.463657+0000","last_active":"2023-11-18T20:59:37.947695+0000","last_peered":"2023-11-18T20:59:37.947695+0000","last_clean":"2023-11-18T20:59:37.947695+0000","last_became_active":"2023-11-18T20:59:25.463001+0000","last_became_peered":"2023-11-18T20:59:25.463001+0000","last_unstale":"2023-11-18T20:59:37.947695+0000","last_undegraded":"2023-11-18T20:59:37.947695+0000","last_fullsized":"2023-11-18T20:59:37.947695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.772550+0000","last_change":"2023-11-18T20:59:27.837801+0000","last_active":"2023-11-18T20:59:35.772550+0000","last_peered":"2023-11-18T20:59:35.772550+0000","last_clean":"2023-11-18T20:59:35.772550+0000","last_became_active":"2023-11-18T20:59:27.836937+0000","last_became_peered":"2023-11-18T20:59:27.836937+0000","last_unstale":"2023-11-18T20:59:35.772550+0000","last_undegraded":"2023-11-18T20:59:35.772550+0000","last_fullsized":"2023-11-18T20:59:35.772550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947102+0000","last_change":"2023-11-18T20:59:35.843015+0000","last_active":"2023-11-18T20:59:37.947102+0000","last_peered":"2023-11-18T20:59:37.947102+0000","last_clean":"2023-11-18T20:59:37.947102+0000","last_became_active":"2023-11-18T20:59:35.842552+0000","last_became_peered":"2023-11-18T20:59:35.842552+0000","last_unstale":"2023-11-18T20:59:37.947102+0000","last_undegraded":"2023-11-18T20:59:37.947102+0000","last_fullsized":"2023-11-18T20:59:37.947102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:17.222664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'7","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:21.928259+0000","last_change":"2023-11-18T20:59:25.497907+0000","last_active":"2023-11-18T21:00:21.928259+0000","last_peered":"2023-11-18T21:00:21.928259+0000","last_clean":"2023-11-18T21:00:21.928259+0000","last_became_active":"2023-11-18T20:59:25.497070+0000","last_became_peered":"2023-11-18T20:59:25.497070+0000","last_unstale":"2023-11-18T21:00:21.928259+0000","last_undegraded":"2023-11-18T21:00:21.928259+0000","last_fullsized":"2023-11-18T21:00:21.928259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769239+0000","last_change":"2023-11-18T20:59:27.868161+0000","last_active":"2023-11-18T20:59:35.769239+0000","last_peered":"2023-11-18T20:59:35.769239+0000","last_clean":"2023-11-18T20:59:35.769239+0000","last_became_active":"2023-11-18T20:59:27.867021+0000","last_became_peered":"2023-11-18T20:59:27.867021+0000","last_unstale":"2023-11-18T20:59:35.769239+0000","last_undegraded":"2023-11-18T20:59:35.769239+0000","last_fullsized":"2023-11-18T20:59:35.769239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.950153+0000","last_change":"2023-11-18T20:59:35.830210+0000","last_active":"2023-11-18T20:59:37.950153+0000","last_peered":"2023-11-18T20:59:37.950153+0000","last_clean":"2023-11-18T20:59:37.950153+0000","last_became_active":"2023-11-18T20:59:35.829636+0000","last_became_peered":"2023-11-18T20:59:35.829636+0000","last_unstale":"2023-11-18T20:59:37.950153+0000","last_undegraded":"2023-11-18T20:59:37.950153+0000","last_fullsized":"2023-11-18T20:59:37.950153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759499+0000","last_change":"2023-11-18T20:59:25.493859+0000","last_active":"2023-11-18T20:59:35.759499+0000","last_peered":"2023-11-18T20:59:35.759499+0000","last_clean":"2023-11-18T20:59:35.759499+0000","last_became_active":"2023-11-18T20:59:25.493087+0000","last_became_peered":"2023-11-18T20:59:25.493087+0000","last_unstale":"2023-11-18T20:59:35.759499+0000","last_undegraded":"2023-11-18T20:59:35.759499+0000","last_fullsized":"2023-11-18T20:59:35.759499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.697210+0000","last_change":"2023-11-18T20:59:27.871929+0000","last_active":"2023-11-18T20:59:35.697210+0000","last_peered":"2023-11-18T20:59:35.697210+0000","last_clean":"2023-11-18T20:59:35.697210+0000","last_became_active":"2023-11-18T20:59:27.871076+0000","last_became_peered":"2023-11-18T20:59:27.871076+0000","last_unstale":"2023-11-18T20:59:35.697210+0000","last_undegraded":"2023-11-18T20:59:35.697210+0000","last_fullsized":"2023-11-18T20:59:35.697210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:24:09.546791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.948997+0000","last_change":"2023-11-18T20:59:35.833547+0000","last_active":"2023-11-18T20:59:37.948997+0000","last_peered":"2023-11-18T20:59:37.948997+0000","last_clean":"2023-11-18T20:59:37.948997+0000","last_became_active":"2023-11-18T20:59:35.833016+0000","last_became_peered":"2023-11-18T20:59:35.833016+0000","last_unstale":"2023-11-18T20:59:37.948997+0000","last_undegraded":"2023-11-18T20:59:37.948997+0000","last_fullsized":"2023-11-18T20:59:37.948997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:58.416590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696332+0000","last_change":"2023-11-18T20:59:27.682005+0000","last_active":"2023-11-18T20:59:35.696332+0000","last_peered":"2023-11-18T20:59:35.696332+0000","last_clean":"2023-11-18T20:59:35.696332+0000","last_became_active":"2023-11-18T20:59:27.681154+0000","last_became_peered":"2023-11-18T20:59:27.681154+0000","last_unstale":"2023-11-18T20:59:35.696332+0000","last_undegraded":"2023-11-18T20:59:35.696332+0000","last_fullsized":"2023-11-18T20:59:35.696332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:10.426499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:09.997710+0000","last_change":"2023-11-18T20:59:25.339269+0000","last_active":"2023-11-18T21:00:09.997710+0000","last_peered":"2023-11-18T21:00:09.997710+0000","last_clean":"2023-11-18T21:00:09.997710+0000","last_became_active":"2023-11-18T20:59:25.338067+0000","last_became_peered":"2023-11-18T20:59:25.338067+0000","last_unstale":"2023-11-18T21:00:09.997710+0000","last_undegraded":"2023-11-18T21:00:09.997710+0000","last_fullsized":"2023-11-18T21:00:09.997710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.310566+0000","last_change":"2023-11-18T20:59:35.776790+0000","last_active":"2023-11-18T20:59:37.310566+0000","last_peered":"2023-11-18T20:59:37.310566+0000","last_clean":"2023-11-18T20:59:37.310566+0000","last_became_active":"2023-11-18T20:59:35.776286+0000","last_became_peered":"2023-11-18T20:59:35.776286+0000","last_unstale":"2023-11-18T20:59:37.310566+0000","last_undegraded":"2023-11-18T20:59:37.310566+0000","last_fullsized":"2023-11-18T20:59:37.310566+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:06.870579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.682428+0000","last_change":"2023-11-18T20:59:27.861550+0000","last_active":"2023-11-18T20:59:35.682428+0000","last_peered":"2023-11-18T20:59:35.682428+0000","last_clean":"2023-11-18T20:59:35.682428+0000","last_became_active":"2023-11-18T20:59:27.861045+0000","last_became_peered":"2023-11-18T20:59:27.861045+0000","last_unstale":"2023-11-18T20:59:35.682428+0000","last_undegraded":"2023-11-18T20:59:35.682428+0000","last_fullsized":"2023-11-18T20:59:35.682428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:16.262503+0000","last_change":"2023-11-18T20:59:25.458601+0000","last_active":"2023-11-18T21:00:16.262503+0000","last_peered":"2023-11-18T21:00:16.262503+0000","last_clean":"2023-11-18T21:00:16.262503+0000","last_became_active":"2023-11-18T20:59:25.457871+0000","last_became_peered":"2023-11-18T20:59:25.457871+0000","last_unstale":"2023-11-18T21:00:16.262503+0000","last_undegraded":"2023-11-18T21:00:16.262503+0000","last_fullsized":"2023-11-18T21:00:16.262503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:09.387812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.685157+0000","last_change":"2023-11-18T20:59:35.842967+0000","last_active":"2023-11-18T20:59:36.685157+0000","last_peered":"2023-11-18T20:59:36.685157+0000","last_clean":"2023-11-18T20:59:36.685157+0000","last_became_active":"2023-11-18T20:59:35.842583+0000","last_became_peered":"2023-11-18T20:59:35.842583+0000","last_unstale":"2023-11-18T20:59:36.685157+0000","last_undegraded":"2023-11-18T20:59:36.685157+0000","last_fullsized":"2023-11-18T20:59:36.685157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:40.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.824183+0000","last_change":"2023-11-18T20:59:27.688043+0000","last_active":"2023-11-18T20:59:35.824183+0000","last_peered":"2023-11-18T20:59:35.824183+0000","last_clean":"2023-11-18T20:59:35.824183+0000","last_became_active":"2023-11-18T20:59:27.687250+0000","last_became_peered":"2023-11-18T20:59:27.687250+0000","last_unstale":"2023-11-18T20:59:35.824183+0000","last_undegraded":"2023-11-18T20:59:35.824183+0000","last_fullsized":"2023-11-18T20:59:35.824183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:16:48.432607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.225926+0000","last_change":"2023-11-18T20:59:25.351927+0000","last_active":"2023-11-18T21:00:10.225926+0000","last_peered":"2023-11-18T21:00:10.225926+0000","last_clean":"2023-11-18T21:00:10.225926+0000","last_became_active":"2023-11-18T20:59:25.351318+0000","last_became_peered":"2023-11-18T20:59:25.351318+0000","last_unstale":"2023-11-18T21:00:10.225926+0000","last_undegraded":"2023-11-18T21:00:10.225926+0000","last_fullsized":"2023-11-18T21:00:10.225926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:20:38.006315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.785771+0000","last_change":"2023-11-18T20:59:35.835375+0000","last_active":"2023-11-18T20:59:36.785771+0000","last_peered":"2023-11-18T20:59:36.785771+0000","last_clean":"2023-11-18T20:59:36.785771+0000","last_became_active":"2023-11-18T20:59:35.834894+0000","last_became_peered":"2023-11-18T20:59:35.834894+0000","last_unstale":"2023-11-18T20:59:36.785771+0000","last_undegraded":"2023-11-18T20:59:36.785771+0000","last_fullsized":"2023-11-18T20:59:36.785771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:33.448377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.695870+0000","last_change":"2023-11-18T20:59:27.687356+0000","last_active":"2023-11-18T20:59:35.695870+0000","last_peered":"2023-11-18T20:59:35.695870+0000","last_clean":"2023-11-18T20:59:35.695870+0000","last_became_active":"2023-11-18T20:59:27.686692+0000","last_became_peered":"2023-11-18T20:59:27.686692+0000","last_unstale":"2023-11-18T20:59:35.695870+0000","last_undegraded":"2023-11-18T20:59:35.695870+0000","last_fullsized":"2023-11-18T20:59:35.695870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:20:58.633153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.169191+0000","last_change":"2023-11-18T20:59:25.347589+0000","last_active":"2023-11-18T21:00:10.169191+0000","last_peered":"2023-11-18T21:00:10.169191+0000","last_clean":"2023-11-18T21:00:10.169191+0000","last_became_active":"2023-11-18T20:59:25.347022+0000","last_became_peered":"2023-11-18T20:59:25.347022+0000","last_unstale":"2023-11-18T21:00:10.169191+0000","last_undegraded":"2023-11-18T21:00:10.169191+0000","last_fullsized":"2023-11-18T21:00:10.169191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.949612+0000","last_change":"2023-11-18T20:59:35.771398+0000","last_active":"2023-11-18T20:59:37.949612+0000","last_peered":"2023-11-18T20:59:37.949612+0000","last_clean":"2023-11-18T20:59:37.949612+0000","last_became_active":"2023-11-18T20:59:35.770923+0000","last_became_peered":"2023-11-18T20:59:35.770923+0000","last_unstale":"2023-11-18T20:59:37.949612+0000","last_undegraded":"2023-11-18T20:59:37.949612+0000","last_fullsized":"2023-11-18T20:59:37.949612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.824728+0000","last_change":"2023-11-18T20:59:27.689972+0000","last_active":"2023-11-18T20:59:35.824728+0000","last_peered":"2023-11-18T20:59:35.824728+0000","last_clean":"2023-11-18T20:59:35.824728+0000","last_became_active":"2023-11-18T20:59:27.689156+0000","last_became_peered":"2023-11-18T20:59:27.689156+0000","last_unstale":"2023-11-18T20:59:35.824728+0000","last_undegraded":"2023-11-18T20:59:35.824728+0000","last_fullsized":"2023-11-18T20:59:35.824728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:58.264895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:09.999740+0000","last_change":"2023-11-18T20:59:25.348005+0000","last_active":"2023-11-18T21:00:09.999740+0000","last_peered":"2023-11-18T21:00:09.999740+0000","last_clean":"2023-11-18T21:00:09.999740+0000","last_became_active":"2023-11-18T20:59:25.346318+0000","last_became_peered":"2023-11-18T20:59:25.346318+0000","last_unstale":"2023-11-18T21:00:09.999740+0000","last_undegraded":"2023-11-18T21:00:09.999740+0000","last_fullsized":"2023-11-18T21:00:09.999740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:37.045716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947894+0000","last_change":"2023-11-18T20:59:35.833754+0000","last_active":"2023-11-18T20:59:37.947894+0000","last_peered":"2023-11-18T20:59:37.947894+0000","last_clean":"2023-11-18T20:59:37.947894+0000","last_became_active":"2023-11-18T20:59:35.833407+0000","last_became_peered":"2023-11-18T20:59:35.833407+0000","last_unstale":"2023-11-18T20:59:37.947894+0000","last_undegraded":"2023-11-18T20:59:37.947894+0000","last_fullsized":"2023-11-18T20:59:37.947894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:38:06.355389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.827293+0000","last_change":"2023-11-18T20:59:27.863887+0000","last_active":"2023-11-18T20:59:35.827293+0000","last_peered":"2023-11-18T20:59:35.827293+0000","last_clean":"2023-11-18T20:59:35.827293+0000","last_became_active":"2023-11-18T20:59:27.863358+0000","last_became_peered":"2023-11-18T20:59:27.863358+0000","last_unstale":"2023-11-18T20:59:35.827293+0000","last_undegraded":"2023-11-18T20:59:35.827293+0000","last_fullsized":"2023-11-18T20:59:35.827293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:50.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.534249+0000","last_change":"2023-11-18T20:59:25.351394+0000","last_active":"2023-11-18T21:00:17.534249+0000","last_peered":"2023-11-18T21:00:17.534249+0000","last_clean":"2023-11-18T21:00:17.534249+0000","last_became_active":"2023-11-18T20:59:25.350705+0000","last_became_peered":"2023-11-18T20:59:25.350705+0000","last_unstale":"2023-11-18T21:00:17.534249+0000","last_undegraded":"2023-11-18T21:00:17.534249+0000","last_fullsized":"2023-11-18T21:00:17.534249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:01:57.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.687959+0000","last_change":"2023-11-18T20:59:35.840991+0000","last_active":"2023-11-18T20:59:36.687959+0000","last_peered":"2023-11-18T20:59:36.687959+0000","last_clean":"2023-11-18T20:59:36.687959+0000","last_became_active":"2023-11-18T20:59:35.840533+0000","last_became_peered":"2023-11-18T20:59:35.840533+0000","last_unstale":"2023-11-18T20:59:36.687959+0000","last_undegraded":"2023-11-18T20:59:36.687959+0000","last_fullsized":"2023-11-18T20:59:36.687959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:06:47.876845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.821773+0000","last_change":"2023-11-18T20:59:27.869100+0000","last_active":"2023-11-18T20:59:35.821773+0000","last_peered":"2023-11-18T20:59:35.821773+0000","last_clean":"2023-11-18T20:59:35.821773+0000","last_became_active":"2023-11-18T20:59:27.868355+0000","last_became_peered":"2023-11-18T20:59:27.868355+0000","last_unstale":"2023-11-18T20:59:35.821773+0000","last_undegraded":"2023-11-18T20:59:35.821773+0000","last_fullsized":"2023-11-18T20:59:35.821773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:25.235096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:21.772713+0000","last_change":"2023-11-18T20:59:25.350304+0000","last_active":"2023-11-18T21:00:21.772713+0000","last_peered":"2023-11-18T21:00:21.772713+0000","last_clean":"2023-11-18T21:00:21.772713+0000","last_became_active":"2023-11-18T20:59:25.349346+0000","last_became_peered":"2023-11-18T20:59:25.349346+0000","last_unstale":"2023-11-18T21:00:21.772713+0000","last_undegraded":"2023-11-18T21:00:21.772713+0000","last_fullsized":"2023-11-18T21:00:21.772713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:41.179268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.445590+0000","last_change":"2023-11-18T20:59:35.847005+0000","last_active":"2023-11-18T20:59:37.445590+0000","last_peered":"2023-11-18T20:59:37.445590+0000","last_clean":"2023-11-18T20:59:37.445590+0000","last_became_active":"2023-11-18T20:59:35.846458+0000","last_became_peered":"2023-11-18T20:59:35.846458+0000","last_unstale":"2023-11-18T20:59:37.445590+0000","last_undegraded":"2023-11-18T20:59:37.445590+0000","last_fullsized":"2023-11-18T20:59:37.445590+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746436+0000","last_change":"2023-11-18T20:59:27.889369+0000","last_active":"2023-11-18T20:59:35.746436+0000","last_peered":"2023-11-18T20:59:35.746436+0000","last_clean":"2023-11-18T20:59:35.746436+0000","last_became_active":"2023-11-18T20:59:27.887876+0000","last_became_peered":"2023-11-18T20:59:27.887876+0000","last_unstale":"2023-11-18T20:59:35.746436+0000","last_undegraded":"2023-11-18T20:59:35.746436+0000","last_fullsized":"2023-11-18T20:59:35.746436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:38.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.946619+0000","last_change":"2023-11-18T20:59:25.459620+0000","last_active":"2023-11-18T20:59:37.946619+0000","last_peered":"2023-11-18T20:59:37.946619+0000","last_clean":"2023-11-18T20:59:37.946619+0000","last_became_active":"2023-11-18T20:59:25.459235+0000","last_became_peered":"2023-11-18T20:59:25.459235+0000","last_unstale":"2023-11-18T20:59:37.946619+0000","last_undegraded":"2023-11-18T20:59:37.946619+0000","last_fullsized":"2023-11-18T20:59:37.946619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:02.325885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.445133+0000","last_change":"2023-11-18T20:59:35.835800+0000","last_active":"2023-11-18T20:59:37.445133+0000","last_peered":"2023-11-18T20:59:37.445133+0000","last_clean":"2023-11-18T20:59:37.445133+0000","last_became_active":"2023-11-18T20:59:35.834275+0000","last_became_peered":"2023-11-18T20:59:35.834275+0000","last_unstale":"2023-11-18T20:59:37.445133+0000","last_undegraded":"2023-11-18T20:59:37.445133+0000","last_fullsized":"2023-11-18T20:59:37.445133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.758369+0000","last_change":"2023-11-18T20:59:27.892676+0000","last_active":"2023-11-18T20:59:35.758369+0000","last_peered":"2023-11-18T20:59:35.758369+0000","last_clean":"2023-11-18T20:59:35.758369+0000","last_became_active":"2023-11-18T20:59:27.892150+0000","last_became_peered":"2023-11-18T20:59:27.892150+0000","last_unstale":"2023-11-18T20:59:35.758369+0000","last_undegraded":"2023-11-18T20:59:35.758369+0000","last_fullsized":"2023-11-18T20:59:35.758369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:04.716391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311063+0000","last_change":"2023-11-18T20:59:25.355096+0000","last_active":"2023-11-18T20:59:37.311063+0000","last_peered":"2023-11-18T20:59:37.311063+0000","last_clean":"2023-11-18T20:59:37.311063+0000","last_became_active":"2023-11-18T20:59:25.354716+0000","last_became_peered":"2023-11-18T20:59:25.354716+0000","last_unstale":"2023-11-18T20:59:37.311063+0000","last_undegraded":"2023-11-18T20:59:37.311063+0000","last_fullsized":"2023-11-18T20:59:37.311063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:51.039181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.446212+0000","last_change":"2023-11-18T20:59:35.839218+0000","last_active":"2023-11-18T20:59:37.446212+0000","last_peered":"2023-11-18T20:59:37.446212+0000","last_clean":"2023-11-18T20:59:37.446212+0000","last_became_active":"2023-11-18T20:59:35.838732+0000","last_became_peered":"2023-11-18T20:59:35.838732+0000","last_unstale":"2023-11-18T20:59:37.446212+0000","last_undegraded":"2023-11-18T20:59:37.446212+0000","last_fullsized":"2023-11-18T20:59:37.446212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:50.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769410+0000","last_change":"2023-11-18T20:59:27.839403+0000","last_active":"2023-11-18T20:59:35.769410+0000","last_peered":"2023-11-18T20:59:35.769410+0000","last_clean":"2023-11-18T20:59:35.769410+0000","last_became_active":"2023-11-18T20:59:27.838664+0000","last_became_peered":"2023-11-18T20:59:27.838664+0000","last_unstale":"2023-11-18T20:59:35.769410+0000","last_undegraded":"2023-11-18T20:59:35.769410+0000","last_fullsized":"2023-11-18T20:59:35.769410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.446537+0000","last_change":"2023-11-18T20:59:25.458840+0000","last_active":"2023-11-18T21:00:17.446537+0000","last_peered":"2023-11-18T21:00:17.446537+0000","last_clean":"2023-11-18T21:00:17.446537+0000","last_became_active":"2023-11-18T20:59:25.458075+0000","last_became_peered":"2023-11-18T20:59:25.458075+0000","last_unstale":"2023-11-18T21:00:17.446537+0000","last_undegraded":"2023-11-18T21:00:17.446537+0000","last_fullsized":"2023-11-18T21:00:17.446537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:48.644992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.446595+0000","last_change":"2023-11-18T20:59:35.833736+0000","last_active":"2023-11-18T20:59:37.446595+0000","last_peered":"2023-11-18T20:59:37.446595+0000","last_clean":"2023-11-18T20:59:37.446595+0000","last_became_active":"2023-11-18T20:59:35.832891+0000","last_became_peered":"2023-11-18T20:59:35.832891+0000","last_unstale":"2023-11-18T20:59:37.446595+0000","last_undegraded":"2023-11-18T20:59:37.446595+0000","last_fullsized":"2023-11-18T20:59:37.446595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:12.929672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819600+0000","last_change":"2023-11-18T20:59:27.889690+0000","last_active":"2023-11-18T20:59:35.819600+0000","last_peered":"2023-11-18T20:59:35.819600+0000","last_clean":"2023-11-18T20:59:35.819600+0000","last_became_active":"2023-11-18T20:59:27.889115+0000","last_became_peered":"2023-11-18T20:59:27.889115+0000","last_unstale":"2023-11-18T20:59:35.819600+0000","last_undegraded":"2023-11-18T20:59:35.819600+0000","last_fullsized":"2023-11-18T20:59:35.819600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:57:08.995074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.515002+0000","last_change":"2023-11-18T20:59:25.460190+0000","last_active":"2023-11-18T21:00:17.515002+0000","last_peered":"2023-11-18T21:00:17.515002+0000","last_clean":"2023-11-18T21:00:17.515002+0000","last_became_active":"2023-11-18T20:59:25.459405+0000","last_became_peered":"2023-11-18T20:59:25.459405+0000","last_unstale":"2023-11-18T21:00:17.515002+0000","last_undegraded":"2023-11-18T21:00:17.515002+0000","last_fullsized":"2023-11-18T21:00:17.515002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947065+0000","last_change":"2023-11-18T20:59:35.842229+0000","last_active":"2023-11-18T20:59:37.947065+0000","last_peered":"2023-11-18T20:59:37.947065+0000","last_clean":"2023-11-18T20:59:37.947065+0000","last_became_active":"2023-11-18T20:59:35.835644+0000","last_became_peered":"2023-11-18T20:59:35.835644+0000","last_unstale":"2023-11-18T20:59:37.947065+0000","last_undegraded":"2023-11-18T20:59:37.947065+0000","last_fullsized":"2023-11-18T20:59:37.947065+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:28.212029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.822632+0000","last_change":"2023-11-18T20:59:27.890885+0000","last_active":"2023-11-18T20:59:35.822632+0000","last_peered":"2023-11-18T20:59:35.822632+0000","last_clean":"2023-11-18T20:59:35.822632+0000","last_became_active":"2023-11-18T20:59:27.890499+0000","last_became_peered":"2023-11-18T20:59:27.890499+0000","last_unstale":"2023-11-18T20:59:35.822632+0000","last_undegraded":"2023-11-18T20:59:35.822632+0000","last_fullsized":"2023-11-18T20:59:35.822632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:33:26.362872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:21.754564+0000","last_change":"2023-11-18T20:59:25.339255+0000","last_active":"2023-11-18T21:00:21.754564+0000","last_peered":"2023-11-18T21:00:21.754564+0000","last_clean":"2023-11-18T21:00:21.754564+0000","last_became_active":"2023-11-18T20:59:25.338020+0000","last_became_peered":"2023-11-18T20:59:25.338020+0000","last_unstale":"2023-11-18T21:00:21.754564+0000","last_undegraded":"2023-11-18T21:00:21.754564+0000","last_fullsized":"2023-11-18T21:00:21.754564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:07.183625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769201+0000","last_change":"2023-11-18T20:58:44.731742+0000","last_active":"2023-11-18T20:59:35.769201+0000","last_peered":"2023-11-18T20:59:35.769201+0000","last_clean":"2023-11-18T20:59:35.769201+0000","last_became_active":"2023-11-18T20:58:44.731076+0000","last_became_peered":"2023-11-18T20:58:44.731076+0000","last_unstale":"2023-11-18T20:59:35.769201+0000","last_undegraded":"2023-11-18T20:59:35.769201+0000","last_fullsized":"2023-11-18T20:59:35.769201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:58:42.561435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:58:42.561435+0000","last_clean_scrub_stamp":"2023-11-18T20:58:42.561435+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:48:40.458317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311487+0000","last_change":"2023-11-18T20:59:35.771637+0000","last_active":"2023-11-18T20:59:37.311487+0000","last_peered":"2023-11-18T20:59:37.311487+0000","last_clean":"2023-11-18T20:59:37.311487+0000","last_became_active":"2023-11-18T20:59:35.771146+0000","last_became_peered":"2023-11-18T20:59:35.771146+0000","last_unstale":"2023-11-18T20:59:37.311487+0000","last_undegraded":"2023-11-18T20:59:37.311487+0000","last_fullsized":"2023-11-18T20:59:37.311487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:15.290602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.697296+0000","last_change":"2023-11-18T20:59:27.684091+0000","last_active":"2023-11-18T20:59:35.697296+0000","last_peered":"2023-11-18T20:59:35.697296+0000","last_clean":"2023-11-18T20:59:35.697296+0000","last_became_active":"2023-11-18T20:59:27.683316+0000","last_became_peered":"2023-11-18T20:59:27.683316+0000","last_unstale":"2023-11-18T20:59:35.697296+0000","last_undegraded":"2023-11-18T20:59:35.697296+0000","last_fullsized":"2023-11-18T20:59:35.697296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:52:02.757528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:21.750687+0000","last_change":"2023-11-18T20:59:25.357198+0000","last_active":"2023-11-18T21:00:21.750687+0000","last_peered":"2023-11-18T21:00:21.750687+0000","last_clean":"2023-11-18T21:00:21.750687+0000","last_became_active":"2023-11-18T20:59:25.356883+0000","last_became_peered":"2023-11-18T20:59:25.356883+0000","last_unstale":"2023-11-18T21:00:21.750687+0000","last_undegraded":"2023-11-18T21:00:21.750687+0000","last_fullsized":"2023-11-18T21:00:21.750687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:09.508737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.949273+0000","last_change":"2023-11-18T20:59:35.834266+0000","last_active":"2023-11-18T20:59:37.949273+0000","last_peered":"2023-11-18T20:59:37.949273+0000","last_clean":"2023-11-18T20:59:37.949273+0000","last_became_active":"2023-11-18T20:59:35.833790+0000","last_became_peered":"2023-11-18T20:59:35.833790+0000","last_unstale":"2023-11-18T20:59:37.949273+0000","last_undegraded":"2023-11-18T20:59:37.949273+0000","last_fullsized":"2023-11-18T20:59:37.949273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:08.464650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759162+0000","last_change":"2023-11-18T20:59:27.873828+0000","last_active":"2023-11-18T20:59:35.759162+0000","last_peered":"2023-11-18T20:59:35.759162+0000","last_clean":"2023-11-18T20:59:35.759162+0000","last_became_active":"2023-11-18T20:59:27.872733+0000","last_became_peered":"2023-11-18T20:59:27.872733+0000","last_unstale":"2023-11-18T20:59:35.759162+0000","last_undegraded":"2023-11-18T20:59:35.759162+0000","last_fullsized":"2023-11-18T20:59:35.759162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.946934+0000","last_change":"2023-11-18T20:59:25.497529+0000","last_active":"2023-11-18T20:59:37.946934+0000","last_peered":"2023-11-18T20:59:37.946934+0000","last_clean":"2023-11-18T20:59:37.946934+0000","last_became_active":"2023-11-18T20:59:25.496694+0000","last_became_peered":"2023-11-18T20:59:25.496694+0000","last_unstale":"2023-11-18T20:59:37.946934+0000","last_undegraded":"2023-11-18T20:59:37.946934+0000","last_fullsized":"2023-11-18T20:59:37.946934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947265+0000","last_change":"2023-11-18T20:59:35.829393+0000","last_active":"2023-11-18T20:59:37.947265+0000","last_peered":"2023-11-18T20:59:37.947265+0000","last_clean":"2023-11-18T20:59:37.947265+0000","last_became_active":"2023-11-18T20:59:35.828446+0000","last_became_peered":"2023-11-18T20:59:35.828446+0000","last_unstale":"2023-11-18T20:59:37.947265+0000","last_undegraded":"2023-11-18T20:59:37.947265+0000","last_fullsized":"2023-11-18T20:59:37.947265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:33.544336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759870+0000","last_change":"2023-11-18T20:59:27.875122+0000","last_active":"2023-11-18T20:59:35.759870+0000","last_peered":"2023-11-18T20:59:35.759870+0000","last_clean":"2023-11-18T20:59:35.759870+0000","last_became_active":"2023-11-18T20:59:27.870220+0000","last_became_peered":"2023-11-18T20:59:27.870220+0000","last_unstale":"2023-11-18T20:59:35.759870+0000","last_undegraded":"2023-11-18T20:59:35.759870+0000","last_fullsized":"2023-11-18T20:59:35.759870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:39.557454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.825276+0000","last_change":"2023-11-18T20:59:25.457826+0000","last_active":"2023-11-18T20:59:35.825276+0000","last_peered":"2023-11-18T20:59:35.825276+0000","last_clean":"2023-11-18T20:59:35.825276+0000","last_became_active":"2023-11-18T20:59:25.457392+0000","last_became_peered":"2023-11-18T20:59:25.457392+0000","last_unstale":"2023-11-18T20:59:35.825276+0000","last_undegraded":"2023-11-18T20:59:35.825276+0000","last_fullsized":"2023-11-18T20:59:35.825276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:07:56.724852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.309761+0000","last_change":"2023-11-18T20:59:35.831579+0000","last_active":"2023-11-18T20:59:37.309761+0000","last_peered":"2023-11-18T20:59:37.309761+0000","last_clean":"2023-11-18T20:59:37.309761+0000","last_became_active":"2023-11-18T20:59:35.831147+0000","last_became_peered":"2023-11-18T20:59:35.831147+0000","last_unstale":"2023-11-18T20:59:37.309761+0000","last_undegraded":"2023-11-18T20:59:37.309761+0000","last_fullsized":"2023-11-18T20:59:37.309761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:08.730686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746569+0000","last_change":"2023-11-18T20:59:27.895618+0000","last_active":"2023-11-18T20:59:35.746569+0000","last_peered":"2023-11-18T20:59:35.746569+0000","last_clean":"2023-11-18T20:59:35.746569+0000","last_became_active":"2023-11-18T20:59:27.894931+0000","last_became_peered":"2023-11-18T20:59:27.894931+0000","last_unstale":"2023-11-18T20:59:35.746569+0000","last_undegraded":"2023-11-18T20:59:35.746569+0000","last_fullsized":"2023-11-18T20:59:35.746569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:33.165546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.686404+0000","last_change":"2023-11-18T20:59:25.458603+0000","last_active":"2023-11-18T20:59:36.686404+0000","last_peered":"2023-11-18T20:59:36.686404+0000","last_clean":"2023-11-18T20:59:36.686404+0000","last_became_active":"2023-11-18T20:59:25.457932+0000","last_became_peered":"2023-11-18T20:59:25.457932+0000","last_unstale":"2023-11-18T20:59:36.686404+0000","last_undegraded":"2023-11-18T20:59:36.686404+0000","last_fullsized":"2023-11-18T20:59:36.686404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.948121+0000","last_change":"2023-11-18T20:59:35.832209+0000","last_active":"2023-11-18T20:59:37.948121+0000","last_peered":"2023-11-18T20:59:37.948121+0000","last_clean":"2023-11-18T20:59:37.948121+0000","last_became_active":"2023-11-18T20:59:35.831804+0000","last_became_peered":"2023-11-18T20:59:35.831804+0000","last_unstale":"2023-11-18T20:59:37.948121+0000","last_undegraded":"2023-11-18T20:59:37.948121+0000","last_fullsized":"2023-11-18T20:59:37.948121+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:13.050905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.695775+0000","last_change":"2023-11-18T20:59:27.884733+0000","last_active":"2023-11-18T20:59:35.695775+0000","last_peered":"2023-11-18T20:59:35.695775+0000","last_clean":"2023-11-18T20:59:35.695775+0000","last_became_active":"2023-11-18T20:59:27.884143+0000","last_became_peered":"2023-11-18T20:59:27.884143+0000","last_unstale":"2023-11-18T20:59:35.695775+0000","last_undegraded":"2023-11-18T20:59:35.695775+0000","last_fullsized":"2023-11-18T20:59:35.695775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:32.466816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'15","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.539089+0000","last_change":"2023-11-18T20:59:25.362761+0000","last_active":"2023-11-18T21:00:17.539089+0000","last_peered":"2023-11-18T21:00:17.539089+0000","last_clean":"2023-11-18T21:00:17.539089+0000","last_became_active":"2023-11-18T20:59:25.362350+0000","last_became_peered":"2023-11-18T20:59:25.362350+0000","last_unstale":"2023-11-18T21:00:17.539089+0000","last_undegraded":"2023-11-18T21:00:17.539089+0000","last_fullsized":"2023-11-18T21:00:17.539089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:32:54.741681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947512+0000","last_change":"2023-11-18T20:59:35.836797+0000","last_active":"2023-11-18T20:59:37.947512+0000","last_peered":"2023-11-18T20:59:37.947512+0000","last_clean":"2023-11-18T20:59:37.947512+0000","last_became_active":"2023-11-18T20:59:35.834153+0000","last_became_peered":"2023-11-18T20:59:35.834153+0000","last_unstale":"2023-11-18T20:59:37.947512+0000","last_undegraded":"2023-11-18T20:59:37.947512+0000","last_fullsized":"2023-11-18T20:59:37.947512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:18.639780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.768765+0000","last_change":"2023-11-18T20:59:27.841401+0000","last_active":"2023-11-18T20:59:35.768765+0000","last_peered":"2023-11-18T20:59:35.768765+0000","last_clean":"2023-11-18T20:59:35.768765+0000","last_became_active":"2023-11-18T20:59:27.840852+0000","last_became_peered":"2023-11-18T20:59:27.840852+0000","last_unstale":"2023-11-18T20:59:35.768765+0000","last_undegraded":"2023-11-18T20:59:35.768765+0000","last_fullsized":"2023-11-18T20:59:35.768765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:21.927324+0000","last_change":"2023-11-18T20:59:25.351707+0000","last_active":"2023-11-18T21:00:21.927324+0000","last_peered":"2023-11-18T21:00:21.927324+0000","last_clean":"2023-11-18T21:00:21.927324+0000","last_became_active":"2023-11-18T20:59:25.351149+0000","last_became_peered":"2023-11-18T20:59:25.351149+0000","last_unstale":"2023-11-18T21:00:21.927324+0000","last_undegraded":"2023-11-18T21:00:21.927324+0000","last_fullsized":"2023-11-18T21:00:21.927324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:37:55.630369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.947503+0000","last_change":"2023-11-18T20:59:35.844046+0000","last_active":"2023-11-18T20:59:37.947503+0000","last_peered":"2023-11-18T20:59:37.947503+0000","last_clean":"2023-11-18T20:59:37.947503+0000","last_became_active":"2023-11-18T20:59:35.843208+0000","last_became_peered":"2023-11-18T20:59:35.843208+0000","last_unstale":"2023-11-18T20:59:37.947503+0000","last_undegraded":"2023-11-18T20:59:37.947503+0000","last_fullsized":"2023-11-18T20:59:37.947503+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:21:06.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696069+0000","last_change":"2023-11-18T20:59:27.866997+0000","last_active":"2023-11-18T20:59:35.696069+0000","last_peered":"2023-11-18T20:59:35.696069+0000","last_clean":"2023-11-18T20:59:35.696069+0000","last_became_active":"2023-11-18T20:59:27.866233+0000","last_became_peered":"2023-11-18T20:59:27.866233+0000","last_unstale":"2023-11-18T20:59:35.696069+0000","last_undegraded":"2023-11-18T20:59:35.696069+0000","last_fullsized":"2023-11-18T20:59:35.696069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:19.998748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:09.999914+0000","last_change":"2023-11-18T20:59:25.362589+0000","last_active":"2023-11-18T21:00:09.999914+0000","last_peered":"2023-11-18T21:00:09.999914+0000","last_clean":"2023-11-18T21:00:09.999914+0000","last_became_active":"2023-11-18T20:59:25.362287+0000","last_became_peered":"2023-11-18T20:59:25.362287+0000","last_unstale":"2023-11-18T21:00:09.999914+0000","last_undegraded":"2023-11-18T21:00:09.999914+0000","last_fullsized":"2023-11-18T21:00:09.999914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:24.791294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.446156+0000","last_change":"2023-11-18T20:59:35.846859+0000","last_active":"2023-11-18T20:59:37.446156+0000","last_peered":"2023-11-18T20:59:37.446156+0000","last_clean":"2023-11-18T20:59:37.446156+0000","last_became_active":"2023-11-18T20:59:35.845378+0000","last_became_peered":"2023-11-18T20:59:35.845378+0000","last_unstale":"2023-11-18T20:59:37.446156+0000","last_undegraded":"2023-11-18T20:59:37.446156+0000","last_fullsized":"2023-11-18T20:59:37.446156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.820183+0000","last_change":"2023-11-18T20:59:27.863967+0000","last_active":"2023-11-18T20:59:35.820183+0000","last_peered":"2023-11-18T20:59:35.820183+0000","last_clean":"2023-11-18T20:59:35.820183+0000","last_became_active":"2023-11-18T20:59:27.863435+0000","last_became_peered":"2023-11-18T20:59:27.863435+0000","last_unstale":"2023-11-18T20:59:35.820183+0000","last_undegraded":"2023-11-18T20:59:35.820183+0000","last_fullsized":"2023-11-18T20:59:35.820183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:04.837624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'7","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.445977+0000","last_change":"2023-11-18T20:59:25.361677+0000","last_active":"2023-11-18T21:00:17.445977+0000","last_peered":"2023-11-18T21:00:17.445977+0000","last_clean":"2023-11-18T21:00:17.445977+0000","last_became_active":"2023-11-18T20:59:25.361313+0000","last_became_peered":"2023-11-18T20:59:25.361313+0000","last_unstale":"2023-11-18T21:00:17.445977+0000","last_undegraded":"2023-11-18T21:00:17.445977+0000","last_fullsized":"2023-11-18T21:00:17.445977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311637+0000","last_change":"2023-11-18T20:59:35.832893+0000","last_active":"2023-11-18T20:59:37.311637+0000","last_peered":"2023-11-18T20:59:37.311637+0000","last_clean":"2023-11-18T20:59:37.311637+0000","last_became_active":"2023-11-18T20:59:35.832562+0000","last_became_peered":"2023-11-18T20:59:35.832562+0000","last_unstale":"2023-11-18T20:59:37.311637+0000","last_undegraded":"2023-11-18T20:59:37.311637+0000","last_fullsized":"2023-11-18T20:59:37.311637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:53:05.127511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759692+0000","last_change":"2023-11-18T20:59:27.874128+0000","last_active":"2023-11-18T20:59:35.759692+0000","last_peered":"2023-11-18T20:59:35.759692+0000","last_clean":"2023-11-18T20:59:35.759692+0000","last_became_active":"2023-11-18T20:59:27.865971+0000","last_became_peered":"2023-11-18T20:59:27.865971+0000","last_unstale":"2023-11-18T20:59:35.759692+0000","last_undegraded":"2023-11-18T20:59:35.759692+0000","last_fullsized":"2023-11-18T20:59:35.759692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.005456+0000","last_change":"2023-11-18T20:59:25.350262+0000","last_active":"2023-11-18T21:00:10.005456+0000","last_peered":"2023-11-18T21:00:10.005456+0000","last_clean":"2023-11-18T21:00:10.005456+0000","last_became_active":"2023-11-18T20:59:25.349577+0000","last_became_peered":"2023-11-18T20:59:25.349577+0000","last_unstale":"2023-11-18T21:00:10.005456+0000","last_undegraded":"2023-11-18T21:00:10.005456+0000","last_fullsized":"2023-11-18T21:00:10.005456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.688756+0000","last_change":"2023-11-18T20:59:35.849720+0000","last_active":"2023-11-18T20:59:36.688756+0000","last_peered":"2023-11-18T20:59:36.688756+0000","last_clean":"2023-11-18T20:59:36.688756+0000","last_became_active":"2023-11-18T20:59:35.848000+0000","last_became_peered":"2023-11-18T20:59:35.848000+0000","last_unstale":"2023-11-18T20:59:36.688756+0000","last_undegraded":"2023-11-18T20:59:36.688756+0000","last_fullsized":"2023-11-18T20:59:36.688756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:41:54.553006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696849+0000","last_change":"2023-11-18T20:59:27.891817+0000","last_active":"2023-11-18T20:59:35.696849+0000","last_peered":"2023-11-18T20:59:35.696849+0000","last_clean":"2023-11-18T20:59:35.696849+0000","last_became_active":"2023-11-18T20:59:27.891260+0000","last_became_peered":"2023-11-18T20:59:27.891260+0000","last_unstale":"2023-11-18T20:59:35.696849+0000","last_undegraded":"2023-11-18T20:59:35.696849+0000","last_fullsized":"2023-11-18T20:59:35.696849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:25.331055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.226396+0000","last_change":"2023-11-18T20:59:25.363983+0000","last_active":"2023-11-18T21:00:10.226396+0000","last_peered":"2023-11-18T21:00:10.226396+0000","last_clean":"2023-11-18T21:00:10.226396+0000","last_became_active":"2023-11-18T20:59:25.363289+0000","last_became_peered":"2023-11-18T20:59:25.363289+0000","last_unstale":"2023-11-18T21:00:10.226396+0000","last_undegraded":"2023-11-18T21:00:10.226396+0000","last_fullsized":"2023-11-18T21:00:10.226396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.950378+0000","last_change":"2023-11-18T20:59:35.771712+0000","last_active":"2023-11-18T20:59:37.950378+0000","last_peered":"2023-11-18T20:59:37.950378+0000","last_clean":"2023-11-18T20:59:37.950378+0000","last_became_active":"2023-11-18T20:59:35.771263+0000","last_became_peered":"2023-11-18T20:59:35.771263+0000","last_unstale":"2023-11-18T20:59:37.950378+0000","last_undegraded":"2023-11-18T20:59:37.950378+0000","last_fullsized":"2023-11-18T20:59:37.950378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.772920+0000","last_change":"2023-11-18T20:59:27.834172+0000","last_active":"2023-11-18T20:59:35.772920+0000","last_peered":"2023-11-18T20:59:35.772920+0000","last_clean":"2023-11-18T20:59:35.772920+0000","last_became_active":"2023-11-18T20:59:27.832589+0000","last_became_peered":"2023-11-18T20:59:27.832589+0000","last_unstale":"2023-11-18T20:59:35.772920+0000","last_undegraded":"2023-11-18T20:59:35.772920+0000","last_fullsized":"2023-11-18T20:59:35.772920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.169769+0000","last_change":"2023-11-18T20:59:25.494236+0000","last_active":"2023-11-18T21:00:10.169769+0000","last_peered":"2023-11-18T21:00:10.169769+0000","last_clean":"2023-11-18T21:00:10.169769+0000","last_became_active":"2023-11-18T20:59:25.493373+0000","last_became_peered":"2023-11-18T20:59:25.493373+0000","last_unstale":"2023-11-18T21:00:10.169769+0000","last_undegraded":"2023-11-18T21:00:10.169769+0000","last_fullsized":"2023-11-18T21:00:10.169769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:13.859109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.784645+0000","last_change":"2023-11-18T20:59:35.773319+0000","last_active":"2023-11-18T20:59:36.784645+0000","last_peered":"2023-11-18T20:59:36.784645+0000","last_clean":"2023-11-18T20:59:36.784645+0000","last_became_active":"2023-11-18T20:59:35.772563+0000","last_became_peered":"2023-11-18T20:59:35.772563+0000","last_unstale":"2023-11-18T20:59:36.784645+0000","last_undegraded":"2023-11-18T20:59:36.784645+0000","last_fullsized":"2023-11-18T20:59:36.784645+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:12.287749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746454+0000","last_change":"2023-11-18T20:59:27.892789+0000","last_active":"2023-11-18T20:59:35.746454+0000","last_peered":"2023-11-18T20:59:35.746454+0000","last_clean":"2023-11-18T20:59:35.746454+0000","last_became_active":"2023-11-18T20:59:27.891883+0000","last_became_peered":"2023-11-18T20:59:27.891883+0000","last_unstale":"2023-11-18T20:59:35.746454+0000","last_undegraded":"2023-11-18T20:59:35.746454+0000","last_fullsized":"2023-11-18T20:59:35.746454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:12.020475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.225054+0000","last_change":"2023-11-18T20:59:25.497309+0000","last_active":"2023-11-18T21:00:10.225054+0000","last_peered":"2023-11-18T21:00:10.225054+0000","last_clean":"2023-11-18T21:00:10.225054+0000","last_became_active":"2023-11-18T20:59:25.496680+0000","last_became_peered":"2023-11-18T20:59:25.496680+0000","last_unstale":"2023-11-18T21:00:10.225054+0000","last_undegraded":"2023-11-18T21:00:10.225054+0000","last_fullsized":"2023-11-18T21:00:10.225054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.688376+0000","last_change":"2023-11-18T20:59:35.842258+0000","last_active":"2023-11-18T20:59:36.688376+0000","last_peered":"2023-11-18T20:59:36.688376+0000","last_clean":"2023-11-18T20:59:36.688376+0000","last_became_active":"2023-11-18T20:59:35.838830+0000","last_became_peered":"2023-11-18T20:59:35.838830+0000","last_unstale":"2023-11-18T20:59:36.688376+0000","last_undegraded":"2023-11-18T20:59:36.688376+0000","last_fullsized":"2023-11-18T20:59:36.688376+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:12:39.697374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.689568+0000","last_change":"2023-11-18T20:59:35.839178+0000","last_active":"2023-11-18T20:59:36.689568+0000","last_peered":"2023-11-18T20:59:36.689568+0000","last_clean":"2023-11-18T20:59:36.689568+0000","last_became_active":"2023-11-18T20:59:35.838375+0000","last_became_peered":"2023-11-18T20:59:35.838375+0000","last_unstale":"2023-11-18T20:59:36.689568+0000","last_undegraded":"2023-11-18T20:59:36.689568+0000","last_fullsized":"2023-11-18T20:59:36.689568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:56:09.565932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.823342+0000","last_change":"2023-11-18T20:59:27.689539+0000","last_active":"2023-11-18T20:59:35.823342+0000","last_peered":"2023-11-18T20:59:35.823342+0000","last_clean":"2023-11-18T20:59:35.823342+0000","last_became_active":"2023-11-18T20:59:27.688522+0000","last_became_peered":"2023-11-18T20:59:27.688522+0000","last_unstale":"2023-11-18T20:59:35.823342+0000","last_undegraded":"2023-11-18T20:59:35.823342+0000","last_fullsized":"2023-11-18T20:59:35.823342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:06:48.337696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:09.999492+0000","last_change":"2023-11-18T20:59:25.494125+0000","last_active":"2023-11-18T21:00:09.999492+0000","last_peered":"2023-11-18T21:00:09.999492+0000","last_clean":"2023-11-18T21:00:09.999492+0000","last_became_active":"2023-11-18T20:59:25.493357+0000","last_became_peered":"2023-11-18T20:59:25.493357+0000","last_unstale":"2023-11-18T21:00:09.999492+0000","last_undegraded":"2023-11-18T21:00:09.999492+0000","last_fullsized":"2023-11-18T21:00:09.999492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:37.311079+0000","last_change":"2023-11-18T20:59:35.776653+0000","last_active":"2023-11-18T20:59:37.311079+0000","last_peered":"2023-11-18T20:59:37.311079+0000","last_clean":"2023-11-18T20:59:37.311079+0000","last_became_active":"2023-11-18T20:59:35.776138+0000","last_became_peered":"2023-11-18T20:59:35.776138+0000","last_unstale":"2023-11-18T20:59:37.311079+0000","last_undegraded":"2023-11-18T20:59:37.311079+0000","last_fullsized":"2023-11-18T20:59:37.311079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:08:25.933599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770015+0000","last_change":"2023-11-18T20:59:27.860987+0000","last_active":"2023-11-18T20:59:35.770015+0000","last_peered":"2023-11-18T20:59:35.770015+0000","last_clean":"2023-11-18T20:59:35.770015+0000","last_became_active":"2023-11-18T20:59:27.860537+0000","last_became_peered":"2023-11-18T20:59:27.860537+0000","last_unstale":"2023-11-18T20:59:35.770015+0000","last_undegraded":"2023-11-18T20:59:35.770015+0000","last_fullsized":"2023-11-18T20:59:35.770015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:17.418543+0000","last_change":"2023-11-18T20:59:25.354967+0000","last_active":"2023-11-18T21:00:17.418543+0000","last_peered":"2023-11-18T21:00:17.418543+0000","last_clean":"2023-11-18T21:00:17.418543+0000","last_became_active":"2023-11-18T20:59:25.354690+0000","last_became_peered":"2023-11-18T20:59:25.354690+0000","last_unstale":"2023-11-18T21:00:17.418543+0000","last_undegraded":"2023-11-18T21:00:17.418543+0000","last_fullsized":"2023-11-18T21:00:17.418543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:50.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:21.771390+0000","last_change":"2023-11-18T20:59:25.346493+0000","last_active":"2023-11-18T21:00:21.771390+0000","last_peered":"2023-11-18T21:00:21.771390+0000","last_clean":"2023-11-18T21:00:21.771390+0000","last_became_active":"2023-11-18T20:59:25.346192+0000","last_became_peered":"2023-11-18T20:59:25.346192+0000","last_unstale":"2023-11-18T21:00:21.771390+0000","last_undegraded":"2023-11-18T21:00:21.771390+0000","last_fullsized":"2023-11-18T21:00:21.771390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:30.162962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819222+0000","last_change":"2023-11-18T20:59:27.868460+0000","last_active":"2023-11-18T20:59:35.819222+0000","last_peered":"2023-11-18T20:59:35.819222+0000","last_clean":"2023-11-18T20:59:35.819222+0000","last_became_active":"2023-11-18T20:59:27.867886+0000","last_became_peered":"2023-11-18T20:59:27.867886+0000","last_unstale":"2023-11-18T20:59:35.819222+0000","last_undegraded":"2023-11-18T20:59:35.819222+0000","last_fullsized":"2023-11-18T20:59:35.819222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:39.647294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.688950+0000","last_change":"2023-11-18T20:59:35.851163+0000","last_active":"2023-11-18T20:59:36.688950+0000","last_peered":"2023-11-18T20:59:36.688950+0000","last_clean":"2023-11-18T20:59:36.688950+0000","last_became_active":"2023-11-18T20:59:35.850427+0000","last_became_peered":"2023-11-18T20:59:35.850427+0000","last_unstale":"2023-11-18T20:59:36.688950+0000","last_undegraded":"2023-11-18T20:59:36.688950+0000","last_fullsized":"2023-11-18T20:59:36.688950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:20.729626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T21:00:10.175066+0000","last_change":"2023-11-18T20:59:25.462276+0000","last_active":"2023-11-18T21:00:10.175066+0000","last_peered":"2023-11-18T21:00:10.175066+0000","last_clean":"2023-11-18T21:00:10.175066+0000","last_became_active":"2023-11-18T20:59:25.460449+0000","last_became_peered":"2023-11-18T20:59:25.460449+0000","last_unstale":"2023-11-18T21:00:10.175066+0000","last_undegraded":"2023-11-18T21:00:10.175066+0000","last_fullsized":"2023-11-18T21:00:10.175066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:25:57.950600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.768671+0000","last_change":"2023-11-18T20:59:27.841332+0000","last_active":"2023-11-18T20:59:35.768671+0000","last_peered":"2023-11-18T20:59:35.768671+0000","last_clean":"2023-11-18T20:59:35.768671+0000","last_became_active":"2023-11-18T20:59:27.840528+0000","last_became_peered":"2023-11-18T20:59:27.840528+0000","last_unstale":"2023-11-18T20:59:35.768671+0000","last_undegraded":"2023-11-18T20:59:35.768671+0000","last_fullsized":"2023-11-18T20:59:35.768671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T20:59:36.785624+0000","last_change":"2023-11-18T20:59:35.776844+0000","last_active":"2023-11-18T20:59:36.785624+0000","last_peered":"2023-11-18T20:59:36.785624+0000","last_clean":"2023-11-18T20:59:36.785624+0000","last_became_active":"2023-11-18T20:59:35.775977+0000","last_became_peered":"2023-11-18T20:59:35.775977+0000","last_unstale":"2023-11-18T20:59:36.785624+0000","last_undegraded":"2023-11-18T20:59:36.785624+0000","last_fullsized":"2023-11-18T20:59:36.785624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:06:00.187752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.745152+0000","last_change":"2023-11-18T20:59:27.888673+0000","last_active":"2023-11-18T20:59:35.745152+0000","last_peered":"2023-11-18T20:59:35.745152+0000","last_clean":"2023-11-18T20:59:35.745152+0000","last_became_active":"2023-11-18T20:59:27.887716+0000","last_became_peered":"2023-11-18T20:59:27.887716+0000","last_unstale":"2023-11-18T20:59:35.745152+0000","last_undegraded":"2023-11-18T20:59:35.745152+0000","last_fullsized":"2023-11-18T20:59:35.745152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.680928+0000","last_change":"2023-11-18T20:59:27.684810+0000","last_active":"2023-11-18T20:59:35.680928+0000","last_peered":"2023-11-18T20:59:35.680928+0000","last_clean":"2023-11-18T20:59:35.680928+0000","last_became_active":"2023-11-18T20:59:27.680712+0000","last_became_peered":"2023-11-18T20:59:27.680712+0000","last_unstale":"2023-11-18T20:59:35.680928+0000","last_undegraded":"2023-11-18T20:59:35.680928+0000","last_fullsized":"2023-11-18T20:59:35.680928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696242+0000","last_change":"2023-11-18T20:59:27.835960+0000","last_active":"2023-11-18T20:59:35.696242+0000","last_peered":"2023-11-18T20:59:35.696242+0000","last_clean":"2023-11-18T20:59:35.696242+0000","last_became_active":"2023-11-18T20:59:27.835120+0000","last_became_peered":"2023-11-18T20:59:27.835120+0000","last_unstale":"2023-11-18T20:59:35.696242+0000","last_undegraded":"2023-11-18T20:59:35.696242+0000","last_fullsized":"2023-11-18T20:59:35.696242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:35:51.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770656+0000","last_change":"2023-11-18T20:59:27.833652+0000","last_active":"2023-11-18T20:59:35.770656+0000","last_peered":"2023-11-18T20:59:35.770656+0000","last_clean":"2023-11-18T20:59:35.770656+0000","last_became_active":"2023-11-18T20:59:27.833049+0000","last_became_peered":"2023-11-18T20:59:27.833049+0000","last_unstale":"2023-11-18T20:59:35.770656+0000","last_undegraded":"2023-11-18T20:59:35.770656+0000","last_fullsized":"2023-11-18T20:59:35.770656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:23.262919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.821721+0000","last_change":"2023-11-18T20:59:27.878824+0000","last_active":"2023-11-18T20:59:35.821721+0000","last_peered":"2023-11-18T20:59:35.821721+0000","last_clean":"2023-11-18T20:59:35.821721+0000","last_became_active":"2023-11-18T20:59:27.878353+0000","last_became_peered":"2023-11-18T20:59:27.878353+0000","last_unstale":"2023-11-18T20:59:35.821721+0000","last_undegraded":"2023-11-18T20:59:35.821721+0000","last_fullsized":"2023-11-18T20:59:35.821721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:04.074467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.820381+0000","last_change":"2023-11-18T20:59:27.866570+0000","last_active":"2023-11-18T20:59:35.820381+0000","last_peered":"2023-11-18T20:59:35.820381+0000","last_clean":"2023-11-18T20:59:35.820381+0000","last_became_active":"2023-11-18T20:59:27.866165+0000","last_became_peered":"2023-11-18T20:59:27.866165+0000","last_unstale":"2023-11-18T20:59:35.820381+0000","last_undegraded":"2023-11-18T20:59:35.820381+0000","last_fullsized":"2023-11-18T20:59:35.820381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:05:51.974471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746338+0000","last_change":"2023-11-18T20:59:27.895340+0000","last_active":"2023-11-18T20:59:35.746338+0000","last_peered":"2023-11-18T20:59:35.746338+0000","last_clean":"2023-11-18T20:59:35.746338+0000","last_became_active":"2023-11-18T20:59:27.893918+0000","last_became_peered":"2023-11-18T20:59:27.893918+0000","last_unstale":"2023-11-18T20:59:35.746338+0000","last_undegraded":"2023-11-18T20:59:35.746338+0000","last_fullsized":"2023-11-18T20:59:35.746338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:11.899550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.772271+0000","last_change":"2023-11-18T20:59:27.839127+0000","last_active":"2023-11-18T20:59:35.772271+0000","last_peered":"2023-11-18T20:59:35.772271+0000","last_clean":"2023-11-18T20:59:35.772271+0000","last_became_active":"2023-11-18T20:59:27.838509+0000","last_became_peered":"2023-11-18T20:59:27.838509+0000","last_unstale":"2023-11-18T20:59:35.772271+0000","last_undegraded":"2023-11-18T20:59:35.772271+0000","last_fullsized":"2023-11-18T20:59:35.772271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696213+0000","last_change":"2023-11-18T20:59:27.836167+0000","last_active":"2023-11-18T20:59:35.696213+0000","last_peered":"2023-11-18T20:59:35.696213+0000","last_clean":"2023-11-18T20:59:35.696213+0000","last_became_active":"2023-11-18T20:59:27.835226+0000","last_became_peered":"2023-11-18T20:59:27.835226+0000","last_unstale":"2023-11-18T20:59:35.696213+0000","last_undegraded":"2023-11-18T20:59:35.696213+0000","last_fullsized":"2023-11-18T20:59:35.696213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:23:46.608216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770190+0000","last_change":"2023-11-18T20:59:27.889937+0000","last_active":"2023-11-18T20:59:35.770190+0000","last_peered":"2023-11-18T20:59:35.770190+0000","last_clean":"2023-11-18T20:59:35.770190+0000","last_became_active":"2023-11-18T20:59:27.889325+0000","last_became_peered":"2023-11-18T20:59:27.889325+0000","last_unstale":"2023-11-18T20:59:35.770190+0000","last_undegraded":"2023-11-18T20:59:35.770190+0000","last_fullsized":"2023-11-18T20:59:35.770190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:39.674424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.768585+0000","last_change":"2023-11-18T20:59:27.867439+0000","last_active":"2023-11-18T20:59:35.768585+0000","last_peered":"2023-11-18T20:59:35.768585+0000","last_clean":"2023-11-18T20:59:35.768585+0000","last_became_active":"2023-11-18T20:59:27.866609+0000","last_became_peered":"2023-11-18T20:59:27.866609+0000","last_unstale":"2023-11-18T20:59:35.768585+0000","last_undegraded":"2023-11-18T20:59:35.768585+0000","last_fullsized":"2023-11-18T20:59:35.768585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:46:49.094141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819017+0000","last_change":"2023-11-18T20:59:27.883416+0000","last_active":"2023-11-18T20:59:35.819017+0000","last_peered":"2023-11-18T20:59:35.819017+0000","last_clean":"2023-11-18T20:59:35.819017+0000","last_became_active":"2023-11-18T20:59:27.882976+0000","last_became_peered":"2023-11-18T20:59:27.882976+0000","last_unstale":"2023-11-18T20:59:35.819017+0000","last_undegraded":"2023-11-18T20:59:35.819017+0000","last_fullsized":"2023-11-18T20:59:35.819017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:12.611142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759028+0000","last_change":"2023-11-18T20:59:27.873520+0000","last_active":"2023-11-18T20:59:35.759028+0000","last_peered":"2023-11-18T20:59:35.759028+0000","last_clean":"2023-11-18T20:59:35.759028+0000","last_became_active":"2023-11-18T20:59:27.872627+0000","last_became_peered":"2023-11-18T20:59:27.872627+0000","last_unstale":"2023-11-18T20:59:35.759028+0000","last_undegraded":"2023-11-18T20:59:35.759028+0000","last_fullsized":"2023-11-18T20:59:35.759028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.697486+0000","last_change":"2023-11-18T20:59:27.687118+0000","last_active":"2023-11-18T20:59:35.697486+0000","last_peered":"2023-11-18T20:59:35.697486+0000","last_clean":"2023-11-18T20:59:35.697486+0000","last_became_active":"2023-11-18T20:59:27.686311+0000","last_became_peered":"2023-11-18T20:59:27.686311+0000","last_unstale":"2023-11-18T20:59:35.697486+0000","last_undegraded":"2023-11-18T20:59:35.697486+0000","last_fullsized":"2023-11-18T20:59:35.697486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:25:27.490214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.681564+0000","last_change":"2023-11-18T20:59:27.892404+0000","last_active":"2023-11-18T20:59:35.681564+0000","last_peered":"2023-11-18T20:59:35.681564+0000","last_clean":"2023-11-18T20:59:35.681564+0000","last_became_active":"2023-11-18T20:59:27.891767+0000","last_became_peered":"2023-11-18T20:59:27.891767+0000","last_unstale":"2023-11-18T20:59:35.681564+0000","last_undegraded":"2023-11-18T20:59:35.681564+0000","last_fullsized":"2023-11-18T20:59:35.681564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.698022+0000","last_change":"2023-11-18T20:59:27.866920+0000","last_active":"2023-11-18T20:59:35.698022+0000","last_peered":"2023-11-18T20:59:35.698022+0000","last_clean":"2023-11-18T20:59:35.698022+0000","last_became_active":"2023-11-18T20:59:27.866153+0000","last_became_peered":"2023-11-18T20:59:27.866153+0000","last_unstale":"2023-11-18T20:59:35.698022+0000","last_undegraded":"2023-11-18T20:59:35.698022+0000","last_fullsized":"2023-11-18T20:59:35.698022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:50:43.894365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.696090+0000","last_change":"2023-11-18T20:59:27.890399+0000","last_active":"2023-11-18T20:59:35.696090+0000","last_peered":"2023-11-18T20:59:35.696090+0000","last_clean":"2023-11-18T20:59:35.696090+0000","last_became_active":"2023-11-18T20:59:27.889704+0000","last_became_peered":"2023-11-18T20:59:27.889704+0000","last_unstale":"2023-11-18T20:59:35.696090+0000","last_undegraded":"2023-11-18T20:59:35.696090+0000","last_fullsized":"2023-11-18T20:59:35.696090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:34:37.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769850+0000","last_change":"2023-11-18T20:59:27.871794+0000","last_active":"2023-11-18T20:59:35.769850+0000","last_peered":"2023-11-18T20:59:35.769850+0000","last_clean":"2023-11-18T20:59:35.769850+0000","last_became_active":"2023-11-18T20:59:27.871337+0000","last_became_peered":"2023-11-18T20:59:27.871337+0000","last_unstale":"2023-11-18T20:59:35.769850+0000","last_undegraded":"2023-11-18T20:59:35.769850+0000","last_fullsized":"2023-11-18T20:59:35.769850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:16.370847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.819983+0000","last_change":"2023-11-18T20:59:27.867288+0000","last_active":"2023-11-18T20:59:35.819983+0000","last_peered":"2023-11-18T20:59:35.819983+0000","last_clean":"2023-11-18T20:59:35.819983+0000","last_became_active":"2023-11-18T20:59:27.866560+0000","last_became_peered":"2023-11-18T20:59:27.866560+0000","last_unstale":"2023-11-18T20:59:35.819983+0000","last_undegraded":"2023-11-18T20:59:35.819983+0000","last_fullsized":"2023-11-18T20:59:35.819983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.823432+0000","last_change":"2023-11-18T20:59:27.878944+0000","last_active":"2023-11-18T20:59:35.823432+0000","last_peered":"2023-11-18T20:59:35.823432+0000","last_clean":"2023-11-18T20:59:35.823432+0000","last_became_active":"2023-11-18T20:59:27.878485+0000","last_became_peered":"2023-11-18T20:59:27.878485+0000","last_unstale":"2023-11-18T20:59:35.823432+0000","last_undegraded":"2023-11-18T20:59:35.823432+0000","last_fullsized":"2023-11-18T20:59:35.823432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:04.749189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.758902+0000","last_change":"2023-11-18T20:59:27.874019+0000","last_active":"2023-11-18T20:59:35.758902+0000","last_peered":"2023-11-18T20:59:35.758902+0000","last_clean":"2023-11-18T20:59:35.758902+0000","last_became_active":"2023-11-18T20:59:27.873255+0000","last_became_peered":"2023-11-18T20:59:27.873255+0000","last_unstale":"2023-11-18T20:59:35.758902+0000","last_undegraded":"2023-11-18T20:59:35.758902+0000","last_fullsized":"2023-11-18T20:59:35.758902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759661+0000","last_change":"2023-11-18T20:59:27.868086+0000","last_active":"2023-11-18T20:59:35.759661+0000","last_peered":"2023-11-18T20:59:35.759661+0000","last_clean":"2023-11-18T20:59:35.759661+0000","last_became_active":"2023-11-18T20:59:27.866901+0000","last_became_peered":"2023-11-18T20:59:27.866901+0000","last_unstale":"2023-11-18T20:59:35.759661+0000","last_undegraded":"2023-11-18T20:59:35.759661+0000","last_fullsized":"2023-11-18T20:59:35.759661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759791+0000","last_change":"2023-11-18T20:59:27.888617+0000","last_active":"2023-11-18T20:59:35.759791+0000","last_peered":"2023-11-18T20:59:35.759791+0000","last_clean":"2023-11-18T20:59:35.759791+0000","last_became_active":"2023-11-18T20:59:27.888068+0000","last_became_peered":"2023-11-18T20:59:27.888068+0000","last_unstale":"2023-11-18T20:59:35.759791+0000","last_undegraded":"2023-11-18T20:59:35.759791+0000","last_fullsized":"2023-11-18T20:59:35.759791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:53.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769443+0000","last_change":"2023-11-18T20:59:27.684428+0000","last_active":"2023-11-18T20:59:35.769443+0000","last_peered":"2023-11-18T20:59:35.769443+0000","last_clean":"2023-11-18T20:59:35.769443+0000","last_became_active":"2023-11-18T20:59:27.682936+0000","last_became_peered":"2023-11-18T20:59:27.682936+0000","last_unstale":"2023-11-18T20:59:35.769443+0000","last_undegraded":"2023-11-18T20:59:35.769443+0000","last_fullsized":"2023-11-18T20:59:35.769443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:52.955875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.769402+0000","last_change":"2023-11-18T20:59:27.865937+0000","last_active":"2023-11-18T20:59:35.769402+0000","last_peered":"2023-11-18T20:59:35.769402+0000","last_clean":"2023-11-18T20:59:35.769402+0000","last_became_active":"2023-11-18T20:59:27.865401+0000","last_became_peered":"2023-11-18T20:59:27.865401+0000","last_unstale":"2023-11-18T20:59:35.769402+0000","last_undegraded":"2023-11-18T20:59:35.769402+0000","last_fullsized":"2023-11-18T20:59:35.769402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:00.251369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.757858+0000","last_change":"2023-11-18T20:59:27.865748+0000","last_active":"2023-11-18T20:59:35.757858+0000","last_peered":"2023-11-18T20:59:35.757858+0000","last_clean":"2023-11-18T20:59:35.757858+0000","last_became_active":"2023-11-18T20:59:27.864956+0000","last_became_peered":"2023-11-18T20:59:27.864956+0000","last_unstale":"2023-11-18T20:59:35.757858+0000","last_undegraded":"2023-11-18T20:59:35.757858+0000","last_fullsized":"2023-11-18T20:59:35.757858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.746209+0000","last_change":"2023-11-18T20:59:27.889838+0000","last_active":"2023-11-18T20:59:35.746209+0000","last_peered":"2023-11-18T20:59:35.746209+0000","last_clean":"2023-11-18T20:59:35.746209+0000","last_became_active":"2023-11-18T20:59:27.889307+0000","last_became_peered":"2023-11-18T20:59:27.889307+0000","last_unstale":"2023-11-18T20:59:35.746209+0000","last_undegraded":"2023-11-18T20:59:35.746209+0000","last_fullsized":"2023-11-18T20:59:35.746209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.758577+0000","last_change":"2023-11-18T20:59:27.866394+0000","last_active":"2023-11-18T20:59:35.758577+0000","last_peered":"2023-11-18T20:59:35.758577+0000","last_clean":"2023-11-18T20:59:35.758577+0000","last_became_active":"2023-11-18T20:59:27.865625+0000","last_became_peered":"2023-11-18T20:59:27.865625+0000","last_unstale":"2023-11-18T20:59:35.758577+0000","last_undegraded":"2023-11-18T20:59:35.758577+0000","last_fullsized":"2023-11-18T20:59:35.758577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.745362+0000","last_change":"2023-11-18T20:59:27.892765+0000","last_active":"2023-11-18T20:59:35.745362+0000","last_peered":"2023-11-18T20:59:35.745362+0000","last_clean":"2023-11-18T20:59:35.745362+0000","last_became_active":"2023-11-18T20:59:27.891753+0000","last_became_peered":"2023-11-18T20:59:27.891753+0000","last_unstale":"2023-11-18T20:59:35.745362+0000","last_undegraded":"2023-11-18T20:59:35.745362+0000","last_fullsized":"2023-11-18T20:59:35.745362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:52.955875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.770669+0000","last_change":"2023-11-18T20:59:27.837531+0000","last_active":"2023-11-18T20:59:35.770669+0000","last_peered":"2023-11-18T20:59:35.770669+0000","last_clean":"2023-11-18T20:59:35.770669+0000","last_became_active":"2023-11-18T20:59:27.836899+0000","last_became_peered":"2023-11-18T20:59:27.836899+0000","last_unstale":"2023-11-18T20:59:35.770669+0000","last_undegraded":"2023-11-18T20:59:35.770669+0000","last_fullsized":"2023-11-18T20:59:35.770669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:04.716391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.771353+0000","last_change":"2023-11-18T20:59:27.864494+0000","last_active":"2023-11-18T20:59:35.771353+0000","last_peered":"2023-11-18T20:59:35.771353+0000","last_clean":"2023-11-18T20:59:35.771353+0000","last_became_active":"2023-11-18T20:59:27.863732+0000","last_became_peered":"2023-11-18T20:59:27.863732+0000","last_unstale":"2023-11-18T20:59:35.771353+0000","last_undegraded":"2023-11-18T20:59:35.771353+0000","last_fullsized":"2023-11-18T20:59:35.771353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-18T20:59:35.759787+0000","last_change":"2023-11-18T20:59:27.873605+0000","last_active":"2023-11-18T20:59:35.759787+0000","last_peered":"2023-11-18T20:59:35.759787+0000","last_clean":"2023-11-18T20:59:35.759787+0000","last_became_active":"2023-11-18T20:59:27.871167+0000","last_became_peered":"2023-11-18T20:59:27.871167+0000","last_unstale":"2023-11-18T20:59:35.759787+0000","last_undegraded":"2023-11-18T20:59:35.759787+0000","last_fullsized":"2023-11-18T20:59:35.759787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:54:51.212807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8857,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":17624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":123628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.625}]},{"osd":1,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.046},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.84599999999999997}]},{"osd":2,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.89400000000000002}]},{"osd":3,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.97099999999999997}]},{"osd":4,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.93000000000000005}]},{"osd":5,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.175},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.80500000000000005}]},{"osd":6,"last update":"Sat Nov 18 20:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.21}]}]},{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":124422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.78200000000000003}]},{"osd":1,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.997},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.97299999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.90400000000000003}]},{"osd":3,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.80600000000000005}]},{"osd":4,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.069}]},{"osd":7,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.76200000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":713802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.496}]},{"osd":1,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.34799999999999998}]},{"osd":2,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.47199999999999998}]},{"osd":3,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.52000000000000002}]},{"osd":6,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.37}]},{"osd":7,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.66800000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":123856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.498}]},{"osd":1,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.41999999999999998}]},{"osd":4,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.57399999999999995}]},{"osd":5,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.66500000000000004}]},{"osd":7,"last update":"Sat Nov 18 20:59:42 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.745},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.64800000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":126505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.69999999999999996}]},{"osd":1,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.93999999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.123},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":1.091}]},{"osd":4,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":1.0269999999999999}]},{"osd":5,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.85299999999999998}]},{"osd":6,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.23}]},{"osd":7,"last update":"Sat Nov 18 20:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.284},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.2609999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":909312,"data_stored":713158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.874},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.442}]},{"osd":2,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.91300000000000003}]},{"osd":3,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.47899999999999998}]},{"osd":4,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.97699999999999998}]},{"osd":5,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.73199999999999998}]},{"osd":6,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Sat Nov 18 20:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.76800000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":327680,"data_stored":123946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.32800000000000001}]},{"osd":2,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.53500000000000003}]},{"osd":3,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.432}]},{"osd":5,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.55800000000000005}]},{"osd":6,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.58399999999999996}]},{"osd":7,"last update":"Sat Nov 18 20:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.622},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.65200000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":128039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.60699999999999998}]},{"osd":1,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.69999999999999996}]},{"osd":2,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.67100000000000004},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.93999999999999995}]},{"osd":3,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.81200000000000006}]},{"osd":5,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.153},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.083}]},{"osd":6,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.405}]},{"osd":7,"last update":"Sat Nov 18 20:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.2450000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T21:00:24.207 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-18T21:00:24.207 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-18T21:00:24.207 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-18T21:00:24.207 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-18T21:00:24.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.364+0000 7fa7deb66640 1 Processor -- start 2023-11-18T21:00:24.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.364+0000 7fa7deb66640 1 -- start start 2023-11-18T21:00:24.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.364+0000 7fa7deb66640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d806adf0 0x7fa7d8072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:24.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.364+0000 7fa7deb66640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7d80c6830 0x7fa7d8153210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:24.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.364+0000 7fa7deb66640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d81597e0 con 0x7fa7d806b1d0 2023-11-18T21:00:24.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.364+0000 7fa7deb66640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d8071ce0 con 0x7fa7d80c6830 2023-11-18T21:00:24.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.364+0000 7fa7deb66640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d80c20c0 con 0x7fa7d806adf0 2023-11-18T21:00:24.367 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.368+0000 7fa7dd103640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7d80c6830 0x7fa7d8153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:24.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.368+0000 7fa7dd103640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7d80c6830 0x7fa7d8153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38534/0 (socket says 172.21.15.49:38534) 2023-11-18T21:00:24.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.368+0000 7fa7dd103640 1 -- 172.21.15.49:0/515638028 learned_addr learned my addr 172.21.15.49:0/515638028 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:24.368 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.368+0000 7fa7dc902640 1 --2- 172.21.15.49:0/515638028 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d806adf0 0x7fa7d8072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:24.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.372+0000 7fa7dd103640 1 -- 172.21.15.49:0/515638028 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d806adf0 msgr2=0x7fa7d8072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:24.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.372+0000 7fa7dd103640 1 --2- 172.21.15.49:0/515638028 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d806adf0 0x7fa7d8072550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:24.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.372+0000 7fa7dd103640 1 -- 172.21.15.49:0/515638028 >> v1:172.21.15.106:6789/0 conn(0x7fa7d806b1d0 legacy=0x7fa7d8159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:24.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.372+0000 7fa7dd103640 1 -- 172.21.15.49:0/515638028 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d80c23a0 con 0x7fa7d80c6830 2023-11-18T21:00:24.374 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.372+0000 7fa7dd103640 1 --2- 172.21.15.49:0/515638028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d80c6830 0x7fa7d8153210 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009e50 tx=0x7fa7d001f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d2ed90928c6704 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:24.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.380+0000 7fa7d77fe640 1 -- 172.21.15.49:0/515638028 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d00af400 con 0x7fa7d80c6830 2023-11-18T21:00:24.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.380+0000 7fa7d77fe640 1 -- 172.21.15.49:0/515638028 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d00ab050 con 0x7fa7d80c6830 2023-11-18T21:00:24.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.380+0000 7fa7d77fe640 1 -- 172.21.15.49:0/515638028 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d00af780 con 0x7fa7d80c6830 2023-11-18T21:00:24.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.380+0000 7fa7deb66640 1 -- 172.21.15.49:0/515638028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d80c6830 msgr2=0x7fa7d8153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:24.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.380+0000 7fa7deb66640 1 --2- 172.21.15.49:0/515638028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d80c6830 0x7fa7d8153210 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009e50 tx=0x7fa7d001f1f0 comp rx=0 tx=0).stop 2023-11-18T21:00:24.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.380+0000 7fa7deb66640 1 -- 172.21.15.49:0/515638028 shutdown_connections 2023-11-18T21:00:24.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.380+0000 7fa7deb66640 1 --2- 172.21.15.49:0/515638028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d80c6830 0x7fa7d8153210 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:24.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.380+0000 7fa7deb66640 1 --2- 172.21.15.49:0/515638028 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d806adf0 0x7fa7d8072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:24.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.380+0000 7fa7deb66640 1 -- 172.21.15.49:0/515638028 >> 172.21.15.49:0/515638028 conn(0x7fa7d8070160 msgr2=0x7fa7d806b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:24.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.380+0000 7fa7deb66640 1 -- 172.21.15.49:0/515638028 shutdown_connections 2023-11-18T21:00:24.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.380+0000 7fa7deb66640 1 -- 172.21.15.49:0/515638028 wait complete. 2023-11-18T21:00:24.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.380+0000 7fa7deb66640 1 Processor -- start 2023-11-18T21:00:24.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.380+0000 7fa7deb66640 1 -- start start 2023-11-18T21:00:24.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.384+0000 7fa7deb66640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7d806adf0 0x7fa7d81e5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:24.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.384+0000 7fa7deb66640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d806b1d0 0x7fa7d81ef5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:24.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.384+0000 7fa7deb66640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d80c6830 0x7fa7d814a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:24.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.384+0000 7fa7deb66640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d81ef1a0 con 0x7fa7d806b1d0 2023-11-18T21:00:24.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.384+0000 7fa7deb66640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d81f27e0 con 0x7fa7d806adf0 2023-11-18T21:00:24.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.384+0000 7fa7deb66640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d81f2ac0 con 0x7fa7d80c6830 2023-11-18T21:00:24.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.384+0000 7fa7d7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d806b1d0 0x7fa7d81ef5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:24.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.384+0000 7fa7d7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d806b1d0 0x7fa7d81ef5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38536/0 (socket says 172.21.15.49:38536) 2023-11-18T21:00:24.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.384+0000 7fa7d7fff640 1 -- 172.21.15.49:0/1084318087 learned_addr learned my addr 172.21.15.49:0/1084318087 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:24.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.384+0000 7fa7dd103640 1 --2- 172.21.15.49:0/1084318087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d80c6830 0x7fa7d814a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.384+0000 7fa7dc902640 1 --2- 172.21.15.49:0/1084318087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7d806adf0 0x7fa7d81e5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:24.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.388+0000 7fa7d7fff640 1 -- 172.21.15.49:0/1084318087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d80c6830 msgr2=0x7fa7d814a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:24.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.388+0000 7fa7d7fff640 1 --2- 172.21.15.49:0/1084318087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d80c6830 0x7fa7d814a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:24.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.388+0000 7fa7d7fff640 1 -- 172.21.15.49:0/1084318087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7d806adf0 msgr2=0x7fa7d81e5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:24.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.388+0000 7fa7d7fff640 1 --2- 172.21.15.49:0/1084318087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7d806adf0 0x7fa7d81e5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:24.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.388+0000 7fa7d7fff640 1 -- 172.21.15.49:0/1084318087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d0009b30 con 0x7fa7d806b1d0 2023-11-18T21:00:24.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.388+0000 7fa7d7fff640 1 --2- 172.21.15.49:0/1084318087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d806b1d0 0x7fa7d81ef5c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c4d0 tx=0x7fa7c800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.392+0000 7fa7d57fa640 1 -- 172.21.15.49:0/1084318087 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80052d0 con 0x7fa7d806b1d0 2023-11-18T21:00:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.392+0000 7fa7d57fa640 1 -- 172.21.15.49:0/1084318087 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c8005430 con 0x7fa7d806b1d0 2023-11-18T21:00:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.392+0000 7fa7deb66640 1 -- 172.21.15.49:0/1084318087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d81f2da0 con 0x7fa7d806b1d0 2023-11-18T21:00:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.392+0000 7fa7d57fa640 1 -- 172.21.15.49:0/1084318087 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8012830 con 0x7fa7d806b1d0 2023-11-18T21:00:24.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.392+0000 7fa7deb66640 1 -- 172.21.15.49:0/1084318087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d81e66e0 con 0x7fa7d806b1d0 2023-11-18T21:00:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.396+0000 7fa7deb66640 1 -- 172.21.15.49:0/1084318087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d81ef2e0 con 0x7fa7d806b1d0 2023-11-18T21:00:24.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.416+0000 7fa7d57fa640 1 -- 172.21.15.49:0/1084318087 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa7c8012990 con 0x7fa7d806b1d0 2023-11-18T21:00:24.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.416+0000 7fa7d57fa640 1 --2- 172.21.15.49:0/1084318087 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fa7b80664f0 0x7fa7b80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:24.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.416+0000 7fa7dc902640 1 --2- 172.21.15.49:0/1084318087 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fa7b80664f0 0x7fa7b80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:24.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.416+0000 7fa7dc902640 1 --2- 172.21.15.49:0/1084318087 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fa7b80664f0 0x7fa7b80689b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0007a60 tx=0x7fa7c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:24.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.416+0000 7fa7d57fa640 1 -- 172.21.15.49:0/1084318087 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa7c8055340 con 0x7fa7d806b1d0 2023-11-18T21:00:24.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.700+0000 7fa7d57fa640 1 -- 172.21.15.49:0/1084318087 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa7c8051680 con 0x7fa7d806b1d0 2023-11-18T21:00:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.904+0000 7fa7deb66640 1 -- 172.21.15.49:0/1084318087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa7d81ef2e0 con 0x7fa7d806b1d0 2023-11-18T21:00:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.952+0000 7fa7d57fa640 1 -- 172.21.15.49:0/1084318087 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa7d81ef2e0 con 0x7fa7d806b1d0 2023-11-18T21:00:24.952 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:24.952 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-18T21:00:24.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.956+0000 7fa7deb66640 1 -- 172.21.15.49:0/1084318087 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fa7b80664f0 msgr2=0x7fa7b80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:24.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.956+0000 7fa7deb66640 1 --2- 172.21.15.49:0/1084318087 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fa7b80664f0 0x7fa7b80689b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0007a60 tx=0x7fa7c0008040 comp rx=0 tx=0).stop 2023-11-18T21:00:24.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.956+0000 7fa7deb66640 1 -- 172.21.15.49:0/1084318087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d806b1d0 msgr2=0x7fa7d81ef5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:24.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.956+0000 7fa7deb66640 1 --2- 172.21.15.49:0/1084318087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d806b1d0 0x7fa7d81ef5c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c4d0 tx=0x7fa7c800c990 comp rx=0 tx=0).stop 2023-11-18T21:00:24.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.956+0000 7fa7deb66640 1 -- 172.21.15.49:0/1084318087 shutdown_connections 2023-11-18T21:00:24.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.956+0000 7fa7deb66640 1 --2- 172.21.15.49:0/1084318087 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fa7b80664f0 0x7fa7b80689b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:24.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.956+0000 7fa7deb66640 1 --2- 172.21.15.49:0/1084318087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d80c6830 0x7fa7d814a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:24.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.956+0000 7fa7deb66640 1 --2- 172.21.15.49:0/1084318087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d806b1d0 0x7fa7d81ef5c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:24.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.956+0000 7fa7deb66640 1 --2- 172.21.15.49:0/1084318087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7d806adf0 0x7fa7d81e5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:24.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.956+0000 7fa7deb66640 1 -- 172.21.15.49:0/1084318087 >> 172.21.15.49:0/1084318087 conn(0x7fa7d8070160 msgr2=0x7fa7d80c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:24.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.956+0000 7fa7deb66640 1 -- 172.21.15.49:0/1084318087 shutdown_connections 2023-11-18T21:00:24.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:24.956+0000 7fa7deb66640 1 -- 172.21.15.49:0/1084318087 wait complete. 2023-11-18T21:00:24.976 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-18T21:00:24.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T21:00:25.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.104+0000 7f1fa29e4640 1 Processor -- start 2023-11-18T21:00:25.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.104+0000 7f1fa29e4640 1 -- start start 2023-11-18T21:00:25.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.108+0000 7f1fa29e4640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1f9c1511e0 0x7f1f9c06a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:25.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.108+0000 7f1fa29e4640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f9c06b7a0 0x7f1f9c15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:25.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.108+0000 7f1fa29e4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9c157450 con 0x7f1f9c1515c0 2023-11-18T21:00:25.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.108+0000 7f1fa29e4640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9c158290 con 0x7f1f9c1511e0 2023-11-18T21:00:25.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.108+0000 7f1fa29e4640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c157710 con 0x7f1f9c06b7a0 2023-11-18T21:00:25.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.108+0000 7f1fa0f81640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f9c06b7a0 0x7f1f9c15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.108+0000 7f1fa0f81640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f9c06b7a0 0x7f1f9c15ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:47166/0 (socket says 172.21.15.49:47166) 2023-11-18T21:00:25.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.108+0000 7f1fa0f81640 1 -- 172.21.15.49:0/846755199 learned_addr learned my addr 172.21.15.49:0/846755199 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:25.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.116+0000 7f1fa0f81640 1 -- 172.21.15.49:0/846755199 >> v2:172.21.15.49:3300/0 conn(0x7f1f9c1511e0 msgr2=0x7f1f9c06a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:25.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.116+0000 7f1fa0f81640 1 --2- 172.21.15.49:0/846755199 >> v2:172.21.15.49:3300/0 conn(0x7f1f9c1511e0 0x7f1f9c06a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:25.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.116+0000 7f1fa0f81640 1 -- 172.21.15.49:0/846755199 >> v1:172.21.15.49:6789/0 conn(0x7f1f9c1515c0 legacy=0x7f1f9c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:25.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.116+0000 7f1fa0f81640 1 -- 172.21.15.49:0/846755199 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c1579f0 con 0x7f1f9c06b7a0 2023-11-18T21:00:25.120 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.120+0000 7f1fa0f81640 1 --2- 172.21.15.49:0/846755199 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f9c06b7a0 0x7f1f9c15ac10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009e50 tx=0x7f1f9401f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c58232d4b7a8ca02 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:25.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.132+0000 7f1f9affd640 1 -- 172.21.15.49:0/846755199 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940af400 con 0x7f1f9c06b7a0 2023-11-18T21:00:25.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.132+0000 7f1f9affd640 1 -- 172.21.15.49:0/846755199 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f940ab050 con 0x7f1f9c06b7a0 2023-11-18T21:00:25.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.132+0000 7f1f9affd640 1 -- 172.21.15.49:0/846755199 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940af780 con 0x7f1f9c06b7a0 2023-11-18T21:00:25.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.132+0000 7f1fa29e4640 1 -- 172.21.15.49:0/846755199 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f9c06b7a0 msgr2=0x7f1f9c15ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:25.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.132+0000 7f1fa29e4640 1 --2- 172.21.15.49:0/846755199 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f9c06b7a0 0x7f1f9c15ac10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009e50 tx=0x7f1f9401f1c0 comp rx=0 tx=0).stop 2023-11-18T21:00:25.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.132+0000 7f1fa29e4640 1 -- 172.21.15.49:0/846755199 shutdown_connections 2023-11-18T21:00:25.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.132+0000 7f1fa29e4640 1 --2- 172.21.15.49:0/846755199 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f9c06b7a0 0x7f1f9c15ac10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:25.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.132+0000 7f1fa29e4640 1 --2- 172.21.15.49:0/846755199 >> v2:172.21.15.49:3300/0 conn(0x7f1f9c1511e0 0x7f1f9c06a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:25.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.132+0000 7f1fa29e4640 1 -- 172.21.15.49:0/846755199 >> 172.21.15.49:0/846755199 conn(0x7f1f9c06d220 msgr2=0x7f1f9c06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:25.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.132+0000 7f1fa29e4640 1 -- 172.21.15.49:0/846755199 shutdown_connections 2023-11-18T21:00:25.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.132+0000 7f1fa29e4640 1 -- 172.21.15.49:0/846755199 wait complete. 2023-11-18T21:00:25.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.132+0000 7f1fa29e4640 1 Processor -- start 2023-11-18T21:00:25.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.144+0000 7f1fa29e4640 1 -- start start 2023-11-18T21:00:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.144+0000 7f1fa29e4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f9c06b7a0 0x7f1f9c0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:25.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.144+0000 7f1fa29e4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f9c1511e0 0x7f1f9c14c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:25.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.144+0000 7f1fa29e4640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f9c1515c0 0x7f1f9c146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:25.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.144+0000 7f1fa29e4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c1f0680 con 0x7f1f9c06b7a0 2023-11-18T21:00:25.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.144+0000 7f1fa29e4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c1f0bb0 con 0x7f1f9c1511e0 2023-11-18T21:00:25.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.144+0000 7f1fa29e4640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c14ccc0 con 0x7f1f9c1515c0 2023-11-18T21:00:25.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.144+0000 7f1fa0f81640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f9c1515c0 0x7f1f9c146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:25.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.144+0000 7f1fa0f81640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f9c1515c0 0x7f1f9c146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:47182/0 (socket says 172.21.15.49:47182) 2023-11-18T21:00:25.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.144+0000 7f1fa0f81640 1 -- 172.21.15.49:0/296020512 learned_addr learned my addr 172.21.15.49:0/296020512 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:25.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.148+0000 7f1f9b7fe640 1 --2- 172.21.15.49:0/296020512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f9c1511e0 0x7f1f9c14c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:25.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.156+0000 7f1fa0f81640 1 -- 172.21.15.49:0/296020512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f9c1511e0 msgr2=0x7f1f9c14c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:25.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.156+0000 7f1fa0f81640 1 --2- 172.21.15.49:0/296020512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f9c1511e0 0x7f1f9c14c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:25.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.156+0000 7f1fa0f81640 1 -- 172.21.15.49:0/296020512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f9c06b7a0 msgr2=0x7f1f9c0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:25.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.156+0000 7f1fa0f81640 1 --2- 172.21.15.49:0/296020512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f9c06b7a0 0x7f1f9c0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:25.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.156+0000 7f1fa0f81640 1 -- 172.21.15.49:0/296020512 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f94009b30 con 0x7f1f9c1515c0 2023-11-18T21:00:25.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.160+0000 7f1fa0f81640 1 --2- 172.21.15.49:0/296020512 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f9c1515c0 0x7f1f9c146530 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1f9401d870 tx=0x7f1f9401bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:25.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.172+0000 7f1f98ff9640 1 -- 172.21.15.49:0/296020512 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940c0070 con 0x7f1f9c1515c0 2023-11-18T21:00:25.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.172+0000 7f1f98ff9640 1 -- 172.21.15.49:0/296020512 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f940afb80 con 0x7f1f9c1515c0 2023-11-18T21:00:25.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.172+0000 7f1f98ff9640 1 -- 172.21.15.49:0/296020512 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940b8400 con 0x7f1f9c1515c0 2023-11-18T21:00:25.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.172+0000 7f1fa29e4640 1 -- 172.21.15.49:0/296020512 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9c14b490 con 0x7f1f9c1515c0 2023-11-18T21:00:25.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.172+0000 7f1fa29e4640 1 -- 172.21.15.49:0/296020512 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9c14c6b0 con 0x7f1f9c1515c0 2023-11-18T21:00:25.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.172+0000 7f1fa29e4640 1 -- 172.21.15.49:0/296020512 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9c14cae0 con 0x7f1f9c1515c0 2023-11-18T21:00:25.447 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:00:25.451 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:00:25.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.524+0000 7f1f98ff9640 1 -- 172.21.15.49:0/296020512 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1f940b6040 con 0x7f1f9c1515c0 2023-11-18T21:00:25.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.524+0000 7f1f98ff9640 1 --2- 172.21.15.49:0/296020512 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1f880664c0 0x7f1f88068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:25.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.524+0000 7f1f9bfff640 1 --2- 172.21.15.49:0/296020512 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1f880664c0 0x7f1f88068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:25.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.524+0000 7f1f9bfff640 1 --2- 172.21.15.49:0/296020512 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1f880664c0 0x7f1f88068980 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009730 tx=0x7f1f8c006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:25.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.532+0000 7f1f98ff9640 1 -- 172.21.15.49:0/296020512 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f940f3950 con 0x7f1f9c1515c0 2023-11-18T21:00:25.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.636+0000 7f1f98ff9640 1 -- 172.21.15.49:0/296020512 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1f940ef590 con 0x7f1f9c1515c0 2023-11-18T21:00:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.824+0000 7f1fa29e4640 1 -- 172.21.15.49:0/296020512 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f9c073e70 con 0x7f1f9c1515c0 2023-11-18T21:00:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.888+0000 7f1f98ff9640 1 -- 172.21.15.49:0/296020512 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18314 (secure 0 0 0) 0x7f1f940b4020 con 0x7f1f9c1515c0 2023-11-18T21:00:25.890 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:25.890 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":29,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T20:59:36.521114+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T21:00:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.892+0000 7f1fa29e4640 1 -- 172.21.15.49:0/296020512 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1f880664c0 msgr2=0x7f1f88068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.892+0000 7f1fa29e4640 1 --2- 172.21.15.49:0/296020512 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1f880664c0 0x7f1f88068980 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009730 tx=0x7f1f8c006ca0 comp rx=0 tx=0).stop 2023-11-18T21:00:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.892+0000 7f1fa29e4640 1 -- 172.21.15.49:0/296020512 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f9c1515c0 msgr2=0x7f1f9c146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.892+0000 7f1fa29e4640 1 --2- 172.21.15.49:0/296020512 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f9c1515c0 0x7f1f9c146530 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1f9401d870 tx=0x7f1f9401bf60 comp rx=0 tx=0).stop 2023-11-18T21:00:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.892+0000 7f1fa29e4640 1 -- 172.21.15.49:0/296020512 shutdown_connections 2023-11-18T21:00:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.892+0000 7f1fa29e4640 1 --2- 172.21.15.49:0/296020512 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1f880664c0 0x7f1f88068980 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.892+0000 7f1fa29e4640 1 --2- 172.21.15.49:0/296020512 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f9c1515c0 0x7f1f9c146530 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.892+0000 7f1fa29e4640 1 --2- 172.21.15.49:0/296020512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f9c1511e0 0x7f1f9c14c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.892+0000 7f1fa29e4640 1 --2- 172.21.15.49:0/296020512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f9c06b7a0 0x7f1f9c0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.892+0000 7f1fa29e4640 1 -- 172.21.15.49:0/296020512 >> 172.21.15.49:0/296020512 conn(0x7f1f9c06d220 msgr2=0x7f1f9c14f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.892+0000 7f1fa29e4640 1 -- 172.21.15.49:0/296020512 shutdown_connections 2023-11-18T21:00:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:25.892+0000 7f1fa29e4640 1 -- 172.21.15.49:0/296020512 wait complete. 2023-11-18T21:00:25.913 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:58:42.362631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:59:22.756454+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:59:25.252588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-18T20:59:33.423071+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-18T21:00:25.914 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T21:00:26.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.076+0000 7f58a49bd640 1 Processor -- start 2023-11-18T21:00:26.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.076+0000 7f58a49bd640 1 -- start start 2023-11-18T21:00:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.076+0000 7f58a49bd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58a0151720 0x7f58a006ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.076+0000 7f58a49bd640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a006f4a0 con 0x7f58a00c40e0 2023-11-18T21:00:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.076+0000 7f58a49bd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a0070be0 con 0x7f58a0151340 2023-11-18T21:00:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.076+0000 7f58a49bd640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a0072570 con 0x7f58a0151720 2023-11-18T21:00:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.080+0000 7f589ed9d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f58a00c40e0 0x7f58a00c70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36244/0 (socket says 172.21.15.49:36244) 2023-11-18T21:00:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.080+0000 7f589ed9d640 1 -- 172.21.15.49:0/2951923148 learned_addr learned my addr 172.21.15.49:0/2951923148 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.080+0000 7f589dd9b640 1 --2- 172.21.15.49:0/2951923148 >> v2:172.21.15.49:3300/0 conn(0x7f58a0151720 0x7f58a006ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:26.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.088+0000 7f589dd9b640 1 -- 172.21.15.49:0/2951923148 >> v1:172.21.15.106:6789/0 conn(0x7f58a0151340 legacy=0x7f58a0157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:26.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.088+0000 7f589dd9b640 1 -- 172.21.15.49:0/2951923148 >> v1:172.21.15.49:6789/0 conn(0x7f58a00c40e0 legacy=0x7f58a00c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:26.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.088+0000 7f589dd9b640 1 -- 172.21.15.49:0/2951923148 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a0070e80 con 0x7f58a0151720 2023-11-18T21:00:26.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.092+0000 7f589dd9b640 1 --2- 172.21.15.49:0/2951923148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a0151720 0x7f58a006ee10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58940097c0 tx=0x7f589401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb034c7f1f1cdce9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:26.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.108+0000 7f589d59a640 1 -- 172.21.15.49:0/2951923148 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58940ab610 con 0x7f58a0151720 2023-11-18T21:00:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.108+0000 7f589d59a640 1 -- 172.21.15.49:0/2951923148 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58940ab770 con 0x7f58a0151720 2023-11-18T21:00:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.108+0000 7f589d59a640 1 -- 172.21.15.49:0/2951923148 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58940abb00 con 0x7f58a0151720 2023-11-18T21:00:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.108+0000 7f58a49bd640 1 -- 172.21.15.49:0/2951923148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a0151720 msgr2=0x7f58a006ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:26.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.112+0000 7f58a49bd640 1 --2- 172.21.15.49:0/2951923148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a0151720 0x7f58a006ee10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58940097c0 tx=0x7f589401c410 comp rx=0 tx=0).stop 2023-11-18T21:00:26.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.112+0000 7f58a49bd640 1 -- 172.21.15.49:0/2951923148 shutdown_connections 2023-11-18T21:00:26.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.112+0000 7f58a49bd640 1 --2- 172.21.15.49:0/2951923148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a0151720 0x7f58a006ee10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:26.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.112+0000 7f58a49bd640 1 -- 172.21.15.49:0/2951923148 >> 172.21.15.49:0/2951923148 conn(0x7f58a006c6a0 msgr2=0x7f58a006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:26.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.112+0000 7f58a49bd640 1 -- 172.21.15.49:0/2951923148 shutdown_connections 2023-11-18T21:00:26.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.112+0000 7f58a49bd640 1 -- 172.21.15.49:0/2951923148 wait complete. 2023-11-18T21:00:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.112+0000 7f58a49bd640 1 Processor -- start 2023-11-18T21:00:26.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.112+0000 7f58a49bd640 1 -- start start 2023-11-18T21:00:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.112+0000 7f58a49bd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a00c40e0 0x7f58a0149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.112+0000 7f58a49bd640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58a0151340 0x7f58a0156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.112+0000 7f58a49bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a0152ab0 0x7f58a0153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.112+0000 7f58a49bd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a01530d0 con 0x7f58a0152ab0 2023-11-18T21:00:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.112+0000 7f58a49bd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a01461f0 con 0x7f58a00c40e0 2023-11-18T21:00:26.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.112+0000 7f58a49bd640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a014a390 con 0x7f58a0151340 2023-11-18T21:00:26.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.124+0000 7f589e59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a00c40e0 0x7f58a0149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:26.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.124+0000 7f589e59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a00c40e0 0x7f58a0149e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:41084/0 (socket says 172.21.15.49:41084) 2023-11-18T21:00:26.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.124+0000 7f589e59c640 1 -- 172.21.15.49:0/31551327 learned_addr learned my addr 172.21.15.49:0/31551327 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:26.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.124+0000 7f589dd9b640 1 --2- 172.21.15.49:0/31551327 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58a0151340 0x7f58a0156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:26.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.132+0000 7f589ed9d640 1 --2- 172.21.15.49:0/31551327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a0152ab0 0x7f58a0153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:26.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.140+0000 7f589dd9b640 1 -- 172.21.15.49:0/31551327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a00c40e0 msgr2=0x7f58a0149e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:26.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.140+0000 7f589dd9b640 1 --2- 172.21.15.49:0/31551327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a00c40e0 0x7f58a0149e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:26.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.140+0000 7f589dd9b640 1 -- 172.21.15.49:0/31551327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a0152ab0 msgr2=0x7f58a0153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:26.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.140+0000 7f589dd9b640 1 --2- 172.21.15.49:0/31551327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a0152ab0 0x7f58a0153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:26.139 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.140+0000 7f589dd9b640 1 -- 172.21.15.49:0/31551327 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5894009420 con 0x7f58a0151340 2023-11-18T21:00:26.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.144+0000 7f589dd9b640 1 --2- 172.21.15.49:0/31551327 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58a0151340 0x7f58a0156a40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58940ac000 tx=0x7f589401ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:26.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.156+0000 7f588effd640 1 -- 172.21.15.49:0/31551327 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894004220 con 0x7f58a0151340 2023-11-18T21:00:26.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.156+0000 7f588effd640 1 -- 172.21.15.49:0/31551327 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5894004380 con 0x7f58a0151340 2023-11-18T21:00:26.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.156+0000 7f588effd640 1 -- 172.21.15.49:0/31551327 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894003840 con 0x7f58a0151340 2023-11-18T21:00:26.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.156+0000 7f58a49bd640 1 -- 172.21.15.49:0/31551327 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a0145030 con 0x7f58a0151340 2023-11-18T21:00:26.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.156+0000 7f58a49bd640 1 -- 172.21.15.49:0/31551327 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a0153340 con 0x7f58a0151340 2023-11-18T21:00:26.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.160+0000 7f58a49bd640 1 -- 172.21.15.49:0/31551327 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a01454e0 con 0x7f58a0151340 2023-11-18T21:00:26.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.212+0000 7f588effd640 1 -- 172.21.15.49:0/31551327 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f58940039a0 con 0x7f58a0151340 2023-11-18T21:00:26.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.212+0000 7f588effd640 1 --2- 172.21.15.49:0/31551327 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58800664c0 0x7f5880068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:26.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.212+0000 7f589e59c640 1 --2- 172.21.15.49:0/31551327 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58800664c0 0x7f5880068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:26.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.216+0000 7f589e59c640 1 --2- 172.21.15.49:0/31551327 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58800664c0 0x7f5880068980 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5890009fd0 tx=0x7f589000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.504+0000 7f588effd640 1 -- 172.21.15.49:0/31551327 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f58940ab590 con 0x7f58a0151340 2023-11-18T21:00:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.536+0000 7f588effd640 1 -- 172.21.15.49:0/31551327 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58940ec400 con 0x7f58a0151340 2023-11-18T21:00:26.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.708+0000 7f58a49bd640 1 -- 172.21.15.49:0/31551327 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58a0153530 con 0x7f58a0151340 2023-11-18T21:00:26.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.896+0000 7f588effd640 1 -- 172.21.15.49:0/31551327 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58940044f0 con 0x7f58a0151340 2023-11-18T21:00:26.896 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-18T21:00:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.900+0000 7f58a49bd640 1 -- 172.21.15.49:0/31551327 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58800664c0 msgr2=0x7f5880068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.900+0000 7f58a49bd640 1 --2- 172.21.15.49:0/31551327 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58800664c0 0x7f5880068980 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5890009fd0 tx=0x7f589000b040 comp rx=0 tx=0).stop 2023-11-18T21:00:26.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.900+0000 7f58a49bd640 1 -- 172.21.15.49:0/31551327 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58a0151340 msgr2=0x7f58a0156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.900+0000 7f58a49bd640 1 --2- 172.21.15.49:0/31551327 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58a0151340 0x7f58a0156a40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58940ac000 tx=0x7f589401ac50 comp rx=0 tx=0).stop 2023-11-18T21:00:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.900+0000 7f58a49bd640 1 -- 172.21.15.49:0/31551327 shutdown_connections 2023-11-18T21:00:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.900+0000 7f58a49bd640 1 --2- 172.21.15.49:0/31551327 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f58800664c0 0x7f5880068980 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.900+0000 7f58a49bd640 1 --2- 172.21.15.49:0/31551327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58a0152ab0 0x7f58a0153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.900+0000 7f58a49bd640 1 --2- 172.21.15.49:0/31551327 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58a0151340 0x7f58a0156a40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.900+0000 7f58a49bd640 1 --2- 172.21.15.49:0/31551327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a00c40e0 0x7f58a0149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.900+0000 7f58a49bd640 1 -- 172.21.15.49:0/31551327 >> 172.21.15.49:0/31551327 conn(0x7f58a006c6a0 msgr2=0x7f58a00c7030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.900+0000 7f58a49bd640 1 -- 172.21.15.49:0/31551327 shutdown_connections 2023-11-18T21:00:26.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:26.900+0000 7f58a49bd640 1 -- 172.21.15.49:0/31551327 wait complete. 2023-11-18T21:00:26.924 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T21:00:27.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.048+0000 7f8f3a6d1640 1 Processor -- start 2023-11-18T21:00:27.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.048+0000 7f8f3a6d1640 1 -- start start 2023-11-18T21:00:27.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.048+0000 7f8f3a6d1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8f341567d0 0x7f8f3414fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.048+0000 7f8f3a6d1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f340c27c0 con 0x7f8f340c4aa0 2023-11-18T21:00:27.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.048+0000 7f8f3a6d1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f340c1ed0 con 0x7f8f340c46c0 2023-11-18T21:00:27.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.048+0000 7f8f3a6d1640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f34156ca0 con 0x7f8f341567d0 2023-11-18T21:00:27.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.048+0000 7f8f2bfff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8f340c4aa0 0x7f8f341560c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36260/0 (socket says 172.21.15.49:36260) 2023-11-18T21:00:27.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.048+0000 7f8f2bfff640 1 -- 172.21.15.49:0/939624246 learned_addr learned my addr 172.21.15.49:0/939624246 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.052+0000 7f8f337fe640 1 -- 172.21.15.49:0/939624246 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445958910 0 0) 0x7f8f340c27c0 con 0x7f8f340c4aa0 2023-11-18T21:00:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.052+0000 7f8f337fe640 1 -- 172.21.15.49:0/939624246 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f20003530 con 0x7f8f340c4aa0 2023-11-18T21:00:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.060+0000 7f8f337fe640 1 -- 172.21.15.49:0/939624246 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3628782922 0 0) 0x7f8f20003530 con 0x7f8f340c4aa0 2023-11-18T21:00:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.060+0000 7f8f337fe640 1 -- 172.21.15.49:0/939624246 >> v2:172.21.15.106:3300/0 conn(0x7f8f341567d0 msgr2=0x7f8f3414fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.060+0000 7f8f337fe640 1 --2- 172.21.15.49:0/939624246 >> v2:172.21.15.106:3300/0 conn(0x7f8f341567d0 0x7f8f3414fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.060+0000 7f8f337fe640 1 -- 172.21.15.49:0/939624246 >> v1:172.21.15.106:6789/0 conn(0x7f8f340c46c0 legacy=0x7f8f340c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.060+0000 7f8f337fe640 1 -- 172.21.15.49:0/939624246 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f34156f60 con 0x7f8f340c4aa0 2023-11-18T21:00:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.060+0000 7f8f337fe640 1 -- 172.21.15.49:0/939624246 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7f8f1c001680 con 0x7f8f340c4aa0 2023-11-18T21:00:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.060+0000 7f8f337fe640 1 -- 172.21.15.49:0/939624246 >> v1:172.21.15.49:6789/0 conn(0x7f8f340c4aa0 legacy=0x7f8f341560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.060+0000 7f8f337fe640 1 --2- 172.21.15.49:0/939624246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f20003a40 0x7f8f20003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.060+0000 7f8f337fe640 1 --2- 172.21.15.49:0/939624246 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f200047d0 0x7f8f20004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.060+0000 7f8f337fe640 1 --2- 172.21.15.49:0/939624246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f20005390 0x7f8f2000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.060+0000 7f8f337fe640 1 -- 172.21.15.49:0/939624246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34156ca0 con 0x7f8f20005390 2023-11-18T21:00:27.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.060+0000 7f8f337fe640 1 -- 172.21.15.49:0/939624246 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2000c240 con 0x7f8f20003a40 2023-11-18T21:00:27.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.060+0000 7f8f337fe640 1 -- 172.21.15.49:0/939624246 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2000c400 con 0x7f8f200047d0 2023-11-18T21:00:27.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.064+0000 7f8f38c6e640 1 --2- 172.21.15.49:0/939624246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f20005390 0x7f8f2000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:27.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.068+0000 7f8f38c6e640 1 -- 172.21.15.49:0/939624246 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f200047d0 msgr2=0x7f8f20004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:27.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.068+0000 7f8f38c6e640 1 --2- 172.21.15.49:0/939624246 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f200047d0 0x7f8f20004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.068+0000 7f8f38c6e640 1 -- 172.21.15.49:0/939624246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f20003a40 msgr2=0x7f8f20003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:27.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.068+0000 7f8f38c6e640 1 --2- 172.21.15.49:0/939624246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f20003a40 0x7f8f20003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.068+0000 7f8f38c6e640 1 -- 172.21.15.49:0/939624246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20003530 con 0x7f8f20005390 2023-11-18T21:00:27.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.068+0000 7f8f38c6e640 1 -- 172.21.15.49:0/939624246 reap_dead start 2023-11-18T21:00:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.072+0000 7f8f38c6e640 1 --2- 172.21.15.49:0/939624246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f20005390 0x7f8f2000b990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009c70 tx=0x7f8f2c01ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3b8030efcce44c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:27.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.076+0000 7f8f337fe640 1 -- 172.21.15.49:0/939624246 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c0a7e50 con 0x7f8f20005390 2023-11-18T21:00:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.076+0000 7f8f337fe640 1 -- 172.21.15.49:0/939624246 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c0039a0 con 0x7f8f20005390 2023-11-18T21:00:27.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.076+0000 7f8f337fe640 1 -- 172.21.15.49:0/939624246 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c003d30 con 0x7f8f20005390 2023-11-18T21:00:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.076+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/939624246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f20005390 msgr2=0x7f8f2000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.076+0000 7f8f3a6d1640 1 --2- 172.21.15.49:0/939624246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f20005390 0x7f8f2000b990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009c70 tx=0x7f8f2c01ee40 comp rx=0 tx=0).stop 2023-11-18T21:00:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.080+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/939624246 shutdown_connections 2023-11-18T21:00:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.080+0000 7f8f3a6d1640 1 --2- 172.21.15.49:0/939624246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f20005390 0x7f8f2000b990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.080+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/939624246 >> 172.21.15.49:0/939624246 conn(0x7f8f3406c6a0 msgr2=0x7f8f3406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.080+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/939624246 shutdown_connections 2023-11-18T21:00:27.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.080+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/939624246 wait complete. 2023-11-18T21:00:27.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.080+0000 7f8f3a6d1640 1 Processor -- start 2023-11-18T21:00:27.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.080+0000 7f8f3a6d1640 1 -- start start 2023-11-18T21:00:27.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.080+0000 7f8f3a6d1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f20005390 0x7f8f341f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.080+0000 7f8f3a6d1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f34155d60 0x7f8f34071e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.080+0000 7f8f3a6d1640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f34142f20 0x7f8f341433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.080+0000 7f8f3a6d1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34072ad0 con 0x7f8f20005390 2023-11-18T21:00:27.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.080+0000 7f8f3a6d1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34155740 con 0x7f8f34155d60 2023-11-18T21:00:27.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.080+0000 7f8f3a6d1640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f341f3670 con 0x7f8f34142f20 2023-11-18T21:00:27.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.080+0000 7f8f33fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f20005390 0x7f8f341f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:27.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.084+0000 7f8f33fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f20005390 0x7f8f341f3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49348/0 (socket says 172.21.15.49:49348) 2023-11-18T21:00:27.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.084+0000 7f8f33fff640 1 -- 172.21.15.49:0/2766326540 learned_addr learned my addr 172.21.15.49:0/2766326540 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.084+0000 7f8f33fff640 1 -- 172.21.15.49:0/2766326540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f34142f20 msgr2=0x7f8f341433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.084+0000 7f8f33fff640 1 --2- 172.21.15.49:0/2766326540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f34142f20 0x7f8f341433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.084+0000 7f8f33fff640 1 -- 172.21.15.49:0/2766326540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f34155d60 msgr2=0x7f8f34071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.084+0000 7f8f33fff640 1 --2- 172.21.15.49:0/2766326540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f34155d60 0x7f8f34071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.084+0000 7f8f33fff640 1 -- 172.21.15.49:0/2766326540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f341438e0 con 0x7f8f20005390 2023-11-18T21:00:27.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.088+0000 7f8f33fff640 1 --2- 172.21.15.49:0/2766326540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f20005390 0x7f8f341f3130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400c410 tx=0x7f8f2400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:27.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.092+0000 7f8f317fa640 1 -- 172.21.15.49:0/2766326540 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24003600 con 0x7f8f20005390 2023-11-18T21:00:27.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.092+0000 7f8f317fa640 1 -- 172.21.15.49:0/2766326540 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f24003780 con 0x7f8f20005390 2023-11-18T21:00:27.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.092+0000 7f8f317fa640 1 -- 172.21.15.49:0/2766326540 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24003b30 con 0x7f8f20005390 2023-11-18T21:00:27.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.092+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/2766326540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f34154ea0 con 0x7f8f20005390 2023-11-18T21:00:27.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.092+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/2766326540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f34155460 con 0x7f8f20005390 2023-11-18T21:00:27.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.092+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/2766326540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f34067520 con 0x7f8f20005390 2023-11-18T21:00:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.112+0000 7f8f317fa640 1 -- 172.21.15.49:0/2766326540 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f24003c90 con 0x7f8f20005390 2023-11-18T21:00:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.112+0000 7f8f317fa640 1 --2- 172.21.15.49:0/2766326540 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f8f140664a0 0x7f8f14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.112+0000 7f8f2bfff640 1 --2- 172.21.15.49:0/2766326540 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f8f140664a0 0x7f8f14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.116+0000 7f8f2bfff640 1 --2- 172.21.15.49:0/2766326540 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f8f140664a0 0x7f8f14068960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8f34144f20 tx=0x7f8f1c001550 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.116+0000 7f8f317fa640 1 -- 172.21.15.49:0/2766326540 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f24054890 con 0x7f8f20005390 2023-11-18T21:00:27.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.480+0000 7f8f317fa640 1 -- 172.21.15.49:0/2766326540 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f240504d0 con 0x7f8f20005390 2023-11-18T21:00:27.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.656+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/2766326540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f34149eb0 con 0x7f8f20005390 2023-11-18T21:00:27.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.724+0000 7f8f317fa640 1 -- 172.21.15.49:0/2766326540 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8f24017070 con 0x7f8f20005390 2023-11-18T21:00:27.725 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-11-18T21:00:27.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.728+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/2766326540 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f8f140664a0 msgr2=0x7f8f14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:27.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.728+0000 7f8f3a6d1640 1 --2- 172.21.15.49:0/2766326540 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f8f140664a0 0x7f8f14068960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8f34144f20 tx=0x7f8f1c001550 comp rx=0 tx=0).stop 2023-11-18T21:00:27.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.728+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/2766326540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f20005390 msgr2=0x7f8f341f3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:27.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.728+0000 7f8f3a6d1640 1 --2- 172.21.15.49:0/2766326540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f20005390 0x7f8f341f3130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400c410 tx=0x7f8f2400c8d0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.728+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/2766326540 shutdown_connections 2023-11-18T21:00:27.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.728+0000 7f8f3a6d1640 1 --2- 172.21.15.49:0/2766326540 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f8f140664a0 0x7f8f14068960 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.728+0000 7f8f3a6d1640 1 --2- 172.21.15.49:0/2766326540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f34142f20 0x7f8f341433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.728+0000 7f8f3a6d1640 1 --2- 172.21.15.49:0/2766326540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f34155d60 0x7f8f34071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.728+0000 7f8f3a6d1640 1 --2- 172.21.15.49:0/2766326540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f20005390 0x7f8f341f3130 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.728+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/2766326540 >> 172.21.15.49:0/2766326540 conn(0x7f8f3406c6a0 msgr2=0x7f8f34144410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:27.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.728+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/2766326540 shutdown_connections 2023-11-18T21:00:27.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.728+0000 7f8f3a6d1640 1 -- 172.21.15.49:0/2766326540 wait complete. 2023-11-18T21:00:27.754 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T21:00:27.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.876+0000 7fe00cab6640 1 Processor -- start 2023-11-18T21:00:27.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.876+0000 7fe00cab6640 1 -- start start 2023-11-18T21:00:27.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.876+0000 7fe00cab6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0080c5290 0x7fe0080c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.876+0000 7fe00cab6640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00815b120 con 0x7fe0080c7020 2023-11-18T21:00:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.876+0000 7fe00cab6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe008157910 con 0x7fe008151600 2023-11-18T21:00:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.876+0000 7fe00cab6640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00806aa40 con 0x7fe0080c5290 2023-11-18T21:00:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.876+0000 7fe00659c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe008151600 0x7fe008157200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:53996/0 (socket says 172.21.15.49:53996) 2023-11-18T21:00:27.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.876+0000 7fe00659c640 1 -- 172.21.15.49:0/3386835835 learned_addr learned my addr 172.21.15.49:0/3386835835 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:27.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.880+0000 7fe00559a640 1 -- 172.21.15.49:0/3386835835 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456805535 0 0) 0x7fe008157910 con 0x7fe008151600 2023-11-18T21:00:27.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.880+0000 7fe00559a640 1 -- 172.21.15.49:0/3386835835 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff4003530 con 0x7fe008151600 2023-11-18T21:00:27.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.884+0000 7fe00559a640 1 -- 172.21.15.49:0/3386835835 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1158340173 0 0) 0x7fdff4003530 con 0x7fe008151600 2023-11-18T21:00:27.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.884+0000 7fe00559a640 1 -- 172.21.15.49:0/3386835835 >> v2:172.21.15.49:3300/0 conn(0x7fe0080c5290 msgr2=0x7fe0080c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:27.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.884+0000 7fe00559a640 1 --2- 172.21.15.49:0/3386835835 >> v2:172.21.15.49:3300/0 conn(0x7fe0080c5290 0x7fe0080c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.884+0000 7fe00559a640 1 -- 172.21.15.49:0/3386835835 >> v1:172.21.15.49:6789/0 conn(0x7fe0080c7020 legacy=0x7fe0080c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:27.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.884+0000 7fe00559a640 1 -- 172.21.15.49:0/3386835835 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00806ad00 con 0x7fe008151600 2023-11-18T21:00:27.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.884+0000 7fe00559a640 1 -- 172.21.15.49:0/3386835835 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7fdff8001a00 con 0x7fe008151600 2023-11-18T21:00:27.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.884+0000 7fe00559a640 1 -- 172.21.15.49:0/3386835835 >> v1:172.21.15.106:6789/0 conn(0x7fe008151600 legacy=0x7fe008157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:27.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.884+0000 7fe00559a640 1 --2- 172.21.15.49:0/3386835835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff4003a40 0x7fdff4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.884+0000 7fe00559a640 1 --2- 172.21.15.49:0/3386835835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdff40047d0 0x7fdff4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.884+0000 7fe00559a640 1 --2- 172.21.15.49:0/3386835835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdff4005390 0x7fdff400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.884+0000 7fe00559a640 1 -- 172.21.15.49:0/3386835835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00806aa40 con 0x7fdff4003a40 2023-11-18T21:00:27.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.884+0000 7fe00559a640 1 -- 172.21.15.49:0/3386835835 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff400c240 con 0x7fdff40047d0 2023-11-18T21:00:27.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.884+0000 7fe00559a640 1 -- 172.21.15.49:0/3386835835 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff400c400 con 0x7fdff4005390 2023-11-18T21:00:27.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.888+0000 7fe005d9b640 1 --2- 172.21.15.49:0/3386835835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdff40047d0 0x7fdff4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:27.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.892+0000 7fe006d9d640 1 --2- 172.21.15.49:0/3386835835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdff4005390 0x7fdff400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:27.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.896+0000 7fe005d9b640 1 -- 172.21.15.49:0/3386835835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdff4005390 msgr2=0x7fdff400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:27.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.896+0000 7fe005d9b640 1 --2- 172.21.15.49:0/3386835835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdff4005390 0x7fdff400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.896+0000 7fe005d9b640 1 -- 172.21.15.49:0/3386835835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff4003a40 msgr2=0x7fdff4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:27.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.896+0000 7fe005d9b640 1 --2- 172.21.15.49:0/3386835835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff4003a40 0x7fdff4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.896+0000 7fe005d9b640 1 -- 172.21.15.49:0/3386835835 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff4003530 con 0x7fdff40047d0 2023-11-18T21:00:27.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.896+0000 7fe006d9d640 1 -- 172.21.15.49:0/3386835835 reap_dead start 2023-11-18T21:00:27.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.900+0000 7fe005d9b640 1 --2- 172.21.15.49:0/3386835835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdff40047d0 0x7fdff4004c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdff0001650 tx=0x7fdff001c2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3489b23525ff5b82 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:27.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.904+0000 7fe00559a640 1 -- 172.21.15.49:0/3386835835 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0005270 con 0x7fdff40047d0 2023-11-18T21:00:27.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.904+0000 7fe00559a640 1 -- 172.21.15.49:0/3386835835 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff00a7070 con 0x7fdff40047d0 2023-11-18T21:00:27.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.904+0000 7fe00559a640 1 -- 172.21.15.49:0/3386835835 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0003620 con 0x7fdff40047d0 2023-11-18T21:00:27.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.904+0000 7fe00cab6640 1 -- 172.21.15.49:0/3386835835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdff40047d0 msgr2=0x7fdff4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:27.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.904+0000 7fe00cab6640 1 --2- 172.21.15.49:0/3386835835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdff40047d0 0x7fdff4004c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdff0001650 tx=0x7fdff001c2c0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.904+0000 7fe00cab6640 1 -- 172.21.15.49:0/3386835835 shutdown_connections 2023-11-18T21:00:27.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.904+0000 7fe00cab6640 1 --2- 172.21.15.49:0/3386835835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdff40047d0 0x7fdff4004c50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.904+0000 7fe00cab6640 1 -- 172.21.15.49:0/3386835835 >> 172.21.15.49:0/3386835835 conn(0x7fe008070160 msgr2=0x7fe00806b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:27.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.904+0000 7fe00cab6640 1 -- 172.21.15.49:0/3386835835 shutdown_connections 2023-11-18T21:00:27.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.904+0000 7fe00cab6640 1 -- 172.21.15.49:0/3386835835 wait complete. 2023-11-18T21:00:27.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.908+0000 7fe00cab6640 1 Processor -- start 2023-11-18T21:00:27.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.908+0000 7fe00cab6640 1 -- start start 2023-11-18T21:00:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.908+0000 7fe00cab6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff40047d0 0x7fe008156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.908+0000 7fe00cab6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe008148f40 0x7fe008149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.908+0000 7fe00cab6640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe008155540 0x7fe0081559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.908+0000 7fe00cab6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0081f3070 con 0x7fdff40047d0 2023-11-18T21:00:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.908+0000 7fe00cab6640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00814ad50 con 0x7fe008148f40 2023-11-18T21:00:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.908+0000 7fe00cab6640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0081f21a0 con 0x7fe008155540 2023-11-18T21:00:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.908+0000 7fe005d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe008148f40 0x7fe008149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:27.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.908+0000 7fe005d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe008148f40 0x7fe008149380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:41116/0 (socket says 172.21.15.49:41116) 2023-11-18T21:00:27.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.908+0000 7fe005d9b640 1 -- 172.21.15.49:0/1751592359 learned_addr learned my addr 172.21.15.49:0/1751592359 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:27.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.908+0000 7fe006d9d640 1 --2- 172.21.15.49:0/1751592359 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe008155540 0x7fe0081559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:27.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.912+0000 7fe00659c640 1 --2- 172.21.15.49:0/1751592359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff40047d0 0x7fe008156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:27.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.912+0000 7fe005d9b640 1 -- 172.21.15.49:0/1751592359 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe008155540 msgr2=0x7fe0081559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:27.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.912+0000 7fe005d9b640 1 --2- 172.21.15.49:0/1751592359 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe008155540 0x7fe0081559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.912+0000 7fe005d9b640 1 -- 172.21.15.49:0/1751592359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff40047d0 msgr2=0x7fe008156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:27.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.912+0000 7fe005d9b640 1 --2- 172.21.15.49:0/1751592359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff40047d0 0x7fe008156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:27.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.912+0000 7fe005d9b640 1 -- 172.21.15.49:0/1751592359 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0081f2460 con 0x7fe008148f40 2023-11-18T21:00:27.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.916+0000 7fe005d9b640 1 --2- 172.21.15.49:0/1751592359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe008148f40 0x7fe008149380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdff001c0f0 tx=0x7fdff4005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:27.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.924+0000 7fdffeffd640 1 -- 172.21.15.49:0/1751592359 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff00b2070 con 0x7fe008148f40 2023-11-18T21:00:27.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.924+0000 7fdffeffd640 1 -- 172.21.15.49:0/1751592359 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff00a4e90 con 0x7fe008148f40 2023-11-18T21:00:27.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.924+0000 7fdffeffd640 1 -- 172.21.15.49:0/1751592359 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0007250 con 0x7fe008148f40 2023-11-18T21:00:27.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.924+0000 7fe00cab6640 1 -- 172.21.15.49:0/1751592359 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0081f2740 con 0x7fe008148f40 2023-11-18T21:00:27.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.924+0000 7fe00cab6640 1 -- 172.21.15.49:0/1751592359 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0081f2d00 con 0x7fe008148f40 2023-11-18T21:00:27.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.924+0000 7fe00cab6640 1 -- 172.21.15.49:0/1751592359 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0080c7840 con 0x7fe008148f40 2023-11-18T21:00:27.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.948+0000 7fdffeffd640 1 -- 172.21.15.49:0/1751592359 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdff00a9020 con 0x7fe008148f40 2023-11-18T21:00:27.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.948+0000 7fdffeffd640 1 --2- 172.21.15.49:0/1751592359 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fdfe80664f0 0x7fdfe80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:27.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.948+0000 7fe00659c640 1 --2- 172.21.15.49:0/1751592359 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fdfe80664f0 0x7fdfe80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:27.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:27.952+0000 7fe00659c640 1 --2- 172.21.15.49:0/1751592359 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fdfe80664f0 0x7fdfe80689b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdff8001b30 tx=0x7fdff800c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:28.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.252+0000 7fdffeffd640 1 -- 172.21.15.49:0/1751592359 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fdff00eea10 con 0x7fe008148f40 2023-11-18T21:00:28.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.272+0000 7fdffeffd640 1 -- 172.21.15.49:0/1751592359 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdff00ee0e0 con 0x7fe008148f40 2023-11-18T21:00:28.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.444+0000 7fe00cab6640 1 -- 172.21.15.49:0/1751592359 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe0081eec30 con 0x7fe008148f40 2023-11-18T21:00:28.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.460+0000 7fdffeffd640 1 -- 172.21.15.49:0/1751592359 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe0081eec30 con 0x7fe008148f40 2023-11-18T21:00:28.459 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-18T21:00:28.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.460+0000 7fe00cab6640 1 -- 172.21.15.49:0/1751592359 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fdfe80664f0 msgr2=0x7fdfe80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:28.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.460+0000 7fe00cab6640 1 --2- 172.21.15.49:0/1751592359 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fdfe80664f0 0x7fdfe80689b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdff8001b30 tx=0x7fdff800c040 comp rx=0 tx=0).stop 2023-11-18T21:00:28.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.460+0000 7fe00cab6640 1 -- 172.21.15.49:0/1751592359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe008148f40 msgr2=0x7fe008149380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:28.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.460+0000 7fe00cab6640 1 --2- 172.21.15.49:0/1751592359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe008148f40 0x7fe008149380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdff001c0f0 tx=0x7fdff4005800 comp rx=0 tx=0).stop 2023-11-18T21:00:28.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.460+0000 7fe00cab6640 1 -- 172.21.15.49:0/1751592359 shutdown_connections 2023-11-18T21:00:28.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.460+0000 7fe00cab6640 1 --2- 172.21.15.49:0/1751592359 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fdfe80664f0 0x7fdfe80689b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:28.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.460+0000 7fe00cab6640 1 --2- 172.21.15.49:0/1751592359 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe008155540 0x7fe0081559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:28.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.460+0000 7fe00cab6640 1 --2- 172.21.15.49:0/1751592359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe008148f40 0x7fe008149380 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:28.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.460+0000 7fe00cab6640 1 --2- 172.21.15.49:0/1751592359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdff40047d0 0x7fe008156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:28.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.460+0000 7fe00cab6640 1 -- 172.21.15.49:0/1751592359 >> 172.21.15.49:0/1751592359 conn(0x7fe008070160 msgr2=0x7fe008072510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:28.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.460+0000 7fe00cab6640 1 -- 172.21.15.49:0/1751592359 shutdown_connections 2023-11-18T21:00:28.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.460+0000 7fe00cab6640 1 -- 172.21.15.49:0/1751592359 wait complete. 2023-11-18T21:00:28.480 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-18T21:00:28.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.604+0000 7efc5c640640 1 Processor -- start 2023-11-18T21:00:28.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.604+0000 7efc5c640640 1 -- start start 2023-11-18T21:00:28.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.608+0000 7efc5c640640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efc5406adc0 0x7efc54072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:28.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.608+0000 7efc5c640640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc5406b1a0 0x7efc54159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:28.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.608+0000 7efc5c640640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc540c2440 con 0x7efc540c65f0 2023-11-18T21:00:28.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.608+0000 7efc5c640640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc540c2720 con 0x7efc5406b1a0 2023-11-18T21:00:28.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.608+0000 7efc5c640640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc540c2a00 con 0x7efc5406adc0 2023-11-18T21:00:28.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.676+0000 7efc59bdb640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc5406b1a0 0x7efc54159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:28.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.696+0000 7efc59bdb640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc5406b1a0 0x7efc54159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49392/0 (socket says 172.21.15.49:49392) 2023-11-18T21:00:28.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.696+0000 7efc59bdb640 1 -- 172.21.15.49:0/49915710 learned_addr learned my addr 172.21.15.49:0/49915710 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.704+0000 7efc5a3dc640 1 --2- 172.21.15.49:0/49915710 >> v2:172.21.15.106:3300/0 conn(0x7efc5406adc0 0x7efc54072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.708+0000 7efc59bdb640 1 -- 172.21.15.49:0/49915710 >> v2:172.21.15.106:3300/0 conn(0x7efc5406adc0 msgr2=0x7efc54072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.708+0000 7efc59bdb640 1 --2- 172.21.15.49:0/49915710 >> v2:172.21.15.106:3300/0 conn(0x7efc5406adc0 0x7efc54072550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.708+0000 7efc59bdb640 1 -- 172.21.15.49:0/49915710 >> v1:172.21.15.49:6789/0 conn(0x7efc540c65f0 legacy=0x7efc541532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.708+0000 7efc59bdb640 1 -- 172.21.15.49:0/49915710 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc540c2ce0 con 0x7efc5406b1a0 2023-11-18T21:00:28.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.720+0000 7efc59bdb640 1 --2- 172.21.15.49:0/49915710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc5406b1a0 0x7efc54159d70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efc540cca60 tx=0x7efc4401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f54fb2e6b1bc582 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:28.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.728+0000 7efc593da640 1 -- 172.21.15.49:0/49915710 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc440a89b0 con 0x7efc5406b1a0 2023-11-18T21:00:28.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.728+0000 7efc593da640 1 -- 172.21.15.49:0/49915710 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc440a8b10 con 0x7efc5406b1a0 2023-11-18T21:00:28.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.728+0000 7efc593da640 1 -- 172.21.15.49:0/49915710 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc440a8ea0 con 0x7efc5406b1a0 2023-11-18T21:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 -- 172.21.15.49:0/49915710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc5406b1a0 msgr2=0x7efc54159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 --2- 172.21.15.49:0/49915710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc5406b1a0 0x7efc54159d70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efc540cca60 tx=0x7efc4401ecb0 comp rx=0 tx=0).stop 2023-11-18T21:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 -- 172.21.15.49:0/49915710 shutdown_connections 2023-11-18T21:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 --2- 172.21.15.49:0/49915710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc5406b1a0 0x7efc54159d70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 --2- 172.21.15.49:0/49915710 >> v2:172.21.15.106:3300/0 conn(0x7efc5406adc0 0x7efc54072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 -- 172.21.15.49:0/49915710 >> 172.21.15.49:0/49915710 conn(0x7efc54070160 msgr2=0x7efc5406b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 -- 172.21.15.49:0/49915710 shutdown_connections 2023-11-18T21:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 -- 172.21.15.49:0/49915710 wait complete. 2023-11-18T21:00:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 Processor -- start 2023-11-18T21:00:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 -- start start 2023-11-18T21:00:28.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc5406adc0 0x7efc5415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:28.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc5406b1a0 0x7efc54155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:28.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc540c65f0 0x7efc5415b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:28.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc54156e40 con 0x7efc540c65f0 2023-11-18T21:00:28.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc54154980 con 0x7efc5406adc0 2023-11-18T21:00:28.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.732+0000 7efc5c640640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc541565c0 con 0x7efc5406b1a0 2023-11-18T21:00:28.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.736+0000 7efc5a3dc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc5406adc0 0x7efc5415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:28.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.736+0000 7efc5abdd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc540c65f0 0x7efc5415b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:28.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.736+0000 7efc5a3dc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc5406adc0 0x7efc5415ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:41140/0 (socket says 172.21.15.49:41140) 2023-11-18T21:00:28.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.736+0000 7efc5a3dc640 1 -- 172.21.15.49:0/3443515608 learned_addr learned my addr 172.21.15.49:0/3443515608 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.740+0000 7efc5abdd640 1 -- 172.21.15.49:0/3443515608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc5406b1a0 msgr2=0x7efc54155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.740+0000 7efc5abdd640 1 --2- 172.21.15.49:0/3443515608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc5406b1a0 0x7efc54155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.740+0000 7efc5abdd640 1 -- 172.21.15.49:0/3443515608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc5406adc0 msgr2=0x7efc5415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.740+0000 7efc5abdd640 1 --2- 172.21.15.49:0/3443515608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc5406adc0 0x7efc5415ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.740+0000 7efc5abdd640 1 -- 172.21.15.49:0/3443515608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440094d0 con 0x7efc540c65f0 2023-11-18T21:00:28.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.744+0000 7efc5abdd640 1 --2- 172.21.15.49:0/3443515608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc540c65f0 0x7efc5415b560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00be00 tx=0x7efc4c00bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.748+0000 7efc4affd640 1 -- 172.21.15.49:0/3443515608 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00ce70 con 0x7efc540c65f0 2023-11-18T21:00:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.748+0000 7efc4affd640 1 -- 172.21.15.49:0/3443515608 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c003980 con 0x7efc540c65f0 2023-11-18T21:00:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.748+0000 7efc4affd640 1 -- 172.21.15.49:0/3443515608 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c003d70 con 0x7efc540c65f0 2023-11-18T21:00:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.748+0000 7efc5c640640 1 -- 172.21.15.49:0/3443515608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5415a7a0 con 0x7efc540c65f0 2023-11-18T21:00:28.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.748+0000 7efc5c640640 1 -- 172.21.15.49:0/3443515608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5415ad60 con 0x7efc540c65f0 2023-11-18T21:00:28.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.748+0000 7efc5c640640 1 -- 172.21.15.49:0/3443515608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc54073e70 con 0x7efc540c65f0 2023-11-18T21:00:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.772+0000 7efc4affd640 1 -- 172.21.15.49:0/3443515608 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efc4c003ed0 con 0x7efc540c65f0 2023-11-18T21:00:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.772+0000 7efc4affd640 1 --2- 172.21.15.49:0/3443515608 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efc380664c0 0x7efc38068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.772+0000 7efc5a3dc640 1 --2- 172.21.15.49:0/3443515608 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efc380664c0 0x7efc38068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:28.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.776+0000 7efc5a3dc640 1 --2- 172.21.15.49:0/3443515608 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efc380664c0 0x7efc38068980 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efc50007b10 tx=0x7efc50008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:28.776+0000 7efc4affd640 1 -- 172.21.15.49:0/3443515608 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7efc4c055820 con 0x7efc540c65f0 2023-11-18T21:00:29.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.072+0000 7efc4affd640 1 -- 172.21.15.49:0/3443515608 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc4c051b60 con 0x7efc540c65f0 2023-11-18T21:00:29.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.252+0000 7efc5c640640 1 -- 172.21.15.49:0/3443515608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efc54152250 con 0x7efc540c65f0 2023-11-18T21:00:29.264 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.264+0000 7efc4affd640 1 -- 172.21.15.49:0/3443515608 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7efc4c022030 con 0x7efc540c65f0 2023-11-18T21:00:29.265 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-11-18T21:00:29.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.268+0000 7efc5c640640 1 -- 172.21.15.49:0/3443515608 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efc380664c0 msgr2=0x7efc38068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:29.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.268+0000 7efc5c640640 1 --2- 172.21.15.49:0/3443515608 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efc380664c0 0x7efc38068980 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efc50007b10 tx=0x7efc50008040 comp rx=0 tx=0).stop 2023-11-18T21:00:29.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.268+0000 7efc5c640640 1 -- 172.21.15.49:0/3443515608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc540c65f0 msgr2=0x7efc5415b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:29.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.268+0000 7efc5c640640 1 --2- 172.21.15.49:0/3443515608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc540c65f0 0x7efc5415b560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00be00 tx=0x7efc4c00bef0 comp rx=0 tx=0).stop 2023-11-18T21:00:29.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.268+0000 7efc5c640640 1 -- 172.21.15.49:0/3443515608 shutdown_connections 2023-11-18T21:00:29.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.268+0000 7efc5c640640 1 --2- 172.21.15.49:0/3443515608 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efc380664c0 0x7efc38068980 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:29.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.268+0000 7efc5c640640 1 --2- 172.21.15.49:0/3443515608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc540c65f0 0x7efc5415b560 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:29.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.268+0000 7efc5c640640 1 --2- 172.21.15.49:0/3443515608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc5406b1a0 0x7efc54155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:29.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.268+0000 7efc5c640640 1 --2- 172.21.15.49:0/3443515608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc5406adc0 0x7efc5415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:29.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.268+0000 7efc5c640640 1 -- 172.21.15.49:0/3443515608 >> 172.21.15.49:0/3443515608 conn(0x7efc54070160 msgr2=0x7efc54158720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:29.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.268+0000 7efc5c640640 1 -- 172.21.15.49:0/3443515608 shutdown_connections 2023-11-18T21:00:29.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.268+0000 7efc5c640640 1 -- 172.21.15.49:0/3443515608 wait complete. 2023-11-18T21:00:29.285 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T21:00:29.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.396+0000 7ffad19ca640 1 Processor -- start 2023-11-18T21:00:29.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.400+0000 7ffad19ca640 1 -- start start 2023-11-18T21:00:29.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.400+0000 7ffad19ca640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffacc1501e0 0x7ffacc156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:29.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.400+0000 7ffad19ca640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc0c0ee0 con 0x7ffacc1505c0 2023-11-18T21:00:29.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.400+0000 7ffad19ca640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc157040 con 0x7ffacc1596e0 2023-11-18T21:00:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.400+0000 7ffad19ca640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0c1c70 con 0x7ffacc1501e0 2023-11-18T21:00:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.400+0000 7ffacaffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffacc1501e0 0x7ffacc156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.400+0000 7ffaca7fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ffacc1505c0 0x7ffacc06fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36274/0 (socket says 172.21.15.49:36274) 2023-11-18T21:00:29.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.400+0000 7ffaca7fc640 1 -- 172.21.15.49:0/3520858793 learned_addr learned my addr 172.21.15.49:0/3520858793 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:29.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.404+0000 7ffacaffd640 1 -- 172.21.15.49:0/3520858793 >> v1:172.21.15.106:6789/0 conn(0x7ffacc1596e0 legacy=0x7ffacc0c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:29.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.404+0000 7ffacaffd640 1 -- 172.21.15.49:0/3520858793 >> v1:172.21.15.49:6789/0 conn(0x7ffacc1505c0 legacy=0x7ffacc06fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:29.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.404+0000 7ffacaffd640 1 -- 172.21.15.49:0/3520858793 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0702b0 con 0x7ffacc1501e0 2023-11-18T21:00:29.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.408+0000 7ffacaffd640 1 --2- 172.21.15.49:0/3520858793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffacc1501e0 0x7ffacc156b00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0097c0 tx=0x7ffabc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775b997de0079b19 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:29.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.412+0000 7ffac9ffb640 1 -- 172.21.15.49:0/3520858793 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0a8970 con 0x7ffacc1501e0 2023-11-18T21:00:29.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.412+0000 7ffac9ffb640 1 -- 172.21.15.49:0/3520858793 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc0a8ad0 con 0x7ffacc1501e0 2023-11-18T21:00:29.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.412+0000 7ffac9ffb640 1 -- 172.21.15.49:0/3520858793 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0a8e60 con 0x7ffacc1501e0 2023-11-18T21:00:29.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 -- 172.21.15.49:0/3520858793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffacc1501e0 msgr2=0x7ffacc156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:29.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 --2- 172.21.15.49:0/3520858793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffacc1501e0 0x7ffacc156b00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0097c0 tx=0x7ffabc01ec70 comp rx=0 tx=0).stop 2023-11-18T21:00:29.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 -- 172.21.15.49:0/3520858793 shutdown_connections 2023-11-18T21:00:29.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 --2- 172.21.15.49:0/3520858793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffacc1501e0 0x7ffacc156b00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:29.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 -- 172.21.15.49:0/3520858793 >> 172.21.15.49:0/3520858793 conn(0x7ffacc06b670 msgr2=0x7ffacc06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:29.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 -- 172.21.15.49:0/3520858793 shutdown_connections 2023-11-18T21:00:29.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 -- 172.21.15.49:0/3520858793 wait complete. 2023-11-18T21:00:29.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 Processor -- start 2023-11-18T21:00:29.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 -- start start 2023-11-18T21:00:29.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffacc1501e0 0x7ffacc158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:29.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffacc1505c0 0x7ffacc1ee390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:29.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffacc1596e0 0x7ffacc0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:29.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc158040 con 0x7ffacc1501e0 2023-11-18T21:00:29.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc158940 con 0x7ffacc1505c0 2023-11-18T21:00:29.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffad19ca640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0c9a20 con 0x7ffacc1596e0 2023-11-18T21:00:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffacaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffacc1501e0 0x7ffacc158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffacaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffacc1501e0 0x7ffacc158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49424/0 (socket says 172.21.15.49:49424) 2023-11-18T21:00:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffacaffd640 1 -- 172.21.15.49:0/4167575923 learned_addr learned my addr 172.21.15.49:0/4167575923 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffaca7fc640 1 --2- 172.21.15.49:0/4167575923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffacc1505c0 0x7ffacc1ee390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:29.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.416+0000 7ffacb7fe640 1 --2- 172.21.15.49:0/4167575923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffacc1596e0 0x7ffacc0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:29.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.420+0000 7ffacaffd640 1 -- 172.21.15.49:0/4167575923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffacc1596e0 msgr2=0x7ffacc0cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:29.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.420+0000 7ffacaffd640 1 --2- 172.21.15.49:0/4167575923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffacc1596e0 0x7ffacc0cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:29.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.420+0000 7ffacaffd640 1 -- 172.21.15.49:0/4167575923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffacc1505c0 msgr2=0x7ffacc1ee390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:29.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.420+0000 7ffacaffd640 1 --2- 172.21.15.49:0/4167575923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffacc1505c0 0x7ffacc1ee390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:29.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.420+0000 7ffacaffd640 1 -- 172.21.15.49:0/4167575923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc009420 con 0x7ffacc1501e0 2023-11-18T21:00:29.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.424+0000 7ffacaffd640 1 --2- 172.21.15.49:0/4167575923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffacc1501e0 0x7ffacc158300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffabc01b880 tx=0x7ffabc01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:29.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.428+0000 7ffac3fff640 1 -- 172.21.15.49:0/4167575923 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0b9610 con 0x7ffacc1501e0 2023-11-18T21:00:29.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.428+0000 7ffac3fff640 1 -- 172.21.15.49:0/4167575923 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc0b9790 con 0x7ffacc1501e0 2023-11-18T21:00:29.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.428+0000 7ffad19ca640 1 -- 172.21.15.49:0/4167575923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc0c9d00 con 0x7ffacc1501e0 2023-11-18T21:00:29.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.428+0000 7ffac3fff640 1 -- 172.21.15.49:0/4167575923 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0b9b40 con 0x7ffacc1501e0 2023-11-18T21:00:29.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.428+0000 7ffad19ca640 1 -- 172.21.15.49:0/4167575923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc0ca2c0 con 0x7ffacc1501e0 2023-11-18T21:00:29.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.428+0000 7ffad19ca640 1 -- 172.21.15.49:0/4167575923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc0ca4b0 con 0x7ffacc1501e0 2023-11-18T21:00:29.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.716+0000 7ffac3fff640 1 -- 172.21.15.49:0/4167575923 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffabc0b7040 con 0x7ffacc1501e0 2023-11-18T21:00:29.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.716+0000 7ffac3fff640 1 --2- 172.21.15.49:0/4167575923 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ffab00664c0 0x7ffab0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:29.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.716+0000 7ffaca7fc640 1 --2- 172.21.15.49:0/4167575923 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ffab00664c0 0x7ffab0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:29.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.716+0000 7ffaca7fc640 1 --2- 172.21.15.49:0/4167575923 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ffab00664c0 0x7ffab0068980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0c6e60 tx=0x7ffab4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.732+0000 7ffac3fff640 1 -- 172.21.15.49:0/4167575923 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ffabc0a8910 con 0x7ffacc1501e0 2023-11-18T21:00:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.732+0000 7ffac3fff640 1 -- 172.21.15.49:0/4167575923 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffabc0efb90 con 0x7ffacc1501e0 2023-11-18T21:00:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:29.964+0000 7ffad19ca640 1 -- 172.21.15.49:0/4167575923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffacc073e70 con 0x7ffacc1501e0 2023-11-18T21:00:30.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.040+0000 7ffac3fff640 1 -- 172.21.15.49:0/4167575923 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6559 (secure 0 0 0) 0x7ffabc0b5020 con 0x7ffacc1501e0 2023-11-18T21:00:30.039 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:30.039 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1013296856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1013296856},{"type":"v1","addr":"172.21.15.49:6833","nonce":1013296856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:59:27.571192+0000","modified":"2023-11-18T21:00:25.344890+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4252,"mds_1":4238,"mds_2":4235,"mds_3":4197,"mds_4":4194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4194":{"gid":4194,"name":"c","rank":4,"incarnation":19,"state":"up:active","state_seq":21,"addr":"172.21.15.49:6835/3397458527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3397458527},{"type":"v1","addr":"172.21.15.49:6835","nonce":3397458527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4197":{"gid":4197,"name":"d","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.106:6835/2795994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2795994685},{"type":"v1","addr":"172.21.15.106:6835","nonce":2795994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4235":{"gid":4235,"name":"f","rank":2,"incarnation":15,"state":"up:active","state_seq":17,"addr":"172.21.15.106:6837/2839781261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":2839781261},{"type":"v1","addr":"172.21.15.106:6837","nonce":2839781261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4238":{"gid":4238,"name":"b","rank":1,"incarnation":11,"state":"up:active","state_seq":16,"addr":"172.21.15.106:6839/957974967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":957974967},{"type":"v1","addr":"172.21.15.106:6839","nonce":957974967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4252":{"gid":4252,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.49:6837/321839377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":321839377},{"type":"v1","addr":"172.21.15.49:6837","nonce":321839377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T21:00:30.040 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 20 2023-11-18T21:00:30.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.044+0000 7ffad19ca640 1 -- 172.21.15.49:0/4167575923 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ffab00664c0 msgr2=0x7ffab0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:30.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.044+0000 7ffad19ca640 1 --2- 172.21.15.49:0/4167575923 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ffab00664c0 0x7ffab0068980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0c6e60 tx=0x7ffab4009040 comp rx=0 tx=0).stop 2023-11-18T21:00:30.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.044+0000 7ffad19ca640 1 -- 172.21.15.49:0/4167575923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffacc1501e0 msgr2=0x7ffacc158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:30.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.044+0000 7ffad19ca640 1 --2- 172.21.15.49:0/4167575923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffacc1501e0 0x7ffacc158300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffabc01b880 tx=0x7ffabc01ba10 comp rx=0 tx=0).stop 2023-11-18T21:00:30.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.044+0000 7ffad19ca640 1 -- 172.21.15.49:0/4167575923 shutdown_connections 2023-11-18T21:00:30.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.044+0000 7ffad19ca640 1 --2- 172.21.15.49:0/4167575923 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ffab00664c0 0x7ffab0068980 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:30.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.044+0000 7ffad19ca640 1 --2- 172.21.15.49:0/4167575923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffacc1596e0 0x7ffacc0cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:30.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.044+0000 7ffad19ca640 1 --2- 172.21.15.49:0/4167575923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffacc1505c0 0x7ffacc1ee390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:30.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.044+0000 7ffad19ca640 1 --2- 172.21.15.49:0/4167575923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffacc1501e0 0x7ffacc158300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:30.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.044+0000 7ffad19ca640 1 -- 172.21.15.49:0/4167575923 >> 172.21.15.49:0/4167575923 conn(0x7ffacc06b670 msgr2=0x7ffacc0b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:30.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.044+0000 7ffad19ca640 1 -- 172.21.15.49:0/4167575923 shutdown_connections 2023-11-18T21:00:30.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.044+0000 7ffad19ca640 1 -- 172.21.15.49:0/4167575923 wait complete. 2023-11-18T21:00:30.066 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T21:00:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.196+0000 7f56a2206640 1 Processor -- start 2023-11-18T21:00:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.196+0000 7f56a2206640 1 -- start start 2023-11-18T21:00:30.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.196+0000 7f56a2206640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f569c06a560 0x7f569c157210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:30.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.196+0000 7f56a2206640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c151950 con 0x7f569c0c8e10 2023-11-18T21:00:30.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.196+0000 7f56a2206640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c06ab80 con 0x7f569c151570 2023-11-18T21:00:30.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.196+0000 7f56a2206640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0c7d40 con 0x7f569c06a560 2023-11-18T21:00:30.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.200+0000 7f569affd640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f569c06a560 0x7f569c157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:30.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.200+0000 7f569b7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f569c151570 0x7f569c0c5290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:54016/0 (socket says 172.21.15.49:54016) 2023-11-18T21:00:30.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.200+0000 7f569b7fe640 1 -- 172.21.15.49:0/2613530767 learned_addr learned my addr 172.21.15.49:0/2613530767 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.208+0000 7f569affd640 1 -- 172.21.15.49:0/2613530767 >> v1:172.21.15.106:6789/0 conn(0x7f569c151570 legacy=0x7f569c0c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.208+0000 7f569affd640 1 -- 172.21.15.49:0/2613530767 >> v1:172.21.15.49:6789/0 conn(0x7f569c0c8e10 legacy=0x7f569c161b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.208+0000 7f569affd640 1 -- 172.21.15.49:0/2613530767 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c06ae20 con 0x7f569c06a560 2023-11-18T21:00:30.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.212+0000 7f569affd640 1 --2- 172.21.15.49:0/2613530767 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f569c06a560 0x7f569c157210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f56900097f0 tx=0x7f569001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc0bc58f0182aa20 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.224+0000 7f569a7fc640 1 -- 172.21.15.49:0/2613530767 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56900ab600 con 0x7f569c06a560 2023-11-18T21:00:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.224+0000 7f569a7fc640 1 -- 172.21.15.49:0/2613530767 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56900a7050 con 0x7f569c06a560 2023-11-18T21:00:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.224+0000 7f569a7fc640 1 -- 172.21.15.49:0/2613530767 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56900ab980 con 0x7f569c06a560 2023-11-18T21:00:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.224+0000 7f56a2206640 1 -- 172.21.15.49:0/2613530767 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f569c06a560 msgr2=0x7f569c157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.224+0000 7f56a2206640 1 --2- 172.21.15.49:0/2613530767 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f569c06a560 0x7f569c157210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f56900097f0 tx=0x7f569001c3f0 comp rx=0 tx=0).stop 2023-11-18T21:00:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.224+0000 7f56a2206640 1 -- 172.21.15.49:0/2613530767 shutdown_connections 2023-11-18T21:00:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.224+0000 7f56a2206640 1 --2- 172.21.15.49:0/2613530767 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f569c06a560 0x7f569c157210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.224+0000 7f56a2206640 1 -- 172.21.15.49:0/2613530767 >> 172.21.15.49:0/2613530767 conn(0x7f569c070160 msgr2=0x7f569c06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.224+0000 7f56a2206640 1 -- 172.21.15.49:0/2613530767 shutdown_connections 2023-11-18T21:00:30.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.224+0000 7f56a2206640 1 -- 172.21.15.49:0/2613530767 wait complete. 2023-11-18T21:00:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.224+0000 7f56a2206640 1 Processor -- start 2023-11-18T21:00:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.224+0000 7f56a2206640 1 -- start start 2023-11-18T21:00:30.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.228+0000 7f56a2206640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f569c06a560 0x7f569c1f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:30.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.228+0000 7f56a2206640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f569c0c8e10 0x7f569c14b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:30.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.228+0000 7f56a2206640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f569c151570 0x7f569c155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:30.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.228+0000 7f56a2206640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c152600 con 0x7f569c0c8e10 2023-11-18T21:00:30.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.228+0000 7f56a2206640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1f0c30 con 0x7f569c06a560 2023-11-18T21:00:30.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.228+0000 7f56a2206640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1f1c00 con 0x7f569c151570 2023-11-18T21:00:30.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.228+0000 7f569b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f569c06a560 0x7f569c1f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:30.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.228+0000 7f569bfff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f569c151570 0x7f569c155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:30.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.228+0000 7f569b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f569c06a560 0x7f569c1f4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:41154/0 (socket says 172.21.15.49:41154) 2023-11-18T21:00:30.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.228+0000 7f569b7fe640 1 -- 172.21.15.49:0/3623218970 learned_addr learned my addr 172.21.15.49:0/3623218970 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:30.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.236+0000 7f569affd640 1 --2- 172.21.15.49:0/3623218970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f569c0c8e10 0x7f569c14b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.244+0000 7f569bfff640 1 -- 172.21.15.49:0/3623218970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f569c06a560 msgr2=0x7f569c1f4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.244+0000 7f569bfff640 1 --2- 172.21.15.49:0/3623218970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f569c06a560 0x7f569c1f4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.244+0000 7f569bfff640 1 -- 172.21.15.49:0/3623218970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f569c0c8e10 msgr2=0x7f569c14b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.244+0000 7f569bfff640 1 --2- 172.21.15.49:0/3623218970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f569c0c8e10 0x7f569c14b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.244+0000 7f569bfff640 1 -- 172.21.15.49:0/3623218970 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5690009420 con 0x7f569c151570 2023-11-18T21:00:30.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.252+0000 7f569bfff640 1 --2- 172.21.15.49:0/3623218970 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f569c151570 0x7f569c155030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f569400be20 tx=0x7f569400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:30.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.260+0000 7f5683fff640 1 -- 172.21.15.49:0/3623218970 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400ce70 con 0x7f569c151570 2023-11-18T21:00:30.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.260+0000 7f5683fff640 1 -- 172.21.15.49:0/3623218970 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5694014440 con 0x7f569c151570 2023-11-18T21:00:30.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.260+0000 7f5683fff640 1 -- 172.21.15.49:0/3623218970 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694014830 con 0x7f569c151570 2023-11-18T21:00:30.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.260+0000 7f56a2206640 1 -- 172.21.15.49:0/3623218970 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c1f50f0 con 0x7f569c151570 2023-11-18T21:00:30.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.260+0000 7f56a2206640 1 -- 172.21.15.49:0/3623218970 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c152320 con 0x7f569c151570 2023-11-18T21:00:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.264+0000 7f56a2206640 1 -- 172.21.15.49:0/3623218970 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569c073e70 con 0x7f569c151570 2023-11-18T21:00:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.316+0000 7f5683fff640 1 -- 172.21.15.49:0/3623218970 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f569401d3b0 con 0x7f569c151570 2023-11-18T21:00:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.316+0000 7f5683fff640 1 --2- 172.21.15.49:0/3623218970 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f56880664c0 0x7f5688068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:30.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.316+0000 7f569b7fe640 1 --2- 172.21.15.49:0/3623218970 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f56880664c0 0x7f5688068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:30.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.316+0000 7f569b7fe640 1 --2- 172.21.15.49:0/3623218970 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f56880664c0 0x7f5688068980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f568c005890 tx=0x7f568c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:30.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.616+0000 7f5683fff640 1 -- 172.21.15.49:0/3623218970 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f56940554a0 con 0x7f569c151570 2023-11-18T21:00:30.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.628+0000 7f5683fff640 1 -- 172.21.15.49:0/3623218970 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56940517e0 con 0x7f569c151570 2023-11-18T21:00:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.804+0000 7f56a2206640 1 -- 172.21.15.49:0/3623218970 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f569c1f50f0 con 0x7f569c151570 2023-11-18T21:00:30.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.864+0000 7f5683fff640 1 -- 172.21.15.49:0/3623218970 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18408 (secure 0 0 0) 0x7f569c1f50f0 con 0x7f569c151570 2023-11-18T21:00:30.865 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:30.865 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":31,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T21:00:28.529922+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T21:00:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.868+0000 7f56a2206640 1 -- 172.21.15.49:0/3623218970 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f56880664c0 msgr2=0x7f5688068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.868+0000 7f56a2206640 1 --2- 172.21.15.49:0/3623218970 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f56880664c0 0x7f5688068980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f568c005890 tx=0x7f568c009040 comp rx=0 tx=0).stop 2023-11-18T21:00:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.868+0000 7f56a2206640 1 -- 172.21.15.49:0/3623218970 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f569c151570 msgr2=0x7f569c155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.868+0000 7f56a2206640 1 --2- 172.21.15.49:0/3623218970 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f569c151570 0x7f569c155030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f569400be20 tx=0x7f569400bf10 comp rx=0 tx=0).stop 2023-11-18T21:00:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.868+0000 7f56a2206640 1 -- 172.21.15.49:0/3623218970 shutdown_connections 2023-11-18T21:00:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.868+0000 7f56a2206640 1 --2- 172.21.15.49:0/3623218970 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f56880664c0 0x7f5688068980 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.868+0000 7f56a2206640 1 --2- 172.21.15.49:0/3623218970 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f569c151570 0x7f569c155030 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.868+0000 7f56a2206640 1 --2- 172.21.15.49:0/3623218970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f569c0c8e10 0x7f569c14b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:30.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.868+0000 7f56a2206640 1 --2- 172.21.15.49:0/3623218970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f569c06a560 0x7f569c1f4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:30.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.868+0000 7f56a2206640 1 -- 172.21.15.49:0/3623218970 >> 172.21.15.49:0/3623218970 conn(0x7f569c070160 msgr2=0x7f569c0c1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:30.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.868+0000 7f56a2206640 1 -- 172.21.15.49:0/3623218970 shutdown_connections 2023-11-18T21:00:30.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:30.868+0000 7f56a2206640 1 -- 172.21.15.49:0/3623218970 wait complete. 2023-11-18T21:00:30.888 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:58:42.362631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:59:22.756454+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:59:25.252588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-18T20:59:33.423071+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-18T21:00:30.888 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T21:00:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.012+0000 7f7fd2712640 1 Processor -- start 2023-11-18T21:00:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.012+0000 7f7fd2712640 1 -- start start 2023-11-18T21:00:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.012+0000 7f7fd2712640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7fcc0c46c0 0x7f7fcc0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.012+0000 7f7fd2712640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7fcc0c4aa0 0x7f7fcc14ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.012+0000 7f7fd2712640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc15a5d0 con 0x7f7fcc156240 2023-11-18T21:00:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.012+0000 7f7fd2712640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc0c38a0 con 0x7f7fcc0c46c0 2023-11-18T21:00:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.012+0000 7f7fd2712640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc15a2f0 con 0x7f7fcc0c4aa0 2023-11-18T21:00:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.012+0000 7f7fcbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7fcc0c46c0 0x7f7fcc0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:31.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.012+0000 7f7fcbfff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7fcc0c46c0 0x7f7fcc0c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49440/0 (socket says 172.21.15.49:49440) 2023-11-18T21:00:31.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.012+0000 7f7fcbfff640 1 -- 172.21.15.49:0/2766272279 learned_addr learned my addr 172.21.15.49:0/2766272279 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:31.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.016+0000 7f7fcbfff640 1 -- 172.21.15.49:0/2766272279 >> v2:172.21.15.106:3300/0 conn(0x7f7fcc0c4aa0 msgr2=0x7f7fcc14ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:31.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.016+0000 7f7fcbfff640 1 --2- 172.21.15.49:0/2766272279 >> v2:172.21.15.106:3300/0 conn(0x7f7fcc0c4aa0 0x7f7fcc14ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:31.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.016+0000 7f7fcbfff640 1 -- 172.21.15.49:0/2766272279 >> v1:172.21.15.49:6789/0 conn(0x7f7fcc156240 legacy=0x7f7fcc1596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:31.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.016+0000 7f7fcbfff640 1 -- 172.21.15.49:0/2766272279 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc0c1f70 con 0x7f7fcc0c46c0 2023-11-18T21:00:31.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.024+0000 7f7fcbfff640 1 --2- 172.21.15.49:0/2766272279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc0c46c0 0x7f7fcc0c6c50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc06d680 tx=0x7f7fbc020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb56df0cdb77e29 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.028+0000 7f7fcaffd640 1 -- 172.21.15.49:0/2766272279 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0aac00 con 0x7f7fcc0c46c0 2023-11-18T21:00:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.028+0000 7f7fcaffd640 1 -- 172.21.15.49:0/2766272279 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc0aad60 con 0x7f7fcc0c46c0 2023-11-18T21:00:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.028+0000 7f7fcaffd640 1 -- 172.21.15.49:0/2766272279 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0b2660 con 0x7f7fcc0c46c0 2023-11-18T21:00:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 -- 172.21.15.49:0/2766272279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc0c46c0 msgr2=0x7f7fcc0c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 --2- 172.21.15.49:0/2766272279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc0c46c0 0x7f7fcc0c6c50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc06d680 tx=0x7f7fbc020f00 comp rx=0 tx=0).stop 2023-11-18T21:00:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 -- 172.21.15.49:0/2766272279 shutdown_connections 2023-11-18T21:00:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 --2- 172.21.15.49:0/2766272279 >> v2:172.21.15.106:3300/0 conn(0x7f7fcc0c4aa0 0x7f7fcc14ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 --2- 172.21.15.49:0/2766272279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc0c46c0 0x7f7fcc0c6c50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 -- 172.21.15.49:0/2766272279 >> 172.21.15.49:0/2766272279 conn(0x7f7fcc06c6a0 msgr2=0x7f7fcc06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 -- 172.21.15.49:0/2766272279 shutdown_connections 2023-11-18T21:00:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 -- 172.21.15.49:0/2766272279 wait complete. 2023-11-18T21:00:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 Processor -- start 2023-11-18T21:00:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 -- start start 2023-11-18T21:00:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fcc0c46c0 0x7f7fcc158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc0c4aa0 0x7f7fcc159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fcc156240 0x7f7fcc071600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1f0070 con 0x7f7fcc0c4aa0 2023-11-18T21:00:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1ef210 con 0x7f7fcc156240 2023-11-18T21:00:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fd2712640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1ef4f0 con 0x7f7fcc0c46c0 2023-11-18T21:00:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc0c4aa0 0x7f7fcc159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc0c4aa0 0x7f7fcc159040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49442/0 (socket says 172.21.15.49:49442) 2023-11-18T21:00:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.032+0000 7f7fcb7fe640 1 -- 172.21.15.49:0/2976772868 learned_addr learned my addr 172.21.15.49:0/2976772868 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.036+0000 7f7fcb7fe640 1 -- 172.21.15.49:0/2976772868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fcc0c46c0 msgr2=0x7f7fcc158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:31.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.036+0000 7f7fcb7fe640 1 --2- 172.21.15.49:0/2976772868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fcc0c46c0 0x7f7fcc158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:31.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.036+0000 7f7fcb7fe640 1 -- 172.21.15.49:0/2976772868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fcc156240 msgr2=0x7f7fcc071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:31.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.036+0000 7f7fcb7fe640 1 --2- 172.21.15.49:0/2976772868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fcc156240 0x7f7fcc071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:31.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.036+0000 7f7fcb7fe640 1 -- 172.21.15.49:0/2976772868 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc0094d0 con 0x7f7fcc0c4aa0 2023-11-18T21:00:31.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.040+0000 7f7fcb7fe640 1 --2- 172.21.15.49:0/2976772868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc0c4aa0 0x7f7fcc159040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000b480 tx=0x7f7fc000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:31.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.044+0000 7f7fc8ff9640 1 -- 172.21.15.49:0/2976772868 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0010870 con 0x7f7fcc0c4aa0 2023-11-18T21:00:31.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.044+0000 7f7fd2712640 1 -- 172.21.15.49:0/2976772868 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fcc1ef7d0 con 0x7f7fcc0c4aa0 2023-11-18T21:00:31.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.044+0000 7f7fd2712640 1 -- 172.21.15.49:0/2976772868 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc1efd90 con 0x7f7fcc0c4aa0 2023-11-18T21:00:31.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.044+0000 7f7fc8ff9640 1 -- 172.21.15.49:0/2976772868 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc00092b0 con 0x7f7fcc0c4aa0 2023-11-18T21:00:31.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.044+0000 7f7fc8ff9640 1 -- 172.21.15.49:0/2976772868 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0010bd0 con 0x7f7fcc0c4aa0 2023-11-18T21:00:31.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.044+0000 7f7fd2712640 1 -- 172.21.15.49:0/2976772868 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac005260 con 0x7f7fcc0c4aa0 2023-11-18T21:00:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.336+0000 7f7fc8ff9640 1 -- 172.21.15.49:0/2976772868 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7fc0010d30 con 0x7f7fcc0c4aa0 2023-11-18T21:00:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.336+0000 7f7fc8ff9640 1 --2- 172.21.15.49:0/2976772868 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7fb80664a0 0x7f7fb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:31.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.336+0000 7f7fcbfff640 1 --2- 172.21.15.49:0/2976772868 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7fb80664a0 0x7f7fb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:31.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.336+0000 7f7fcbfff640 1 --2- 172.21.15.49:0/2976772868 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7fb80664a0 0x7f7fb8068960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0b4000 tx=0x7f7fbc004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.348+0000 7f7fc8ff9640 1 -- 172.21.15.49:0/2976772868 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f7fc0055cf0 con 0x7f7fcc0c4aa0 2023-11-18T21:00:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.348+0000 7f7fc8ff9640 1 -- 172.21.15.49:0/2976772868 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7fc0055130 con 0x7f7fcc0c4aa0 2023-11-18T21:00:31.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.536+0000 7f7fd2712640 1 -- 172.21.15.49:0/2976772868 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7fac005a90 con 0x7f7fcc0c4aa0 2023-11-18T21:00:31.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.552+0000 7f7fc8ff9640 1 -- 172.21.15.49:0/2976772868 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7fc001e020 con 0x7f7fcc0c4aa0 2023-11-18T21:00:31.551 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-18T21:00:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.552+0000 7f7fd2712640 1 -- 172.21.15.49:0/2976772868 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7fb80664a0 msgr2=0x7f7fb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.552+0000 7f7fd2712640 1 --2- 172.21.15.49:0/2976772868 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7fb80664a0 0x7f7fb8068960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0b4000 tx=0x7f7fbc004740 comp rx=0 tx=0).stop 2023-11-18T21:00:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.552+0000 7f7fd2712640 1 -- 172.21.15.49:0/2976772868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc0c4aa0 msgr2=0x7f7fcc159040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.552+0000 7f7fd2712640 1 --2- 172.21.15.49:0/2976772868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc0c4aa0 0x7f7fcc159040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000b480 tx=0x7f7fc000b940 comp rx=0 tx=0).stop 2023-11-18T21:00:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.552+0000 7f7fd2712640 1 -- 172.21.15.49:0/2976772868 shutdown_connections 2023-11-18T21:00:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.552+0000 7f7fd2712640 1 --2- 172.21.15.49:0/2976772868 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7fb80664a0 0x7f7fb8068960 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.552+0000 7f7fd2712640 1 --2- 172.21.15.49:0/2976772868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fcc156240 0x7f7fcc071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.552+0000 7f7fd2712640 1 --2- 172.21.15.49:0/2976772868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc0c4aa0 0x7f7fcc159040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.552+0000 7f7fd2712640 1 --2- 172.21.15.49:0/2976772868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fcc0c46c0 0x7f7fcc158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.552+0000 7f7fd2712640 1 -- 172.21.15.49:0/2976772868 >> 172.21.15.49:0/2976772868 conn(0x7f7fcc06c6a0 msgr2=0x7f7fcc14dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.552+0000 7f7fd2712640 1 -- 172.21.15.49:0/2976772868 shutdown_connections 2023-11-18T21:00:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.552+0000 7f7fd2712640 1 -- 172.21.15.49:0/2976772868 wait complete. 2023-11-18T21:00:31.572 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T21:00:31.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.704+0000 7fe494b88640 1 Processor -- start 2023-11-18T21:00:31.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.704+0000 7fe494b88640 1 -- start start 2023-11-18T21:00:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.704+0000 7fe494b88640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe4900c5180 0x7fe490156f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.704+0000 7fe494b88640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4900c6820 con 0x7fe4900c5560 2023-11-18T21:00:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.704+0000 7fe494b88640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe490156af0 con 0x7fe4900c7440 2023-11-18T21:00:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.704+0000 7fe494b88640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4900c4370 con 0x7fe4900c5180 2023-11-18T21:00:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.728+0000 7fe48ed9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe4900c7440 0x7fe49014ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:54018/0 (socket says 172.21.15.49:54018) 2023-11-18T21:00:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.728+0000 7fe48ed9d640 1 -- 172.21.15.49:0/2219715668 learned_addr learned my addr 172.21.15.49:0/2219715668 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:31.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.776+0000 7fe48e59c640 1 --2- 172.21.15.49:0/2219715668 >> v2:172.21.15.49:3300/0 conn(0x7fe4900c5180 0x7fe490156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:31.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.784+0000 7fe48e59c640 1 -- 172.21.15.49:0/2219715668 >> v1:172.21.15.106:6789/0 conn(0x7fe4900c7440 legacy=0x7fe49014ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:31.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.784+0000 7fe48e59c640 1 -- 172.21.15.49:0/2219715668 >> v1:172.21.15.49:6789/0 conn(0x7fe4900c5560 legacy=0x7fe49006b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:31.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.784+0000 7fe48e59c640 1 -- 172.21.15.49:0/2219715668 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4900c6260 con 0x7fe4900c5180 2023-11-18T21:00:31.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.788+0000 7fe48e59c640 1 --2- 172.21.15.49:0/2219715668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4900c5180 0x7fe490156f80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe4800097f0 tx=0x7fe48001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f03dbf270df1bc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:31.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.796+0000 7fe48d59a640 1 -- 172.21.15.49:0/2219715668 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4800ad660 con 0x7fe4900c5180 2023-11-18T21:00:31.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.796+0000 7fe48d59a640 1 -- 172.21.15.49:0/2219715668 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4800ad7c0 con 0x7fe4900c5180 2023-11-18T21:00:31.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.796+0000 7fe48d59a640 1 -- 172.21.15.49:0/2219715668 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4800adb50 con 0x7fe4900c5180 2023-11-18T21:00:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 -- 172.21.15.49:0/2219715668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4900c5180 msgr2=0x7fe490156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 --2- 172.21.15.49:0/2219715668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4900c5180 0x7fe490156f80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe4800097f0 tx=0x7fe48001c450 comp rx=0 tx=0).stop 2023-11-18T21:00:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 -- 172.21.15.49:0/2219715668 shutdown_connections 2023-11-18T21:00:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 --2- 172.21.15.49:0/2219715668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4900c5180 0x7fe490156f80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 -- 172.21.15.49:0/2219715668 >> 172.21.15.49:0/2219715668 conn(0x7fe49006d220 msgr2=0x7fe49006d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 -- 172.21.15.49:0/2219715668 shutdown_connections 2023-11-18T21:00:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 -- 172.21.15.49:0/2219715668 wait complete. 2023-11-18T21:00:31.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 Processor -- start 2023-11-18T21:00:31.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 -- start start 2023-11-18T21:00:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4900c5180 0x7fe4900cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4900c5560 0x7fe4900c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4900c7440 0x7fe4901466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe490147fd0 con 0x7fe4900c5180 2023-11-18T21:00:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4901f6560 con 0x7fe4900c7440 2023-11-18T21:00:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.800+0000 7fe494b88640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4901f6840 con 0x7fe4900c5560 2023-11-18T21:00:31.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.812+0000 7fe48dd9b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4900c5560 0x7fe4900c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:31.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.812+0000 7fe48dd9b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4900c5560 0x7fe4900c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:40036/0 (socket says 172.21.15.49:40036) 2023-11-18T21:00:31.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.812+0000 7fe48dd9b640 1 -- 172.21.15.49:0/2124490035 learned_addr learned my addr 172.21.15.49:0/2124490035 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:31.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.820+0000 7fe48e59c640 1 --2- 172.21.15.49:0/2124490035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4900c5180 0x7fe4900cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:31.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.820+0000 7fe48dd9b640 1 -- 172.21.15.49:0/2124490035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4900c7440 msgr2=0x7fe4901466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:31.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.820+0000 7fe48dd9b640 1 --2- 172.21.15.49:0/2124490035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4900c7440 0x7fe4901466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:31.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.820+0000 7fe48dd9b640 1 -- 172.21.15.49:0/2124490035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4900c5180 msgr2=0x7fe4900cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:31.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.820+0000 7fe48dd9b640 1 --2- 172.21.15.49:0/2124490035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4900c5180 0x7fe4900cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:31.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.820+0000 7fe48dd9b640 1 -- 172.21.15.49:0/2124490035 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480009420 con 0x7fe4900c5560 2023-11-18T21:00:31.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.828+0000 7fe48dd9b640 1 --2- 172.21.15.49:0/2124490035 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4900c5560 0x7fe4900c91e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe48400c420 tx=0x7fe48400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:31.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.836+0000 7fe47effd640 1 -- 172.21.15.49:0/2124490035 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840052d0 con 0x7fe4900c5560 2023-11-18T21:00:31.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.836+0000 7fe494b88640 1 -- 172.21.15.49:0/2124490035 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4901f2820 con 0x7fe4900c5560 2023-11-18T21:00:31.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.836+0000 7fe494b88640 1 -- 172.21.15.49:0/2124490035 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4901f2de0 con 0x7fe4900c5560 2023-11-18T21:00:31.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.840+0000 7fe47effd640 1 -- 172.21.15.49:0/2124490035 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484005430 con 0x7fe4900c5560 2023-11-18T21:00:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.840+0000 7fe47effd640 1 -- 172.21.15.49:0/2124490035 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484007220 con 0x7fe4900c5560 2023-11-18T21:00:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:31.840+0000 7fe494b88640 1 -- 172.21.15.49:0/2124490035 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe474005260 con 0x7fe4900c5560 2023-11-18T21:00:32.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.152+0000 7fe47effd640 1 -- 172.21.15.49:0/2124490035 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe484007380 con 0x7fe4900c5560 2023-11-18T21:00:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.152+0000 7fe47effd640 1 --2- 172.21.15.49:0/2124490035 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe4700664a0 0x7fe470068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:32.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.156+0000 7fe48e59c640 1 --2- 172.21.15.49:0/2124490035 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe4700664a0 0x7fe470068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:32.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.156+0000 7fe48e59c640 1 --2- 172.21.15.49:0/2124490035 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe4700664a0 0x7fe470068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe4800af000 tx=0x7fe480008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:32.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.160+0000 7fe47effd640 1 -- 172.21.15.49:0/2124490035 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fe4840556c0 con 0x7fe4900c5560 2023-11-18T21:00:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.192+0000 7fe47effd640 1 -- 172.21.15.49:0/2124490035 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe484051300 con 0x7fe4900c5560 2023-11-18T21:00:32.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.384+0000 7fe494b88640 1 -- 172.21.15.49:0/2124490035 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe474005a90 con 0x7fe4900c5560 2023-11-18T21:00:32.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.392+0000 7fe47effd640 1 -- 172.21.15.49:0/2124490035 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe4840200a0 con 0x7fe4900c5560 2023-11-18T21:00:32.394 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-11-18T21:00:32.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.396+0000 7fe494b88640 1 -- 172.21.15.49:0/2124490035 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe4700664a0 msgr2=0x7fe470068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:32.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.396+0000 7fe494b88640 1 --2- 172.21.15.49:0/2124490035 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe4700664a0 0x7fe470068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe4800af000 tx=0x7fe480008040 comp rx=0 tx=0).stop 2023-11-18T21:00:32.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.396+0000 7fe494b88640 1 -- 172.21.15.49:0/2124490035 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4900c5560 msgr2=0x7fe4900c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:32.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.396+0000 7fe494b88640 1 --2- 172.21.15.49:0/2124490035 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4900c5560 0x7fe4900c91e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe48400c420 tx=0x7fe48400c8e0 comp rx=0 tx=0).stop 2023-11-18T21:00:32.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.396+0000 7fe494b88640 1 -- 172.21.15.49:0/2124490035 shutdown_connections 2023-11-18T21:00:32.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.396+0000 7fe494b88640 1 --2- 172.21.15.49:0/2124490035 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe4700664a0 0x7fe470068960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:32.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.396+0000 7fe494b88640 1 --2- 172.21.15.49:0/2124490035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4900c7440 0x7fe4901466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:32.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.396+0000 7fe494b88640 1 --2- 172.21.15.49:0/2124490035 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4900c5560 0x7fe4900c91e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:32.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.396+0000 7fe494b88640 1 --2- 172.21.15.49:0/2124490035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4900c5180 0x7fe4900cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:32.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.396+0000 7fe494b88640 1 -- 172.21.15.49:0/2124490035 >> 172.21.15.49:0/2124490035 conn(0x7fe49006d220 msgr2=0x7fe49006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:32.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.396+0000 7fe494b88640 1 -- 172.21.15.49:0/2124490035 shutdown_connections 2023-11-18T21:00:32.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.396+0000 7fe494b88640 1 -- 172.21.15.49:0/2124490035 wait complete. 2023-11-18T21:00:32.417 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T21:00:32.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.544+0000 7f3b3d722640 1 Processor -- start 2023-11-18T21:00:32.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.544+0000 7f3b3d722640 1 -- start start 2023-11-18T21:00:32.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.544+0000 7f3b3d722640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3b3806e8f0 0x7f3b3806ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:32.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.544+0000 7f3b3d722640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b380cd990 con 0x7f3b381518c0 2023-11-18T21:00:32.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.544+0000 7f3b3d722640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3815b870 con 0x7f3b381514e0 2023-11-18T21:00:32.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.544+0000 7f3b3d722640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3815aa10 con 0x7f3b3806e8f0 2023-11-18T21:00:32.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.544+0000 7f3b377fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3b3806e8f0 0x7f3b3806ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:32.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.544+0000 7f3b367fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3b381518c0 0x7f3b38157db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36294/0 (socket says 172.21.15.49:36294) 2023-11-18T21:00:32.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.544+0000 7f3b367fc640 1 -- 172.21.15.49:0/1467258404 learned_addr learned my addr 172.21.15.49:0/1467258404 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:32.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.548+0000 7f3b377fe640 1 -- 172.21.15.49:0/1467258404 >> v1:172.21.15.106:6789/0 conn(0x7f3b381514e0 legacy=0x7f3b380c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.548+0000 7f3b377fe640 1 -- 172.21.15.49:0/1467258404 >> v1:172.21.15.49:6789/0 conn(0x7f3b381518c0 legacy=0x7f3b38157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.548+0000 7f3b377fe640 1 -- 172.21.15.49:0/1467258404 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3815acf0 con 0x7f3b3806e8f0 2023-11-18T21:00:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.556+0000 7f3b377fe640 1 --2- 172.21.15.49:0/1467258404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b3806e8f0 0x7f3b3806ed30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3b300097c0 tx=0x7f3b3001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9f7604937d1dec server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.560+0000 7f3b35ffb640 1 -- 172.21.15.49:0/1467258404 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300ab600 con 0x7f3b3806e8f0 2023-11-18T21:00:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.560+0000 7f3b35ffb640 1 -- 172.21.15.49:0/1467258404 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b300a7050 con 0x7f3b3806e8f0 2023-11-18T21:00:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.560+0000 7f3b35ffb640 1 -- 172.21.15.49:0/1467258404 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300ab980 con 0x7f3b3806e8f0 2023-11-18T21:00:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.560+0000 7f3b3d722640 1 -- 172.21.15.49:0/1467258404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b3806e8f0 msgr2=0x7f3b3806ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.560+0000 7f3b3d722640 1 --2- 172.21.15.49:0/1467258404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b3806e8f0 0x7f3b3806ed30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3b300097c0 tx=0x7f3b3001c480 comp rx=0 tx=0).stop 2023-11-18T21:00:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.560+0000 7f3b3d722640 1 -- 172.21.15.49:0/1467258404 shutdown_connections 2023-11-18T21:00:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.560+0000 7f3b3d722640 1 --2- 172.21.15.49:0/1467258404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b3806e8f0 0x7f3b3806ed30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.560+0000 7f3b3d722640 1 -- 172.21.15.49:0/1467258404 >> 172.21.15.49:0/1467258404 conn(0x7f3b38060fd0 msgr2=0x7f3b380613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.560+0000 7f3b3d722640 1 -- 172.21.15.49:0/1467258404 shutdown_connections 2023-11-18T21:00:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.560+0000 7f3b3d722640 1 -- 172.21.15.49:0/1467258404 wait complete. 2023-11-18T21:00:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.560+0000 7f3b3d722640 1 Processor -- start 2023-11-18T21:00:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.560+0000 7f3b3d722640 1 -- start start 2023-11-18T21:00:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.564+0000 7f3b3d722640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b3806e8f0 0x7f3b3806b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.564+0000 7f3b3d722640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b381514e0 0x7f3b381f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.564+0000 7f3b3d722640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b381f5bd0 0x7f3b3814a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:32.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.564+0000 7f3b3d722640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3814d8d0 con 0x7f3b381f5bd0 2023-11-18T21:00:32.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.564+0000 7f3b3d722640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380ccd40 con 0x7f3b3806e8f0 2023-11-18T21:00:32.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.564+0000 7f3b3d722640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b381f6060 con 0x7f3b381514e0 2023-11-18T21:00:32.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.564+0000 7f3b377fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b381f5bd0 0x7f3b3814a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.564+0000 7f3b377fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b381f5bd0 0x7f3b3814a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49476/0 (socket says 172.21.15.49:49476) 2023-11-18T21:00:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.564+0000 7f3b377fe640 1 -- 172.21.15.49:0/1736354297 learned_addr learned my addr 172.21.15.49:0/1736354297 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.564+0000 7f3b36ffd640 1 --2- 172.21.15.49:0/1736354297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b3806e8f0 0x7f3b3806b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.564+0000 7f3b367fc640 1 --2- 172.21.15.49:0/1736354297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b381514e0 0x7f3b381f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.568+0000 7f3b377fe640 1 -- 172.21.15.49:0/1736354297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b381514e0 msgr2=0x7f3b381f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.568+0000 7f3b377fe640 1 --2- 172.21.15.49:0/1736354297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b381514e0 0x7f3b381f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.568+0000 7f3b377fe640 1 -- 172.21.15.49:0/1736354297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b3806e8f0 msgr2=0x7f3b3806b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.568+0000 7f3b377fe640 1 --2- 172.21.15.49:0/1736354297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b3806e8f0 0x7f3b3806b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.568+0000 7f3b377fe640 1 -- 172.21.15.49:0/1736354297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b30009420 con 0x7f3b381f5bd0 2023-11-18T21:00:32.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.568+0000 7f3b377fe640 1 --2- 172.21.15.49:0/1736354297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b381f5bd0 0x7f3b3814a910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3b3001a0b0 tx=0x7f3b30019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:32.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.572+0000 7f3b2f7fe640 1 -- 172.21.15.49:0/1736354297 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300b48d0 con 0x7f3b381f5bd0 2023-11-18T21:00:32.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.572+0000 7f3b2f7fe640 1 -- 172.21.15.49:0/1736354297 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b300b4a30 con 0x7f3b381f5bd0 2023-11-18T21:00:32.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.572+0000 7f3b2f7fe640 1 -- 172.21.15.49:0/1736354297 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300b4de0 con 0x7f3b381f5bd0 2023-11-18T21:00:32.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.572+0000 7f3b3d722640 1 -- 172.21.15.49:0/1736354297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b381f6300 con 0x7f3b381f5bd0 2023-11-18T21:00:32.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.572+0000 7f3b3d722640 1 -- 172.21.15.49:0/1736354297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3814c7d0 con 0x7f3b381f5bd0 2023-11-18T21:00:32.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.576+0000 7f3b3d722640 1 -- 172.21.15.49:0/1736354297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b38067520 con 0x7f3b381f5bd0 2023-11-18T21:00:32.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.860+0000 7f3b2f7fe640 1 -- 172.21.15.49:0/1736354297 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b300b2040 con 0x7f3b381f5bd0 2023-11-18T21:00:32.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.860+0000 7f3b2f7fe640 1 --2- 172.21.15.49:0/1736354297 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b180664c0 0x7f3b18068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:32.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.860+0000 7f3b36ffd640 1 --2- 172.21.15.49:0/1736354297 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b180664c0 0x7f3b18068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:32.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.864+0000 7f3b36ffd640 1 --2- 172.21.15.49:0/1736354297 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b180664c0 0x7f3b18068980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b280012f0 tx=0x7f3b28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:32.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.900+0000 7f3b2f7fe640 1 -- 172.21.15.49:0/1736354297 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f3b300f0520 con 0x7f3b381f5bd0 2023-11-18T21:00:32.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:32.904+0000 7f3b2f7fe640 1 -- 172.21.15.49:0/1736354297 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b300ec160 con 0x7f3b381f5bd0 2023-11-18T21:00:33.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.076+0000 7f3b3d722640 1 -- 172.21.15.49:0/1736354297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b3814dd10 con 0x7f3b381f5bd0 2023-11-18T21:00:33.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.108+0000 7f3b2f7fe640 1 -- 172.21.15.49:0/1736354297 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b300b0030 con 0x7f3b381f5bd0 2023-11-18T21:00:33.109 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-18T21:00:33.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.112+0000 7f3b3d722640 1 -- 172.21.15.49:0/1736354297 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b180664c0 msgr2=0x7f3b18068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:33.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.112+0000 7f3b3d722640 1 --2- 172.21.15.49:0/1736354297 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b180664c0 0x7f3b18068980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b280012f0 tx=0x7f3b28009040 comp rx=0 tx=0).stop 2023-11-18T21:00:33.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.112+0000 7f3b3d722640 1 -- 172.21.15.49:0/1736354297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b381f5bd0 msgr2=0x7f3b3814a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:33.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.112+0000 7f3b3d722640 1 --2- 172.21.15.49:0/1736354297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b381f5bd0 0x7f3b3814a910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3b3001a0b0 tx=0x7f3b30019220 comp rx=0 tx=0).stop 2023-11-18T21:00:33.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.112+0000 7f3b3d722640 1 -- 172.21.15.49:0/1736354297 shutdown_connections 2023-11-18T21:00:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.112+0000 7f3b3d722640 1 --2- 172.21.15.49:0/1736354297 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b180664c0 0x7f3b18068980 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.112+0000 7f3b3d722640 1 --2- 172.21.15.49:0/1736354297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b381f5bd0 0x7f3b3814a910 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.112+0000 7f3b3d722640 1 --2- 172.21.15.49:0/1736354297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b381514e0 0x7f3b381f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.112+0000 7f3b3d722640 1 --2- 172.21.15.49:0/1736354297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b3806e8f0 0x7f3b3806b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.112+0000 7f3b3d722640 1 -- 172.21.15.49:0/1736354297 >> 172.21.15.49:0/1736354297 conn(0x7f3b38060fd0 msgr2=0x7f3b380c9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:33.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.112+0000 7f3b3d722640 1 -- 172.21.15.49:0/1736354297 shutdown_connections 2023-11-18T21:00:33.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.112+0000 7f3b3d722640 1 -- 172.21.15.49:0/1736354297 wait complete. 2023-11-18T21:00:33.131 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-18T21:00:33.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.256+0000 7fb4d478c640 1 Processor -- start 2023-11-18T21:00:33.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.256+0000 7fb4d478c640 1 -- start start 2023-11-18T21:00:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.256+0000 7fb4d478c640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4cc0ccfb0 0x7fb4cc0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.256+0000 7fb4d478c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb4cc15a830 0x7fb4cc1572c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.256+0000 7fb4d478c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4cc0c9f30 0x7fb4cc0cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.256+0000 7fb4d478c640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4cc0cd8d0 con 0x7fb4cc0c9f30 2023-11-18T21:00:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.256+0000 7fb4d478c640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4cc0c9aa0 con 0x7fb4cc15a830 2023-11-18T21:00:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.256+0000 7fb4d478c640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0ca3a0 con 0x7fb4cc0ccfb0 2023-11-18T21:00:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.256+0000 7fb4d2d29640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4cc0c9f30 0x7fb4cc0cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.256+0000 7fb4d2d29640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4cc0c9f30 0x7fb4cc0cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49486/0 (socket says 172.21.15.49:49486) 2023-11-18T21:00:33.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.256+0000 7fb4d2d29640 1 -- 172.21.15.49:0/3263049075 learned_addr learned my addr 172.21.15.49:0/3263049075 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:33.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.260+0000 7fb4d2d29640 1 -- 172.21.15.49:0/3263049075 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4cc0ccfb0 msgr2=0x7fb4cc0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:33.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.260+0000 7fb4d2d29640 1 --2- 172.21.15.49:0/3263049075 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4cc0ccfb0 0x7fb4cc0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.260+0000 7fb4d2d29640 1 -- 172.21.15.49:0/3263049075 >> v2:172.21.15.106:3300/0 conn(0x7fb4cc15a830 msgr2=0x7fb4cc1572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:33.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.260+0000 7fb4d2d29640 1 --2- 172.21.15.49:0/3263049075 >> v2:172.21.15.106:3300/0 conn(0x7fb4cc15a830 0x7fb4cc1572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.260+0000 7fb4d2d29640 1 -- 172.21.15.49:0/3263049075 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4cc15adb0 con 0x7fb4cc0c9f30 2023-11-18T21:00:33.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.264+0000 7fb4d2d29640 1 --2- 172.21.15.49:0/3263049075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4cc0c9f30 0x7fb4cc0cd390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0cda90 tx=0x7fb4c401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb84aea4f9c5a82 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:33.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d1526640 1 -- 172.21.15.49:0/3263049075 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c40a89b0 con 0x7fb4cc0c9f30 2023-11-18T21:00:33.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d1526640 1 -- 172.21.15.49:0/3263049075 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c40a8b10 con 0x7fb4cc0c9f30 2023-11-18T21:00:33.267 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d1526640 1 -- 172.21.15.49:0/3263049075 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c40a8ea0 con 0x7fb4cc0c9f30 2023-11-18T21:00:33.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 -- 172.21.15.49:0/3263049075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4cc0c9f30 msgr2=0x7fb4cc0cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:33.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 --2- 172.21.15.49:0/3263049075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4cc0c9f30 0x7fb4cc0cd390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0cda90 tx=0x7fb4c401ecf0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 -- 172.21.15.49:0/3263049075 shutdown_connections 2023-11-18T21:00:33.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 --2- 172.21.15.49:0/3263049075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4cc0c9f30 0x7fb4cc0cd390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 --2- 172.21.15.49:0/3263049075 >> v2:172.21.15.106:3300/0 conn(0x7fb4cc15a830 0x7fb4cc1572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 --2- 172.21.15.49:0/3263049075 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4cc0ccfb0 0x7fb4cc0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 -- 172.21.15.49:0/3263049075 >> 172.21.15.49:0/3263049075 conn(0x7fb4cc061400 msgr2=0x7fb4cc061810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:33.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 -- 172.21.15.49:0/3263049075 shutdown_connections 2023-11-18T21:00:33.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 -- 172.21.15.49:0/3263049075 wait complete. 2023-11-18T21:00:33.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 Processor -- start 2023-11-18T21:00:33.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 -- start start 2023-11-18T21:00:33.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4cc0c9f30 0x7fb4cc0c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4cc0ccfb0 0x7fb4cc0cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4cc15a830 0x7fb4cc155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0c7ef0 con 0x7fb4cc0ccfb0 2023-11-18T21:00:33.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0c7670 con 0x7fb4cc15a830 2023-11-18T21:00:33.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.268+0000 7fb4d478c640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0c7870 con 0x7fb4cc0c9f30 2023-11-18T21:00:33.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.272+0000 7fb4d1d27640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4cc0ccfb0 0x7fb4cc0cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:33.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.272+0000 7fb4d1d27640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4cc0ccfb0 0x7fb4cc0cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49494/0 (socket says 172.21.15.49:49494) 2023-11-18T21:00:33.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.272+0000 7fb4d1d27640 1 -- 172.21.15.49:0/2405070465 learned_addr learned my addr 172.21.15.49:0/2405070465 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:33.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.276+0000 7fb4d1d27640 1 -- 172.21.15.49:0/2405070465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4cc0c9f30 msgr2=0x7fb4cc0c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:33.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.276+0000 7fb4d1d27640 1 --2- 172.21.15.49:0/2405070465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4cc0c9f30 0x7fb4cc0c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.276+0000 7fb4d1d27640 1 -- 172.21.15.49:0/2405070465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4cc15a830 msgr2=0x7fb4cc155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:33.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.276+0000 7fb4d1d27640 1 --2- 172.21.15.49:0/2405070465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4cc15a830 0x7fb4cc155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.276+0000 7fb4d1d27640 1 -- 172.21.15.49:0/2405070465 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c40094d0 con 0x7fb4cc0ccfb0 2023-11-18T21:00:33.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.276+0000 7fb4d1d27640 1 --2- 172.21.15.49:0/2405070465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4cc0ccfb0 0x7fb4cc0cc0f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00b550 tx=0x7fb4bc00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:33.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.284+0000 7fb4c2ffd640 1 -- 172.21.15.49:0/2405070465 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc011890 con 0x7fb4cc0ccfb0 2023-11-18T21:00:33.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.284+0000 7fb4c2ffd640 1 -- 172.21.15.49:0/2405070465 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc011a10 con 0x7fb4cc0ccfb0 2023-11-18T21:00:33.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.284+0000 7fb4c2ffd640 1 -- 172.21.15.49:0/2405070465 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc011dc0 con 0x7fb4cc0ccfb0 2023-11-18T21:00:33.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.284+0000 7fb4d478c640 1 -- 172.21.15.49:0/2405070465 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4cc155700 con 0x7fb4cc0ccfb0 2023-11-18T21:00:33.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.284+0000 7fb4d478c640 1 -- 172.21.15.49:0/2405070465 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4cc1458b0 con 0x7fb4cc0ccfb0 2023-11-18T21:00:33.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.284+0000 7fb4d478c640 1 -- 172.21.15.49:0/2405070465 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4cc073e70 con 0x7fb4cc0ccfb0 2023-11-18T21:00:33.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.572+0000 7fb4c2ffd640 1 -- 172.21.15.49:0/2405070465 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb4bc01a400 con 0x7fb4cc0ccfb0 2023-11-18T21:00:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.572+0000 7fb4c2ffd640 1 --2- 172.21.15.49:0/2405070465 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb4b00664a0 0x7fb4b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.572+0000 7fb4d2528640 1 --2- 172.21.15.49:0/2405070465 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb4b00664a0 0x7fb4b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:33.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.572+0000 7fb4d2528640 1 --2- 172.21.15.49:0/2405070465 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb4b00664a0 0x7fb4b0068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb4c800ab90 tx=0x7fb4c8009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:33.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.604+0000 7fb4c2ffd640 1 -- 172.21.15.49:0/2405070465 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fb4bc056000 con 0x7fb4cc0ccfb0 2023-11-18T21:00:33.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.608+0000 7fb4c2ffd640 1 -- 172.21.15.49:0/2405070465 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4bc051c40 con 0x7fb4cc0ccfb0 2023-11-18T21:00:33.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.768+0000 7fb4d478c640 1 -- 172.21.15.49:0/2405070465 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb4cc0b1d50 con 0x7fb4cc0ccfb0 2023-11-18T21:00:33.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.776+0000 7fb4c2ffd640 1 -- 172.21.15.49:0/2405070465 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb4bc015020 con 0x7fb4cc0ccfb0 2023-11-18T21:00:33.776 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-11-18T21:00:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.776+0000 7fb4d478c640 1 -- 172.21.15.49:0/2405070465 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb4b00664a0 msgr2=0x7fb4b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.776+0000 7fb4d478c640 1 --2- 172.21.15.49:0/2405070465 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb4b00664a0 0x7fb4b0068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb4c800ab90 tx=0x7fb4c8009250 comp rx=0 tx=0).stop 2023-11-18T21:00:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.776+0000 7fb4d478c640 1 -- 172.21.15.49:0/2405070465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4cc0ccfb0 msgr2=0x7fb4cc0cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.776+0000 7fb4d478c640 1 --2- 172.21.15.49:0/2405070465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4cc0ccfb0 0x7fb4cc0cc0f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00b550 tx=0x7fb4bc00ba10 comp rx=0 tx=0).stop 2023-11-18T21:00:33.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.776+0000 7fb4d478c640 1 -- 172.21.15.49:0/2405070465 shutdown_connections 2023-11-18T21:00:33.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.776+0000 7fb4d478c640 1 --2- 172.21.15.49:0/2405070465 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb4b00664a0 0x7fb4b0068960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.776+0000 7fb4d478c640 1 --2- 172.21.15.49:0/2405070465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4cc15a830 0x7fb4cc155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.776+0000 7fb4d478c640 1 --2- 172.21.15.49:0/2405070465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4cc0ccfb0 0x7fb4cc0cc0f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.776+0000 7fb4d478c640 1 --2- 172.21.15.49:0/2405070465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4cc0c9f30 0x7fb4cc0c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.776+0000 7fb4d478c640 1 -- 172.21.15.49:0/2405070465 >> 172.21.15.49:0/2405070465 conn(0x7fb4cc061400 msgr2=0x7fb4cc14ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:33.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.776+0000 7fb4d478c640 1 -- 172.21.15.49:0/2405070465 shutdown_connections 2023-11-18T21:00:33.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.776+0000 7fb4d478c640 1 -- 172.21.15.49:0/2405070465 wait complete. 2023-11-18T21:00:33.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T21:00:33.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.912+0000 7ff6fe4b9640 1 Processor -- start 2023-11-18T21:00:33.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.912+0000 7ff6fe4b9640 1 -- start start 2023-11-18T21:00:33.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.916+0000 7ff6fe4b9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff6f81501e0 0x7ff6f8156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.916+0000 7ff6fe4b9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f80c0ee0 con 0x7ff6f81505c0 2023-11-18T21:00:33.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.916+0000 7ff6fe4b9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f8157040 con 0x7ff6f81596e0 2023-11-18T21:00:33.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.916+0000 7ff6fe4b9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f80c1c70 con 0x7ff6f81501e0 2023-11-18T21:00:33.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.916+0000 7ff6f77fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff6f81505c0 0x7ff6f806fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36306/0 (socket says 172.21.15.49:36306) 2023-11-18T21:00:33.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.916+0000 7ff6f77fe640 1 -- 172.21.15.49:0/3488015224 learned_addr learned my addr 172.21.15.49:0/3488015224 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:33.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.916+0000 7ff6f7fff640 1 --2- 172.21.15.49:0/3488015224 >> v2:172.21.15.106:3300/0 conn(0x7ff6f81501e0 0x7ff6f8156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:33.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.920+0000 7ff6f6ffd640 1 -- 172.21.15.49:0/3488015224 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214922730 0 0) 0x7ff6f80c0ee0 con 0x7ff6f81505c0 2023-11-18T21:00:33.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.920+0000 7ff6f6ffd640 1 -- 172.21.15.49:0/3488015224 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e0003530 con 0x7ff6f81505c0 2023-11-18T21:00:33.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.924+0000 7ff6f6ffd640 1 -- 172.21.15.49:0/3488015224 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 500401212 0 0) 0x7ff6e0003530 con 0x7ff6f81505c0 2023-11-18T21:00:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.924+0000 7ff6f6ffd640 1 -- 172.21.15.49:0/3488015224 >> v2:172.21.15.106:3300/0 conn(0x7ff6f81501e0 msgr2=0x7ff6f8156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.924+0000 7ff6f6ffd640 1 --2- 172.21.15.49:0/3488015224 >> v2:172.21.15.106:3300/0 conn(0x7ff6f81501e0 0x7ff6f8156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.924+0000 7ff6f6ffd640 1 -- 172.21.15.49:0/3488015224 >> v1:172.21.15.106:6789/0 conn(0x7ff6f81596e0 legacy=0x7ff6f80c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.924+0000 7ff6f6ffd640 1 -- 172.21.15.49:0/3488015224 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f80702b0 con 0x7ff6f81505c0 2023-11-18T21:00:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.924+0000 7ff6f6ffd640 1 -- 172.21.15.49:0/3488015224 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7ff6e8001680 con 0x7ff6f81505c0 2023-11-18T21:00:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.924+0000 7ff6f6ffd640 1 -- 172.21.15.49:0/3488015224 >> v1:172.21.15.49:6789/0 conn(0x7ff6f81505c0 legacy=0x7ff6f806fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.924+0000 7ff6f6ffd640 1 --2- 172.21.15.49:0/3488015224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6e0003a40 0x7ff6e0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.924+0000 7ff6f6ffd640 1 --2- 172.21.15.49:0/3488015224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6e00047d0 0x7ff6e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.924+0000 7ff6f6ffd640 1 --2- 172.21.15.49:0/3488015224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e00051e0 0x7ff6e000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.924+0000 7ff6f6ffd640 1 -- 172.21.15.49:0/3488015224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80c1c70 con 0x7ff6e00047d0 2023-11-18T21:00:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.924+0000 7ff6f6ffd640 1 -- 172.21.15.49:0/3488015224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e000e300 con 0x7ff6e0003a40 2023-11-18T21:00:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.924+0000 7ff6f6ffd640 1 -- 172.21.15.49:0/3488015224 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e000e4c0 con 0x7ff6e00051e0 2023-11-18T21:00:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.924+0000 7ff6f77fe640 1 --2- 172.21.15.49:0/3488015224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6e00047d0 0x7ff6e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:33.926 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.928+0000 7ff6fca56640 1 --2- 172.21.15.49:0/3488015224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e00051e0 0x7ff6e000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:33.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.932+0000 7ff6fca56640 1 -- 172.21.15.49:0/3488015224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6e0003a40 msgr2=0x7ff6e0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:33.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.932+0000 7ff6fca56640 1 --2- 172.21.15.49:0/3488015224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6e0003a40 0x7ff6e0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.932+0000 7ff6fca56640 1 -- 172.21.15.49:0/3488015224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6e00047d0 msgr2=0x7ff6e0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:33.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.932+0000 7ff6fca56640 1 --2- 172.21.15.49:0/3488015224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6e00047d0 0x7ff6e0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.932+0000 7ff6fca56640 1 -- 172.21.15.49:0/3488015224 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0003530 con 0x7ff6e00051e0 2023-11-18T21:00:33.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.936+0000 7ff6fca56640 1 -- 172.21.15.49:0/3488015224 reap_dead start 2023-11-18T21:00:33.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.940+0000 7ff6fca56640 1 --2- 172.21.15.49:0/3488015224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e00051e0 0x7ff6e000dba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0001e70 tx=0x7ff6f001c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce333757d0236b70 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:33.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.948+0000 7ff6f6ffd640 1 -- 172.21.15.49:0/3488015224 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0003b80 con 0x7ff6e00051e0 2023-11-18T21:00:33.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.948+0000 7ff6f6ffd640 1 -- 172.21.15.49:0/3488015224 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0003d00 con 0x7ff6e00051e0 2023-11-18T21:00:33.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.948+0000 7ff6f6ffd640 1 -- 172.21.15.49:0/3488015224 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0005260 con 0x7ff6e00051e0 2023-11-18T21:00:33.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.948+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3488015224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e00051e0 msgr2=0x7ff6e000dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:33.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.948+0000 7ff6fe4b9640 1 --2- 172.21.15.49:0/3488015224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e00051e0 0x7ff6e000dba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0001e70 tx=0x7ff6f001c760 comp rx=0 tx=0).stop 2023-11-18T21:00:33.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.948+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3488015224 shutdown_connections 2023-11-18T21:00:33.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.948+0000 7ff6fe4b9640 1 --2- 172.21.15.49:0/3488015224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e00051e0 0x7ff6e000dba0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.948+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3488015224 >> 172.21.15.49:0/3488015224 conn(0x7ff6f806b670 msgr2=0x7ff6f806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:33.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.948+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3488015224 shutdown_connections 2023-11-18T21:00:33.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.948+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3488015224 wait complete. 2023-11-18T21:00:33.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.952+0000 7ff6fe4b9640 1 Processor -- start 2023-11-18T21:00:33.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.952+0000 7ff6fe4b9640 1 -- start start 2023-11-18T21:00:33.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.952+0000 7ff6fe4b9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6e00051e0 0x7ff6f80c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.952+0000 7ff6fe4b9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6f81523e0 0x7ff6f8148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.952+0000 7ff6fe4b9640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6f8158b60 0x7ff6f8149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.952+0000 7ff6fe4b9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f8159380 con 0x7ff6e00051e0 2023-11-18T21:00:33.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.952+0000 7ff6fe4b9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f81590a0 con 0x7ff6f81523e0 2023-11-18T21:00:33.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.952+0000 7ff6fe4b9640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f8152b50 con 0x7ff6f8158b60 2023-11-18T21:00:33.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.952+0000 7ff6f77fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6f81523e0 0x7ff6f8148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.956+0000 7ff6fca56640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6f8158b60 0x7ff6f8149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.956+0000 7ff6f77fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6f81523e0 0x7ff6f8148e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:41228/0 (socket says 172.21.15.49:41228) 2023-11-18T21:00:33.955 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.956+0000 7ff6f77fe640 1 -- 172.21.15.49:0/3378478147 learned_addr learned my addr 172.21.15.49:0/3378478147 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:33.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.956+0000 7ff6f7fff640 1 --2- 172.21.15.49:0/3378478147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6e00051e0 0x7ff6f80c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:33.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.960+0000 7ff6f7fff640 1 -- 172.21.15.49:0/3378478147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6f8158b60 msgr2=0x7ff6f8149360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:33.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.960+0000 7ff6f7fff640 1 --2- 172.21.15.49:0/3378478147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6f8158b60 0x7ff6f8149360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.960+0000 7ff6f7fff640 1 -- 172.21.15.49:0/3378478147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6f81523e0 msgr2=0x7ff6f8148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:33.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.960+0000 7ff6f7fff640 1 --2- 172.21.15.49:0/3378478147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6f81523e0 0x7ff6f8148e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:33.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.960+0000 7ff6f7fff640 1 -- 172.21.15.49:0/3378478147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f8152e30 con 0x7ff6e00051e0 2023-11-18T21:00:33.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.964+0000 7ff6f7fff640 1 --2- 172.21.15.49:0/3378478147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6e00051e0 0x7ff6f80c68e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00e7c0 tx=0x7ff6ec00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:33.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.972+0000 7ff6f4ff9640 1 -- 172.21.15.49:0/3378478147 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00c6b0 con 0x7ff6e00051e0 2023-11-18T21:00:33.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.972+0000 7ff6f4ff9640 1 -- 172.21.15.49:0/3378478147 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec00c830 con 0x7ff6e00051e0 2023-11-18T21:00:33.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.972+0000 7ff6f4ff9640 1 -- 172.21.15.49:0/3378478147 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00cbe0 con 0x7ff6e00051e0 2023-11-18T21:00:33.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.972+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3378478147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f8153110 con 0x7ff6e00051e0 2023-11-18T21:00:33.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.972+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3378478147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f814f9f0 con 0x7ff6e00051e0 2023-11-18T21:00:33.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.972+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3378478147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f8073e70 con 0x7ff6e00051e0 2023-11-18T21:00:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.996+0000 7ff6f4ff9640 1 -- 172.21.15.49:0/3378478147 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff6ec00cd40 con 0x7ff6e00051e0 2023-11-18T21:00:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.996+0000 7ff6f4ff9640 1 --2- 172.21.15.49:0/3378478147 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff6e40664c0 0x7ff6e4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.996+0000 7ff6f77fe640 1 --2- 172.21.15.49:0/3378478147 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff6e40664c0 0x7ff6e4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:33.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:33.996+0000 7ff6f77fe640 1 --2- 172.21.15.49:0/3378478147 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff6e40664c0 0x7ff6e4068980 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8149e10 tx=0x7ff6e8007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:34.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.292+0000 7ff6f4ff9640 1 -- 172.21.15.49:0/3378478147 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff6ec0556b0 con 0x7ff6e00051e0 2023-11-18T21:00:34.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.292+0000 7ff6f4ff9640 1 -- 172.21.15.49:0/3378478147 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6ec0519f0 con 0x7ff6e00051e0 2023-11-18T21:00:34.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.500+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3378478147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6f815a140 con 0x7ff6e00051e0 2023-11-18T21:00:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.696+0000 7ff6f4ff9640 1 -- 172.21.15.49:0/3378478147 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6559 (secure 0 0 0) 0x7ff6ec021090 con 0x7ff6e00051e0 2023-11-18T21:00:34.698 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:34.698 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1013296856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1013296856},{"type":"v1","addr":"172.21.15.49:6833","nonce":1013296856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:59:27.571192+0000","modified":"2023-11-18T21:00:25.344890+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4252,"mds_1":4238,"mds_2":4235,"mds_3":4197,"mds_4":4194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4194":{"gid":4194,"name":"c","rank":4,"incarnation":19,"state":"up:active","state_seq":21,"addr":"172.21.15.49:6835/3397458527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3397458527},{"type":"v1","addr":"172.21.15.49:6835","nonce":3397458527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4197":{"gid":4197,"name":"d","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.106:6835/2795994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2795994685},{"type":"v1","addr":"172.21.15.106:6835","nonce":2795994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4235":{"gid":4235,"name":"f","rank":2,"incarnation":15,"state":"up:active","state_seq":17,"addr":"172.21.15.106:6837/2839781261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":2839781261},{"type":"v1","addr":"172.21.15.106:6837","nonce":2839781261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4238":{"gid":4238,"name":"b","rank":1,"incarnation":11,"state":"up:active","state_seq":16,"addr":"172.21.15.106:6839/957974967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":957974967},{"type":"v1","addr":"172.21.15.106:6839","nonce":957974967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4252":{"gid":4252,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.49:6837/321839377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":321839377},{"type":"v1","addr":"172.21.15.49:6837","nonce":321839377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T21:00:34.698 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 20 2023-11-18T21:00:34.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.700+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3378478147 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff6e40664c0 msgr2=0x7ff6e4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:34.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.700+0000 7ff6fe4b9640 1 --2- 172.21.15.49:0/3378478147 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff6e40664c0 0x7ff6e4068980 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8149e10 tx=0x7ff6e8007040 comp rx=0 tx=0).stop 2023-11-18T21:00:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.700+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3378478147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6e00051e0 msgr2=0x7ff6f80c68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.700+0000 7ff6fe4b9640 1 --2- 172.21.15.49:0/3378478147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6e00051e0 0x7ff6f80c68e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00e7c0 tx=0x7ff6ec00ec80 comp rx=0 tx=0).stop 2023-11-18T21:00:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.700+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3378478147 shutdown_connections 2023-11-18T21:00:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.700+0000 7ff6fe4b9640 1 --2- 172.21.15.49:0/3378478147 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff6e40664c0 0x7ff6e4068980 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.700+0000 7ff6fe4b9640 1 --2- 172.21.15.49:0/3378478147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6f8158b60 0x7ff6f8149360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.700+0000 7ff6fe4b9640 1 --2- 172.21.15.49:0/3378478147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6f81523e0 0x7ff6f8148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.700+0000 7ff6fe4b9640 1 --2- 172.21.15.49:0/3378478147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6e00051e0 0x7ff6f80c68e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.700+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3378478147 >> 172.21.15.49:0/3378478147 conn(0x7ff6f806b670 msgr2=0x7ff6f806ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:34.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.700+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3378478147 shutdown_connections 2023-11-18T21:00:34.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.700+0000 7ff6fe4b9640 1 -- 172.21.15.49:0/3378478147 wait complete. 2023-11-18T21:00:34.726 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T21:00:34.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.864+0000 7f92f1c16640 1 Processor -- start 2023-11-18T21:00:34.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.864+0000 7f92f1c16640 1 -- start start 2023-11-18T21:00:34.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.868+0000 7f92f1c16640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f92ec151340 0x7f92ec06ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:34.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.868+0000 7f92f1c16640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92ec151720 0x7f92ec157c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:34.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.868+0000 7f92f1c16640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec06f4a0 con 0x7f92ec0c40e0 2023-11-18T21:00:34.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.868+0000 7f92f1c16640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ec072570 con 0x7f92ec151340 2023-11-18T21:00:34.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.868+0000 7f92f1c16640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec070be0 con 0x7f92ec151720 2023-11-18T21:00:34.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.868+0000 7f92eaffd640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92ec151720 0x7f92ec157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:34.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.868+0000 7f92eb7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f92ec151340 0x7f92ec06ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:34.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.868+0000 7f92eaffd640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92ec151720 0x7f92ec157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:40080/0 (socket says 172.21.15.49:40080) 2023-11-18T21:00:34.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.868+0000 7f92eaffd640 1 -- 172.21.15.49:0/364520752 learned_addr learned my addr 172.21.15.49:0/364520752 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:34.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.876+0000 7f92eaffd640 1 -- 172.21.15.49:0/364520752 >> v2:172.21.15.106:3300/0 conn(0x7f92ec151340 msgr2=0x7f92ec06ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:34.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.876+0000 7f92eaffd640 1 --2- 172.21.15.49:0/364520752 >> v2:172.21.15.106:3300/0 conn(0x7f92ec151340 0x7f92ec06ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:34.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.876+0000 7f92eaffd640 1 -- 172.21.15.49:0/364520752 >> v1:172.21.15.49:6789/0 conn(0x7f92ec0c40e0 legacy=0x7f92ec0c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:34.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.876+0000 7f92eaffd640 1 -- 172.21.15.49:0/364520752 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec158190 con 0x7f92ec151720 2023-11-18T21:00:34.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.880+0000 7f92eaffd640 1 --2- 172.21.15.49:0/364520752 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92ec151720 0x7f92ec157c50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009870 tx=0x7f92dc01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=862d2778644225dc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.884+0000 7f92ea7fc640 1 -- 172.21.15.49:0/364520752 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0ac600 con 0x7f92ec151720 2023-11-18T21:00:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.888+0000 7f92ea7fc640 1 -- 172.21.15.49:0/364520752 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc0a8050 con 0x7f92ec151720 2023-11-18T21:00:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.888+0000 7f92ea7fc640 1 -- 172.21.15.49:0/364520752 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0ac980 con 0x7f92ec151720 2023-11-18T21:00:34.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 -- 172.21.15.49:0/364520752 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92ec151720 msgr2=0x7f92ec157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:34.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 --2- 172.21.15.49:0/364520752 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92ec151720 0x7f92ec157c50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009870 tx=0x7f92dc01c4d0 comp rx=0 tx=0).stop 2023-11-18T21:00:34.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 -- 172.21.15.49:0/364520752 shutdown_connections 2023-11-18T21:00:34.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 --2- 172.21.15.49:0/364520752 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92ec151720 0x7f92ec157c50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:34.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 --2- 172.21.15.49:0/364520752 >> v2:172.21.15.106:3300/0 conn(0x7f92ec151340 0x7f92ec06ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:34.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 -- 172.21.15.49:0/364520752 >> 172.21.15.49:0/364520752 conn(0x7f92ec06c6a0 msgr2=0x7f92ec06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:34.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 -- 172.21.15.49:0/364520752 shutdown_connections 2023-11-18T21:00:34.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 -- 172.21.15.49:0/364520752 wait complete. 2023-11-18T21:00:34.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 Processor -- start 2023-11-18T21:00:34.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 -- start start 2023-11-18T21:00:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92ec0c40e0 0x7f92ec1f2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92ec151340 0x7f92ec1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92ec151720 0x7f92ec0c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec158850 con 0x7f92ec0c40e0 2023-11-18T21:00:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec1f21f0 con 0x7f92ec151720 2023-11-18T21:00:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.892+0000 7f92f1c16640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec1f5c30 con 0x7f92ec151340 2023-11-18T21:00:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.896+0000 7f92ebfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92ec151720 0x7f92ec0c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.896+0000 7f92ebfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92ec151720 0x7f92ec0c1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:41242/0 (socket says 172.21.15.49:41242) 2023-11-18T21:00:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.896+0000 7f92ebfff640 1 -- 172.21.15.49:0/207172842 learned_addr learned my addr 172.21.15.49:0/207172842 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:34.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.896+0000 7f92eaffd640 1 --2- 172.21.15.49:0/207172842 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92ec151340 0x7f92ec1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:34.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.908+0000 7f92eaffd640 1 -- 172.21.15.49:0/207172842 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92ec151720 msgr2=0x7f92ec0c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:34.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.908+0000 7f92eaffd640 1 --2- 172.21.15.49:0/207172842 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92ec151720 0x7f92ec0c1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:34.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.908+0000 7f92eaffd640 1 -- 172.21.15.49:0/207172842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92ec0c40e0 msgr2=0x7f92ec1f2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:34.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.908+0000 7f92eaffd640 1 --2- 172.21.15.49:0/207172842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92ec0c40e0 0x7f92ec1f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:34.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.908+0000 7f92eaffd640 1 -- 172.21.15.49:0/207172842 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc0094d0 con 0x7f92ec151340 2023-11-18T21:00:34.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.916+0000 7f92eaffd640 1 --2- 172.21.15.49:0/207172842 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92ec151340 0x7f92ec1558c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f92ec06f940 tx=0x7f92dc019270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.928+0000 7f92d3fff640 1 -- 172.21.15.49:0/207172842 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0b5830 con 0x7f92ec151340 2023-11-18T21:00:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.928+0000 7f92d3fff640 1 -- 172.21.15.49:0/207172842 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc0b59b0 con 0x7f92ec151340 2023-11-18T21:00:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.928+0000 7f92d3fff640 1 -- 172.21.15.49:0/207172842 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0b5d60 con 0x7f92ec151340 2023-11-18T21:00:34.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.928+0000 7f92f1c16640 1 -- 172.21.15.49:0/207172842 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec1f6120 con 0x7f92ec151340 2023-11-18T21:00:34.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.928+0000 7f92f1c16640 1 -- 172.21.15.49:0/207172842 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec1f1e50 con 0x7f92ec151340 2023-11-18T21:00:34.928 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:34.928+0000 7f92f1c16640 1 -- 172.21.15.49:0/207172842 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ec1f1cb0 con 0x7f92ec151340 2023-11-18T21:00:35.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.328+0000 7f92d3fff640 1 -- 172.21.15.49:0/207172842 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92dc0b3070 con 0x7f92ec151340 2023-11-18T21:00:35.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.332+0000 7f92d3fff640 1 --2- 172.21.15.49:0/207172842 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f92d80664a0 0x7f92d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:35.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.332+0000 7f92eb7fe640 1 --2- 172.21.15.49:0/207172842 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f92d80664a0 0x7f92d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:35.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.332+0000 7f92eb7fe640 1 --2- 172.21.15.49:0/207172842 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f92d80664a0 0x7f92d8068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f92e0006aa0 tx=0x7f92e0006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:35.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.336+0000 7f92d3fff640 1 -- 172.21.15.49:0/207172842 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f92dc0f0860 con 0x7f92ec151340 2023-11-18T21:00:35.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.372+0000 7f92d3fff640 1 -- 172.21.15.49:0/207172842 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92dc0ec4a0 con 0x7f92ec151340 2023-11-18T21:00:35.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.564+0000 7f92f1c16640 1 -- 172.21.15.49:0/207172842 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92ec1f1cb0 con 0x7f92ec151340 2023-11-18T21:00:35.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.656+0000 7f92d3fff640 1 -- 172.21.15.49:0/207172842 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18408 (secure 0 0 0) 0x7f92ec1f1cb0 con 0x7f92ec151340 2023-11-18T21:00:35.656 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:35.656 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":31,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T21:00:28.529922+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T21:00:35.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.660+0000 7f92f1c16640 1 -- 172.21.15.49:0/207172842 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f92d80664a0 msgr2=0x7f92d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:35.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.660+0000 7f92f1c16640 1 --2- 172.21.15.49:0/207172842 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f92d80664a0 0x7f92d8068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f92e0006aa0 tx=0x7f92e0006a30 comp rx=0 tx=0).stop 2023-11-18T21:00:35.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.660+0000 7f92f1c16640 1 -- 172.21.15.49:0/207172842 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92ec151340 msgr2=0x7f92ec1558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:35.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.660+0000 7f92f1c16640 1 --2- 172.21.15.49:0/207172842 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92ec151340 0x7f92ec1558c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f92ec06f940 tx=0x7f92dc019270 comp rx=0 tx=0).stop 2023-11-18T21:00:35.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.660+0000 7f92f1c16640 1 -- 172.21.15.49:0/207172842 shutdown_connections 2023-11-18T21:00:35.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.660+0000 7f92f1c16640 1 --2- 172.21.15.49:0/207172842 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f92d80664a0 0x7f92d8068960 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:35.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.660+0000 7f92f1c16640 1 --2- 172.21.15.49:0/207172842 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92ec151720 0x7f92ec0c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:35.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.660+0000 7f92f1c16640 1 --2- 172.21.15.49:0/207172842 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92ec151340 0x7f92ec1558c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:35.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.660+0000 7f92f1c16640 1 --2- 172.21.15.49:0/207172842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92ec0c40e0 0x7f92ec1f2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:35.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.660+0000 7f92f1c16640 1 -- 172.21.15.49:0/207172842 >> 172.21.15.49:0/207172842 conn(0x7f92ec06c6a0 msgr2=0x7f92ec160450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:35.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.660+0000 7f92f1c16640 1 -- 172.21.15.49:0/207172842 shutdown_connections 2023-11-18T21:00:35.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.660+0000 7f92f1c16640 1 -- 172.21.15.49:0/207172842 wait complete. 2023-11-18T21:00:35.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T21:00:35.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.800+0000 7f8970724640 1 Processor -- start 2023-11-18T21:00:35.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.800+0000 7f8970724640 1 -- start start 2023-11-18T21:00:35.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.800+0000 7f8970724640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89680c5080 0x7f89680c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:35.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.800+0000 7f8970724640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89681577d0 0x7f8968157c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:35.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.800+0000 7f8970724640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896806ac70 con 0x7f89680c4ca0 2023-11-18T21:00:35.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.800+0000 7f8970724640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896815b930 con 0x7f89680c5080 2023-11-18T21:00:35.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.800+0000 7f8970724640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8968158180 con 0x7f89681577d0 2023-11-18T21:00:35.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.800+0000 7f896dcbf640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89680c5080 0x7f89680c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:35.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.800+0000 7f896dcbf640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f89680c5080 0x7f89680c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46270/0 (socket says 172.21.15.49:46270) 2023-11-18T21:00:35.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.800+0000 7f896dcbf640 1 -- 172.21.15.49:0/1474643620 learned_addr learned my addr 172.21.15.49:0/1474643620 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.804+0000 7f896dcbf640 1 -- 172.21.15.49:0/1474643620 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89681577d0 msgr2=0x7f8968157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.804+0000 7f896dcbf640 1 --2- 172.21.15.49:0/1474643620 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89681577d0 0x7f8968157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.804+0000 7f896dcbf640 1 -- 172.21.15.49:0/1474643620 >> v1:172.21.15.106:6789/0 conn(0x7f89680c4ca0 legacy=0x7f896806a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.804+0000 7f896dcbf640 1 -- 172.21.15.49:0/1474643620 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896815ab10 con 0x7f89680c5080 2023-11-18T21:00:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.808+0000 7f896dcbf640 1 --2- 172.21.15.49:0/1474643620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89680c5080 0x7f89680c7a60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f89680cc2f0 tx=0x7f895801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd65fda9904c72ac server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:35.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.832+0000 7f896d4be640 1 -- 172.21.15.49:0/1474643620 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89580ab670 con 0x7f89680c5080 2023-11-18T21:00:35.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.832+0000 7f896d4be640 1 -- 172.21.15.49:0/1474643620 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89580ab7d0 con 0x7f89680c5080 2023-11-18T21:00:35.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.832+0000 7f896d4be640 1 -- 172.21.15.49:0/1474643620 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89580abb60 con 0x7f89680c5080 2023-11-18T21:00:35.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.832+0000 7f8970724640 1 -- 172.21.15.49:0/1474643620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89680c5080 msgr2=0x7f89680c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.832+0000 7f8970724640 1 --2- 172.21.15.49:0/1474643620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89680c5080 0x7f89680c7a60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f89680cc2f0 tx=0x7f895801c4b0 comp rx=0 tx=0).stop 2023-11-18T21:00:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.832+0000 7f8970724640 1 -- 172.21.15.49:0/1474643620 shutdown_connections 2023-11-18T21:00:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.832+0000 7f8970724640 1 --2- 172.21.15.49:0/1474643620 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89681577d0 0x7f8968157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.832+0000 7f8970724640 1 --2- 172.21.15.49:0/1474643620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89680c5080 0x7f89680c7a60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.832+0000 7f8970724640 1 -- 172.21.15.49:0/1474643620 >> 172.21.15.49:0/1474643620 conn(0x7f896806d220 msgr2=0x7f896806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.832+0000 7f8970724640 1 -- 172.21.15.49:0/1474643620 shutdown_connections 2023-11-18T21:00:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.832+0000 7f8970724640 1 -- 172.21.15.49:0/1474643620 wait complete. 2023-11-18T21:00:35.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.836+0000 7f8970724640 1 Processor -- start 2023-11-18T21:00:35.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.836+0000 7f8970724640 1 -- start start 2023-11-18T21:00:35.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.836+0000 7f8970724640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89680c4ca0 0x7f8968155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:35.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.836+0000 7f8970724640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89680c5080 0x7f8968158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:35.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.836+0000 7f8970724640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89681577d0 0x7f8968158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:35.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.836+0000 7f8970724640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896814ca20 con 0x7f89680c5080 2023-11-18T21:00:35.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.836+0000 7f8970724640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896814bf30 con 0x7f89680c4ca0 2023-11-18T21:00:35.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.836+0000 7f8970724640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896815a640 con 0x7f89681577d0 2023-11-18T21:00:35.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.836+0000 7f896ecc1640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89681577d0 0x7f8968158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:35.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.836+0000 7f896e4c0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89680c4ca0 0x7f8968155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:35.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.836+0000 7f896ecc1640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89681577d0 0x7f8968158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:58340/0 (socket says 172.21.15.49:58340) 2023-11-18T21:00:35.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.836+0000 7f896ecc1640 1 -- 172.21.15.49:0/4146886413 learned_addr learned my addr 172.21.15.49:0/4146886413 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:35.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.844+0000 7f896dcbf640 1 --2- 172.21.15.49:0/4146886413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89680c5080 0x7f8968158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:35.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.844+0000 7f896ecc1640 1 -- 172.21.15.49:0/4146886413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89680c4ca0 msgr2=0x7f8968155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:35.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.844+0000 7f896ecc1640 1 --2- 172.21.15.49:0/4146886413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89680c4ca0 0x7f8968155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:35.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.844+0000 7f896ecc1640 1 -- 172.21.15.49:0/4146886413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89680c5080 msgr2=0x7f8968158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:35.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.844+0000 7f896ecc1640 1 --2- 172.21.15.49:0/4146886413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89680c5080 0x7f8968158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:35.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.844+0000 7f896ecc1640 1 -- 172.21.15.49:0/4146886413 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89580094d0 con 0x7f89681577d0 2023-11-18T21:00:35.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.852+0000 7f896ecc1640 1 --2- 172.21.15.49:0/4146886413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89681577d0 0x7f8968158ed0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f896000b970 tx=0x7f896000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.864+0000 7f895effd640 1 -- 172.21.15.49:0/4146886413 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896000cb40 con 0x7f89681577d0 2023-11-18T21:00:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.864+0000 7f895effd640 1 -- 172.21.15.49:0/4146886413 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896000ccc0 con 0x7f89681577d0 2023-11-18T21:00:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.864+0000 7f895effd640 1 -- 172.21.15.49:0/4146886413 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8960014680 con 0x7f89681577d0 2023-11-18T21:00:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.864+0000 7f8970724640 1 -- 172.21.15.49:0/4146886413 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896814c180 con 0x7f89681577d0 2023-11-18T21:00:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.864+0000 7f8970724640 1 -- 172.21.15.49:0/4146886413 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896814c740 con 0x7f89681577d0 2023-11-18T21:00:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:35.864+0000 7f8970724640 1 -- 172.21.15.49:0/4146886413 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8968073e70 con 0x7f89681577d0 2023-11-18T21:00:36.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.152+0000 7f895effd640 1 -- 172.21.15.49:0/4146886413 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f896001d3b0 con 0x7f89681577d0 2023-11-18T21:00:36.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.156+0000 7f895effd640 1 --2- 172.21.15.49:0/4146886413 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f894c0664c0 0x7f894c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:36.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.156+0000 7f896e4c0640 1 --2- 172.21.15.49:0/4146886413 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f894c0664c0 0x7f894c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:36.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.156+0000 7f896e4c0640 1 --2- 172.21.15.49:0/4146886413 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f894c0664c0 0x7f894c068980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8964007fd0 tx=0x7f8964009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:36.161 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.160+0000 7f895effd640 1 -- 172.21.15.49:0/4146886413 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f896000ce30 con 0x7f89681577d0 2023-11-18T21:00:36.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.188+0000 7f895effd640 1 -- 172.21.15.49:0/4146886413 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8960051730 con 0x7f89681577d0 2023-11-18T21:00:36.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.388+0000 7f8970724640 1 -- 172.21.15.49:0/4146886413 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89680c4820 con 0x7f89681577d0 2023-11-18T21:00:36.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.408+0000 7f895effd640 1 -- 172.21.15.49:0/4146886413 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6559 (secure 0 0 0) 0x7f8960019020 con 0x7f89681577d0 2023-11-18T21:00:36.408 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:00:36.408 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1013296856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1013296856},{"type":"v1","addr":"172.21.15.49:6833","nonce":1013296856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:59:27.571192+0000","modified":"2023-11-18T21:00:25.344890+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4252,"mds_1":4238,"mds_2":4235,"mds_3":4197,"mds_4":4194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4194":{"gid":4194,"name":"c","rank":4,"incarnation":19,"state":"up:active","state_seq":21,"addr":"172.21.15.49:6835/3397458527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3397458527},{"type":"v1","addr":"172.21.15.49:6835","nonce":3397458527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4197":{"gid":4197,"name":"d","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.106:6835/2795994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2795994685},{"type":"v1","addr":"172.21.15.106:6835","nonce":2795994685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4235":{"gid":4235,"name":"f","rank":2,"incarnation":15,"state":"up:active","state_seq":17,"addr":"172.21.15.106:6837/2839781261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":2839781261},{"type":"v1","addr":"172.21.15.106:6837","nonce":2839781261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4238":{"gid":4238,"name":"b","rank":1,"incarnation":11,"state":"up:active","state_seq":16,"addr":"172.21.15.106:6839/957974967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":957974967},{"type":"v1","addr":"172.21.15.106:6839","nonce":957974967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4252":{"gid":4252,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.49:6837/321839377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":321839377},{"type":"v1","addr":"172.21.15.49:6837","nonce":321839377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T21:00:36.408 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 20 2023-11-18T21:00:36.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.408+0000 7f8970724640 1 -- 172.21.15.49:0/4146886413 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f894c0664c0 msgr2=0x7f894c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:36.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.408+0000 7f8970724640 1 --2- 172.21.15.49:0/4146886413 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f894c0664c0 0x7f894c068980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8964007fd0 tx=0x7f8964009040 comp rx=0 tx=0).stop 2023-11-18T21:00:36.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.408+0000 7f8970724640 1 -- 172.21.15.49:0/4146886413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89681577d0 msgr2=0x7f8968158ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:36.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.408+0000 7f8970724640 1 --2- 172.21.15.49:0/4146886413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89681577d0 0x7f8968158ed0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f896000b970 tx=0x7f896000be30 comp rx=0 tx=0).stop 2023-11-18T21:00:36.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.408+0000 7f8970724640 1 -- 172.21.15.49:0/4146886413 shutdown_connections 2023-11-18T21:00:36.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.408+0000 7f8970724640 1 --2- 172.21.15.49:0/4146886413 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f894c0664c0 0x7f894c068980 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:36.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.408+0000 7f8970724640 1 --2- 172.21.15.49:0/4146886413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89681577d0 0x7f8968158ed0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:36.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.408+0000 7f8970724640 1 --2- 172.21.15.49:0/4146886413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89680c5080 0x7f8968158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:36.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.408+0000 7f8970724640 1 --2- 172.21.15.49:0/4146886413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89680c4ca0 0x7f8968155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:36.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.408+0000 7f8970724640 1 -- 172.21.15.49:0/4146886413 >> 172.21.15.49:0/4146886413 conn(0x7f896806d220 msgr2=0x7f8968160d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:36.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.412+0000 7f8970724640 1 -- 172.21.15.49:0/4146886413 shutdown_connections 2023-11-18T21:00:36.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:36.412+0000 7f8970724640 1 -- 172.21.15.49:0/4146886413 wait complete. 2023-11-18T21:00:37.033 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-18T20:59:27.571192+0000', 'modified': '2023-11-18T21:00:25.344890+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4252, 'mds_1': 4238, 'mds_2': 4235, 'mds_3': 4197, 'mds_4': 4194}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4194': {'gid': 4194, 'name': 'c', 'rank': 4, 'incarnation': 19, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.49:6835/3397458527', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 3397458527}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 3397458527}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4197': {'gid': 4197, 'name': 'd', 'rank': 3, 'incarnation': 17, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.106:6835/2795994685', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6834', 'nonce': 2795994685}, {'type': 'v1', 'addr': '172.21.15.106:6835', 'nonce': 2795994685}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4235': {'gid': 4235, 'name': 'f', 'rank': 2, 'incarnation': 15, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.106:6837/2839781261', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6836', 'nonce': 2839781261}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 2839781261}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4238': {'gid': 4238, 'name': 'b', 'rank': 1, 'incarnation': 11, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.106:6839/957974967', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6838', 'nonce': 957974967}, {'type': 'v1', 'addr': '172.21.15.106:6839', 'nonce': 957974967}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4252': {'gid': 4252, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.49:6837/321839377', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6836', 'nonce': 321839377}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 321839377}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-18T21:00:37.033 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-11-18T21:00:37.033 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-18T21:00:37.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.168+0000 7f1bdacc1640 1 Processor -- start 2023-11-18T21:00:37.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.168+0000 7f1bdacc1640 1 -- start start 2023-11-18T21:00:37.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.168+0000 7f1bdacc1640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bd406eb70 0x7f1bd40713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.168+0000 7f1bdacc1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd4072990 con 0x7f1bd406e790 2023-11-18T21:00:37.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.168+0000 7f1bdacc1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd40c6f60 con 0x7f1bd4070b20 2023-11-18T21:00:37.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.168+0000 7f1bdacc1640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40c25e0 con 0x7f1bd406eb70 2023-11-18T21:00:37.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.172+0000 7f1bd8a5d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1bd406e790 0x7f1bd40c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50644/0 (socket says 172.21.15.49:50644) 2023-11-18T21:00:37.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.172+0000 7f1bd8a5d640 1 -- 172.21.15.49:0/1056607110 learned_addr learned my addr 172.21.15.49:0/1056607110 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:37.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.172+0000 7f1bd3fff640 1 --2- 172.21.15.49:0/1056607110 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bd406eb70 0x7f1bd40713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.172+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855516874 0 0) 0x7f1bd4072990 con 0x7f1bd406e790 2023-11-18T21:00:37.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.172+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc4003530 con 0x7f1bd406e790 2023-11-18T21:00:37.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413865854 0 0) 0x7f1bd40c6f60 con 0x7f1bd4070b20 2023-11-18T21:00:37.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bd4072990 con 0x7f1bd4070b20 2023-11-18T21:00:37.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4006512999 0 0) 0x7f1bc4003530 con 0x7f1bd406e790 2023-11-18T21:00:37.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bd406eb70 msgr2=0x7f1bd40713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 --2- 172.21.15.49:0/1056607110 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bd406eb70 0x7f1bd40713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 >> v1:172.21.15.106:6789/0 conn(0x7f1bd4070b20 legacy=0x7f1bd40c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd40c7240 con 0x7f1bd406e790 2023-11-18T21:00:37.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7f1bc8001680 con 0x7f1bd406e790 2023-11-18T21:00:37.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 >> v1:172.21.15.49:6789/0 conn(0x7f1bd406e790 legacy=0x7f1bd40c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 --2- 172.21.15.49:0/1056607110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bc4003bb0 0x7f1bc4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 --2- 172.21.15.49:0/1056607110 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bd406eb70 0x7f1bc40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 --2- 172.21.15.49:0/1056607110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc4004d10 0x7f1bc4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40c25e0 con 0x7f1bc4004d10 2023-11-18T21:00:37.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc400dcd0 con 0x7f1bc4003bb0 2023-11-18T21:00:37.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.176+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc400de90 con 0x7f1bd406eb70 2023-11-18T21:00:37.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.180+0000 7f1bd925e640 1 --2- 172.21.15.49:0/1056607110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc4004d10 0x7f1bc4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.184+0000 7f1bd3fff640 1 --2- 172.21.15.49:0/1056607110 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bd406eb70 0x7f1bc40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.184+0000 7f1bd925e640 1 -- 172.21.15.49:0/1056607110 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bd406eb70 msgr2=0x7f1bc40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.184+0000 7f1bd925e640 1 --2- 172.21.15.49:0/1056607110 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bd406eb70 0x7f1bc40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.184+0000 7f1bd925e640 1 -- 172.21.15.49:0/1056607110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bc4003bb0 msgr2=0x7f1bc4003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.184+0000 7f1bd925e640 1 --2- 172.21.15.49:0/1056607110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bc4003bb0 0x7f1bc4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.184+0000 7f1bd925e640 1 -- 172.21.15.49:0/1056607110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc4003530 con 0x7f1bc4004d10 2023-11-18T21:00:37.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.184+0000 7f1bd3fff640 1 --2- 172.21.15.49:0/1056607110 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bd406eb70 0x7f1bc40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T21:00:37.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.188+0000 7f1bd925e640 1 --2- 172.21.15.49:0/1056607110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc4004d10 0x7f1bc4005190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc001fd0 tx=0x7f1bcc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e3cc231151b0d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:37.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc003b80 con 0x7f1bc4004d10 2023-11-18T21:00:37.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc003d00 con 0x7f1bc4004d10 2023-11-18T21:00:37.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bd37fe640 1 -- 172.21.15.49:0/1056607110 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc005310 con 0x7f1bc4004d10 2023-11-18T21:00:37.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bdacc1640 1 -- 172.21.15.49:0/1056607110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc4004d10 msgr2=0x7f1bc4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bdacc1640 1 --2- 172.21.15.49:0/1056607110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc4004d10 0x7f1bc4005190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc001fd0 tx=0x7f1bcc01c8e0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bd925e640 1 -- 172.21.15.49:0/1056607110 reap_dead start 2023-11-18T21:00:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bdacc1640 1 -- 172.21.15.49:0/1056607110 shutdown_connections 2023-11-18T21:00:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bdacc1640 1 -- 172.21.15.49:0/1056607110 >> 172.21.15.49:0/1056607110 conn(0x7f1bd406c6a0 msgr2=0x7f1bd406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bdacc1640 1 -- 172.21.15.49:0/1056607110 shutdown_connections 2023-11-18T21:00:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bdacc1640 1 -- 172.21.15.49:0/1056607110 wait complete. 2023-11-18T21:00:37.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bdacc1640 1 Processor -- start 2023-11-18T21:00:37.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bdacc1640 1 -- start start 2023-11-18T21:00:37.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bdacc1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bd4155cb0 0x7f1bd41eb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bdacc1640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bd4156090 0x7f1bd4149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bdacc1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bd4073b80 0x7f1bd41497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bdacc1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40c9a80 con 0x7f1bd4073b80 2023-11-18T21:00:37.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bdacc1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd41eabf0 con 0x7f1bd4155cb0 2023-11-18T21:00:37.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bdacc1640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd41ee5a0 con 0x7f1bd4156090 2023-11-18T21:00:37.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.196+0000 7f1bd925e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bd4073b80 0x7f1bd41497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.200+0000 7f1bd925e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bd4073b80 0x7f1bd41497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46294/0 (socket says 172.21.15.49:46294) 2023-11-18T21:00:37.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.200+0000 7f1bd925e640 1 -- 172.21.15.49:0/3260517871 learned_addr learned my addr 172.21.15.49:0/3260517871 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:37.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.200+0000 7f1bd3fff640 1 --2- 172.21.15.49:0/3260517871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bd4156090 0x7f1bd4149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.200+0000 7f1bd8a5d640 1 --2- 172.21.15.49:0/3260517871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bd4155cb0 0x7f1bd41eb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.200+0000 7f1bd925e640 1 -- 172.21.15.49:0/3260517871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bd4156090 msgr2=0x7f1bd4149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.200+0000 7f1bd925e640 1 --2- 172.21.15.49:0/3260517871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bd4156090 0x7f1bd4149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.200+0000 7f1bd925e640 1 -- 172.21.15.49:0/3260517871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bd4155cb0 msgr2=0x7f1bd41eb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.200+0000 7f1bd925e640 1 --2- 172.21.15.49:0/3260517871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bd4155cb0 0x7f1bd41eb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.200+0000 7f1bd925e640 1 -- 172.21.15.49:0/3260517871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd41ee880 con 0x7f1bd4073b80 2023-11-18T21:00:37.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.204+0000 7f1bd925e640 1 --2- 172.21.15.49:0/3260517871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bd4073b80 0x7f1bd41497c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc001fd0 tx=0x7f1bc4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.208+0000 7f1bd17fa640 1 -- 172.21.15.49:0/3260517871 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc003b90 con 0x7f1bd4073b80 2023-11-18T21:00:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.208+0000 7f1bd17fa640 1 -- 172.21.15.49:0/3260517871 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc003e70 con 0x7f1bd4073b80 2023-11-18T21:00:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.208+0000 7f1bd17fa640 1 -- 172.21.15.49:0/3260517871 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc006d60 con 0x7f1bd4073b80 2023-11-18T21:00:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.208+0000 7f1bdacc1640 1 -- 172.21.15.49:0/3260517871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd41eeb60 con 0x7f1bd4073b80 2023-11-18T21:00:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.208+0000 7f1bdacc1640 1 -- 172.21.15.49:0/3260517871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd41eae00 con 0x7f1bd4073b80 2023-11-18T21:00:37.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.212+0000 7f1bdddf0000 1 Processor -- start 2023-11-18T21:00:37.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.212+0000 7f1bdddf0000 1 -- start start 2023-11-18T21:00:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.212+0000 7f1bdddf0000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa1b40 0x558ee8fa1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.212+0000 7f1bdddf0000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa69f0 0x558ee8fa6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.212+0000 7f1bdddf0000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fa76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.212+0000 7f1bdddf0000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee8dd0130 con 0x558ee8fa7310 2023-11-18T21:00:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.212+0000 7f1bdddf0000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee8dbd9a0 con 0x558ee8fa1b40 2023-11-18T21:00:37.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.212+0000 7f1bdddf0000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ee8dbaed0 con 0x558ee8fa69f0 2023-11-18T21:00:37.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.216+0000 7f1bd8a5d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa69f0 0x558ee8fa6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.216+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa1b40 0x558ee8fa1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.216+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa1b40 0x558ee8fa1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:53128/0 (socket says 172.21.15.49:53128) 2023-11-18T21:00:37.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.216+0000 7f1bd3fff640 1 -- 172.21.15.49:0/3937311111 learned_addr learned my addr 172.21.15.49:0/3937311111 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:37.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.224+0000 7f1bd3fff640 1 -- 172.21.15.49:0/3937311111 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa69f0 msgr2=0x558ee8fa6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.224+0000 7f1bd3fff640 1 --2- 172.21.15.49:0/3937311111 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa69f0 0x558ee8fa6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.224+0000 7f1bd3fff640 1 -- 172.21.15.49:0/3937311111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 msgr2=0x558ee8fa76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.224+0000 7f1bd3fff640 1 --2- 172.21.15.49:0/3937311111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fa76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.224+0000 7f1bd3fff640 1 -- 172.21.15.49:0/3937311111 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ee8aae890 con 0x558ee8fa1b40 2023-11-18T21:00:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.228+0000 7f1bd3fff640 1 --2- 172.21.15.49:0/3937311111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa1b40 0x558ee8fa1f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009a40 tx=0x7f1bc0009f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=597bacb527222f5a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.228+0000 7f1bd17fa640 1 -- 172.21.15.49:0/3260517871 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1bcc0a55d0 con 0x7f1bd4073b80 2023-11-18T21:00:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.232+0000 7f1bd17fa640 1 --2- 172.21.15.49:0/3260517871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1bb80664c0 0x7f1bb8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.232+0000 7f1bd8a5d640 1 --2- 172.21.15.49:0/3260517871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1bb80664c0 0x7f1bb8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.232+0000 7f1bd8a5d640 1 --2- 172.21.15.49:0/3260517871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1bb80664c0 0x7f1bb8068980 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8001410 tx=0x7f1bc8001bb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.232+0000 7f1bd17fa640 1 -- 172.21.15.49:0/3260517871 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f1bcc005800 con 0x7f1bd4073b80 2023-11-18T21:00:37.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bbe7fc640 1 -- 172.21.15.49:0/3937311111 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0015e70 con 0x558ee8fa1b40 2023-11-18T21:00:37.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bbe7fc640 1 -- 172.21.15.49:0/3937311111 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc0018480 con 0x558ee8fa1b40 2023-11-18T21:00:37.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bbe7fc640 1 -- 172.21.15.49:0/3937311111 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0018830 con 0x558ee8fa1b40 2023-11-18T21:00:37.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 -- 172.21.15.49:0/3937311111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa1b40 msgr2=0x558ee8fa1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/3937311111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa1b40 0x558ee8fa1f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009a40 tx=0x7f1bc0009f00 comp rx=0 tx=0).stop 2023-11-18T21:00:37.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 -- 172.21.15.49:0/3937311111 shutdown_connections 2023-11-18T21:00:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/3937311111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fa76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/3937311111 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa69f0 0x558ee8fa6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/3937311111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa1b40 0x558ee8fa1f20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 -- 172.21.15.49:0/3937311111 >> 172.21.15.49:0/3937311111 conn(0x558ee8fa27a0 msgr2=0x558ee8fa4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 -- 172.21.15.49:0/3937311111 shutdown_connections 2023-11-18T21:00:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 -- 172.21.15.49:0/3937311111 wait complete. 2023-11-18T21:00:37.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 -- start start 2023-11-18T21:00:37.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 Processor -- start 2023-11-18T21:00:37.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa1b40 0x558ee8fa0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa69f0 0x558ee8fa1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa7310 0x558ee8fb1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee8db67c0 con 0x558ee8fa69f0 2023-11-18T21:00:37.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee8d6ebf0 con 0x558ee8fa1b40 2023-11-18T21:00:37.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ee8d74a90 con 0x558ee8fa7310 2023-11-18T21:00:37.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.240+0000 7f1bdddf0000 10 client.0 _ll_register_callbacks cb 0x558ee8f513c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T21:00:37.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.244+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa69f0 0x558ee8fa1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.244+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa69f0 0x558ee8fa1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46310/0 (socket says 172.21.15.49:46310) 2023-11-18T21:00:37.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.244+0000 7f1bd3fff640 1 -- 172.21.15.49:0/2309849100 learned_addr learned my addr 172.21.15.49:0/2309849100 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:37.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.244+0000 7f1bd925e640 1 --2- 172.21.15.49:0/2309849100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa7310 0x558ee8fb1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.244+0000 7f1bd8a5d640 1 --2- 172.21.15.49:0/2309849100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa1b40 0x558ee8fa0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.244+0000 7f1bd3fff640 1 -- 172.21.15.49:0/2309849100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa7310 msgr2=0x558ee8fb1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.244+0000 7f1bd3fff640 1 --2- 172.21.15.49:0/2309849100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa7310 0x558ee8fb1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.248+0000 7f1bd3fff640 1 -- 172.21.15.49:0/2309849100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa1b40 msgr2=0x558ee8fa0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.248+0000 7f1bd3fff640 1 --2- 172.21.15.49:0/2309849100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa1b40 0x558ee8fa0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.248+0000 7f1bd3fff640 1 -- 172.21.15.49:0/2309849100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc000e040 con 0x558ee8fa69f0 2023-11-18T21:00:37.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.248+0000 7f1bd3fff640 1 --2- 172.21.15.49:0/2309849100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa69f0 0x558ee8fa1250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1bc001b040 tx=0x7f1bc0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b980adf678539b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:37.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.248+0000 7f1bb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-18T21:00:37.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.252+0000 7f1bb37fe640 1 -- 172.21.15.49:0/2309849100 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0018850 con 0x558ee8fa69f0 2023-11-18T21:00:37.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.252+0000 7f1bb37fe640 1 -- 172.21.15.49:0/2309849100 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f1bc00189b0 con 0x558ee8fa69f0 2023-11-18T21:00:37.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.252+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2309849100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ee8d78470 con 0x558ee8fa69f0 2023-11-18T21:00:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.256+0000 7f1bb37fe640 1 -- 172.21.15.49:0/2309849100 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bc0018b70 con 0x558ee8fa69f0 2023-11-18T21:00:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.256+0000 7f1bdddf0000 10 client.4599 fetch_fsmap learned FSMap version 20 2023-11-18T21:00:37.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.256+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2309849100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x558ee8d77190 con 0x558ee8fa69f0 2023-11-18T21:00:37.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.260+0000 7f1bb37fe640 1 -- 172.21.15.49:0/2309849100 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ee8d78470 con 0x558ee8fa69f0 2023-11-18T21:00:37.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.260+0000 7f1bb37fe640 1 -- 172.21.15.49:0/2309849100 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f1bc0018cd0 con 0x558ee8fa69f0 2023-11-18T21:00:37.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.260+0000 7f1bdddf0000 10 client.4599 fetch_fsmap finished waiting for FSMap version 20 2023-11-18T21:00:37.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.260+0000 7f1bdddf0000 10 client.4599 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-18T21:00:37.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.260+0000 7f1bdddf0000 20 client.4599 populate_metadata read hostname 'smithi049' 2023-11-18T21:00:37.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.260+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/2309849100 >> [v2:172.21.15.49:6834/3397458527,v1:172.21.15.49:6835/3397458527] conn(0x558ee8fb2b00 0x558ee8fb2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.260+0000 7f1bdddf0000 4 client.4599 mds_command: new command op to 4194 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-18T21:00:37.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.260+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2309849100 --> [v2:172.21.15.49:6834/3397458527,v1:172.21.15.49:6835/3397458527] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558ee8d7bb50 con 0x558ee8fb2b00 2023-11-18T21:00:37.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.260+0000 7f1bd8a5d640 1 --2- 172.21.15.49:0/2309849100 >> [v2:172.21.15.49:6834/3397458527,v1:172.21.15.49:6835/3397458527] conn(0x558ee8fb2b00 0x558ee8fb2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.304+0000 7f1bd8a5d640 1 --2- 172.21.15.49:0/2309849100 >> [v2:172.21.15.49:6834/3397458527,v1:172.21.15.49:6835/3397458527] conn(0x558ee8fb2b00 0x558ee8fb2ee0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5fb94e097e80d408 server_cookie=2db1cca7311f4f71 in_seq=0 out_seq=0 2023-11-18T21:00:37.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.304+0000 7f1bb37fe640 10 client.4599 ms_handle_connect on v2:172.21.15.49:6834/3397458527 2023-11-18T21:00:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bb37fe640 1 -- 172.21.15.49:0/2309849100 <== mds.4 v2:172.21.15.49:6834/3397458527 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558ee8d7bb50 con 0x558ee8fb2b00 2023-11-18T21:00:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bb37fe640 10 client.4599 handle_command_reply: tid=0 2023-11-18T21:00:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bdddf0000 1 client.4599 shutdown 2023-11-18T21:00:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2309849100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa69f0 msgr2=0x558ee8fa1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/2309849100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa69f0 0x558ee8fa1250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1bc001b040 tx=0x7f1bc0018000 comp rx=0 tx=0).stop 2023-11-18T21:00:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2309849100 shutdown_connections 2023-11-18T21:00:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/2309849100 >> [v2:172.21.15.49:6834/3397458527,v1:172.21.15.49:6835/3397458527] conn(0x558ee8fb2b00 0x558ee8fb2ee0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bb37fe640 0 client.4599 ms_handle_reset on v2:172.21.15.49:6834/3397458527 2023-11-18T21:00:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/2309849100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa7310 0x558ee8fb1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/2309849100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa69f0 0x558ee8fa1250 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/2309849100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa1b40 0x558ee8fa0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2309849100 >> 172.21.15.49:0/2309849100 conn(0x558ee8fa27a0 msgr2=0x558ee8fa6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:37.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2309849100 shutdown_connections 2023-11-18T21:00:37.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2309849100 wait complete. 2023-11-18T21:00:37.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.504+0000 7f1bdddf0000 20 client.4599 trim_cache size 0 max 16384 2023-11-18T21:00:37.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.548+0000 7f1bdddf0000 1 Processor -- start 2023-11-18T21:00:37.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.548+0000 7f1bdddf0000 1 -- start start 2023-11-18T21:00:37.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.552+0000 7f1bdddf0000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa1b40 0x558ee8f6a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.552+0000 7f1bdddf0000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa69f0 0x558ee8f6aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.552+0000 7f1bdddf0000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fb2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.552+0000 7f1bdddf0000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee8a6f940 con 0x558ee8fa7310 2023-11-18T21:00:37.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.552+0000 7f1bdddf0000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee8d6fd60 con 0x558ee8fa69f0 2023-11-18T21:00:37.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.552+0000 7f1bdddf0000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ee8db3fd0 con 0x558ee8fa1b40 2023-11-18T21:00:37.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.552+0000 7f1bd925e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fb2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.552+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa69f0 0x558ee8f6aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.552+0000 7f1bd925e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fb2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46318/0 (socket says 172.21.15.49:46318) 2023-11-18T21:00:37.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.552+0000 7f1bd925e640 1 -- 172.21.15.49:0/4018702773 learned_addr learned my addr 172.21.15.49:0/4018702773 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:37.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.552+0000 7f1bd8a5d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa1b40 0x558ee8f6a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.556+0000 7f1bd925e640 1 -- 172.21.15.49:0/4018702773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa1b40 msgr2=0x558ee8f6a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.556+0000 7f1bd925e640 1 --2- 172.21.15.49:0/4018702773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa1b40 0x558ee8f6a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.556+0000 7f1bd925e640 1 -- 172.21.15.49:0/4018702773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa69f0 msgr2=0x558ee8f6aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.556+0000 7f1bd925e640 1 --2- 172.21.15.49:0/4018702773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa69f0 0x558ee8f6aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.556+0000 7f1bd925e640 1 -- 172.21.15.49:0/4018702773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ee8d5d490 con 0x558ee8fa7310 2023-11-18T21:00:37.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.560+0000 7f1bd925e640 1 --2- 172.21.15.49:0/4018702773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fb2ee0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc11b9c0 tx=0x7f1bcc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648ea52f8fc4bd9f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.564+0000 7f1bbeffd640 1 -- 172.21.15.49:0/4018702773 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0ec9f0 con 0x558ee8fa7310 2023-11-18T21:00:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.564+0000 7f1bbeffd640 1 -- 172.21.15.49:0/4018702773 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc001c20 con 0x558ee8fa7310 2023-11-18T21:00:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.564+0000 7f1bbeffd640 1 -- 172.21.15.49:0/4018702773 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0f64a0 con 0x558ee8fa7310 2023-11-18T21:00:37.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.568+0000 7f1bdddf0000 1 -- 172.21.15.49:0/4018702773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 msgr2=0x558ee8fb2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.568+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/4018702773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fb2ee0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc11b9c0 tx=0x7f1bcc009040 comp rx=0 tx=0).stop 2023-11-18T21:00:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.568+0000 7f1bdddf0000 1 -- 172.21.15.49:0/4018702773 shutdown_connections 2023-11-18T21:00:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.568+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/4018702773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fb2ee0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.568+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/4018702773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa69f0 0x558ee8f6aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.568+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/4018702773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa1b40 0x558ee8f6a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.568+0000 7f1bdddf0000 1 -- 172.21.15.49:0/4018702773 >> 172.21.15.49:0/4018702773 conn(0x558ee8fa27a0 msgr2=0x558ee8fa6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.568+0000 7f1bdddf0000 1 -- 172.21.15.49:0/4018702773 shutdown_connections 2023-11-18T21:00:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.568+0000 7f1bdddf0000 1 -- 172.21.15.49:0/4018702773 wait complete. 2023-11-18T21:00:37.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.568+0000 7f1bdddf0000 1 -- start start 2023-11-18T21:00:37.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.568+0000 7f1bdddf0000 1 Processor -- start 2023-11-18T21:00:37.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.572+0000 7f1bdddf0000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa1b40 0x558ee8fc3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.572+0000 7f1bdddf0000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa69f0 0x558ee8fc4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.571 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.572+0000 7f1bdddf0000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fc4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.572+0000 7f1bdddf0000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee8db2130 con 0x558ee8fa7310 2023-11-18T21:00:37.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.572+0000 7f1bdddf0000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee8d758f0 con 0x558ee8fa69f0 2023-11-18T21:00:37.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.572+0000 7f1bdddf0000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ee8db0ca0 con 0x558ee8fa1b40 2023-11-18T21:00:37.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.572+0000 7f1bdddf0000 10 client.0 _ll_register_callbacks cb 0x558ee8f31bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T21:00:37.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.572+0000 7f1bd925e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fc4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.572+0000 7f1bd925e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fc4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46334/0 (socket says 172.21.15.49:46334) 2023-11-18T21:00:37.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.572+0000 7f1bd925e640 1 -- 172.21.15.49:0/2763983112 learned_addr learned my addr 172.21.15.49:0/2763983112 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:37.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.572+0000 7f1bd3fff640 1 --2- 172.21.15.49:0/2763983112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa69f0 0x558ee8fc4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.572+0000 7f1bd8a5d640 1 --2- 172.21.15.49:0/2763983112 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa1b40 0x558ee8fc3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.576+0000 7f1bd925e640 1 -- 172.21.15.49:0/2763983112 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa1b40 msgr2=0x558ee8fc3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.576+0000 7f1bd925e640 1 --2- 172.21.15.49:0/2763983112 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa1b40 0x558ee8fc3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.576+0000 7f1bd925e640 1 -- 172.21.15.49:0/2763983112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa69f0 msgr2=0x558ee8fc4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.576+0000 7f1bd925e640 1 --2- 172.21.15.49:0/2763983112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa69f0 0x558ee8fc4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.576+0000 7f1bd925e640 1 -- 172.21.15.49:0/2763983112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd41eeb60 con 0x558ee8fa7310 2023-11-18T21:00:37.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.580+0000 7f1bd925e640 1 --2- 172.21.15.49:0/2763983112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fc4650 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc01d180 tx=0x7f1bcc11b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54e39bd702b7071 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:37.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.580+0000 7f1bb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-18T21:00:37.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.584+0000 7f1bb37fe640 1 -- 172.21.15.49:0/2763983112 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0f64a0 con 0x558ee8fa7310 2023-11-18T21:00:37.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.584+0000 7f1bb37fe640 1 -- 172.21.15.49:0/2763983112 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f1bcc0f6600 con 0x558ee8fa7310 2023-11-18T21:00:37.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.584+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2763983112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ee8db5110 con 0x558ee8fa7310 2023-11-18T21:00:37.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.588+0000 7f1bb37fe640 1 -- 172.21.15.49:0/2763983112 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bcc0ea440 con 0x558ee8fa7310 2023-11-18T21:00:37.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.588+0000 7f1bdddf0000 10 client.4605 fetch_fsmap learned FSMap version 20 2023-11-18T21:00:37.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.588+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2763983112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x558ee8aaecc0 con 0x558ee8fa7310 2023-11-18T21:00:37.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.592+0000 7f1bb37fe640 1 -- 172.21.15.49:0/2763983112 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ee8db5110 con 0x558ee8fa7310 2023-11-18T21:00:37.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.592+0000 7f1bb37fe640 1 -- 172.21.15.49:0/2763983112 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f1bcc0ea5a0 con 0x558ee8fa7310 2023-11-18T21:00:37.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.592+0000 7f1bdddf0000 10 client.4605 fetch_fsmap finished waiting for FSMap version 20 2023-11-18T21:00:37.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.592+0000 7f1bdddf0000 10 client.4605 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-18T21:00:37.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.592+0000 7f1bdddf0000 20 client.4605 populate_metadata read hostname 'smithi049' 2023-11-18T21:00:37.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.596+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/2763983112 >> [v2:172.21.15.49:6834/3397458527,v1:172.21.15.49:6835/3397458527] conn(0x558ee9017110 0x558ee9019500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.596+0000 7f1bdddf0000 4 client.4605 mds_command: new command op to 4194 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-18T21:00:37.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.596+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2763983112 --> [v2:172.21.15.49:6834/3397458527,v1:172.21.15.49:6835/3397458527] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558ee8de49a0 con 0x558ee9017110 2023-11-18T21:00:37.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.596+0000 7f1bd8a5d640 1 --2- 172.21.15.49:0/2763983112 >> [v2:172.21.15.49:6834/3397458527,v1:172.21.15.49:6835/3397458527] conn(0x558ee9017110 0x558ee9019500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.600+0000 7f1bd8a5d640 1 --2- 172.21.15.49:0/2763983112 >> [v2:172.21.15.49:6834/3397458527,v1:172.21.15.49:6835/3397458527] conn(0x558ee9017110 0x558ee9019500 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c5c4670eab85910a server_cookie=dfd645c659a834f8 in_seq=0 out_seq=0 2023-11-18T21:00:37.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.600+0000 7f1bb37fe640 10 client.4605 ms_handle_connect on v2:172.21.15.49:6834/3397458527 2023-11-18T21:00:37.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bb37fe640 1 -- 172.21.15.49:0/2763983112 <== mds.4 v2:172.21.15.49:6834/3397458527 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x558ee8de49a0 con 0x558ee9017110 2023-11-18T21:00:37.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bb37fe640 10 client.4605 handle_command_reply: tid=0 2023-11-18T21:00:37.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdddf0000 1 client.4605 shutdown 2023-11-18T21:00:37.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2763983112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 msgr2=0x558ee8fc4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/2763983112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fc4650 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc01d180 tx=0x7f1bcc11b8f0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2763983112 shutdown_connections 2023-11-18T21:00:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/2763983112 >> [v2:172.21.15.49:6834/3397458527,v1:172.21.15.49:6835/3397458527] conn(0x558ee9017110 0x558ee9019500 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/2763983112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ee8fa7310 0x558ee8fc4650 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bb37fe640 0 client.4605 ms_handle_reset on v2:172.21.15.49:6834/3397458527 2023-11-18T21:00:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/2763983112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ee8fa69f0 0x558ee8fc4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdddf0000 1 --2- 172.21.15.49:0/2763983112 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ee8fa1b40 0x558ee8fc3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2763983112 >> 172.21.15.49:0/2763983112 conn(0x558ee8fa27a0 msgr2=0x558ee8fa59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2763983112 shutdown_connections 2023-11-18T21:00:37.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdddf0000 1 -- 172.21.15.49:0/2763983112 wait complete. 2023-11-18T21:00:37.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdddf0000 20 client.4605 trim_cache size 0 max 16384 2023-11-18T21:00:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T21:00:37.626 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "4b788c4a-a91a-4c5d-8f44-e74d82d94e56", 2023-11-18T21:00:37.626 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 4, 2023-11-18T21:00:37.626 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4194, 2023-11-18T21:00:37.626 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-18T21:00:37.627 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-18T21:00:37.627 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-18T21:00:37.627 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 13.797801336999999, 2023-11-18T21:00:37.627 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 20, 2023-11-18T21:00:37.627 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 31, 2023-11-18T21:00:37.627 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 29, 2023-11-18T21:00:37.627 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 90.269993165000002 2023-11-18T21:00:37.627 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T21:00:37.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdacc1640 1 -- 172.21.15.49:0/3260517871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1bb80664c0 msgr2=0x7f1bb8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdacc1640 1 --2- 172.21.15.49:0/3260517871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1bb80664c0 0x7f1bb8068980 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8001410 tx=0x7f1bc8001bb0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdacc1640 1 -- 172.21.15.49:0/3260517871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bd4073b80 msgr2=0x7f1bd41497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdacc1640 1 --2- 172.21.15.49:0/3260517871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bd4073b80 0x7f1bd41497c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc001fd0 tx=0x7f1bc4005800 comp rx=0 tx=0).stop 2023-11-18T21:00:37.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdacc1640 1 -- 172.21.15.49:0/3260517871 shutdown_connections 2023-11-18T21:00:37.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdacc1640 1 --2- 172.21.15.49:0/3260517871 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1bb80664c0 0x7f1bb8068980 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdacc1640 1 --2- 172.21.15.49:0/3260517871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bd4073b80 0x7f1bd41497c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdacc1640 1 --2- 172.21.15.49:0/3260517871 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bd4156090 0x7f1bd4149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdacc1640 1 --2- 172.21.15.49:0/3260517871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bd4155cb0 0x7f1bd41eb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdacc1640 1 -- 172.21.15.49:0/3260517871 >> 172.21.15.49:0/3260517871 conn(0x7f1bd406c6a0 msgr2=0x7f1bd4152250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:37.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdacc1640 1 -- 172.21.15.49:0/3260517871 shutdown_connections 2023-11-18T21:00:37.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.624+0000 7f1bdacc1640 1 -- 172.21.15.49:0/3260517871 wait complete. 2023-11-18T21:00:37.645 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-18T21:00:37.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.772+0000 7fd42f39a640 1 Processor -- start 2023-11-18T21:00:37.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.772+0000 7fd42f39a640 1 -- start start 2023-11-18T21:00:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.772+0000 7fd42f39a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd428151340 0x7fd42806ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.772+0000 7fd42f39a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd428151720 0x7fd428157c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.772+0000 7fd42f39a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42806f4a0 con 0x7fd4280c40e0 2023-11-18T21:00:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.772+0000 7fd42f39a640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd428072570 con 0x7fd428151720 2023-11-18T21:00:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.772+0000 7fd42f39a640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd428070be0 con 0x7fd428151340 2023-11-18T21:00:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.772+0000 7fd42d136640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd428151340 0x7fd42806ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.772+0000 7fd42c935640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd428151720 0x7fd428157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.776+0000 7fd42c935640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd428151720 0x7fd428157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:53168/0 (socket says 172.21.15.49:53168) 2023-11-18T21:00:37.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.776+0000 7fd42c935640 1 -- 172.21.15.49:0/1053498202 learned_addr learned my addr 172.21.15.49:0/1053498202 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:37.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.776+0000 7fd42d136640 1 --2- 172.21.15.49:0/1053498202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd428151340 0x7fd42806ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:58400/0 (socket says 172.21.15.49:58400) 2023-11-18T21:00:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.780+0000 7fd42d136640 1 -- 172.21.15.49:0/1053498202 >> v2:172.21.15.106:3300/0 conn(0x7fd428151720 msgr2=0x7fd428157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.780+0000 7fd42d136640 1 --2- 172.21.15.49:0/1053498202 >> v2:172.21.15.106:3300/0 conn(0x7fd428151720 0x7fd428157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.780+0000 7fd42d136640 1 -- 172.21.15.49:0/1053498202 >> v1:172.21.15.106:6789/0 conn(0x7fd4280c40e0 legacy=0x7fd4280c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.780+0000 7fd42d136640 1 -- 172.21.15.49:0/1053498202 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd428158190 con 0x7fd428151340 2023-11-18T21:00:37.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.788+0000 7fd42d136640 1 --2- 172.21.15.49:0/1053498202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd428151340 0x7fd42806ee10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd42400dbe0 tx=0x7fd424020720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8984fba0cd6a86d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:37.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.796+0000 7fd41ffff640 1 -- 172.21.15.49:0/1053498202 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400d0d0 con 0x7fd428151340 2023-11-18T21:00:37.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.796+0000 7fd41ffff640 1 -- 172.21.15.49:0/1053498202 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42400d230 con 0x7fd428151340 2023-11-18T21:00:37.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.796+0000 7fd41ffff640 1 -- 172.21.15.49:0/1053498202 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4240aa6f0 con 0x7fd428151340 2023-11-18T21:00:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.796+0000 7fd42f39a640 1 -- 172.21.15.49:0/1053498202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd428151340 msgr2=0x7fd42806ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.796+0000 7fd42f39a640 1 --2- 172.21.15.49:0/1053498202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd428151340 0x7fd42806ee10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd42400dbe0 tx=0x7fd424020720 comp rx=0 tx=0).stop 2023-11-18T21:00:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.796+0000 7fd42f39a640 1 -- 172.21.15.49:0/1053498202 shutdown_connections 2023-11-18T21:00:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.796+0000 7fd42f39a640 1 --2- 172.21.15.49:0/1053498202 >> v2:172.21.15.106:3300/0 conn(0x7fd428151720 0x7fd428157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.796+0000 7fd42f39a640 1 --2- 172.21.15.49:0/1053498202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd428151340 0x7fd42806ee10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.796+0000 7fd42f39a640 1 -- 172.21.15.49:0/1053498202 >> 172.21.15.49:0/1053498202 conn(0x7fd42806c6a0 msgr2=0x7fd42806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.796+0000 7fd42f39a640 1 -- 172.21.15.49:0/1053498202 shutdown_connections 2023-11-18T21:00:37.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.796+0000 7fd42f39a640 1 -- 172.21.15.49:0/1053498202 wait complete. 2023-11-18T21:00:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.800+0000 7fd42f39a640 1 Processor -- start 2023-11-18T21:00:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.800+0000 7fd42f39a640 1 -- start start 2023-11-18T21:00:37.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.800+0000 7fd42f39a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4280c40e0 0x7fd428144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.800+0000 7fd42f39a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd428151340 0x7fd42813ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.800+0000 7fd42f39a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd428151720 0x7fd4281486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.800+0000 7fd42f39a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd428149b80 con 0x7fd428151720 2023-11-18T21:00:37.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.800+0000 7fd42f39a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4281463b0 con 0x7fd428151340 2023-11-18T21:00:37.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.800+0000 7fd42f39a640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4281457c0 con 0x7fd4280c40e0 2023-11-18T21:00:37.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.800+0000 7fd42d937640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd428151720 0x7fd4281486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.800+0000 7fd42d937640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd428151720 0x7fd4281486d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46350/0 (socket says 172.21.15.49:46350) 2023-11-18T21:00:37.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.800+0000 7fd42d937640 1 -- 172.21.15.49:0/1665639188 learned_addr learned my addr 172.21.15.49:0/1665639188 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:37.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.800+0000 7fd42c935640 1 --2- 172.21.15.49:0/1665639188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd428151340 0x7fd42813ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.804+0000 7fd42d136640 1 --2- 172.21.15.49:0/1665639188 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4280c40e0 0x7fd428144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.804+0000 7fd42d937640 1 -- 172.21.15.49:0/1665639188 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4280c40e0 msgr2=0x7fd428144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.804+0000 7fd42d937640 1 --2- 172.21.15.49:0/1665639188 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4280c40e0 0x7fd428144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.804+0000 7fd42d937640 1 -- 172.21.15.49:0/1665639188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd428151340 msgr2=0x7fd42813ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.804+0000 7fd42d937640 1 --2- 172.21.15.49:0/1665639188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd428151340 0x7fd42813ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.804+0000 7fd42d937640 1 -- 172.21.15.49:0/1665639188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42400d8c0 con 0x7fd428151720 2023-11-18T21:00:37.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.808+0000 7fd42d937640 1 --2- 172.21.15.49:0/1665639188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd428151720 0x7fd4281486d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd42000c780 tx=0x7fd42000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:37.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.832+0000 7fd41dffb640 1 -- 172.21.15.49:0/1665639188 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420004b70 con 0x7fd428151720 2023-11-18T21:00:37.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.832+0000 7fd41dffb640 1 -- 172.21.15.49:0/1665639188 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42000ce90 con 0x7fd428151720 2023-11-18T21:00:37.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.832+0000 7fd41dffb640 1 -- 172.21.15.49:0/1665639188 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42000a850 con 0x7fd428151720 2023-11-18T21:00:37.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.832+0000 7fd42f39a640 1 -- 172.21.15.49:0/1665639188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42814a330 con 0x7fd428151720 2023-11-18T21:00:37.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.832+0000 7fd42f39a640 1 -- 172.21.15.49:0/1665639188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd428145d60 con 0x7fd428151720 2023-11-18T21:00:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.836+0000 7fd4324c9000 1 Processor -- start 2023-11-18T21:00:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.836+0000 7fd4324c9000 1 -- start start 2023-11-18T21:00:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.836+0000 7fd4324c9000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de2969930 0x559de2969d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.836+0000 7fd4324c9000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de296e9f0 0x559de296edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.836+0000 7fd4324c9000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296f310 0x559de296f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.836+0000 7fd4324c9000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x559de2798130 con 0x559de296e9f0 2023-11-18T21:00:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.836+0000 7fd4324c9000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559de27859a0 con 0x559de296f310 2023-11-18T21:00:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.836+0000 7fd4324c9000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559de2782ed0 con 0x559de2969930 2023-11-18T21:00:37.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.836+0000 7fd42c935640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de2969930 0x559de2969d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.836+0000 7fd42c935640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296f310 0x559de296f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.840+0000 7fd42c935640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296f310 0x559de296f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:53190/0 (socket says 172.21.15.49:53190) 2023-11-18T21:00:37.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.840+0000 7fd42c935640 1 -- 172.21.15.49:0/3129959833 learned_addr learned my addr 172.21.15.49:0/3129959833 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:37.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.844+0000 7fd42c935640 1 -- 172.21.15.49:0/3129959833 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de2969930 msgr2=0x559de2969d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.844+0000 7fd42c935640 1 --2- 172.21.15.49:0/3129959833 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de2969930 0x559de2969d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.844+0000 7fd42c935640 1 -- 172.21.15.49:0/3129959833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de296e9f0 msgr2=0x559de296edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.844+0000 7fd42c935640 1 --2- 172.21.15.49:0/3129959833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de296e9f0 0x559de296edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.844+0000 7fd42c935640 1 -- 172.21.15.49:0/3129959833 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559de2476890 con 0x559de296f310 2023-11-18T21:00:37.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.848+0000 7fd42c935640 1 --2- 172.21.15.49:0/3129959833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296f310 0x559de296f6f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd4180188b0 tx=0x7fd418009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99b4f9df0a2fc0ab server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:37.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.860+0000 7fd40affd640 1 -- 172.21.15.49:0/3129959833 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418004030 con 0x559de296f310 2023-11-18T21:00:37.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.860+0000 7fd40affd640 1 -- 172.21.15.49:0/3129959833 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd418004190 con 0x559de296f310 2023-11-18T21:00:37.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.860+0000 7fd40affd640 1 -- 172.21.15.49:0/3129959833 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418013950 con 0x559de296f310 2023-11-18T21:00:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.860+0000 7fd4324c9000 1 -- 172.21.15.49:0/3129959833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296f310 msgr2=0x559de296f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:37.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.860+0000 7fd4324c9000 1 --2- 172.21.15.49:0/3129959833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296f310 0x559de296f6f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd4180188b0 tx=0x7fd418009240 comp rx=0 tx=0).stop 2023-11-18T21:00:37.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.860+0000 7fd4324c9000 1 -- 172.21.15.49:0/3129959833 shutdown_connections 2023-11-18T21:00:37.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.860+0000 7fd4324c9000 1 --2- 172.21.15.49:0/3129959833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296f310 0x559de296f6f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.860+0000 7fd4324c9000 1 --2- 172.21.15.49:0/3129959833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de296e9f0 0x559de296edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.860+0000 7fd4324c9000 1 --2- 172.21.15.49:0/3129959833 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de2969930 0x559de2969d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.860+0000 7fd4324c9000 1 -- 172.21.15.49:0/3129959833 >> 172.21.15.49:0/3129959833 conn(0x559de296a7a0 msgr2=0x559de296cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:37.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.860+0000 7fd4324c9000 1 -- 172.21.15.49:0/3129959833 shutdown_connections 2023-11-18T21:00:37.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.860+0000 7fd4324c9000 1 -- 172.21.15.49:0/3129959833 wait complete. 2023-11-18T21:00:37.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.860+0000 7fd4324c9000 1 -- start start 2023-11-18T21:00:37.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.860+0000 7fd4324c9000 1 Processor -- start 2023-11-18T21:00:37.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.864+0000 7fd4324c9000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de2969930 0x559de2968d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.864+0000 7fd4324c9000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296e9f0 0x559de2969250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.864+0000 7fd4324c9000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de296f310 0x559de2978990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.864+0000 7fd4324c9000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x559de277e7c0 con 0x559de296f310 2023-11-18T21:00:37.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.864+0000 7fd4324c9000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559de2736bf0 con 0x559de296e9f0 2023-11-18T21:00:37.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.864+0000 7fd4324c9000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559de273ca90 con 0x559de2969930 2023-11-18T21:00:37.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.864+0000 7fd4324c9000 10 client.0 _ll_register_callbacks cb 0x559de29193c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T21:00:37.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.864+0000 7fd42c935640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de2969930 0x559de2968d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.864+0000 7fd42c935640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de2969930 0x559de2968d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:58426/0 (socket says 172.21.15.49:58426) 2023-11-18T21:00:37.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.864+0000 7fd42c935640 1 -- 172.21.15.49:0/3731032865 learned_addr learned my addr 172.21.15.49:0/3731032865 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:37.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.868+0000 7fd42d136640 1 --2- 172.21.15.49:0/3731032865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296e9f0 0x559de2969250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.868+0000 7fd41dffb640 1 -- 172.21.15.49:0/1665639188 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd42000a9b0 con 0x7fd428151720 2023-11-18T21:00:37.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.868+0000 7fd41dffb640 1 --2- 172.21.15.49:0/1665639188 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd40c066460 0x7fd40c068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.868+0000 7fd42d937640 1 --2- 172.21.15.49:0/1665639188 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd40c066460 0x7fd40c068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.868+0000 7fd42d937640 1 --2- 172.21.15.49:0/1665639188 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd40c066460 0x7fd40c068920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd42000a430 tx=0x7fd42005b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:37.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.872+0000 7fd42c935640 1 -- 172.21.15.49:0/3731032865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296e9f0 msgr2=0x559de2969250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.872+0000 7fd42c935640 1 --2- 172.21.15.49:0/3731032865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296e9f0 0x559de2969250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.872+0000 7fd42c935640 1 -- 172.21.15.49:0/3731032865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de296f310 msgr2=0x559de2978990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:37.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.872+0000 7fd42c935640 1 --2- 172.21.15.49:0/3731032865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de296f310 0x559de2978990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:37.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.872+0000 7fd42c935640 1 -- 172.21.15.49:0/3731032865 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd418018590 con 0x559de2969930 2023-11-18T21:00:37.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.876+0000 7fd41dffb640 1 -- 172.21.15.49:0/1665639188 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fd420059190 con 0x7fd428151720 2023-11-18T21:00:37.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.880+0000 7fd42c935640 1 --2- 172.21.15.49:0/3731032865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de2969930 0x559de2968d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd418006a50 tx=0x7fd4180046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=254e06e5b6161867 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:37.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.880+0000 7fd403fff640 10 client.0 ms_handle_connect on v2:172.21.15.106:3301/0 2023-11-18T21:00:37.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.884+0000 7fd403fff640 1 -- 172.21.15.49:0/3731032865 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418013d60 con 0x559de2969930 2023-11-18T21:00:37.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.884+0000 7fd4324c9000 1 -- 172.21.15.49:0/3731032865 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559de2740470 con 0x559de2969930 2023-11-18T21:00:37.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.888+0000 7fd403fff640 1 -- 172.21.15.49:0/3731032865 <== mon.2 v2:172.21.15.106:3301/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fd418003620 con 0x559de2969930 2023-11-18T21:00:37.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.892+0000 7fd403fff640 1 -- 172.21.15.49:0/3731032865 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd418003800 con 0x559de2969930 2023-11-18T21:00:37.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.892+0000 7fd4324c9000 10 client.4547 fetch_fsmap learned FSMap version 20 2023-11-18T21:00:37.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.892+0000 7fd4324c9000 1 -- 172.21.15.49:0/3731032865 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x559de273f190 con 0x559de2969930 2023-11-18T21:00:37.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.904+0000 7fd403fff640 1 -- 172.21.15.49:0/3731032865 <== mon.2 v2:172.21.15.106:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559de2740470 con 0x559de2969930 2023-11-18T21:00:37.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.904+0000 7fd403fff640 1 -- 172.21.15.49:0/3731032865 <== mon.2 v2:172.21.15.106:3301/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fd418020020 con 0x559de2969930 2023-11-18T21:00:37.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.904+0000 7fd4324c9000 10 client.4547 fetch_fsmap finished waiting for FSMap version 20 2023-11-18T21:00:37.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.904+0000 7fd4324c9000 10 client.4547 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-18T21:00:37.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.904+0000 7fd4324c9000 20 client.4547 populate_metadata read hostname 'smithi049' 2023-11-18T21:00:37.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.904+0000 7fd4324c9000 1 --2- 172.21.15.49:0/3731032865 >> [v2:172.21.15.106:6834/2795994685,v1:172.21.15.106:6835/2795994685] conn(0x559de29796d0 0x559de2979ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:37.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.904+0000 7fd4324c9000 4 client.4547 mds_command: new command op to 4197 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-18T21:00:37.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.904+0000 7fd4324c9000 1 -- 172.21.15.49:0/3731032865 --> [v2:172.21.15.106:6834/2795994685,v1:172.21.15.106:6835/2795994685] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559de2743b50 con 0x559de29796d0 2023-11-18T21:00:37.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.904+0000 7fd42d136640 1 --2- 172.21.15.49:0/3731032865 >> [v2:172.21.15.106:6834/2795994685,v1:172.21.15.106:6835/2795994685] conn(0x559de29796d0 0x559de2979ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:37.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.992+0000 7fd42d136640 1 --2- 172.21.15.49:0/3731032865 >> [v2:172.21.15.106:6834/2795994685,v1:172.21.15.106:6835/2795994685] conn(0x559de29796d0 0x559de2979ab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5ccdde00ac1e1515 server_cookie=ec392f6e8bd105e2 in_seq=0 out_seq=0 2023-11-18T21:00:37.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:37.992+0000 7fd403fff640 10 client.4547 ms_handle_connect on v2:172.21.15.106:6834/2795994685 2023-11-18T21:00:38.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd403fff640 1 -- 172.21.15.49:0/3731032865 <== mds.3 v2:172.21.15.106:6834/2795994685 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559de2743b50 con 0x559de29796d0 2023-11-18T21:00:38.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd403fff640 10 client.4547 handle_command_reply: tid=0 2023-11-18T21:00:38.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd4324c9000 1 client.4547 shutdown 2023-11-18T21:00:38.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd4324c9000 1 -- 172.21.15.49:0/3731032865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de2969930 msgr2=0x559de2968d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:38.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd4324c9000 1 --2- 172.21.15.49:0/3731032865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de2969930 0x559de2968d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd418006a50 tx=0x7fd4180046d0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd4324c9000 1 -- 172.21.15.49:0/3731032865 shutdown_connections 2023-11-18T21:00:38.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd4324c9000 1 --2- 172.21.15.49:0/3731032865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de296f310 0x559de2978990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd4324c9000 1 --2- 172.21.15.49:0/3731032865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296e9f0 0x559de2969250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd4324c9000 1 --2- 172.21.15.49:0/3731032865 >> [v2:172.21.15.106:6834/2795994685,v1:172.21.15.106:6835/2795994685] conn(0x559de29796d0 0x559de2979ab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd4324c9000 1 --2- 172.21.15.49:0/3731032865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de2969930 0x559de2968d10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd403fff640 0 client.4547 ms_handle_reset on v2:172.21.15.106:6834/2795994685 2023-11-18T21:00:38.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd4324c9000 1 -- 172.21.15.49:0/3731032865 >> 172.21.15.49:0/3731032865 conn(0x559de296a7a0 msgr2=0x559de2933ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:38.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd4324c9000 1 -- 172.21.15.49:0/3731032865 shutdown_connections 2023-11-18T21:00:38.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd4324c9000 1 -- 172.21.15.49:0/3731032865 wait complete. 2023-11-18T21:00:38.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.168+0000 7fd4324c9000 20 client.4547 trim_cache size 0 max 16384 2023-11-18T21:00:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.212+0000 7fd4324c9000 1 Processor -- start 2023-11-18T21:00:38.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.212+0000 7fd4324c9000 1 -- start start 2023-11-18T21:00:38.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.216+0000 7fd4324c9000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de2969930 0x559de296d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.216+0000 7fd4324c9000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296e9f0 0x559de2978640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.216+0000 7fd4324c9000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de296f310 0x559de2978b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.216+0000 7fd4324c9000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x559de2437940 con 0x559de2969930 2023-11-18T21:00:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.216+0000 7fd4324c9000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559de27f17a0 con 0x559de296e9f0 2023-11-18T21:00:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.216+0000 7fd4324c9000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559de277f070 con 0x559de296f310 2023-11-18T21:00:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.216+0000 7fd42c935640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de2969930 0x559de296d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.216+0000 7fd42c935640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de2969930 0x559de296d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46396/0 (socket says 172.21.15.49:46396) 2023-11-18T21:00:38.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.216+0000 7fd42c935640 1 -- 172.21.15.49:0/4271125417 learned_addr learned my addr 172.21.15.49:0/4271125417 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:38.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.220+0000 7fd42c935640 1 -- 172.21.15.49:0/4271125417 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de296f310 msgr2=0x559de2978b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:38.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.220+0000 7fd42c935640 1 --2- 172.21.15.49:0/4271125417 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de296f310 0x559de2978b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.220+0000 7fd42c935640 1 -- 172.21.15.49:0/4271125417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296e9f0 msgr2=0x559de2978640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:38.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.220+0000 7fd42c935640 1 --2- 172.21.15.49:0/4271125417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296e9f0 0x559de2978640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.220+0000 7fd42c935640 1 -- 172.21.15.49:0/4271125417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559de2725490 con 0x559de2969930 2023-11-18T21:00:38.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.224+0000 7fd42c935640 1 --2- 172.21.15.49:0/4271125417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de2969930 0x559de296d1c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd418009f20 tx=0x7fd418027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762ca0547ef35763 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:38.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.228+0000 7fd40b7fe640 1 -- 172.21.15.49:0/4271125417 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418009240 con 0x559de2969930 2023-11-18T21:00:38.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.228+0000 7fd40b7fe640 1 -- 172.21.15.49:0/4271125417 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd418004340 con 0x559de2969930 2023-11-18T21:00:38.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.228+0000 7fd40b7fe640 1 -- 172.21.15.49:0/4271125417 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4180044b0 con 0x559de2969930 2023-11-18T21:00:38.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.232+0000 7fd4324c9000 1 -- 172.21.15.49:0/4271125417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de2969930 msgr2=0x559de296d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:38.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.232+0000 7fd4324c9000 1 --2- 172.21.15.49:0/4271125417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de2969930 0x559de296d1c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd418009f20 tx=0x7fd418027040 comp rx=0 tx=0).stop 2023-11-18T21:00:38.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.232+0000 7fd4324c9000 1 -- 172.21.15.49:0/4271125417 shutdown_connections 2023-11-18T21:00:38.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.232+0000 7fd4324c9000 1 --2- 172.21.15.49:0/4271125417 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de296f310 0x559de2978b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.232+0000 7fd4324c9000 1 --2- 172.21.15.49:0/4271125417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de296e9f0 0x559de2978640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.232+0000 7fd4324c9000 1 --2- 172.21.15.49:0/4271125417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de2969930 0x559de296d1c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.232+0000 7fd4324c9000 1 -- 172.21.15.49:0/4271125417 >> 172.21.15.49:0/4271125417 conn(0x559de296a7a0 msgr2=0x559de296de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:38.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.232+0000 7fd4324c9000 1 -- 172.21.15.49:0/4271125417 shutdown_connections 2023-11-18T21:00:38.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.232+0000 7fd4324c9000 1 -- 172.21.15.49:0/4271125417 wait complete. 2023-11-18T21:00:38.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.232+0000 7fd4324c9000 1 -- start start 2023-11-18T21:00:38.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.232+0000 7fd4324c9000 1 Processor -- start 2023-11-18T21:00:38.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.236+0000 7fd4324c9000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de2969930 0x559de29ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.236+0000 7fd4324c9000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de296e9f0 0x559de29ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.236+0000 7fd4324c9000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de296f310 0x559de2931100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.236+0000 7fd4324c9000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x559de277bbc0 con 0x559de296e9f0 2023-11-18T21:00:38.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.236+0000 7fd4324c9000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559de277bfd0 con 0x559de2969930 2023-11-18T21:00:38.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.236+0000 7fd4324c9000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559de2968d60 con 0x559de296f310 2023-11-18T21:00:38.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.236+0000 7fd4324c9000 10 client.0 _ll_register_callbacks cb 0x559de28f9bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T21:00:38.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.236+0000 7fd42d136640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de296e9f0 0x559de29ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.236+0000 7fd42c935640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de2969930 0x559de29ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.240+0000 7fd42c935640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de2969930 0x559de29ce430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:53208/0 (socket says 172.21.15.49:53208) 2023-11-18T21:00:38.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.240+0000 7fd42c935640 1 -- 172.21.15.49:0/1423314401 learned_addr learned my addr 172.21.15.49:0/1423314401 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:38.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.240+0000 7fd42d136640 1 -- 172.21.15.49:0/1423314401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de296f310 msgr2=0x559de2931100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:38.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.240+0000 7fd42d136640 1 --2- 172.21.15.49:0/1423314401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de296f310 0x559de2931100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.240+0000 7fd42d136640 1 -- 172.21.15.49:0/1423314401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de2969930 msgr2=0x559de29ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:38.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.240+0000 7fd42d136640 1 --2- 172.21.15.49:0/1423314401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de2969930 0x559de29ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.240+0000 7fd42d136640 1 -- 172.21.15.49:0/1423314401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559de273f190 con 0x559de296e9f0 2023-11-18T21:00:38.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.244+0000 7fd42d136640 1 --2- 172.21.15.49:0/1423314401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de296e9f0 0x559de29ce970 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd4240af000 tx=0x7fd42401d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c48012da56b505f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:38.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.244+0000 7fd403fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-18T21:00:38.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.252+0000 7fd403fff640 1 -- 172.21.15.49:0/1423314401 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400b040 con 0x559de296e9f0 2023-11-18T21:00:38.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.252+0000 7fd403fff640 1 -- 172.21.15.49:0/1423314401 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fd4240ae070 con 0x559de296e9f0 2023-11-18T21:00:38.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.252+0000 7fd4324c9000 1 -- 172.21.15.49:0/1423314401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559de277d110 con 0x559de296e9f0 2023-11-18T21:00:38.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.252+0000 7fd403fff640 1 -- 172.21.15.49:0/1423314401 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4240c05d0 con 0x559de296e9f0 2023-11-18T21:00:38.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.252+0000 7fd4324c9000 10 client.4614 fetch_fsmap learned FSMap version 20 2023-11-18T21:00:38.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.252+0000 7fd4324c9000 1 -- 172.21.15.49:0/1423314401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x559de2476cc0 con 0x559de296e9f0 2023-11-18T21:00:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.260+0000 7fd403fff640 1 -- 172.21.15.49:0/1423314401 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559de277d110 con 0x559de296e9f0 2023-11-18T21:00:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.260+0000 7fd403fff640 1 -- 172.21.15.49:0/1423314401 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fd4240c0730 con 0x559de296e9f0 2023-11-18T21:00:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.260+0000 7fd4324c9000 10 client.4614 fetch_fsmap finished waiting for FSMap version 20 2023-11-18T21:00:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.260+0000 7fd4324c9000 10 client.4614 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-18T21:00:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.260+0000 7fd4324c9000 20 client.4614 populate_metadata read hostname 'smithi049' 2023-11-18T21:00:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.260+0000 7fd4324c9000 1 --2- 172.21.15.49:0/1423314401 >> [v2:172.21.15.106:6834/2795994685,v1:172.21.15.106:6835/2795994685] conn(0x559de29db920 0x559de2931c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.260+0000 7fd4324c9000 4 client.4614 mds_command: new command op to 4197 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-18T21:00:38.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.260+0000 7fd4324c9000 1 -- 172.21.15.49:0/1423314401 --> [v2:172.21.15.106:6834/2795994685,v1:172.21.15.106:6835/2795994685] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559de27ac9a0 con 0x559de29db920 2023-11-18T21:00:38.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.260+0000 7fd42c935640 1 --2- 172.21.15.49:0/1423314401 >> [v2:172.21.15.106:6834/2795994685,v1:172.21.15.106:6835/2795994685] conn(0x559de29db920 0x559de2931c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.268+0000 7fd42c935640 1 --2- 172.21.15.49:0/1423314401 >> [v2:172.21.15.106:6834/2795994685,v1:172.21.15.106:6835/2795994685] conn(0x559de29db920 0x559de2931c40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c9f696171018874d server_cookie=86c505a746da6d0e in_seq=0 out_seq=0 2023-11-18T21:00:38.268 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.268+0000 7fd403fff640 10 client.4614 ms_handle_connect on v2:172.21.15.106:6834/2795994685 2023-11-18T21:00:38.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd403fff640 1 -- 172.21.15.49:0/1423314401 <== mds.3 v2:172.21.15.106:6834/2795994685 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x559de27ac9a0 con 0x559de29db920 2023-11-18T21:00:38.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd403fff640 10 client.4614 handle_command_reply: tid=0 2023-11-18T21:00:38.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd4324c9000 1 client.4614 shutdown 2023-11-18T21:00:38.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd4324c9000 1 -- 172.21.15.49:0/1423314401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de296e9f0 msgr2=0x559de29ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:38.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd4324c9000 1 --2- 172.21.15.49:0/1423314401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de296e9f0 0x559de29ce970 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd4240af000 tx=0x7fd42401d4c0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd4324c9000 1 -- 172.21.15.49:0/1423314401 shutdown_connections 2023-11-18T21:00:38.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd4324c9000 1 --2- 172.21.15.49:0/1423314401 >> [v2:172.21.15.106:6834/2795994685,v1:172.21.15.106:6835/2795994685] conn(0x559de29db920 0x559de2931c40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd4324c9000 1 --2- 172.21.15.49:0/1423314401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559de296f310 0x559de2931100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd4324c9000 1 --2- 172.21.15.49:0/1423314401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559de296e9f0 0x559de29ce970 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd4324c9000 1 --2- 172.21.15.49:0/1423314401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559de2969930 0x559de29ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd403fff640 0 client.4614 ms_handle_reset on v2:172.21.15.106:6834/2795994685 2023-11-18T21:00:38.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd4324c9000 1 -- 172.21.15.49:0/1423314401 >> 172.21.15.49:0/1423314401 conn(0x559de296a7a0 msgr2=0x559de297aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:38.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd4324c9000 1 -- 172.21.15.49:0/1423314401 shutdown_connections 2023-11-18T21:00:38.294 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd4324c9000 1 -- 172.21.15.49:0/1423314401 wait complete. 2023-11-18T21:00:38.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.292+0000 7fd4324c9000 20 client.4614 trim_cache size 0 max 16384 2023-11-18T21:00:38.295 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T21:00:38.295 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "4b788c4a-a91a-4c5d-8f44-e74d82d94e56", 2023-11-18T21:00:38.295 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 3, 2023-11-18T21:00:38.295 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4197, 2023-11-18T21:00:38.295 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-18T21:00:38.295 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-18T21:00:38.296 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-18T21:00:38.296 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 17.800655076000002, 2023-11-18T21:00:38.296 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 20, 2023-11-18T21:00:38.296 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 31, 2023-11-18T21:00:38.296 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 29, 2023-11-18T21:00:38.296 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 90.909361751000006 2023-11-18T21:00:38.296 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T21:00:38.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.296+0000 7fd42f39a640 1 -- 172.21.15.49:0/1665639188 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd40c066460 msgr2=0x7fd40c068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:38.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.296+0000 7fd42f39a640 1 --2- 172.21.15.49:0/1665639188 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd40c066460 0x7fd40c068920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd42000a430 tx=0x7fd42005b040 comp rx=0 tx=0).stop 2023-11-18T21:00:38.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.296+0000 7fd42f39a640 1 -- 172.21.15.49:0/1665639188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd428151720 msgr2=0x7fd4281486d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:38.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.296+0000 7fd42f39a640 1 --2- 172.21.15.49:0/1665639188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd428151720 0x7fd4281486d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd42000c780 tx=0x7fd42000cc40 comp rx=0 tx=0).stop 2023-11-18T21:00:38.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.296+0000 7fd42f39a640 1 -- 172.21.15.49:0/1665639188 shutdown_connections 2023-11-18T21:00:38.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.296+0000 7fd42f39a640 1 --2- 172.21.15.49:0/1665639188 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fd40c066460 0x7fd40c068920 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.296+0000 7fd42f39a640 1 --2- 172.21.15.49:0/1665639188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd428151720 0x7fd4281486d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.296+0000 7fd42f39a640 1 --2- 172.21.15.49:0/1665639188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd428151340 0x7fd42813ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.296+0000 7fd42f39a640 1 --2- 172.21.15.49:0/1665639188 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4280c40e0 0x7fd428144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.296+0000 7fd42f39a640 1 -- 172.21.15.49:0/1665639188 >> 172.21.15.49:0/1665639188 conn(0x7fd42806c6a0 msgr2=0x7fd428154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:38.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.296+0000 7fd42f39a640 1 -- 172.21.15.49:0/1665639188 shutdown_connections 2023-11-18T21:00:38.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.296+0000 7fd42f39a640 1 -- 172.21.15.49:0/1665639188 wait complete. 2023-11-18T21:00:38.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-11-18T21:00:38.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.452+0000 7f48021db640 1 Processor -- start 2023-11-18T21:00:38.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.452+0000 7f48021db640 1 -- start start 2023-11-18T21:00:38.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.452+0000 7f48021db640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47fc0c3260 0x7f47fc0c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.452+0000 7f48021db640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f47fc159870 0x7f47fc159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.452+0000 7f48021db640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47fc156f60 con 0x7f47fc0c4ce0 2023-11-18T21:00:38.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.452+0000 7f48021db640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47fc06bd30 con 0x7f47fc159870 2023-11-18T21:00:38.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.452+0000 7f48021db640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc0c5600 con 0x7f47fc0c3260 2023-11-18T21:00:38.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.452+0000 7f47fbfff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f47fc159870 0x7f47fc159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.456+0000 7f47faffd640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47fc0c3260 0x7f47fc0c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.456+0000 7f47fbfff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f47fc159870 0x7f47fc159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:53220/0 (socket says 172.21.15.49:53220) 2023-11-18T21:00:38.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.456+0000 7f47fbfff640 1 -- 172.21.15.49:0/2568614404 learned_addr learned my addr 172.21.15.49:0/2568614404 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:38.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.460+0000 7f47fbfff640 1 -- 172.21.15.49:0/2568614404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47fc0c3260 msgr2=0x7f47fc0c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:38.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.460+0000 7f47fbfff640 1 --2- 172.21.15.49:0/2568614404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47fc0c3260 0x7f47fc0c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.460+0000 7f47fbfff640 1 -- 172.21.15.49:0/2568614404 >> v1:172.21.15.49:6789/0 conn(0x7f47fc0c4ce0 legacy=0x7f47fc06b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:38.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.460+0000 7f47fbfff640 1 -- 172.21.15.49:0/2568614404 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc150750 con 0x7f47fc159870 2023-11-18T21:00:38.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.464+0000 7f47fbfff640 1 --2- 172.21.15.49:0/2568614404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47fc159870 0x7f47fc159ce0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009e50 tx=0x7f47ec01f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=512b9931c6003850 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:38.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.480+0000 7f47fa7fc640 1 -- 172.21.15.49:0/2568614404 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0af400 con 0x7f47fc159870 2023-11-18T21:00:38.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.480+0000 7f47fa7fc640 1 -- 172.21.15.49:0/2568614404 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec0ab050 con 0x7f47fc159870 2023-11-18T21:00:38.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.480+0000 7f47fa7fc640 1 -- 172.21.15.49:0/2568614404 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0af780 con 0x7f47fc159870 2023-11-18T21:00:38.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.480+0000 7f48021db640 1 -- 172.21.15.49:0/2568614404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47fc159870 msgr2=0x7f47fc159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:38.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.480+0000 7f48021db640 1 --2- 172.21.15.49:0/2568614404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47fc159870 0x7f47fc159ce0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009e50 tx=0x7f47ec01f1c0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.480+0000 7f48021db640 1 -- 172.21.15.49:0/2568614404 shutdown_connections 2023-11-18T21:00:38.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.480+0000 7f48021db640 1 --2- 172.21.15.49:0/2568614404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47fc159870 0x7f47fc159ce0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.480+0000 7f48021db640 1 --2- 172.21.15.49:0/2568614404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47fc0c3260 0x7f47fc0c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.480+0000 7f48021db640 1 -- 172.21.15.49:0/2568614404 >> 172.21.15.49:0/2568614404 conn(0x7f47fc0713a0 msgr2=0x7f47fc0717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:38.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.480+0000 7f48021db640 1 -- 172.21.15.49:0/2568614404 shutdown_connections 2023-11-18T21:00:38.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.480+0000 7f48021db640 1 -- 172.21.15.49:0/2568614404 wait complete. 2023-11-18T21:00:38.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.480+0000 7f48021db640 1 Processor -- start 2023-11-18T21:00:38.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.480+0000 7f48021db640 1 -- start start 2023-11-18T21:00:38.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.484+0000 7f48021db640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47fc0c3260 0x7f47fc1448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.484+0000 7f48021db640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47fc0c4ce0 0x7f47fc0c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.484+0000 7f48021db640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47fc159870 0x7f47fc1478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.484+0000 7f48021db640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc1582a0 con 0x7f47fc159870 2023-11-18T21:00:38.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.484+0000 7f48021db640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc148c10 con 0x7f47fc0c3260 2023-11-18T21:00:38.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.484+0000 7f48021db640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc146360 con 0x7f47fc0c4ce0 2023-11-18T21:00:38.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.484+0000 7f47fbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47fc159870 0x7f47fc1478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.484+0000 7f47faffd640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47fc0c4ce0 0x7f47fc0c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.484+0000 7f47fbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47fc159870 0x7f47fc1478f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46412/0 (socket says 172.21.15.49:46412) 2023-11-18T21:00:38.484 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.484+0000 7f47fbfff640 1 -- 172.21.15.49:0/134018619 learned_addr learned my addr 172.21.15.49:0/134018619 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:38.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.488+0000 7f47fbfff640 1 -- 172.21.15.49:0/134018619 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47fc0c4ce0 msgr2=0x7f47fc0c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:38.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.488+0000 7f47fbfff640 1 --2- 172.21.15.49:0/134018619 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47fc0c4ce0 0x7f47fc0c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.488+0000 7f47fbfff640 1 -- 172.21.15.49:0/134018619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47fc0c3260 msgr2=0x7f47fc1448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:38.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.488+0000 7f47fbfff640 1 --2- 172.21.15.49:0/134018619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47fc0c3260 0x7f47fc1448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.488+0000 7f47fbfff640 1 -- 172.21.15.49:0/134018619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec009b30 con 0x7f47fc159870 2023-11-18T21:00:38.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.492+0000 7f47fbfff640 1 --2- 172.21.15.49:0/134018619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47fc159870 0x7f47fc1478f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f47ec01d870 tx=0x7f47ec01bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:38.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.496+0000 7f47e3fff640 1 -- 172.21.15.49:0/134018619 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0afcb0 con 0x7f47fc159870 2023-11-18T21:00:38.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.496+0000 7f47e3fff640 1 -- 172.21.15.49:0/134018619 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec0afe10 con 0x7f47fc159870 2023-11-18T21:00:38.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.496+0000 7f47e3fff640 1 -- 172.21.15.49:0/134018619 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0b9650 con 0x7f47fc159870 2023-11-18T21:00:38.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.496+0000 7f48021db640 1 -- 172.21.15.49:0/134018619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47fc146080 con 0x7f47fc159870 2023-11-18T21:00:38.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.496+0000 7f48021db640 1 -- 172.21.15.49:0/134018619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47fc144e30 con 0x7f47fc159870 2023-11-18T21:00:38.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.500+0000 7f480530a000 1 Processor -- start 2023-11-18T21:00:38.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.500+0000 7f480530a000 1 -- start start 2023-11-18T21:00:38.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.500+0000 7f480530a000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1fa9930 0x5571a1fa9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.500+0000 7f480530a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fae9f0 0x5571a1faedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.500+0000 7f480530a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1faf310 0x5571a1faf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.500+0000 7f480530a000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a1dd8130 con 0x5571a1fa9930 2023-11-18T21:00:38.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.500+0000 7f480530a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a1dc59a0 con 0x5571a1fae9f0 2023-11-18T21:00:38.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.500+0000 7f480530a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571a1dc2ed0 con 0x5571a1faf310 2023-11-18T21:00:38.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.500+0000 7f47fb7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fae9f0 0x5571a1faedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.500+0000 7f47faffd640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1faf310 0x5571a1faf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.500+0000 7f47fb7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fae9f0 0x5571a1faedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:53230/0 (socket says 172.21.15.49:53230) 2023-11-18T21:00:38.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.500+0000 7f47fb7fe640 1 -- 172.21.15.49:0/2609768354 learned_addr learned my addr 172.21.15.49:0/2609768354 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:38.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.504+0000 7f47faffd640 1 --2- 172.21.15.49:0/2609768354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1fa9930 0x5571a1fa9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.508+0000 7f47fb7fe640 1 -- 172.21.15.49:0/2609768354 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1faf310 msgr2=0x5571a1faf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:38.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.508+0000 7f47fb7fe640 1 --2- 172.21.15.49:0/2609768354 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1faf310 0x5571a1faf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.508+0000 7f47fb7fe640 1 -- 172.21.15.49:0/2609768354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1fa9930 msgr2=0x5571a1fa9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:38.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.508+0000 7f47fb7fe640 1 --2- 172.21.15.49:0/2609768354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1fa9930 0x5571a1fa9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.508+0000 7f47fb7fe640 1 -- 172.21.15.49:0/2609768354 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571a1ab6890 con 0x5571a1fae9f0 2023-11-18T21:00:38.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.512+0000 7f47fb7fe640 1 --2- 172.21.15.49:0/2609768354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fae9f0 0x5571a1faedd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f47f4001690 tx=0x7f47f4001b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c68e33ea29cb512 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:38.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.516+0000 7f47e3fff640 1 -- 172.21.15.49:0/134018619 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f47ec0b6070 con 0x7f47fc159870 2023-11-18T21:00:38.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.516+0000 7f47e3fff640 1 --2- 172.21.15.49:0/134018619 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f47e80664c0 0x7f47e8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.516+0000 7f47faffd640 1 --2- 172.21.15.49:0/134018619 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f47e80664c0 0x7f47e8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.520+0000 7f47faffd640 1 --2- 172.21.15.49:0/134018619 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f47e80664c0 0x7f47e8068980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f47f0006aa0 tx=0x7f47f0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:38.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.520+0000 7f47e3fff640 1 -- 172.21.15.49:0/134018619 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f47ec0f3420 con 0x7f47fc159870 2023-11-18T21:00:38.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.524+0000 7f47e17fa640 1 -- 172.21.15.49:0/2609768354 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400c6c0 con 0x5571a1fae9f0 2023-11-18T21:00:38.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.524+0000 7f47e17fa640 1 -- 172.21.15.49:0/2609768354 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f400c820 con 0x5571a1fae9f0 2023-11-18T21:00:38.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.524+0000 7f47e17fa640 1 -- 172.21.15.49:0/2609768354 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400cc10 con 0x5571a1fae9f0 2023-11-18T21:00:38.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.524+0000 7f480530a000 1 -- 172.21.15.49:0/2609768354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fae9f0 msgr2=0x5571a1faedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:38.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.524+0000 7f480530a000 1 --2- 172.21.15.49:0/2609768354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fae9f0 0x5571a1faedd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f47f4001690 tx=0x7f47f4001b50 comp rx=0 tx=0).stop 2023-11-18T21:00:38.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.524+0000 7f480530a000 1 -- 172.21.15.49:0/2609768354 shutdown_connections 2023-11-18T21:00:38.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.524+0000 7f480530a000 1 --2- 172.21.15.49:0/2609768354 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1faf310 0x5571a1faf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.524+0000 7f480530a000 1 --2- 172.21.15.49:0/2609768354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fae9f0 0x5571a1faedd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.524+0000 7f480530a000 1 --2- 172.21.15.49:0/2609768354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1fa9930 0x5571a1fa9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.524+0000 7f480530a000 1 -- 172.21.15.49:0/2609768354 >> 172.21.15.49:0/2609768354 conn(0x5571a1faa7a0 msgr2=0x5571a1facb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:38.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f480530a000 1 -- 172.21.15.49:0/2609768354 shutdown_connections 2023-11-18T21:00:38.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f480530a000 1 -- 172.21.15.49:0/2609768354 wait complete. 2023-11-18T21:00:38.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f480530a000 1 -- start start 2023-11-18T21:00:38.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f480530a000 1 Processor -- start 2023-11-18T21:00:38.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f480530a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fa9930 0x5571a1fa8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f480530a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fae9f0 0x5571a1fa9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f480530a000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1faf310 0x5571a1fb8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f480530a000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a1dbe7c0 con 0x5571a1faf310 2023-11-18T21:00:38.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f480530a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a1d76bf0 con 0x5571a1fae9f0 2023-11-18T21:00:38.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f480530a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571a1d7ca90 con 0x5571a1fa9930 2023-11-18T21:00:38.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f480530a000 10 client.0 _ll_register_callbacks cb 0x5571a1f593c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T21:00:38.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f47fbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1faf310 0x5571a1fb8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f47fbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1faf310 0x5571a1fb8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46428/0 (socket says 172.21.15.49:46428) 2023-11-18T21:00:38.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f47fbfff640 1 -- 172.21.15.49:0/3054834815 learned_addr learned my addr 172.21.15.49:0/3054834815 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:38.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.528+0000 7f47fb7fe640 1 --2- 172.21.15.49:0/3054834815 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fa9930 0x5571a1fa8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.532+0000 7f47faffd640 1 --2- 172.21.15.49:0/3054834815 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fae9f0 0x5571a1fa9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.532+0000 7f47fbfff640 1 -- 172.21.15.49:0/3054834815 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fa9930 msgr2=0x5571a1fa8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:38.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.532+0000 7f47fbfff640 1 --2- 172.21.15.49:0/3054834815 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fa9930 0x5571a1fa8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.532+0000 7f47fbfff640 1 -- 172.21.15.49:0/3054834815 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fae9f0 msgr2=0x5571a1fa9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:38.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.532+0000 7f47fbfff640 1 --2- 172.21.15.49:0/3054834815 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fae9f0 0x5571a1fa9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.532+0000 7f47fbfff640 1 -- 172.21.15.49:0/3054834815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f40012c0 con 0x5571a1faf310 2023-11-18T21:00:38.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.536+0000 7f47fbfff640 1 --2- 172.21.15.49:0/3054834815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1faf310 0x5571a1fb8990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0faaf0 tx=0x7f47ec0f2e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b092647ff3c4632 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:38.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.536+0000 7f47da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-18T21:00:38.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.540+0000 7f47da7fc640 1 -- 172.21.15.49:0/3054834815 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0fada0 con 0x5571a1faf310 2023-11-18T21:00:38.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.540+0000 7f47da7fc640 1 -- 172.21.15.49:0/3054834815 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f47ec0f7bb0 con 0x5571a1faf310 2023-11-18T21:00:38.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.540+0000 7f480530a000 1 -- 172.21.15.49:0/3054834815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571a1d80470 con 0x5571a1faf310 2023-11-18T21:00:38.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.540+0000 7f47da7fc640 1 -- 172.21.15.49:0/3054834815 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47ec0f7d70 con 0x5571a1faf310 2023-11-18T21:00:38.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.540+0000 7f480530a000 10 client.4620 fetch_fsmap learned FSMap version 20 2023-11-18T21:00:38.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.540+0000 7f480530a000 1 -- 172.21.15.49:0/3054834815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x5571a1d7f190 con 0x5571a1faf310 2023-11-18T21:00:38.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.544+0000 7f47da7fc640 1 -- 172.21.15.49:0/3054834815 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5571a1d80470 con 0x5571a1faf310 2023-11-18T21:00:38.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.544+0000 7f47da7fc640 1 -- 172.21.15.49:0/3054834815 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f47ec005d20 con 0x5571a1faf310 2023-11-18T21:00:38.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.544+0000 7f480530a000 10 client.4620 fetch_fsmap finished waiting for FSMap version 20 2023-11-18T21:00:38.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.544+0000 7f480530a000 10 client.4620 resolve_mds: resolved name 'f' to daemon mds.f 2023-11-18T21:00:38.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.544+0000 7f480530a000 20 client.4620 populate_metadata read hostname 'smithi049' 2023-11-18T21:00:38.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.544+0000 7f480530a000 1 --2- 172.21.15.49:0/3054834815 >> [v2:172.21.15.106:6836/2839781261,v1:172.21.15.106:6837/2839781261] conn(0x5571a1fb96d0 0x5571a1fb9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.544+0000 7f480530a000 4 client.4620 mds_command: new command op to 4235 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-18T21:00:38.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.544+0000 7f480530a000 1 -- 172.21.15.49:0/3054834815 --> [v2:172.21.15.106:6836/2839781261,v1:172.21.15.106:6837/2839781261] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571a1d83b50 con 0x5571a1fb96d0 2023-11-18T21:00:38.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.548+0000 7f47fb7fe640 1 --2- 172.21.15.49:0/3054834815 >> [v2:172.21.15.106:6836/2839781261,v1:172.21.15.106:6837/2839781261] conn(0x5571a1fb96d0 0x5571a1fb9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.624+0000 7f47fb7fe640 1 --2- 172.21.15.49:0/3054834815 >> [v2:172.21.15.106:6836/2839781261,v1:172.21.15.106:6837/2839781261] conn(0x5571a1fb96d0 0x5571a1fb9ab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5c3ded6f5a6815f2 server_cookie=97ea25c83b06ecd4 in_seq=0 out_seq=0 2023-11-18T21:00:38.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.624+0000 7f47da7fc640 10 client.4620 ms_handle_connect on v2:172.21.15.106:6836/2839781261 2023-11-18T21:00:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.816+0000 7f47da7fc640 1 -- 172.21.15.49:0/3054834815 <== mds.2 v2:172.21.15.106:6836/2839781261 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5571a1d83b50 con 0x5571a1fb96d0 2023-11-18T21:00:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.816+0000 7f47da7fc640 10 client.4620 handle_command_reply: tid=0 2023-11-18T21:00:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.820+0000 7f480530a000 1 client.4620 shutdown 2023-11-18T21:00:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.820+0000 7f480530a000 1 -- 172.21.15.49:0/3054834815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1faf310 msgr2=0x5571a1fb8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.820+0000 7f480530a000 1 --2- 172.21.15.49:0/3054834815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1faf310 0x5571a1fb8990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0faaf0 tx=0x7f47ec0f2e60 comp rx=0 tx=0).stop 2023-11-18T21:00:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.820+0000 7f480530a000 1 -- 172.21.15.49:0/3054834815 shutdown_connections 2023-11-18T21:00:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.820+0000 7f480530a000 1 --2- 172.21.15.49:0/3054834815 >> [v2:172.21.15.106:6836/2839781261,v1:172.21.15.106:6837/2839781261] conn(0x5571a1fb96d0 0x5571a1fb9ab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.820+0000 7f480530a000 1 --2- 172.21.15.49:0/3054834815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1faf310 0x5571a1fb8990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.820+0000 7f480530a000 1 --2- 172.21.15.49:0/3054834815 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fae9f0 0x5571a1fa9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.820+0000 7f480530a000 1 --2- 172.21.15.49:0/3054834815 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fa9930 0x5571a1fa8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.820+0000 7f480530a000 1 -- 172.21.15.49:0/3054834815 >> 172.21.15.49:0/3054834815 conn(0x5571a1faa7a0 msgr2=0x5571a1f73ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:38.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.820+0000 7f47da7fc640 0 client.4620 ms_handle_reset on v2:172.21.15.106:6836/2839781261 2023-11-18T21:00:38.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.820+0000 7f480530a000 1 -- 172.21.15.49:0/3054834815 shutdown_connections 2023-11-18T21:00:38.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.820+0000 7f480530a000 1 -- 172.21.15.49:0/3054834815 wait complete. 2023-11-18T21:00:38.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.820+0000 7f480530a000 20 client.4620 trim_cache size 0 max 16384 2023-11-18T21:00:38.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.864+0000 7f480530a000 1 Processor -- start 2023-11-18T21:00:38.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.864+0000 7f480530a000 1 -- start start 2023-11-18T21:00:38.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.864+0000 7f480530a000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1faa7a0 0x5571a200abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.864+0000 7f480530a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fa9930 0x5571a200b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.864+0000 7f480530a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fae9f0 0x5571a200b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.864+0000 7f480530a000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a1a77940 con 0x5571a1faa7a0 2023-11-18T21:00:38.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.864+0000 7f480530a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a1d598a0 con 0x5571a1fa9930 2023-11-18T21:00:38.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.864+0000 7f480530a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571a1dba130 con 0x5571a1fae9f0 2023-11-18T21:00:38.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.868+0000 7f47fb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1faa7a0 0x5571a200abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.868+0000 7f47fb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1faa7a0 0x5571a200abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46432/0 (socket says 172.21.15.49:46432) 2023-11-18T21:00:38.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.868+0000 7f47fb7fe640 1 -- 172.21.15.49:0/2377367038 learned_addr learned my addr 172.21.15.49:0/2377367038 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:38.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.868+0000 7f47fbfff640 1 --2- 172.21.15.49:0/2377367038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fae9f0 0x5571a200b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.868+0000 7f47faffd640 1 --2- 172.21.15.49:0/2377367038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fa9930 0x5571a200b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.872+0000 7f47fb7fe640 1 -- 172.21.15.49:0/2377367038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fae9f0 msgr2=0x5571a200b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:38.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.872+0000 7f47fb7fe640 1 --2- 172.21.15.49:0/2377367038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fae9f0 0x5571a200b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.872+0000 7f47fb7fe640 1 -- 172.21.15.49:0/2377367038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fa9930 msgr2=0x5571a200b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:38.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.872+0000 7f47fb7fe640 1 --2- 172.21.15.49:0/2377367038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fa9930 0x5571a200b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.872+0000 7f47fb7fe640 1 -- 172.21.15.49:0/2377367038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571a1d65490 con 0x5571a1faa7a0 2023-11-18T21:00:38.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.876+0000 7f47fb7fe640 1 --2- 172.21.15.49:0/2377367038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1faa7a0 0x5571a200abf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f47f40015b0 tx=0x7f47f4009050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc3f653edb2e079 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:38.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.880+0000 7f47e1ffb640 1 -- 172.21.15.49:0/2377367038 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f40053c0 con 0x5571a1faa7a0 2023-11-18T21:00:38.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.880+0000 7f47e1ffb640 1 -- 172.21.15.49:0/2377367038 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f4025b00 con 0x5571a1faa7a0 2023-11-18T21:00:38.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.880+0000 7f47e1ffb640 1 -- 172.21.15.49:0/2377367038 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4025e90 con 0x5571a1faa7a0 2023-11-18T21:00:38.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.884+0000 7f480530a000 1 -- 172.21.15.49:0/2377367038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1faa7a0 msgr2=0x5571a200abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:38.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.884+0000 7f480530a000 1 --2- 172.21.15.49:0/2377367038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1faa7a0 0x5571a200abf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f47f40015b0 tx=0x7f47f4009050 comp rx=0 tx=0).stop 2023-11-18T21:00:38.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.884+0000 7f480530a000 1 -- 172.21.15.49:0/2377367038 shutdown_connections 2023-11-18T21:00:38.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.884+0000 7f480530a000 1 --2- 172.21.15.49:0/2377367038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fae9f0 0x5571a200b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.884+0000 7f480530a000 1 --2- 172.21.15.49:0/2377367038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1fa9930 0x5571a200b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.884+0000 7f480530a000 1 --2- 172.21.15.49:0/2377367038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1faa7a0 0x5571a200abf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.884+0000 7f480530a000 1 -- 172.21.15.49:0/2377367038 >> 172.21.15.49:0/2377367038 conn(0x5571a1fada90 msgr2=0x5571a1f72240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:38.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.884+0000 7f480530a000 1 -- 172.21.15.49:0/2377367038 shutdown_connections 2023-11-18T21:00:38.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.884+0000 7f480530a000 1 -- 172.21.15.49:0/2377367038 wait complete. 2023-11-18T21:00:38.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.884+0000 7f480530a000 1 -- start start 2023-11-18T21:00:38.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.884+0000 7f480530a000 1 Processor -- start 2023-11-18T21:00:38.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.888+0000 7f480530a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fa9930 0x5571a1f714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.888+0000 7f480530a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1faa7a0 0x5571a200fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.888+0000 7f480530a000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1fae9f0 0x5571a2010390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.888+0000 7f480530a000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a1dbbfd0 con 0x5571a1fae9f0 2023-11-18T21:00:38.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.888+0000 7f480530a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a1d7d8f0 con 0x5571a1faa7a0 2023-11-18T21:00:38.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.888+0000 7f480530a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571a1f73dd0 con 0x5571a1fa9930 2023-11-18T21:00:38.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.888+0000 7f480530a000 10 client.0 _ll_register_callbacks cb 0x5571a1f39bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T21:00:38.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.888+0000 7f47fbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1fae9f0 0x5571a2010390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.888+0000 7f47fbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1fae9f0 0x5571a2010390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46436/0 (socket says 172.21.15.49:46436) 2023-11-18T21:00:38.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.888+0000 7f47fbfff640 1 -- 172.21.15.49:0/2459657529 learned_addr learned my addr 172.21.15.49:0/2459657529 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:38.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.888+0000 7f47faffd640 1 --2- 172.21.15.49:0/2459657529 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1faa7a0 0x5571a200fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.888+0000 7f47fb7fe640 1 --2- 172.21.15.49:0/2459657529 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fa9930 0x5571a1f714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.892+0000 7f47fbfff640 1 -- 172.21.15.49:0/2459657529 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fa9930 msgr2=0x5571a1f714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:38.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.892+0000 7f47fbfff640 1 --2- 172.21.15.49:0/2459657529 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fa9930 0x5571a1f714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.892+0000 7f47fbfff640 1 -- 172.21.15.49:0/2459657529 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1faa7a0 msgr2=0x5571a200fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:38.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.892+0000 7f47fbfff640 1 --2- 172.21.15.49:0/2459657529 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1faa7a0 0x5571a200fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.892+0000 7f47fbfff640 1 -- 172.21.15.49:0/2459657529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5571a1ab6890 con 0x5571a1fae9f0 2023-11-18T21:00:38.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.896+0000 7f47fbfff640 1 --2- 172.21.15.49:0/2459657529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1fae9f0 0x5571a2010390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009560 tx=0x7f47ec009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459b578a1cb439e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:38.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.896+0000 7f47da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-18T21:00:38.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.900+0000 7f47da7fc640 1 -- 172.21.15.49:0/2459657529 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0eeea0 con 0x5571a1fae9f0 2023-11-18T21:00:38.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.900+0000 7f47da7fc640 1 -- 172.21.15.49:0/2459657529 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f47ec0f1c80 con 0x5571a1fae9f0 2023-11-18T21:00:38.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.900+0000 7f480530a000 1 -- 172.21.15.49:0/2459657529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571a1dbd110 con 0x5571a1fae9f0 2023-11-18T21:00:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.904+0000 7f47da7fc640 1 -- 172.21.15.49:0/2459657529 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47ec0f1e60 con 0x5571a1fae9f0 2023-11-18T21:00:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.904+0000 7f480530a000 10 client.4626 fetch_fsmap learned FSMap version 20 2023-11-18T21:00:38.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.904+0000 7f480530a000 1 -- 172.21.15.49:0/2459657529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x5571a1ab6cc0 con 0x5571a1fae9f0 2023-11-18T21:00:38.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.912+0000 7f47da7fc640 1 -- 172.21.15.49:0/2459657529 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5571a1dbd110 con 0x5571a1fae9f0 2023-11-18T21:00:38.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.912+0000 7f47da7fc640 1 -- 172.21.15.49:0/2459657529 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f47ec005d20 con 0x5571a1fae9f0 2023-11-18T21:00:38.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.912+0000 7f480530a000 10 client.4626 fetch_fsmap finished waiting for FSMap version 20 2023-11-18T21:00:38.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.912+0000 7f480530a000 10 client.4626 resolve_mds: resolved name 'f' to daemon mds.f 2023-11-18T21:00:38.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.912+0000 7f480530a000 20 client.4626 populate_metadata read hostname 'smithi049' 2023-11-18T21:00:38.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.912+0000 7f480530a000 1 --2- 172.21.15.49:0/2459657529 >> [v2:172.21.15.106:6836/2839781261,v1:172.21.15.106:6837/2839781261] conn(0x5571a1faf310 0x5571a200a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:38.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.912+0000 7f480530a000 4 client.4626 mds_command: new command op to 4235 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-18T21:00:38.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.912+0000 7f480530a000 1 -- 172.21.15.49:0/2459657529 --> [v2:172.21.15.106:6836/2839781261,v1:172.21.15.106:6837/2839781261] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5571a1dec9a0 con 0x5571a1faf310 2023-11-18T21:00:38.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.916+0000 7f47fb7fe640 1 --2- 172.21.15.49:0/2459657529 >> [v2:172.21.15.106:6836/2839781261,v1:172.21.15.106:6837/2839781261] conn(0x5571a1faf310 0x5571a200a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:38.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.924+0000 7f47fb7fe640 1 --2- 172.21.15.49:0/2459657529 >> [v2:172.21.15.106:6836/2839781261,v1:172.21.15.106:6837/2839781261] conn(0x5571a1faf310 0x5571a200a9e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ac700a432da5fe6f server_cookie=82e76b1642b3882d in_seq=0 out_seq=0 2023-11-18T21:00:38.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.924+0000 7f47da7fc640 10 client.4626 ms_handle_connect on v2:172.21.15.106:6836/2839781261 2023-11-18T21:00:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f47da7fc640 1 -- 172.21.15.49:0/2459657529 <== mds.2 v2:172.21.15.106:6836/2839781261 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5571a1dec9a0 con 0x5571a1faf310 2023-11-18T21:00:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f47da7fc640 10 client.4626 handle_command_reply: tid=0 2023-11-18T21:00:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f480530a000 1 client.4626 shutdown 2023-11-18T21:00:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f480530a000 1 -- 172.21.15.49:0/2459657529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1fae9f0 msgr2=0x5571a2010390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f480530a000 1 --2- 172.21.15.49:0/2459657529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1fae9f0 0x5571a2010390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009560 tx=0x7f47ec009810 comp rx=0 tx=0).stop 2023-11-18T21:00:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f480530a000 1 -- 172.21.15.49:0/2459657529 shutdown_connections 2023-11-18T21:00:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f480530a000 1 --2- 172.21.15.49:0/2459657529 >> [v2:172.21.15.106:6836/2839781261,v1:172.21.15.106:6837/2839781261] conn(0x5571a1faf310 0x5571a200a9e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f480530a000 1 --2- 172.21.15.49:0/2459657529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5571a1fae9f0 0x5571a2010390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f480530a000 1 --2- 172.21.15.49:0/2459657529 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571a1faa7a0 0x5571a200fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f480530a000 1 --2- 172.21.15.49:0/2459657529 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5571a1fa9930 0x5571a1f714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f480530a000 1 -- 172.21.15.49:0/2459657529 >> 172.21.15.49:0/2459657529 conn(0x5571a1fada90 msgr2=0x5571a1fa91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f47da7fc640 0 client.4626 ms_handle_reset on v2:172.21.15.106:6836/2839781261 2023-11-18T21:00:38.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f480530a000 1 -- 172.21.15.49:0/2459657529 shutdown_connections 2023-11-18T21:00:38.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f480530a000 1 -- 172.21.15.49:0/2459657529 wait complete. 2023-11-18T21:00:38.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f480530a000 20 client.4626 trim_cache size 0 max 16384 2023-11-18T21:00:38.950 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T21:00:38.950 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "4b788c4a-a91a-4c5d-8f44-e74d82d94e56", 2023-11-18T21:00:38.950 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 2, 2023-11-18T21:00:38.951 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4235, 2023-11-18T21:00:38.951 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-18T21:00:38.951 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-18T21:00:38.951 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-18T21:00:38.951 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 22.692473367000002, 2023-11-18T21:00:38.951 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 20, 2023-11-18T21:00:38.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 31, 2023-11-18T21:00:38.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 29, 2023-11-18T21:00:38.951 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 89.564525703000001 2023-11-18T21:00:38.951 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T21:00:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f48021db640 1 -- 172.21.15.49:0/134018619 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f47e80664c0 msgr2=0x7f47e8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f48021db640 1 --2- 172.21.15.49:0/134018619 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f47e80664c0 0x7f47e8068980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f47f0006aa0 tx=0x7f47f0009190 comp rx=0 tx=0).stop 2023-11-18T21:00:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f48021db640 1 -- 172.21.15.49:0/134018619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47fc159870 msgr2=0x7f47fc1478f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.948+0000 7f48021db640 1 --2- 172.21.15.49:0/134018619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47fc159870 0x7f47fc1478f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f47ec01d870 tx=0x7f47ec01bf60 comp rx=0 tx=0).stop 2023-11-18T21:00:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.952+0000 7f48021db640 1 -- 172.21.15.49:0/134018619 shutdown_connections 2023-11-18T21:00:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.952+0000 7f48021db640 1 --2- 172.21.15.49:0/134018619 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f47e80664c0 0x7f47e8068980 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.952+0000 7f48021db640 1 --2- 172.21.15.49:0/134018619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f47fc159870 0x7f47fc1478f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.952+0000 7f48021db640 1 --2- 172.21.15.49:0/134018619 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47fc0c4ce0 0x7f47fc0c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.952+0000 7f48021db640 1 --2- 172.21.15.49:0/134018619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47fc0c3260 0x7f47fc1448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:38.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.952+0000 7f48021db640 1 -- 172.21.15.49:0/134018619 >> 172.21.15.49:0/134018619 conn(0x7f47fc0713a0 msgr2=0x7f47fc071780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:38.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.952+0000 7f48021db640 1 -- 172.21.15.49:0/134018619 shutdown_connections 2023-11-18T21:00:38.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:38.952+0000 7f48021db640 1 -- 172.21.15.49:0/134018619 wait complete. 2023-11-18T21:00:38.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-18T21:00:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.108+0000 7fe5b3b51640 1 Processor -- start 2023-11-18T21:00:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.108+0000 7fe5b3b51640 1 -- start start 2023-11-18T21:00:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.108+0000 7fe5b3b51640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5ac157b30 0x7fe5ac06b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.108+0000 7fe5b3b51640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ac06bcd0 con 0x7fe5ac0c7cd0 2023-11-18T21:00:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.108+0000 7fe5b3b51640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ac0c2b50 con 0x7fe5ac1611b0 2023-11-18T21:00:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.108+0000 7fe5b3b51640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac160d60 con 0x7fe5ac157b30 2023-11-18T21:00:39.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.108+0000 7fe5b10ec640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe5ac0c7cd0 0x7fe5ac0ccad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50660/0 (socket says 172.21.15.49:50660) 2023-11-18T21:00:39.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.108+0000 7fe5b10ec640 1 -- 172.21.15.49:0/2491827117 learned_addr learned my addr 172.21.15.49:0/2491827117 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:39.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.112+0000 7fe5b18ed640 1 --2- 172.21.15.49:0/2491827117 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5ac157b30 0x7fe5ac06b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.112+0000 7fe5b08eb640 1 -- 172.21.15.49:0/2491827117 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076901300 0 0) 0x7fe5ac06bcd0 con 0x7fe5ac0c7cd0 2023-11-18T21:00:39.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.112+0000 7fe5b08eb640 1 -- 172.21.15.49:0/2491827117 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe598003530 con 0x7fe5ac0c7cd0 2023-11-18T21:00:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.116+0000 7fe5b08eb640 1 -- 172.21.15.49:0/2491827117 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1917734203 0 0) 0x7fe598003530 con 0x7fe5ac0c7cd0 2023-11-18T21:00:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.116+0000 7fe5b08eb640 1 -- 172.21.15.49:0/2491827117 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5ac157b30 msgr2=0x7fe5ac06b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.116+0000 7fe5b08eb640 1 --2- 172.21.15.49:0/2491827117 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5ac157b30 0x7fe5ac06b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.116+0000 7fe5b08eb640 1 -- 172.21.15.49:0/2491827117 >> v1:172.21.15.106:6789/0 conn(0x7fe5ac1611b0 legacy=0x7fe5ac161640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.116+0000 7fe5b08eb640 1 -- 172.21.15.49:0/2491827117 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac0c2e10 con 0x7fe5ac0c7cd0 2023-11-18T21:00:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.116+0000 7fe5b08eb640 1 -- 172.21.15.49:0/2491827117 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7fe5a8001680 con 0x7fe5ac0c7cd0 2023-11-18T21:00:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.116+0000 7fe5b08eb640 1 -- 172.21.15.49:0/2491827117 >> v1:172.21.15.49:6789/0 conn(0x7fe5ac0c7cd0 legacy=0x7fe5ac0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.116+0000 7fe5b08eb640 1 --2- 172.21.15.49:0/2491827117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe598003a20 0x7fe598003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.116+0000 7fe5b08eb640 1 --2- 172.21.15.49:0/2491827117 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5ac157b30 0x7fe5980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.116+0000 7fe5b08eb640 1 --2- 172.21.15.49:0/2491827117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe598004d10 0x7fe598005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.116+0000 7fe5b08eb640 1 -- 172.21.15.49:0/2491827117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac160d60 con 0x7fe598004d10 2023-11-18T21:00:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.116+0000 7fe5b08eb640 1 -- 172.21.15.49:0/2491827117 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59800bb70 con 0x7fe598003a20 2023-11-18T21:00:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.116+0000 7fe5b08eb640 1 -- 172.21.15.49:0/2491827117 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59800bd30 con 0x7fe5ac157b30 2023-11-18T21:00:39.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.120+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/2491827117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe598004d10 0x7fe598005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.120+0000 7fe5b18ed640 1 --2- 172.21.15.49:0/2491827117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe598003a20 0x7fe598003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.124+0000 7fe5b10ec640 1 --2- 172.21.15.49:0/2491827117 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5ac157b30 0x7fe5980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.124+0000 7fe5b20ee640 1 -- 172.21.15.49:0/2491827117 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5ac157b30 msgr2=0x7fe5980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.124+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/2491827117 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5ac157b30 0x7fe5980047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.124+0000 7fe5b20ee640 1 -- 172.21.15.49:0/2491827117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe598003a20 msgr2=0x7fe598003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.124+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/2491827117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe598003a20 0x7fe598003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.124+0000 7fe5b20ee640 1 -- 172.21.15.49:0/2491827117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe598003530 con 0x7fe598004d10 2023-11-18T21:00:39.128 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.128+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/2491827117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe598004d10 0x7fe598005190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4001e70 tx=0x7fe5a401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f762dd3499c99e91 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:39.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.132+0000 7fe5b08eb640 1 -- 172.21.15.49:0/2491827117 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4003b80 con 0x7fe598004d10 2023-11-18T21:00:39.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.132+0000 7fe5b08eb640 1 -- 172.21.15.49:0/2491827117 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a4003ce0 con 0x7fe598004d10 2023-11-18T21:00:39.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.132+0000 7fe5b08eb640 1 -- 172.21.15.49:0/2491827117 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a40052c0 con 0x7fe598004d10 2023-11-18T21:00:39.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b3b51640 1 -- 172.21.15.49:0/2491827117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe598004d10 msgr2=0x7fe598005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b3b51640 1 --2- 172.21.15.49:0/2491827117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe598004d10 0x7fe598005190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4001e70 tx=0x7fe5a401c760 comp rx=0 tx=0).stop 2023-11-18T21:00:39.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b20ee640 1 -- 172.21.15.49:0/2491827117 reap_dead start 2023-11-18T21:00:39.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b3b51640 1 -- 172.21.15.49:0/2491827117 shutdown_connections 2023-11-18T21:00:39.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b3b51640 1 -- 172.21.15.49:0/2491827117 >> 172.21.15.49:0/2491827117 conn(0x7fe5ac0708a0 msgr2=0x7fe5ac070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:39.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b3b51640 1 -- 172.21.15.49:0/2491827117 shutdown_connections 2023-11-18T21:00:39.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b3b51640 1 -- 172.21.15.49:0/2491827117 wait complete. 2023-11-18T21:00:39.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b3b51640 1 Processor -- start 2023-11-18T21:00:39.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b3b51640 1 -- start start 2023-11-18T21:00:39.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b3b51640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5ac150620 0x7fe5ac0c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b3b51640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5ac150a00 0x7fe5ac0c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b3b51640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5ac0b2900 0x7fe5ac153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b3b51640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac1f4320 con 0x7fe5ac150620 2023-11-18T21:00:39.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b3b51640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac0c68b0 con 0x7fe5ac0b2900 2023-11-18T21:00:39.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b3b51640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac1f34d0 con 0x7fe5ac150a00 2023-11-18T21:00:39.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b18ed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5ac150620 0x7fe5ac0c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b18ed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5ac150620 0x7fe5ac0c52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46454/0 (socket says 172.21.15.49:46454) 2023-11-18T21:00:39.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b18ed640 1 -- 172.21.15.49:0/1373102256 learned_addr learned my addr 172.21.15.49:0/1373102256 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:39.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/1373102256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5ac0b2900 0x7fe5ac153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.136+0000 7fe5b10ec640 1 --2- 172.21.15.49:0/1373102256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5ac150a00 0x7fe5ac0c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.140+0000 7fe5b18ed640 1 -- 172.21.15.49:0/1373102256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5ac150a00 msgr2=0x7fe5ac0c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.140+0000 7fe5b18ed640 1 --2- 172.21.15.49:0/1373102256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5ac150a00 0x7fe5ac0c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.140+0000 7fe5b18ed640 1 -- 172.21.15.49:0/1373102256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5ac0b2900 msgr2=0x7fe5ac153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.140+0000 7fe5b18ed640 1 --2- 172.21.15.49:0/1373102256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5ac0b2900 0x7fe5ac153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.142 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.140+0000 7fe5b18ed640 1 -- 172.21.15.49:0/1373102256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac151e50 con 0x7fe5ac150620 2023-11-18T21:00:39.144 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.144+0000 7fe5b18ed640 1 --2- 172.21.15.49:0/1373102256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5ac150620 0x7fe5ac0c52f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0011960 tx=0x7fe5a0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:39.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.148+0000 7fe59e7fc640 1 -- 172.21.15.49:0/1373102256 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000faf0 con 0x7fe5ac150620 2023-11-18T21:00:39.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.148+0000 7fe59e7fc640 1 -- 172.21.15.49:0/1373102256 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a000fc50 con 0x7fe5ac150620 2023-11-18T21:00:39.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.148+0000 7fe5b3b51640 1 -- 172.21.15.49:0/1373102256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ac1f36e0 con 0x7fe5ac150620 2023-11-18T21:00:39.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.148+0000 7fe59e7fc640 1 -- 172.21.15.49:0/1373102256 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0014440 con 0x7fe5ac150620 2023-11-18T21:00:39.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.148+0000 7fe5b3b51640 1 -- 172.21.15.49:0/1373102256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ac1f3c60 con 0x7fe5ac150620 2023-11-18T21:00:39.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.152+0000 7fe5b6c80000 1 Processor -- start 2023-11-18T21:00:39.150 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.152+0000 7fe5b6c80000 1 -- start start 2023-11-18T21:00:39.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.152+0000 7fe5b6c80000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 0x557bd1239d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.152+0000 7fe5b6c80000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123e9f0 0x557bd123edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.152+0000 7fe5b6c80000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123f310 0x557bd123f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.152+0000 7fe5b6c80000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd1068130 con 0x557bd123e9f0 2023-11-18T21:00:39.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.152+0000 7fe5b6c80000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd10559a0 con 0x557bd1239930 2023-11-18T21:00:39.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.152+0000 7fe5b6c80000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x557bd1052ed0 con 0x557bd123f310 2023-11-18T21:00:39.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.152+0000 7fe5b20ee640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 0x557bd1239d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.152+0000 7fe5b20ee640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 0x557bd1239d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:53280/0 (socket says 172.21.15.49:53280) 2023-11-18T21:00:39.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.152+0000 7fe5b20ee640 1 -- 172.21.15.49:0/912086725 learned_addr learned my addr 172.21.15.49:0/912086725 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:39.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.156+0000 7fe5b10ec640 1 --2- 172.21.15.49:0/912086725 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123f310 0x557bd123f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.160+0000 7fe5b20ee640 1 -- 172.21.15.49:0/912086725 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123f310 msgr2=0x557bd123f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.160+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/912086725 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123f310 0x557bd123f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.160+0000 7fe5b20ee640 1 -- 172.21.15.49:0/912086725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123e9f0 msgr2=0x557bd123edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.160+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/912086725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123e9f0 0x557bd123edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.160+0000 7fe5b20ee640 1 -- 172.21.15.49:0/912086725 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bd0d46890 con 0x557bd1239930 2023-11-18T21:00:39.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.164+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/912086725 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 0x557bd1239d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe5a401c590 tx=0x7fe5a40014b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a945b1a798131aa server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:39.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.168+0000 7fe59e7fc640 1 -- 172.21.15.49:0/1373102256 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe5a00145a0 con 0x7fe5ac150620 2023-11-18T21:00:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.168+0000 7fe59e7fc640 1 --2- 172.21.15.49:0/1373102256 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe5900664c0 0x7fe590068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.168+0000 7fe5b18ed640 1 --2- 172.21.15.49:0/1373102256 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe5900664c0 0x7fe590068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.172+0000 7fe5b18ed640 1 --2- 172.21.15.49:0/1373102256 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe5900664c0 0x7fe590068980 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0000c10 tx=0x7fe5a0051b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:39.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.172+0000 7fe59e7fc640 1 -- 172.21.15.49:0/1373102256 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fe5a0055e60 con 0x7fe5ac150620 2023-11-18T21:00:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.176+0000 7fe58f7fe640 1 -- 172.21.15.49:0/912086725 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4003b80 con 0x557bd1239930 2023-11-18T21:00:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.176+0000 7fe58f7fe640 1 -- 172.21.15.49:0/912086725 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a4006b60 con 0x557bd1239930 2023-11-18T21:00:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.176+0000 7fe58f7fe640 1 -- 172.21.15.49:0/912086725 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4005080 con 0x557bd1239930 2023-11-18T21:00:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.176+0000 7fe5b6c80000 1 -- 172.21.15.49:0/912086725 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 msgr2=0x557bd1239d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.176+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/912086725 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 0x557bd1239d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe5a401c590 tx=0x7fe5a40014b0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.176+0000 7fe5b6c80000 1 -- 172.21.15.49:0/912086725 shutdown_connections 2023-11-18T21:00:39.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.176+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/912086725 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123f310 0x557bd123f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.176+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/912086725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123e9f0 0x557bd123edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.176+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/912086725 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 0x557bd1239d10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.176+0000 7fe5b6c80000 1 -- 172.21.15.49:0/912086725 >> 172.21.15.49:0/912086725 conn(0x557bd123a7a0 msgr2=0x557bd123cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:39.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.176+0000 7fe5b6c80000 1 -- 172.21.15.49:0/912086725 shutdown_connections 2023-11-18T21:00:39.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.176+0000 7fe5b6c80000 1 -- 172.21.15.49:0/912086725 wait complete. 2023-11-18T21:00:39.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.180+0000 7fe5b6c80000 1 -- start start 2023-11-18T21:00:39.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.180+0000 7fe5b6c80000 1 Processor -- start 2023-11-18T21:00:39.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.180+0000 7fe5b6c80000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 0x557bd1238d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.180+0000 7fe5b6c80000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 0x557bd1239250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.180+0000 7fe5b6c80000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123f310 0x557bd1248990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.180+0000 7fe5b6c80000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd104e7c0 con 0x557bd123f310 2023-11-18T21:00:39.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.180+0000 7fe5b6c80000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd1006bf0 con 0x557bd1239930 2023-11-18T21:00:39.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.180+0000 7fe5b6c80000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x557bd100ca90 con 0x557bd123e9f0 2023-11-18T21:00:39.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.180+0000 7fe5b6c80000 10 client.0 _ll_register_callbacks cb 0x557bd11e93c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T21:00:39.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.180+0000 7fe5b20ee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123f310 0x557bd1248990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.180+0000 7fe5b20ee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123f310 0x557bd1248990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46458/0 (socket says 172.21.15.49:46458) 2023-11-18T21:00:39.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.180+0000 7fe5b20ee640 1 -- 172.21.15.49:0/4059964896 learned_addr learned my addr 172.21.15.49:0/4059964896 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:39.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.180+0000 7fe5b10ec640 1 --2- 172.21.15.49:0/4059964896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 0x557bd1239250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.184+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/4059964896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 0x557bd1238d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.184+0000 7fe5b20ee640 1 -- 172.21.15.49:0/4059964896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 msgr2=0x557bd1239250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.184+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/4059964896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 0x557bd1239250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.184+0000 7fe5b20ee640 1 -- 172.21.15.49:0/4059964896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 msgr2=0x557bd1238d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.184+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/4059964896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 0x557bd1238d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.184+0000 7fe5b20ee640 1 -- 172.21.15.49:0/4059964896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe598003530 con 0x557bd123f310 2023-11-18T21:00:39.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.184+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/4059964896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123f310 0x557bd1248990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4001ce0 tx=0x7fe5a40a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726f300bf9bbc518 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:39.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.184+0000 7fe58cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-18T21:00:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.188+0000 7fe58cff9640 1 -- 172.21.15.49:0/4059964896 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4006b60 con 0x557bd123f310 2023-11-18T21:00:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.188+0000 7fe58cff9640 1 -- 172.21.15.49:0/4059964896 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fe5a4006cc0 con 0x557bd123f310 2023-11-18T21:00:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.188+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4059964896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557bd1010470 con 0x557bd123f310 2023-11-18T21:00:39.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.192+0000 7fe58cff9640 1 -- 172.21.15.49:0/4059964896 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5a4006e80 con 0x557bd123f310 2023-11-18T21:00:39.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.192+0000 7fe5b6c80000 10 client.4635 fetch_fsmap learned FSMap version 20 2023-11-18T21:00:39.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.192+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4059964896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x557bd100f190 con 0x557bd123f310 2023-11-18T21:00:39.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.196+0000 7fe58cff9640 1 -- 172.21.15.49:0/4059964896 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557bd1010470 con 0x557bd123f310 2023-11-18T21:00:39.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.196+0000 7fe58cff9640 1 -- 172.21.15.49:0/4059964896 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fe5a4005190 con 0x557bd123f310 2023-11-18T21:00:39.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.196+0000 7fe5b6c80000 10 client.4635 fetch_fsmap finished waiting for FSMap version 20 2023-11-18T21:00:39.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.196+0000 7fe5b6c80000 10 client.4635 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-18T21:00:39.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.196+0000 7fe5b6c80000 20 client.4635 populate_metadata read hostname 'smithi049' 2023-11-18T21:00:39.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.196+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/4059964896 >> [v2:172.21.15.106:6838/957974967,v1:172.21.15.106:6839/957974967] conn(0x557bd12496d0 0x557bd1249ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.196+0000 7fe5b6c80000 4 client.4635 mds_command: new command op to 4238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-18T21:00:39.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.196+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4059964896 --> [v2:172.21.15.106:6838/957974967,v1:172.21.15.106:6839/957974967] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557bd1013b50 con 0x557bd12496d0 2023-11-18T21:00:39.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.196+0000 7fe5b10ec640 1 --2- 172.21.15.49:0/4059964896 >> [v2:172.21.15.106:6838/957974967,v1:172.21.15.106:6839/957974967] conn(0x557bd12496d0 0x557bd1249ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.292+0000 7fe5b10ec640 1 --2- 172.21.15.49:0/4059964896 >> [v2:172.21.15.106:6838/957974967,v1:172.21.15.106:6839/957974967] conn(0x557bd12496d0 0x557bd1249ab0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ff5ec39b4f80f588 server_cookie=5b2ec2f9c94bae65 in_seq=0 out_seq=0 2023-11-18T21:00:39.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.292+0000 7fe58cff9640 10 client.4635 ms_handle_connect on v2:172.21.15.106:6838/957974967 2023-11-18T21:00:39.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe58cff9640 1 -- 172.21.15.49:0/4059964896 <== mds.1 v2:172.21.15.106:6838/957974967 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557bd1013b50 con 0x557bd12496d0 2023-11-18T21:00:39.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe58cff9640 10 client.4635 handle_command_reply: tid=0 2023-11-18T21:00:39.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe5b6c80000 1 client.4635 shutdown 2023-11-18T21:00:39.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4059964896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123f310 msgr2=0x557bd1248990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/4059964896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123f310 0x557bd1248990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4001ce0 tx=0x7fe5a40a7000 comp rx=0 tx=0).stop 2023-11-18T21:00:39.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4059964896 shutdown_connections 2023-11-18T21:00:39.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/4059964896 >> [v2:172.21.15.106:6838/957974967,v1:172.21.15.106:6839/957974967] conn(0x557bd12496d0 0x557bd1249ab0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/4059964896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123f310 0x557bd1248990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/4059964896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 0x557bd1239250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/4059964896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 0x557bd1238d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe58cff9640 0 client.4635 ms_handle_reset on v2:172.21.15.106:6838/957974967 2023-11-18T21:00:39.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4059964896 >> 172.21.15.49:0/4059964896 conn(0x557bd123a7a0 msgr2=0x557bd1203ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:39.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4059964896 shutdown_connections 2023-11-18T21:00:39.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4059964896 wait complete. 2023-11-18T21:00:39.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.480+0000 7fe5b6c80000 20 client.4635 trim_cache size 0 max 16384 2023-11-18T21:00:39.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.524+0000 7fe5b6c80000 1 Processor -- start 2023-11-18T21:00:39.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.524+0000 7fe5b6c80000 1 -- start start 2023-11-18T21:00:39.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.528+0000 7fe5b6c80000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd1239930 0x557bd124aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.528+0000 7fe5b6c80000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 0x557bd124b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.528+0000 7fe5b6c80000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd123f310 0x557bd1201de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.528+0000 7fe5b6c80000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd0d07940 con 0x557bd1239930 2023-11-18T21:00:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.528+0000 7fe5b6c80000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd0fd5a00 con 0x557bd123f310 2023-11-18T21:00:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.528+0000 7fe5b6c80000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x557bd104f070 con 0x557bd123e9f0 2023-11-18T21:00:39.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.528+0000 7fe5b20ee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd1239930 0x557bd124aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.528+0000 7fe5b20ee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd1239930 0x557bd124aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46470/0 (socket says 172.21.15.49:46470) 2023-11-18T21:00:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.528+0000 7fe5b20ee640 1 -- 172.21.15.49:0/3223879710 learned_addr learned my addr 172.21.15.49:0/3223879710 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.528+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/3223879710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd123f310 0x557bd1201de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.528+0000 7fe5b10ec640 1 --2- 172.21.15.49:0/3223879710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 0x557bd124b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.532+0000 7fe5b20ee640 1 -- 172.21.15.49:0/3223879710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 msgr2=0x557bd124b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.532+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/3223879710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 0x557bd124b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.532+0000 7fe5b20ee640 1 -- 172.21.15.49:0/3223879710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd123f310 msgr2=0x557bd1201de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.532+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/3223879710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd123f310 0x557bd1201de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.532+0000 7fe5b20ee640 1 -- 172.21.15.49:0/3223879710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bd0ff5490 con 0x557bd1239930 2023-11-18T21:00:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.532+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/3223879710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd1239930 0x557bd124aac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe5a401c7a0 tx=0x7fe5a40bf000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52f57a079892c86 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:39.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.540+0000 7fe58ffff640 1 -- 172.21.15.49:0/3223879710 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a40050e0 con 0x557bd1239930 2023-11-18T21:00:39.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.540+0000 7fe58ffff640 1 -- 172.21.15.49:0/3223879710 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a40bf070 con 0x557bd1239930 2023-11-18T21:00:39.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.540+0000 7fe58ffff640 1 -- 172.21.15.49:0/3223879710 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4006b60 con 0x557bd1239930 2023-11-18T21:00:39.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.540+0000 7fe5b6c80000 1 -- 172.21.15.49:0/3223879710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd1239930 msgr2=0x557bd124aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.540+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/3223879710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd1239930 0x557bd124aac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe5a401c7a0 tx=0x7fe5a40bf000 comp rx=0 tx=0).stop 2023-11-18T21:00:39.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 -- 172.21.15.49:0/3223879710 shutdown_connections 2023-11-18T21:00:39.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/3223879710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd123f310 0x557bd1201de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/3223879710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 0x557bd124b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/3223879710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd1239930 0x557bd124aac0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 -- 172.21.15.49:0/3223879710 >> 172.21.15.49:0/3223879710 conn(0x557bd123a7a0 msgr2=0x557bd1247730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:39.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 -- 172.21.15.49:0/3223879710 shutdown_connections 2023-11-18T21:00:39.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 -- 172.21.15.49:0/3223879710 wait complete. 2023-11-18T21:00:39.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 -- start start 2023-11-18T21:00:39.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 Processor -- start 2023-11-18T21:00:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 0x557bd129b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 0x557bd129b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123f310 0x557bd12010d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd100d8f0 con 0x557bd123f310 2023-11-18T21:00:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd104e7c0 con 0x557bd1239930 2023-11-18T21:00:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x557bd1017910 con 0x557bd123e9f0 2023-11-18T21:00:39.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b6c80000 10 client.0 _ll_register_callbacks cb 0x557bd11c9bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T21:00:39.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b20ee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123f310 0x557bd12010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b20ee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123f310 0x557bd12010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46478/0 (socket says 172.21.15.49:46478) 2023-11-18T21:00:39.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.544+0000 7fe5b20ee640 1 -- 172.21.15.49:0/4086436182 learned_addr learned my addr 172.21.15.49:0/4086436182 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:39.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.548+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/4086436182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 0x557bd129b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.548+0000 7fe5b10ec640 1 --2- 172.21.15.49:0/4086436182 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 0x557bd129b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.548+0000 7fe5b20ee640 1 -- 172.21.15.49:0/4086436182 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 msgr2=0x557bd129b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.548+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/4086436182 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 0x557bd129b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.548+0000 7fe5b20ee640 1 -- 172.21.15.49:0/4086436182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 msgr2=0x557bd129b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.548+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/4086436182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 0x557bd129b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.548+0000 7fe5b20ee640 1 -- 172.21.15.49:0/4086436182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557bd100f190 con 0x557bd123f310 2023-11-18T21:00:39.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.552+0000 7fe5b20ee640 1 --2- 172.21.15.49:0/4086436182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123f310 0x557bd12010d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40013e0 tx=0x7fe5a401afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d64748846e1b29 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:39.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.552+0000 7fe58cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2023-11-18T21:00:39.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.556+0000 7fe58cff9640 1 -- 172.21.15.49:0/4086436182 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4003b30 con 0x557bd123f310 2023-11-18T21:00:39.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.556+0000 7fe58cff9640 1 -- 172.21.15.49:0/4086436182 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fe5a40a6b90 con 0x557bd123f310 2023-11-18T21:00:39.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.556+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4086436182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557bd104d110 con 0x557bd123f310 2023-11-18T21:00:39.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.560+0000 7fe58cff9640 1 -- 172.21.15.49:0/4086436182 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5a40a6d50 con 0x557bd123f310 2023-11-18T21:00:39.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.560+0000 7fe5b6c80000 10 client.4641 fetch_fsmap learned FSMap version 20 2023-11-18T21:00:39.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.560+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4086436182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x557bd0d46cc0 con 0x557bd123f310 2023-11-18T21:00:39.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.564+0000 7fe58cff9640 1 -- 172.21.15.49:0/4086436182 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557bd104d110 con 0x557bd123f310 2023-11-18T21:00:39.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.564+0000 7fe58cff9640 1 -- 172.21.15.49:0/4086436182 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fe5a40a6400 con 0x557bd123f310 2023-11-18T21:00:39.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.564+0000 7fe5b6c80000 10 client.4641 fetch_fsmap finished waiting for FSMap version 20 2023-11-18T21:00:39.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.564+0000 7fe5b6c80000 10 client.4641 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-18T21:00:39.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.564+0000 7fe5b6c80000 20 client.4641 populate_metadata read hostname 'smithi049' 2023-11-18T21:00:39.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.564+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/4086436182 >> [v2:172.21.15.106:6838/957974967,v1:172.21.15.106:6839/957974967] conn(0x557bd1201a90 0x557bd1201e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.564+0000 7fe5b6c80000 4 client.4641 mds_command: new command op to 4238 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-18T21:00:39.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.564+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4086436182 --> [v2:172.21.15.106:6838/957974967,v1:172.21.15.106:6839/957974967] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557bd107c9a0 con 0x557bd1201a90 2023-11-18T21:00:39.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.568+0000 7fe5b10ec640 1 --2- 172.21.15.49:0/4086436182 >> [v2:172.21.15.106:6838/957974967,v1:172.21.15.106:6839/957974967] conn(0x557bd1201a90 0x557bd1201e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.572+0000 7fe5b10ec640 1 --2- 172.21.15.49:0/4086436182 >> [v2:172.21.15.106:6838/957974967,v1:172.21.15.106:6839/957974967] conn(0x557bd1201a90 0x557bd1201e70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=de50577a60006d70 server_cookie=2df16a2cd11e6a6f in_seq=0 out_seq=0 2023-11-18T21:00:39.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.576+0000 7fe58cff9640 10 client.4641 ms_handle_connect on v2:172.21.15.106:6838/957974967 2023-11-18T21:00:39.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe58cff9640 1 -- 172.21.15.49:0/4086436182 <== mds.1 v2:172.21.15.106:6838/957974967 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x557bd107c9a0 con 0x557bd1201a90 2023-11-18T21:00:39.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe58cff9640 10 client.4641 handle_command_reply: tid=0 2023-11-18T21:00:39.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b6c80000 1 client.4641 shutdown 2023-11-18T21:00:39.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4086436182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123f310 msgr2=0x557bd12010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/4086436182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123f310 0x557bd12010d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40013e0 tx=0x7fe5a401afa0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4086436182 shutdown_connections 2023-11-18T21:00:39.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/4086436182 >> [v2:172.21.15.106:6838/957974967,v1:172.21.15.106:6839/957974967] conn(0x557bd1201a90 0x557bd1201e70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/4086436182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557bd123f310 0x557bd12010d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/4086436182 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557bd123e9f0 0x557bd129b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b6c80000 1 --2- 172.21.15.49:0/4086436182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557bd1239930 0x557bd129b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4086436182 >> 172.21.15.49:0/4086436182 conn(0x557bd123a7a0 msgr2=0x557bd124b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:39.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe58cff9640 0 client.4641 ms_handle_reset on v2:172.21.15.106:6838/957974967 2023-11-18T21:00:39.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4086436182 shutdown_connections 2023-11-18T21:00:39.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b6c80000 1 -- 172.21.15.49:0/4086436182 wait complete. 2023-11-18T21:00:39.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b6c80000 20 client.4641 trim_cache size 0 max 16384 2023-11-18T21:00:39.601 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T21:00:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "4b788c4a-a91a-4c5d-8f44-e74d82d94e56", 2023-11-18T21:00:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 1, 2023-11-18T21:00:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4238, 2023-11-18T21:00:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-18T21:00:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-18T21:00:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-18T21:00:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 30.726604351999999, 2023-11-18T21:00:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 20, 2023-11-18T21:00:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 31, 2023-11-18T21:00:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 29, 2023-11-18T21:00:39.602 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 90.157819372000006 2023-11-18T21:00:39.602 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T21:00:39.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b3b51640 1 -- 172.21.15.49:0/1373102256 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe5900664c0 msgr2=0x7fe590068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b3b51640 1 --2- 172.21.15.49:0/1373102256 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe5900664c0 0x7fe590068980 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0000c10 tx=0x7fe5a0051b70 comp rx=0 tx=0).stop 2023-11-18T21:00:39.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b3b51640 1 -- 172.21.15.49:0/1373102256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5ac150620 msgr2=0x7fe5ac0c52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b3b51640 1 --2- 172.21.15.49:0/1373102256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5ac150620 0x7fe5ac0c52f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0011960 tx=0x7fe5a0011e20 comp rx=0 tx=0).stop 2023-11-18T21:00:39.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b3b51640 1 -- 172.21.15.49:0/1373102256 shutdown_connections 2023-11-18T21:00:39.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b3b51640 1 --2- 172.21.15.49:0/1373102256 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe5900664c0 0x7fe590068980 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b3b51640 1 --2- 172.21.15.49:0/1373102256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5ac0b2900 0x7fe5ac153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b3b51640 1 --2- 172.21.15.49:0/1373102256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5ac150a00 0x7fe5ac0c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b3b51640 1 --2- 172.21.15.49:0/1373102256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5ac150620 0x7fe5ac0c52f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b3b51640 1 -- 172.21.15.49:0/1373102256 >> 172.21.15.49:0/1373102256 conn(0x7fe5ac0708a0 msgr2=0x7fe5ac0c8720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:39.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b3b51640 1 -- 172.21.15.49:0/1373102256 shutdown_connections 2023-11-18T21:00:39.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.600+0000 7fe5b3b51640 1 -- 172.21.15.49:0/1373102256 wait complete. 2023-11-18T21:00:39.638 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-18T21:00:39.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.772+0000 7faad47fe640 1 Processor -- start 2023-11-18T21:00:39.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.772+0000 7faad47fe640 1 -- start start 2023-11-18T21:00:39.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.776+0000 7faad47fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faacc15c9e0 0x7faacc1532b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.776+0000 7faad47fe640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc06ec00 con 0x7faacc0cd110 2023-11-18T21:00:39.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.776+0000 7faad47fe640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc1593f0 con 0x7faacc0ccd30 2023-11-18T21:00:39.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.776+0000 7faad47fe640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faacc15cf20 con 0x7faacc15c9e0 2023-11-18T21:00:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.776+0000 7faad2d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faacc15c9e0 0x7faacc1532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.776+0000 7faad2d9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faacc15c9e0 0x7faacc1532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46492/0 (socket says 172.21.15.49:46492) 2023-11-18T21:00:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.776+0000 7faad2d9b640 1 -- 172.21.15.49:0/2428208317 learned_addr learned my addr 172.21.15.49:0/2428208317 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:39.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.780+0000 7faad2d9b640 1 -- 172.21.15.49:0/2428208317 >> v1:172.21.15.106:6789/0 conn(0x7faacc0ccd30 legacy=0x7faacc0c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.780+0000 7faad2d9b640 1 -- 172.21.15.49:0/2428208317 >> v1:172.21.15.49:6789/0 conn(0x7faacc0cd110 legacy=0x7faacc159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.780+0000 7faad2d9b640 1 -- 172.21.15.49:0/2428208317 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc15d200 con 0x7faacc15c9e0 2023-11-18T21:00:39.784 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.784+0000 7faad2d9b640 1 --2- 172.21.15.49:0/2428208317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faacc15c9e0 0x7faacc1532b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faac4009e50 tx=0x7faac401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9835de1392964a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:39.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.788+0000 7faad1598640 1 -- 172.21.15.49:0/2428208317 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40a56e0 con 0x7faacc15c9e0 2023-11-18T21:00:39.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.788+0000 7faad1598640 1 -- 172.21.15.49:0/2428208317 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac40a5840 con 0x7faacc15c9e0 2023-11-18T21:00:39.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.788+0000 7faad1598640 1 -- 172.21.15.49:0/2428208317 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40a5bd0 con 0x7faacc15c9e0 2023-11-18T21:00:39.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.788+0000 7faad47fe640 1 -- 172.21.15.49:0/2428208317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faacc15c9e0 msgr2=0x7faacc1532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.788+0000 7faad47fe640 1 --2- 172.21.15.49:0/2428208317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faacc15c9e0 0x7faacc1532b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faac4009e50 tx=0x7faac401ca10 comp rx=0 tx=0).stop 2023-11-18T21:00:39.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.788+0000 7faad47fe640 1 -- 172.21.15.49:0/2428208317 shutdown_connections 2023-11-18T21:00:39.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.788+0000 7faad47fe640 1 --2- 172.21.15.49:0/2428208317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faacc15c9e0 0x7faacc1532b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.788+0000 7faad47fe640 1 -- 172.21.15.49:0/2428208317 >> 172.21.15.49:0/2428208317 conn(0x7faacc0708a0 msgr2=0x7faacc070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:39.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.788+0000 7faad47fe640 1 -- 172.21.15.49:0/2428208317 shutdown_connections 2023-11-18T21:00:39.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.788+0000 7faad47fe640 1 -- 172.21.15.49:0/2428208317 wait complete. 2023-11-18T21:00:39.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.792+0000 7faad47fe640 1 Processor -- start 2023-11-18T21:00:39.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.792+0000 7faad47fe640 1 -- start start 2023-11-18T21:00:39.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.792+0000 7faad47fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faacc0ccd30 0x7faacc13d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.792+0000 7faad47fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faacc0cd110 0x7faacc1490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.792+0000 7faad47fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faacc15c9e0 0x7faacc13c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.792+0000 7faad47fe640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc149630 con 0x7faacc0cd110 2023-11-18T21:00:39.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.792+0000 7faad47fe640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc148b10 con 0x7faacc15c9e0 2023-11-18T21:00:39.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.792+0000 7faad47fe640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faacc148db0 con 0x7faacc0ccd30 2023-11-18T21:00:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.792+0000 7faad1d99640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faacc0cd110 0x7faacc1490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.792+0000 7faad1d99640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faacc0cd110 0x7faacc1490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46500/0 (socket says 172.21.15.49:46500) 2023-11-18T21:00:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.792+0000 7faad1d99640 1 -- 172.21.15.49:0/407619136 learned_addr learned my addr 172.21.15.49:0/407619136 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.792+0000 7faad2d9b640 1 --2- 172.21.15.49:0/407619136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faacc15c9e0 0x7faacc13c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.792+0000 7faad259a640 1 --2- 172.21.15.49:0/407619136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faacc0ccd30 0x7faacc13d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.796+0000 7faad1d99640 1 -- 172.21.15.49:0/407619136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faacc0ccd30 msgr2=0x7faacc13d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.796+0000 7faad1d99640 1 --2- 172.21.15.49:0/407619136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faacc0ccd30 0x7faacc13d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.796+0000 7faad1d99640 1 -- 172.21.15.49:0/407619136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faacc15c9e0 msgr2=0x7faacc13c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.796+0000 7faad1d99640 1 --2- 172.21.15.49:0/407619136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faacc15c9e0 0x7faacc13c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.796+0000 7faad1d99640 1 -- 172.21.15.49:0/407619136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac4009b30 con 0x7faacc0cd110 2023-11-18T21:00:39.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.800+0000 7faad1d99640 1 --2- 172.21.15.49:0/407619136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faacc0cd110 0x7faacc1490f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faabc00c4d0 tx=0x7faabc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:39.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.804+0000 7faac2ffd640 1 -- 172.21.15.49:0/407619136 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc0052d0 con 0x7faacc0cd110 2023-11-18T21:00:39.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.804+0000 7faac2ffd640 1 -- 172.21.15.49:0/407619136 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc005430 con 0x7faacc0cd110 2023-11-18T21:00:39.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.804+0000 7faac2ffd640 1 -- 172.21.15.49:0/407619136 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc012830 con 0x7faacc0cd110 2023-11-18T21:00:39.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.804+0000 7faad47fe640 1 -- 172.21.15.49:0/407619136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faacc0cc1a0 con 0x7faacc0cd110 2023-11-18T21:00:39.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.804+0000 7faad47fe640 1 -- 172.21.15.49:0/407619136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faacc0cc760 con 0x7faacc0cd110 2023-11-18T21:00:39.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.808+0000 7faad792d000 1 Processor -- start 2023-11-18T21:00:39.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.808+0000 7faad792d000 1 -- start start 2023-11-18T21:00:39.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.808+0000 7faad792d000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 0x55793b891d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.808+0000 7faad792d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b8969f0 0x55793b896dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.808+0000 7faad792d000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b897310 0x55793b8976f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.808+0000 7faad792d000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793b6c0130 con 0x55793b897310 2023-11-18T21:00:39.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.808+0000 7faad792d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793b6ad9a0 con 0x55793b8969f0 2023-11-18T21:00:39.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.808+0000 7faad792d000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55793b6aaed0 con 0x55793b891930 2023-11-18T21:00:39.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.816+0000 7faad259a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b8969f0 0x55793b896dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.816+0000 7faad2d9b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 0x55793b891d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.816+0000 7faad259a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b8969f0 0x55793b896dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:53326/0 (socket says 172.21.15.49:53326) 2023-11-18T21:00:39.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.816+0000 7faad259a640 1 -- 172.21.15.49:0/822332618 learned_addr learned my addr 172.21.15.49:0/822332618 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:39.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.820+0000 7faad1d99640 1 --2- 172.21.15.49:0/822332618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b897310 0x55793b8976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.824+0000 7faad2d9b640 1 -- 172.21.15.49:0/822332618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b8969f0 msgr2=0x55793b896dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.824+0000 7faad2d9b640 1 --2- 172.21.15.49:0/822332618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b8969f0 0x55793b896dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.824+0000 7faad2d9b640 1 -- 172.21.15.49:0/822332618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b897310 msgr2=0x55793b8976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.824+0000 7faad2d9b640 1 --2- 172.21.15.49:0/822332618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b897310 0x55793b8976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.824+0000 7faad2d9b640 1 -- 172.21.15.49:0/822332618 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55793b39e890 con 0x55793b891930 2023-11-18T21:00:39.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.828+0000 7faad2d9b640 1 --2- 172.21.15.49:0/822332618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 0x55793b891d10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faac40ab000 tx=0x7faac4004ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6349995d5cc299f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faaaffff640 1 -- 172.21.15.49:0/822332618 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40a5bb0 con 0x55793b891930 2023-11-18T21:00:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faaaffff640 1 -- 172.21.15.49:0/822332618 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac40a5d30 con 0x55793b891930 2023-11-18T21:00:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faaaffff640 1 -- 172.21.15.49:0/822332618 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40a5ea0 con 0x55793b891930 2023-11-18T21:00:39.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faad792d000 1 -- 172.21.15.49:0/822332618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 msgr2=0x55793b891d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:39.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faad792d000 1 --2- 172.21.15.49:0/822332618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 0x55793b891d10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faac40ab000 tx=0x7faac4004ac0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faad792d000 1 -- 172.21.15.49:0/822332618 shutdown_connections 2023-11-18T21:00:39.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faad792d000 1 --2- 172.21.15.49:0/822332618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b897310 0x55793b8976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faad792d000 1 --2- 172.21.15.49:0/822332618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b8969f0 0x55793b896dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faad792d000 1 --2- 172.21.15.49:0/822332618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 0x55793b891d10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faad792d000 1 -- 172.21.15.49:0/822332618 >> 172.21.15.49:0/822332618 conn(0x55793b8927a0 msgr2=0x55793b894b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:39.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faad792d000 1 -- 172.21.15.49:0/822332618 shutdown_connections 2023-11-18T21:00:39.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faad792d000 1 -- 172.21.15.49:0/822332618 wait complete. 2023-11-18T21:00:39.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faad792d000 1 -- start start 2023-11-18T21:00:39.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faad792d000 1 Processor -- start 2023-11-18T21:00:39.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.840+0000 7faad792d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b891930 0x55793b890d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.844+0000 7faad792d000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b8969f0 0x55793b891250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.844+0000 7faad792d000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b897310 0x55793b8a0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.844+0000 7faad792d000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793b6a67c0 con 0x55793b8969f0 2023-11-18T21:00:39.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.844+0000 7faad792d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793b65ebf0 con 0x55793b891930 2023-11-18T21:00:39.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.844+0000 7faad792d000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55793b664a90 con 0x55793b897310 2023-11-18T21:00:39.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.844+0000 7faad792d000 10 client.0 _ll_register_callbacks cb 0x55793b8413c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T21:00:39.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.844+0000 7faad2d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b891930 0x55793b890d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.844+0000 7faad2d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b891930 0x55793b890d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:53334/0 (socket says 172.21.15.49:53334) 2023-11-18T21:00:39.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.844+0000 7faad2d9b640 1 -- 172.21.15.49:0/851275414 learned_addr learned my addr 172.21.15.49:0/851275414 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:39.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.848+0000 7faad1d99640 1 --2- 172.21.15.49:0/851275414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b897310 0x55793b8a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.852+0000 7faad2d9b640 1 -- 172.21.15.49:0/851275414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b897310 msgr2=0x55793b8a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.852+0000 7faad2d9b640 1 --2- 172.21.15.49:0/851275414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b897310 0x55793b8a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.852+0000 7faad2d9b640 1 -- 172.21.15.49:0/851275414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b8969f0 msgr2=0x55793b891250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:39.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.852+0000 7faad2d9b640 1 --2- 172.21.15.49:0/851275414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b8969f0 0x55793b891250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:39.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.852+0000 7faad2d9b640 1 -- 172.21.15.49:0/851275414 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faacc15d200 con 0x55793b891930 2023-11-18T21:00:39.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.860+0000 7faad2d9b640 1 --2- 172.21.15.49:0/851275414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b891930 0x55793b890d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faac401a640 tx=0x7faac401b250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a43f24b54a0bf0fc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.860+0000 7faaad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2023-11-18T21:00:39.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.864+0000 7faac2ffd640 1 -- 172.21.15.49:0/407619136 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faabc012a90 con 0x7faacc0cd110 2023-11-18T21:00:39.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.864+0000 7faac2ffd640 1 --2- 172.21.15.49:0/407619136 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7faab0066460 0x7faab0068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:39.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.868+0000 7faad259a640 1 --2- 172.21.15.49:0/407619136 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7faab0066460 0x7faab0068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:39.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.868+0000 7faad259a640 1 --2- 172.21.15.49:0/407619136 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7faab0066460 0x7faab0068920 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faac80077f0 tx=0x7faac8007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:39.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.872+0000 7faaad7fa640 1 -- 172.21.15.49:0/851275414 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40ca650 con 0x55793b891930 2023-11-18T21:00:39.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.872+0000 7faad792d000 1 -- 172.21.15.49:0/851275414 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55793b668470 con 0x55793b891930 2023-11-18T21:00:39.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.872+0000 7faac2ffd640 1 -- 172.21.15.49:0/407619136 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7faabc055840 con 0x7faacc0cd110 2023-11-18T21:00:39.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:39.880+0000 7faaad7fa640 1 -- 172.21.15.49:0/851275414 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7faac40ceaf0 con 0x55793b891930 2023-11-18T21:00:40.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.116+0000 7faaad7fa640 1 -- 172.21.15.49:0/851275414 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7faac40cecb0 con 0x55793b891930 2023-11-18T21:00:40.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.116+0000 7faad792d000 10 client.4651 fetch_fsmap learned FSMap version 20 2023-11-18T21:00:40.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.116+0000 7faad792d000 1 -- 172.21.15.49:0/851275414 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55793b667190 con 0x55793b891930 2023-11-18T21:00:40.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.152+0000 7faaad7fa640 1 -- 172.21.15.49:0/851275414 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55793b668470 con 0x55793b891930 2023-11-18T21:00:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.152+0000 7faaad7fa640 1 -- 172.21.15.49:0/851275414 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7faac40ca7b0 con 0x55793b891930 2023-11-18T21:00:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.152+0000 7faad792d000 10 client.4651 fetch_fsmap finished waiting for FSMap version 20 2023-11-18T21:00:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.152+0000 7faad792d000 10 client.4651 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-18T21:00:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.152+0000 7faad792d000 20 client.4651 populate_metadata read hostname 'smithi049' 2023-11-18T21:00:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.152+0000 7faad792d000 1 --2- 172.21.15.49:0/851275414 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x55793b8a16d0 0x55793b8a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.152+0000 7faad792d000 4 client.4651 mds_command: new command op to 4252 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-18T21:00:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.152+0000 7faad792d000 1 -- 172.21.15.49:0/851275414 --> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55793b66bb50 con 0x55793b8a16d0 2023-11-18T21:00:40.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.156+0000 7faad1d99640 1 --2- 172.21.15.49:0/851275414 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x55793b8a16d0 0x55793b8a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:40.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.164+0000 7faad1d99640 1 --2- 172.21.15.49:0/851275414 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x55793b8a16d0 0x55793b8a1ab0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b03db892874d13d1 server_cookie=ca9a602d8fda75f6 in_seq=0 out_seq=0 2023-11-18T21:00:40.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.164+0000 7faaad7fa640 10 client.4651 ms_handle_connect on v2:172.21.15.49:6836/321839377 2023-11-18T21:00:40.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faaad7fa640 1 -- 172.21.15.49:0/851275414 <== mds.0 v2:172.21.15.49:6836/321839377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55793b66bb50 con 0x55793b8a16d0 2023-11-18T21:00:40.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faaad7fa640 10 client.4651 handle_command_reply: tid=0 2023-11-18T21:00:40.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faad792d000 1 client.4651 shutdown 2023-11-18T21:00:40.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faad792d000 1 -- 172.21.15.49:0/851275414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b891930 msgr2=0x55793b890d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faad792d000 1 --2- 172.21.15.49:0/851275414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b891930 0x55793b890d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faac401a640 tx=0x7faac401b250 comp rx=0 tx=0).stop 2023-11-18T21:00:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faad792d000 1 -- 172.21.15.49:0/851275414 shutdown_connections 2023-11-18T21:00:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faad792d000 1 --2- 172.21.15.49:0/851275414 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x55793b8a16d0 0x55793b8a1ab0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faad792d000 1 --2- 172.21.15.49:0/851275414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b897310 0x55793b8a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faad792d000 1 --2- 172.21.15.49:0/851275414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b8969f0 0x55793b891250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faaad7fa640 0 client.4651 ms_handle_reset on v2:172.21.15.49:6836/321839377 2023-11-18T21:00:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faad792d000 1 --2- 172.21.15.49:0/851275414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b891930 0x55793b890d10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faad792d000 1 -- 172.21.15.49:0/851275414 >> 172.21.15.49:0/851275414 conn(0x55793b8927a0 msgr2=0x55793b85bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faad792d000 1 -- 172.21.15.49:0/851275414 shutdown_connections 2023-11-18T21:00:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faad792d000 1 -- 172.21.15.49:0/851275414 wait complete. 2023-11-18T21:00:40.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.200+0000 7faad792d000 20 client.4651 trim_cache size 0 max 16384 2023-11-18T21:00:40.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.248+0000 7faad792d000 1 Processor -- start 2023-11-18T21:00:40.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.248+0000 7faad792d000 1 -- start start 2023-11-18T21:00:40.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.248+0000 7faad792d000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 0x55793b894b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:40.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.248+0000 7faad792d000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b8969f0 0x55793b8950d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:40.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.248+0000 7faad792d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b897310 0x55793b895610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:40.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.248+0000 7faad792d000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793b35f940 con 0x55793b8969f0 2023-11-18T21:00:40.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.248+0000 7faad792d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793b890d60 con 0x55793b897310 2023-11-18T21:00:40.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.248+0000 7faad792d000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55793b6a52b0 con 0x55793b891930 2023-11-18T21:00:40.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.248+0000 7faad259a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 0x55793b894b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:40.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.248+0000 7faad2d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b897310 0x55793b895610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:40.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.252+0000 7faad2d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b897310 0x55793b895610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:53346/0 (socket says 172.21.15.49:53346) 2023-11-18T21:00:40.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.252+0000 7faad2d9b640 1 -- 172.21.15.49:0/3440638358 learned_addr learned my addr 172.21.15.49:0/3440638358 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:40.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.256+0000 7faad2d9b640 1 -- 172.21.15.49:0/3440638358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 msgr2=0x55793b894b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:40.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.256+0000 7faad2d9b640 1 --2- 172.21.15.49:0/3440638358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 0x55793b894b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.256+0000 7faad2d9b640 1 -- 172.21.15.49:0/3440638358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b8969f0 msgr2=0x55793b8950d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:40.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.256+0000 7faad2d9b640 1 --2- 172.21.15.49:0/3440638358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b8969f0 0x55793b8950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.256+0000 7faad2d9b640 1 -- 172.21.15.49:0/3440638358 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55793b64d490 con 0x55793b897310 2023-11-18T21:00:40.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.256+0000 7faad259a640 1 --2- 172.21.15.49:0/3440638358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 0x55793b894b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T21:00:40.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.268+0000 7faad2d9b640 1 --2- 172.21.15.49:0/3440638358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b897310 0x55793b895610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faac4000f90 tx=0x7faac40c4000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52e6d640165e0a22 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.404+0000 7faac0ff9640 1 -- 172.21.15.49:0/3440638358 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40a5cc0 con 0x55793b897310 2023-11-18T21:00:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.404+0000 7faac0ff9640 1 -- 172.21.15.49:0/3440638358 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac4009150 con 0x55793b897310 2023-11-18T21:00:40.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.404+0000 7faac0ff9640 1 -- 172.21.15.49:0/3440638358 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40ca450 con 0x55793b897310 2023-11-18T21:00:40.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.404+0000 7faad792d000 1 -- 172.21.15.49:0/3440638358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b897310 msgr2=0x55793b895610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:40.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.404+0000 7faad792d000 1 --2- 172.21.15.49:0/3440638358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b897310 0x55793b895610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faac4000f90 tx=0x7faac40c4000 comp rx=0 tx=0).stop 2023-11-18T21:00:40.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.404+0000 7faad792d000 1 -- 172.21.15.49:0/3440638358 shutdown_connections 2023-11-18T21:00:40.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.404+0000 7faad792d000 1 --2- 172.21.15.49:0/3440638358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b897310 0x55793b895610 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.404+0000 7faad792d000 1 --2- 172.21.15.49:0/3440638358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b8969f0 0x55793b8950d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.404+0000 7faad792d000 1 --2- 172.21.15.49:0/3440638358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 0x55793b894b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.404+0000 7faad792d000 1 -- 172.21.15.49:0/3440638358 >> 172.21.15.49:0/3440638358 conn(0x55793b8927a0 msgr2=0x55793b8a0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:40.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.404+0000 7faad792d000 1 -- 172.21.15.49:0/3440638358 shutdown_connections 2023-11-18T21:00:40.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.404+0000 7faad792d000 1 -- 172.21.15.49:0/3440638358 wait complete. 2023-11-18T21:00:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.408+0000 7faad792d000 1 -- start start 2023-11-18T21:00:40.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.408+0000 7faad792d000 1 Processor -- start 2023-11-18T21:00:40.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.412+0000 7faad792d000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 0x55793b8f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:40.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.412+0000 7faad792d000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b8969f0 0x55793b8f6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:40.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.412+0000 7faad792d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b897310 0x55793b858d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:40.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.412+0000 7faad792d000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793b6418a0 con 0x55793b8969f0 2023-11-18T21:00:40.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.412+0000 7faad792d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793b65fd60 con 0x55793b897310 2023-11-18T21:00:40.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.412+0000 7faad792d000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55793b39f1b0 con 0x55793b891930 2023-11-18T21:00:40.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.412+0000 7faad792d000 10 client.0 _ll_register_callbacks cb 0x55793b821bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T21:00:40.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.412+0000 7faad2d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b897310 0x55793b858d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:40.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.412+0000 7faad259a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 0x55793b8f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:40.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.412+0000 7faad2d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b897310 0x55793b858d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:53358/0 (socket says 172.21.15.49:53358) 2023-11-18T21:00:40.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.412+0000 7faad2d9b640 1 -- 172.21.15.49:0/1544256023 learned_addr learned my addr 172.21.15.49:0/1544256023 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:40.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.420+0000 7faad2d9b640 1 -- 172.21.15.49:0/1544256023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 msgr2=0x55793b8f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:40.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.420+0000 7faad2d9b640 1 --2- 172.21.15.49:0/1544256023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 0x55793b8f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.420+0000 7faad2d9b640 1 -- 172.21.15.49:0/1544256023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b8969f0 msgr2=0x55793b8f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:40.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.420+0000 7faad2d9b640 1 --2- 172.21.15.49:0/1544256023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b8969f0 0x55793b8f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.420+0000 7faad2d9b640 1 -- 172.21.15.49:0/1544256023 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faacc1593f0 con 0x55793b897310 2023-11-18T21:00:40.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.424+0000 7faad2d9b640 1 --2- 172.21.15.49:0/1544256023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b897310 0x55793b858d70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faac401a640 tx=0x7faac40a7070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=667e86f05fa182c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:40.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.424+0000 7faaad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2023-11-18T21:00:40.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.428+0000 7faaad7fa640 1 -- 172.21.15.49:0/1544256023 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40ca660 con 0x55793b897310 2023-11-18T21:00:40.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.428+0000 7faaad7fa640 1 -- 172.21.15.49:0/1544256023 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7faac40ca7c0 con 0x55793b897310 2023-11-18T21:00:40.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.428+0000 7faad792d000 1 -- 172.21.15.49:0/1544256023 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55793b6a5110 con 0x55793b897310 2023-11-18T21:00:40.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.612+0000 7faaad7fa640 1 -- 172.21.15.49:0/1544256023 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7faac40039a0 con 0x55793b897310 2023-11-18T21:00:40.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.612+0000 7faad792d000 10 client.4657 fetch_fsmap learned FSMap version 20 2023-11-18T21:00:40.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.612+0000 7faad792d000 1 -- 172.21.15.49:0/1544256023 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55793b667190 con 0x55793b897310 2023-11-18T21:00:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.624+0000 7faaad7fa640 1 -- 172.21.15.49:0/1544256023 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55793b6a5110 con 0x55793b897310 2023-11-18T21:00:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.624+0000 7faaad7fa640 1 -- 172.21.15.49:0/1544256023 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7faac40df060 con 0x55793b897310 2023-11-18T21:00:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.624+0000 7faad792d000 10 client.4657 fetch_fsmap finished waiting for FSMap version 20 2023-11-18T21:00:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.624+0000 7faad792d000 10 client.4657 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-18T21:00:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.624+0000 7faad792d000 20 client.4657 populate_metadata read hostname 'smithi049' 2023-11-18T21:00:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.624+0000 7faad792d000 1 --2- 172.21.15.49:0/1544256023 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x55793b8592b0 0x55793b859690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.624+0000 7faad792d000 4 client.4657 mds_command: new command op to 4252 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-18T21:00:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.624+0000 7faad792d000 1 -- 172.21.15.49:0/1544256023 --> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55793b6d49a0 con 0x55793b8592b0 2023-11-18T21:00:40.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.624+0000 7faad259a640 1 --2- 172.21.15.49:0/1544256023 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x55793b8592b0 0x55793b859690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:40.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.636+0000 7faad259a640 1 --2- 172.21.15.49:0/1544256023 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x55793b8592b0 0x55793b859690 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8663c8876877a310 server_cookie=82ad7b3d8c3869dd in_seq=0 out_seq=0 2023-11-18T21:00:40.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.636+0000 7faaad7fa640 10 client.4657 ms_handle_connect on v2:172.21.15.49:6836/321839377 2023-11-18T21:00:40.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faaad7fa640 1 -- 172.21.15.49:0/1544256023 <== mds.0 v2:172.21.15.49:6836/321839377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55793b6d49a0 con 0x55793b8592b0 2023-11-18T21:00:40.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faaad7fa640 10 client.4657 handle_command_reply: tid=0 2023-11-18T21:00:40.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad792d000 1 client.4657 shutdown 2023-11-18T21:00:40.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad792d000 1 -- 172.21.15.49:0/1544256023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b897310 msgr2=0x55793b858d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:40.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad792d000 1 --2- 172.21.15.49:0/1544256023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b897310 0x55793b858d70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faac401a640 tx=0x7faac40a7070 comp rx=0 tx=0).stop 2023-11-18T21:00:40.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad792d000 1 -- 172.21.15.49:0/1544256023 shutdown_connections 2023-11-18T21:00:40.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad792d000 1 --2- 172.21.15.49:0/1544256023 >> [v2:172.21.15.49:6836/321839377,v1:172.21.15.49:6837/321839377] conn(0x55793b8592b0 0x55793b859690 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad792d000 1 --2- 172.21.15.49:0/1544256023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55793b897310 0x55793b858d70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faaad7fa640 0 client.4657 ms_handle_reset on v2:172.21.15.49:6836/321839377 2023-11-18T21:00:40.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad792d000 1 --2- 172.21.15.49:0/1544256023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55793b8969f0 0x55793b8f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad792d000 1 --2- 172.21.15.49:0/1544256023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55793b891930 0x55793b8f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad792d000 1 -- 172.21.15.49:0/1544256023 >> 172.21.15.49:0/1544256023 conn(0x55793b8927a0 msgr2=0x55793b8961d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:40.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad792d000 1 -- 172.21.15.49:0/1544256023 shutdown_connections 2023-11-18T21:00:40.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad792d000 1 -- 172.21.15.49:0/1544256023 wait complete. 2023-11-18T21:00:40.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad792d000 20 client.4657 trim_cache size 0 max 16384 2023-11-18T21:00:40.646 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T21:00:40.646 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "4b788c4a-a91a-4c5d-8f44-e74d82d94e56", 2023-11-18T21:00:40.646 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2023-11-18T21:00:40.646 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4252, 2023-11-18T21:00:40.646 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2023-11-18T21:00:40.646 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2023-11-18T21:00:40.646 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2023-11-18T21:00:40.646 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 71.092756291000001, 2023-11-18T21:00:40.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 20, 2023-11-18T21:00:40.647 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 31, 2023-11-18T21:00:40.647 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 29, 2023-11-18T21:00:40.647 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 88.999208225000004 2023-11-18T21:00:40.647 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T21:00:40.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad47fe640 1 -- 172.21.15.49:0/407619136 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7faab0066460 msgr2=0x7faab0068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:40.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad47fe640 1 --2- 172.21.15.49:0/407619136 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7faab0066460 0x7faab0068920 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faac80077f0 tx=0x7faac8007e40 comp rx=0 tx=0).stop 2023-11-18T21:00:40.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad47fe640 1 -- 172.21.15.49:0/407619136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faacc0cd110 msgr2=0x7faacc1490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:40.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad47fe640 1 --2- 172.21.15.49:0/407619136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faacc0cd110 0x7faacc1490f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faabc00c4d0 tx=0x7faabc00c990 comp rx=0 tx=0).stop 2023-11-18T21:00:40.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad47fe640 1 -- 172.21.15.49:0/407619136 shutdown_connections 2023-11-18T21:00:40.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad47fe640 1 --2- 172.21.15.49:0/407619136 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7faab0066460 0x7faab0068920 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad47fe640 1 --2- 172.21.15.49:0/407619136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faacc15c9e0 0x7faacc13c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad47fe640 1 --2- 172.21.15.49:0/407619136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faacc0cd110 0x7faacc1490f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad47fe640 1 --2- 172.21.15.49:0/407619136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faacc0ccd30 0x7faacc13d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:40.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad47fe640 1 -- 172.21.15.49:0/407619136 >> 172.21.15.49:0/407619136 conn(0x7faacc0708a0 msgr2=0x7faacc157bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:40.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad47fe640 1 -- 172.21.15.49:0/407619136 shutdown_connections 2023-11-18T21:00:40.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:40.644+0000 7faad47fe640 1 -- 172.21.15.49:0/407619136 wait complete. 2023-11-18T21:00:40.673 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-18T21:00:40.683 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-18T21:00:40.683 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-11-18T21:00:40.683 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-11-18T21:00:40.683 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-18T21:00:40.683 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T21:00:40.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:40.683 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-18T21:00:40.690 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-18T21:00:40.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:40.690 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T21:00:40.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:40.748 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2023-11-18T21:00:40.932 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-18T21:00:40.932 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T21:00:41.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.064+0000 7ff91f0a5640 1 Processor -- start 2023-11-18T21:00:41.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.064+0000 7ff91f0a5640 1 -- start start 2023-11-18T21:00:41.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.064+0000 7ff91f0a5640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff9181501f0 0x7ff91815a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.064+0000 7ff91f0a5640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9180c6c50 0x7ff9181560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.064+0000 7ff91f0a5640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9180c27d0 con 0x7ff9181505d0 2023-11-18T21:00:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.064+0000 7ff91f0a5640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9180c3270 con 0x7ff9181501f0 2023-11-18T21:00:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.064+0000 7ff91f0a5640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180c25e0 con 0x7ff9180c6c50 2023-11-18T21:00:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.064+0000 7ff917fff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff9181505d0 0x7ff9180c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50676/0 (socket says 172.21.15.49:50676) 2023-11-18T21:00:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.064+0000 7ff917fff640 1 -- 172.21.15.49:0/2158491819 learned_addr learned my addr 172.21.15.49:0/2158491819 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:00:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.064+0000 7ff91d642640 1 --2- 172.21.15.49:0/2158491819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9180c6c50 0x7ff9181560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.064+0000 7ff91ce41640 1 --2- 172.21.15.49:0/2158491819 >> v2:172.21.15.106:3300/0 conn(0x7ff9181501f0 0x7ff91815a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:41.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.068+0000 7ff9177fe640 1 -- 172.21.15.49:0/2158491819 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265721890 0 0) 0x7ff9180c27d0 con 0x7ff9181505d0 2023-11-18T21:00:41.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.068+0000 7ff9177fe640 1 -- 172.21.15.49:0/2158491819 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff908003530 con 0x7ff9181505d0 2023-11-18T21:00:41.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff9177fe640 1 -- 172.21.15.49:0/2158491819 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1327952021 0 0) 0x7ff908003530 con 0x7ff9181505d0 2023-11-18T21:00:41.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff9177fe640 1 -- 172.21.15.49:0/2158491819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9180c6c50 msgr2=0x7ff9181560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:41.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff9177fe640 1 --2- 172.21.15.49:0/2158491819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9180c6c50 0x7ff9181560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:41.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff9177fe640 1 -- 172.21.15.49:0/2158491819 >> v2:172.21.15.106:3300/0 conn(0x7ff9181501f0 msgr2=0x7ff91815a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:41.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff9177fe640 1 --2- 172.21.15.49:0/2158491819 >> v2:172.21.15.106:3300/0 conn(0x7ff9181501f0 0x7ff91815a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:41.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff9177fe640 1 -- 172.21.15.49:0/2158491819 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9180c2ab0 con 0x7ff9181505d0 2023-11-18T21:00:41.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff9177fe640 1 -- 172.21.15.49:0/2158491819 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7ff904001680 con 0x7ff9181505d0 2023-11-18T21:00:41.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff9177fe640 1 -- 172.21.15.49:0/2158491819 >> v1:172.21.15.49:6789/0 conn(0x7ff9181505d0 legacy=0x7ff9180c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:41.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff9177fe640 1 --2- 172.21.15.49:0/2158491819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9080039f0 0x7ff908003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:41.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff9177fe640 1 --2- 172.21.15.49:0/2158491819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9180c6c50 0x7ff9080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:41.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff9177fe640 1 --2- 172.21.15.49:0/2158491819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff908004d10 0x7ff908005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:41.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff9177fe640 1 -- 172.21.15.49:0/2158491819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90800dba0 con 0x7ff9080039f0 2023-11-18T21:00:41.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff9177fe640 1 -- 172.21.15.49:0/2158491819 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90800dce0 con 0x7ff908004d10 2023-11-18T21:00:41.072 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff9177fe640 1 -- 172.21.15.49:0/2158491819 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90800de50 con 0x7ff9180c6c50 2023-11-18T21:00:41.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.072+0000 7ff91ce41640 1 --2- 172.21.15.49:0/2158491819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9080039f0 0x7ff908003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:41.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.076+0000 7ff91ce41640 1 -- 172.21.15.49:0/2158491819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9180c6c50 msgr2=0x7ff9080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:41.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.076+0000 7ff91ce41640 1 --2- 172.21.15.49:0/2158491819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff9180c6c50 0x7ff9080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:41.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.076+0000 7ff91ce41640 1 -- 172.21.15.49:0/2158491819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff908004d10 msgr2=0x7ff908005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:00:41.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.076+0000 7ff91ce41640 1 --2- 172.21.15.49:0/2158491819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff908004d10 0x7ff908005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:41.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.076+0000 7ff91ce41640 1 -- 172.21.15.49:0/2158491819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff908003530 con 0x7ff9080039f0 2023-11-18T21:00:41.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.080+0000 7ff91ce41640 1 --2- 172.21.15.49:0/2158491819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9080039f0 0x7ff908003e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009ae0 tx=0x7ff90c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d900ce9e2413245 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:41.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.084+0000 7ff9177fe640 1 -- 172.21.15.49:0/2158491819 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0a5630 con 0x7ff9080039f0 2023-11-18T21:00:41.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.084+0000 7ff9177fe640 1 -- 172.21.15.49:0/2158491819 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c0a5790 con 0x7ff9080039f0 2023-11-18T21:00:41.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.084+0000 7ff9177fe640 1 -- 172.21.15.49:0/2158491819 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0a5b40 con 0x7ff9080039f0 2023-11-18T21:00:41.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2158491819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9080039f0 msgr2=0x7ff908003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:41.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91f0a5640 1 --2- 172.21.15.49:0/2158491819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9080039f0 0x7ff908003e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009ae0 tx=0x7ff90c01ca00 comp rx=0 tx=0).stop 2023-11-18T21:00:41.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91d642640 1 -- 172.21.15.49:0/2158491819 reap_dead start 2023-11-18T21:00:41.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2158491819 shutdown_connections 2023-11-18T21:00:41.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2158491819 >> 172.21.15.49:0/2158491819 conn(0x7ff91806c6a0 msgr2=0x7ff91806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:41.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2158491819 shutdown_connections 2023-11-18T21:00:41.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2158491819 wait complete. 2023-11-18T21:00:41.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91f0a5640 1 Processor -- start 2023-11-18T21:00:41.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91f0a5640 1 -- start start 2023-11-18T21:00:41.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91f0a5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9080039f0 0x7ff91813e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:41.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91f0a5640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff91814da80 0x7ff9181edd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:41.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91f0a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff91814ec40 0x7ff9181ee250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:41.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91f0a5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91814f430 con 0x7ff91814ec40 2023-11-18T21:00:41.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91f0a5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9181ee790 con 0x7ff9080039f0 2023-11-18T21:00:41.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91f0a5640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91814df70 con 0x7ff91814da80 2023-11-18T21:00:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91d642640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff91814ec40 0x7ff9181ee250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91d642640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff91814ec40 0x7ff9181ee250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46562/0 (socket says 172.21.15.49:46562) 2023-11-18T21:00:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.088+0000 7ff91d642640 1 -- 172.21.15.49:0/2183472280 learned_addr learned my addr 172.21.15.49:0/2183472280 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:00:41.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.092+0000 7ff91ce41640 1 --2- 172.21.15.49:0/2183472280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9080039f0 0x7ff91813e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:41.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.092+0000 7ff917fff640 1 --2- 172.21.15.49:0/2183472280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff91814da80 0x7ff9181edd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:41.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.096+0000 7ff91d642640 1 -- 172.21.15.49:0/2183472280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff91814da80 msgr2=0x7ff9181edd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:41.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.096+0000 7ff91d642640 1 --2- 172.21.15.49:0/2183472280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff91814da80 0x7ff9181edd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:41.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.096+0000 7ff91d642640 1 -- 172.21.15.49:0/2183472280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9080039f0 msgr2=0x7ff91813e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:41.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.096+0000 7ff91d642640 1 --2- 172.21.15.49:0/2183472280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9080039f0 0x7ff91813e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:41.095 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.096+0000 7ff91d642640 1 -- 172.21.15.49:0/2183472280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9181f1320 con 0x7ff91814ec40 2023-11-18T21:00:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.096+0000 7ff91d642640 1 --2- 172.21.15.49:0/2183472280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff91814ec40 0x7ff9181ee250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff918072c60 tx=0x7ff91000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.100+0000 7ff9157fa640 1 -- 172.21.15.49:0/2183472280 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910010040 con 0x7ff91814ec40 2023-11-18T21:00:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.100+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2183472280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9181f1600 con 0x7ff91814ec40 2023-11-18T21:00:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.100+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2183472280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9181f1bc0 con 0x7ff91814ec40 2023-11-18T21:00:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.100+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2183472280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff918067520 con 0x7ff91814ec40 2023-11-18T21:00:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.100+0000 7ff9157fa640 1 -- 172.21.15.49:0/2183472280 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91000bb10 con 0x7ff91814ec40 2023-11-18T21:00:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.100+0000 7ff9157fa640 1 -- 172.21.15.49:0/2183472280 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91000be80 con 0x7ff91814ec40 2023-11-18T21:00:41.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.392+0000 7ff9157fa640 1 -- 172.21.15.49:0/2183472280 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff91001d400 con 0x7ff91814ec40 2023-11-18T21:00:41.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.392+0000 7ff9157fa640 1 --2- 172.21.15.49:0/2183472280 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff8fc0664a0 0x7ff8fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:00:41.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.392+0000 7ff91ce41640 1 --2- 172.21.15.49:0/2183472280 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff8fc0664a0 0x7ff8fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:00:41.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.392+0000 7ff91ce41640 1 --2- 172.21.15.49:0/2183472280 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff8fc0664a0 0x7ff8fc068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0af000 tx=0x7ff90c0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:00:41.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.424+0000 7ff9157fa640 1 -- 172.21.15.49:0/2183472280 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff910055a20 con 0x7ff91814ec40 2023-11-18T21:00:41.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.424+0000 7ff9157fa640 1 -- 172.21.15.49:0/2183472280 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9100557f0 con 0x7ff91814ec40 2023-11-18T21:00:41.648 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.648+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2183472280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff9181416b0 con 0x7ff91814ec40 2023-11-18T21:00:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.660+0000 7ff9157fa640 1 -- 172.21.15.49:0/2183472280 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff9100553e0 con 0x7ff91814ec40 2023-11-18T21:00:41.661 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-18T21:00:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.664+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2183472280 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff8fc0664a0 msgr2=0x7ff8fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.664+0000 7ff91f0a5640 1 --2- 172.21.15.49:0/2183472280 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff8fc0664a0 0x7ff8fc068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0af000 tx=0x7ff90c0046d0 comp rx=0 tx=0).stop 2023-11-18T21:00:41.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.664+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2183472280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff91814ec40 msgr2=0x7ff9181ee250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:00:41.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.664+0000 7ff91f0a5640 1 --2- 172.21.15.49:0/2183472280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff91814ec40 0x7ff9181ee250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff918072c60 tx=0x7ff91000b480 comp rx=0 tx=0).stop 2023-11-18T21:00:41.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.664+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2183472280 shutdown_connections 2023-11-18T21:00:41.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.664+0000 7ff91f0a5640 1 --2- 172.21.15.49:0/2183472280 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff8fc0664a0 0x7ff8fc068960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:41.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.664+0000 7ff91f0a5640 1 --2- 172.21.15.49:0/2183472280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff91814ec40 0x7ff9181ee250 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:41.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.664+0000 7ff91f0a5640 1 --2- 172.21.15.49:0/2183472280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff91814da80 0x7ff9181edd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:41.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.664+0000 7ff91f0a5640 1 --2- 172.21.15.49:0/2183472280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9080039f0 0x7ff91813e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:00:41.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.664+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2183472280 >> 172.21.15.49:0/2183472280 conn(0x7ff91806c6a0 msgr2=0x7ff918155340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:00:41.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.664+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2183472280 shutdown_connections 2023-11-18T21:00:41.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:41.664+0000 7ff91f0a5640 1 -- 172.21.15.49:0/2183472280 wait complete. 2023-11-18T21:00:41.682 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-18T21:00:41.682 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T21:00:41.682 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-11-18T21:00:41.682 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-18T21:00:41.682 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T21:00:41.682 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-18T21:00:41.682 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-18T21:00:41.683 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T21:00:41.683 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T21:00:41.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:41.683 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-11-18T21:00:41.689 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T21:00:41.690 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T21:00:41.690 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T21:00:41.690 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-18T21:00:41.690 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-11-18T21:00:41.690 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-18T21:00:41.690 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-18T21:00:41.691 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-11-18T21:00:41.691 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-11-18T21:00:41.691 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-18T21:00:41.691 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-11-18T21:00:41.691 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-11-18T21:00:41.691 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T21:00:41.691 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-11-18T21:00:41.692 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-11-18T21:00:41.692 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-18T21:00:41.692 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42051sec preferred_lft 42051sec 2023-11-18T21:00:41.692 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-11-18T21:00:41.692 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-18T21:00:41.692 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-18T21:00:41.693 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-11-18T21:00:41.693 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-11-18T21:00:41.693 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-18T21:00:41.693 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:fd:06:92:9c brd ff:ff:ff:ff:ff:ff 2023-11-18T21:00:41.694 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-18T21:00:41.694 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-11-18T21:00:41.694 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-18T21:00:41.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:41.694 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-18T21:00:41.694 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-18T21:00:41.694 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2023-11-18T21:00:41.695 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2023-11-18T21:00:41.695 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2023-11-18T21:00:41.695 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-18T21:00:41.695 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-18T21:00:41.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:41.776 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T21:00:41.827 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-11-18T21:00:41.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:41.828 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-11-18T21:00:41.876 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-11-18T21:00:41.876 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T21:00:41.876 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-18T21:00:41.876 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-18T21:00:41.876 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-18T21:00:41.877 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T21:00:41.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:41.877 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-18T21:00:41.877 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-18T21:00:41.878 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-18T21:00:41.878 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-18T21:00:41.878 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-18T21:00:41.878 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-18T21:00:41.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:41.955 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-18T21:00:42.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:42.003 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2023-11-18T21:00:42.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:42.051 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-18T21:00:42.051 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-18T21:00:42.051 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:42.051 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-18T21:00:42.051 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-18T21:00:42.121 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-18T21:00:42.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:42.122 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-18T21:00:42.122 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-18T21:00:42.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-18T21:00:42.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-18T21:00:42.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-18T21:00:42.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-18T21:00:42.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-18T21:00:42.122 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-18T21:00:42.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:42.214 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-11-18T21:00:42.214 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-11-18T21:00:42.214 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-11-18T21:00:42.214 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2023-11-18T21:00:42.214 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-11-18T21:00:42.234 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-11-18T21:00:42.234 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T21:00:42.234 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-18T21:00:42.282 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-18T21:00:42.282 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T21:00:42.283 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-18T21:00:42.330 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-18T21:00:42.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-11-18T21:00:42.387 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T21:00:42.438 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2023-11-18T21:00:42.438 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2023-11-18T21:00:42.438 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2023-11-18T21:00:42.438 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2023-11-18T21:00:42.438 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2023-11-18T21:00:42.438 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2023-11-18T21:00:42.438 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2023-11-18T21:00:42.438 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2023-11-18T21:00:42.438 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2023-11-18T21:00:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2023-11-18T21:00:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2023-11-18T21:00:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2023-11-18T21:00:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T21:00:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2023-11-18T21:00:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2023-11-18T21:00:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2023-11-18T21:00:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2023-11-18T21:00:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2023-11-18T21:00:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2023-11-18T21:00:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2023-11-18T21:00:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2023-11-18T21:00:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2023-11-18T21:00:42.440 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2023-11-18T21:00:42.440 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2023-11-18T21:00:42.440 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T21:00:42.440 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T21:00:42.440 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T21:00:42.440 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T21:00:42.440 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2023-11-18T21:00:42.440 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:42.440 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:42.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:42.441 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-11-18T21:00:42.487 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-18T21:00:42.487 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-18T21:00:42.532 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-11-18T21:00:42.548 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T21:00:42.595 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2023-11-18T21:00:42.595 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2023-11-18T21:00:42.595 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2023-11-18T21:00:42.595 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2023-11-18T21:00:42.595 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2023-11-18T21:00:42.595 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2023-11-18T21:00:42.595 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2023-11-18T21:00:42.595 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2023-11-18T21:00:42.596 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2023-11-18T21:00:42.596 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2023-11-18T21:00:42.596 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2023-11-18T21:00:42.596 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2023-11-18T21:00:42.596 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T21:00:42.596 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2023-11-18T21:00:42.596 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2023-11-18T21:00:42.596 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2023-11-18T21:00:42.596 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2023-11-18T21:00:42.596 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2023-11-18T21:00:42.596 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2023-11-18T21:00:42.596 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2023-11-18T21:00:42.596 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2023-11-18T21:00:42.597 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2023-11-18T21:00:42.597 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2023-11-18T21:00:42.597 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2023-11-18T21:00:42.597 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T21:00:42.597 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T21:00:42.597 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T21:00:42.597 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T21:00:42.597 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2023-11-18T21:00:42.597 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:42.597 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:42.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:42.598 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-11-18T21:00:43.748 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-11-18T21:00:43.763 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T21:00:43.811 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2023-11-18T21:00:43.811 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2023-11-18T21:00:43.811 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2023-11-18T21:00:43.811 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2023-11-18T21:00:43.811 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2023-11-18T21:00:43.811 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2023-11-18T21:00:43.812 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2023-11-18T21:00:43.812 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2023-11-18T21:00:43.812 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2023-11-18T21:00:43.812 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2023-11-18T21:00:43.812 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2023-11-18T21:00:43.812 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2023-11-18T21:00:43.812 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T21:00:43.812 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2023-11-18T21:00:43.812 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2023-11-18T21:00:43.812 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2023-11-18T21:00:43.812 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2023-11-18T21:00:43.812 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2023-11-18T21:00:43.812 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2023-11-18T21:00:43.813 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2023-11-18T21:00:43.813 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2023-11-18T21:00:43.813 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2023-11-18T21:00:43.813 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2023-11-18T21:00:43.813 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2023-11-18T21:00:43.813 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T21:00:43.813 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T21:00:43.813 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T21:00:43.813 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T21:00:43.813 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2023-11-18T21:00:43.813 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:43.813 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:43.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:43.814 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-11-18T21:00:44.964 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-11-18T21:00:44.978 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T21:00:45.027 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2023-11-18T21:00:45.028 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2023-11-18T21:00:45.028 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2023-11-18T21:00:45.028 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2023-11-18T21:00:45.028 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2023-11-18T21:00:45.028 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2023-11-18T21:00:45.028 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2023-11-18T21:00:45.028 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2023-11-18T21:00:45.028 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2023-11-18T21:00:45.028 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2023-11-18T21:00:45.028 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2023-11-18T21:00:45.029 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2023-11-18T21:00:45.029 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T21:00:45.029 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2023-11-18T21:00:45.029 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2023-11-18T21:00:45.029 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2023-11-18T21:00:45.029 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2023-11-18T21:00:45.029 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2023-11-18T21:00:45.029 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2023-11-18T21:00:45.029 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2023-11-18T21:00:45.029 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2023-11-18T21:00:45.029 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2023-11-18T21:00:45.029 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2023-11-18T21:00:45.030 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2023-11-18T21:00:45.030 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T21:00:45.030 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T21:00:45.030 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T21:00:45.030 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T21:00:45.030 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2023-11-18T21:00:45.030 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:45.030 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:45.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:45.031 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-11-18T21:00:46.179 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-11-18T21:00:46.192 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T21:00:46.239 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2023-11-18T21:00:46.239 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2023-11-18T21:00:46.239 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2023-11-18T21:00:46.239 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2023-11-18T21:00:46.239 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2023-11-18T21:00:46.239 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2023-11-18T21:00:46.239 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2023-11-18T21:00:46.239 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2023-11-18T21:00:46.240 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2023-11-18T21:00:46.240 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2023-11-18T21:00:46.240 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2023-11-18T21:00:46.240 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2023-11-18T21:00:46.240 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T21:00:46.240 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2023-11-18T21:00:46.240 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2023-11-18T21:00:46.240 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2023-11-18T21:00:46.240 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2023-11-18T21:00:46.240 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2023-11-18T21:00:46.240 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2023-11-18T21:00:46.240 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2023-11-18T21:00:46.240 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2023-11-18T21:00:46.241 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2023-11-18T21:00:46.241 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2023-11-18T21:00:46.241 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2023-11-18T21:00:46.241 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T21:00:46.241 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T21:00:46.241 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T21:00:46.241 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T21:00:46.241 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2023-11-18T21:00:46.241 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:46.241 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:46.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:46.242 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-11-18T21:00:47.392 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-11-18T21:00:47.405 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T21:00:47.451 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2023-11-18T21:00:47.452 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2023-11-18T21:00:47.452 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2023-11-18T21:00:47.452 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2023-11-18T21:00:47.452 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2023-11-18T21:00:47.452 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2023-11-18T21:00:47.452 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2023-11-18T21:00:47.452 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2023-11-18T21:00:47.452 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2023-11-18T21:00:47.452 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2023-11-18T21:00:47.452 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2023-11-18T21:00:47.453 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2023-11-18T21:00:47.453 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T21:00:47.453 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2023-11-18T21:00:47.453 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2023-11-18T21:00:47.453 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2023-11-18T21:00:47.453 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2023-11-18T21:00:47.453 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2023-11-18T21:00:47.453 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2023-11-18T21:00:47.453 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2023-11-18T21:00:47.453 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2023-11-18T21:00:47.453 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2023-11-18T21:00:47.453 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2023-11-18T21:00:47.453 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2023-11-18T21:00:47.454 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T21:00:47.454 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T21:00:47.454 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T21:00:47.454 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T21:00:47.454 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2023-11-18T21:00:47.454 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:47.454 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:47.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:47.455 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-11-18T21:00:48.604 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-11-18T21:00:48.620 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T21:00:48.669 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2023-11-18T21:00:48.669 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2023-11-18T21:00:48.669 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2023-11-18T21:00:48.669 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2023-11-18T21:00:48.669 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2023-11-18T21:00:48.670 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2023-11-18T21:00:48.670 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2023-11-18T21:00:48.670 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2023-11-18T21:00:48.670 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2023-11-18T21:00:48.670 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2023-11-18T21:00:48.670 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2023-11-18T21:00:48.670 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2023-11-18T21:00:48.670 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T21:00:48.670 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2023-11-18T21:00:48.670 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2023-11-18T21:00:48.670 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2023-11-18T21:00:48.670 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2023-11-18T21:00:48.670 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2023-11-18T21:00:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2023-11-18T21:00:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2023-11-18T21:00:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2023-11-18T21:00:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2023-11-18T21:00:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2023-11-18T21:00:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2023-11-18T21:00:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T21:00:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T21:00:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T21:00:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T21:00:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2023-11-18T21:00:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:48.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:48.672 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-11-18T21:00:49.527 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[46081]: starting ceph client 2023-11-18T21:00:49.629 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2023-11-18T21:00:49.408+0000 68d0100 -1 init, newargv = 0x7e2f180 newargc=15 2023-11-18T21:00:49.819 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-11-18T21:00:49.835 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T21:00:49.888 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2023-11-18T21:00:49.888 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2023-11-18T21:00:49.888 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2023-11-18T21:00:49.888 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2023-11-18T21:00:49.888 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2023-11-18T21:00:49.888 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2023-11-18T21:00:49.888 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2023-11-18T21:00:49.888 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2023-11-18T21:00:49.888 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2023-11-18T21:00:49.889 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2023-11-18T21:00:49.889 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2023-11-18T21:00:49.889 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2023-11-18T21:00:49.889 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T21:00:49.889 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2023-11-18T21:00:49.889 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2023-11-18T21:00:49.889 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2023-11-18T21:00:49.889 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2023-11-18T21:00:49.889 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2023-11-18T21:00:49.889 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2023-11-18T21:00:49.889 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2023-11-18T21:00:49.889 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2023-11-18T21:00:49.890 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2023-11-18T21:00:49.890 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2023-11-18T21:00:49.890 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2023-11-18T21:00:49.890 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T21:00:49.890 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T21:00:49.890 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T21:00:49.890 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T21:00:49.890 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2023-11-18T21:00:49.890 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:49.890 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:49.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:49.891 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-11-18T21:00:51.040 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-11-18T21:00:51.056 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T21:00:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2023-11-18T21:00:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2023-11-18T21:00:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2023-11-18T21:00:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2023-11-18T21:00:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2023-11-18T21:00:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2023-11-18T21:00:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2023-11-18T21:00:51.109 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2023-11-18T21:00:51.109 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2023-11-18T21:00:51.109 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2023-11-18T21:00:51.109 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2023-11-18T21:00:51.109 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2023-11-18T21:00:51.109 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T21:00:51.110 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2023-11-18T21:00:51.110 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2023-11-18T21:00:51.110 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2023-11-18T21:00:51.110 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2023-11-18T21:00:51.110 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2023-11-18T21:00:51.110 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2023-11-18T21:00:51.110 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2023-11-18T21:00:51.111 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2023-11-18T21:00:51.111 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2023-11-18T21:00:51.111 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2023-11-18T21:00:51.111 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2023-11-18T21:00:51.111 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T21:00:51.111 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T21:00:51.111 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T21:00:51.112 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T21:00:51.112 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2023-11-18T21:00:51.112 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:51.112 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:51.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:51.113 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-11-18T21:00:51.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[46081]: starting fuse 2023-11-18T21:00:52.261 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2023-11-18T21:00:52.277 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T21:00:52.323 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2023-11-18T21:00:52.324 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2023-11-18T21:00:52.324 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2023-11-18T21:00:52.324 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2023-11-18T21:00:52.324 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2023-11-18T21:00:52.324 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2023-11-18T21:00:52.324 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2023-11-18T21:00:52.324 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2023-11-18T21:00:52.324 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2023-11-18T21:00:52.325 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2023-11-18T21:00:52.325 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2023-11-18T21:00:52.325 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2023-11-18T21:00:52.325 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T21:00:52.325 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2023-11-18T21:00:52.325 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2023-11-18T21:00:52.325 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2023-11-18T21:00:52.325 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2023-11-18T21:00:52.325 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2023-11-18T21:00:52.326 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2023-11-18T21:00:52.326 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2023-11-18T21:00:52.326 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2023-11-18T21:00:52.326 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2023-11-18T21:00:52.326 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2023-11-18T21:00:52.326 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2023-11-18T21:00:52.326 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T21:00:52.326 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T21:00:52.327 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T21:00:52.327 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T21:00:52.327 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2023-11-18T21:00:52.327 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:52.327 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:00:52.327 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-18T21:00:52.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:52.328 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2023-11-18T21:00:52.375 INFO:teuthology.orchestra.run.smithi049.stdout:45 2023-11-18T21:00:52.375 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-18T21:00:52.375 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2023-11-18T21:00:52.375 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2023-11-18T21:00:52.375 DEBUG:teuthology.orchestra.run.smithi049:> import re 2023-11-18T21:00:52.375 DEBUG:teuthology.orchestra.run.smithi049:> import os 2023-11-18T21:00:52.376 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2023-11-18T21:00:52.376 DEBUG:teuthology.orchestra.run.smithi049:> 2023-11-18T21:00:52.376 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2023-11-18T21:00:52.376 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-18T21:00:52.376 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2023-11-18T21:00:52.376 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-18T21:00:52.376 DEBUG:teuthology.orchestra.run.smithi049:> 2023-11-18T21:00:52.376 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2023-11-18T21:00:52.377 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2023-11-18T21:00:52.377 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2023-11-18T21:00:52.377 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2023-11-18T21:00:52.377 DEBUG:teuthology.orchestra.run.smithi049:> 2023-11-18T21:00:52.377 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2023-11-18T21:00:52.377 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-18T21:00:52.377 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-18T21:00:52.377 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-18T21:00:52.378 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2023-11-18T21:00:52.378 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2023-11-18T21:00:52.378 DEBUG:teuthology.orchestra.run.smithi049:> return f 2023-11-18T21:00:52.378 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-18T21:00:52.378 DEBUG:teuthology.orchestra.run.smithi049:> 2023-11-18T21:00:52.378 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2023-11-18T21:00:52.378 DEBUG:teuthology.orchestra.run.smithi049:> ' 2023-11-18T21:00:52.507 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.46081.asok 2023-11-18T21:00:52.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:00:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-18T21:00:52.519 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46081.asok 2023-11-18T21:00:52.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:52.519 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46081.asok status 2023-11-18T21:00:52.800 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T21:00:52.800 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2023-11-18T21:00:52.801 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe", 2023-11-18T21:00:52.801 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 18.0.0-7418-gb0f45a51 (b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe) reef (dev)", 2023-11-18T21:00:52.801 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2023-11-18T21:00:52.801 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2023-11-18T21:00:52.801 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-18T21:00:52.801 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "46081", 2023-11-18T21:00:52.801 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2023-11-18T21:00:52.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-18T21:00:52.801 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2023-11-18T21:00:52.801 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2023-11-18T21:00:52.801 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4665, 2023-11-18T21:00:52.801 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2023-11-18T21:00:52.801 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2023-11-18T21:00:52.801 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2023-11-18T21:00:52.802 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4665 2023-11-18T21:00:52.802 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-18T21:00:52.802 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-11-18T21:00:52.802 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-11-18T21:00:52.802 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-11-18T21:00:52.802 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 416733838 2023-11-18T21:00:52.802 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-11-18T21:00:52.802 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-18T21:00:52.802 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2023-11-18T21:00:52.802 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2023-11-18T21:00:52.802 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2023-11-18T21:00:52.802 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 416733838 2023-11-18T21:00:52.802 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-11-18T21:00:52.803 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4665 192.168.0.1:0/416733838", 2023-11-18T21:00:52.803 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/416733838", 2023-11-18T21:00:52.803 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2023-11-18T21:00:52.803 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 20, 2023-11-18T21:00:52.803 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 31, 2023-11-18T21:00:52.803 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2023-11-18T21:00:52.803 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2023-11-18T21:00:52.803 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2023-11-18T21:00:52.803 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T21:00:52.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:52.816 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2023-11-18T21:00:52.817 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-18T21:00:52.886 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2023-11-18T21:00:52.886 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-18T21:00:52.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:00:52.886 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-18T21:00:52.935 INFO:teuthology.run_tasks:Running task workunit... 2023-11-18T21:00:52.953 INFO:tasks.workunit:Pulling workunits from ref b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T21:00:52.953 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-18T21:00:52.953 INFO:tasks.workunit:timeout=3h 2023-11-18T21:00:52.953 INFO:tasks.workunit:cleanup=True 2023-11-18T21:00:52.954 DEBUG:teuthology.orchestra.run.smithi049:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-18T21:00:52.961 INFO:teuthology.orchestra.run.smithi049.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-11-18T21:00:52.961 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-11-18T21:00:52.961 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 2dh/45d Inode: 1 Links: 2 2023-11-18T21:00:52.961 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T21:00:52.961 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-11-18T21:00:52.961 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-11-18 20:59:29.855044279 +0000 2023-11-18T21:00:52.962 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-11-18 20:59:47.493997700 +0000 2023-11-18T21:00:52.962 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-11-18T21:00:52.962 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-11-18T21:00:52.962 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-11-18T21:00:54.294 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T21:00:54.301 INFO:tasks.workunit.client.0.smithi049.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-18T21:00:55.520 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:00:55.524 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:01:25.576 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:01:25.578 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:01:39.451 INFO:tasks.workunit.client.0.smithi049.stderr:Note: switching to 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'. 2023-11-18T21:01:39.452 INFO:tasks.workunit.client.0.smithi049.stderr: 2023-11-18T21:01:39.452 INFO:tasks.workunit.client.0.smithi049.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-18T21:01:39.452 INFO:tasks.workunit.client.0.smithi049.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-18T21:01:39.452 INFO:tasks.workunit.client.0.smithi049.stderr:state without impacting any branches by switching back to a branch. 2023-11-18T21:01:39.452 INFO:tasks.workunit.client.0.smithi049.stderr: 2023-11-18T21:01:39.452 INFO:tasks.workunit.client.0.smithi049.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-18T21:01:39.452 INFO:tasks.workunit.client.0.smithi049.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-18T21:01:39.452 INFO:tasks.workunit.client.0.smithi049.stderr: 2023-11-18T21:01:39.452 INFO:tasks.workunit.client.0.smithi049.stderr: git switch -c 2023-11-18T21:01:39.452 INFO:tasks.workunit.client.0.smithi049.stderr: 2023-11-18T21:01:39.452 INFO:tasks.workunit.client.0.smithi049.stderr:Or undo this operation with: 2023-11-18T21:01:39.452 INFO:tasks.workunit.client.0.smithi049.stderr: 2023-11-18T21:01:39.453 INFO:tasks.workunit.client.0.smithi049.stderr: git switch - 2023-11-18T21:01:39.453 INFO:tasks.workunit.client.0.smithi049.stderr: 2023-11-18T21:01:39.453 INFO:tasks.workunit.client.0.smithi049.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-18T21:01:39.453 INFO:tasks.workunit.client.0.smithi049.stderr: 2023-11-18T21:01:39.453 INFO:tasks.workunit.client.0.smithi049.stderr:HEAD is now at b0f45a51a24 Merge pull request #54530 from yuw1/fix_typo 2023-11-18T21:01:39.457 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-18T21:01:39.464 INFO:tasks.workunit.client.0.smithi049.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-18T21:01:39.466 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-18T21:01:39.466 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-18T21:01:40.290 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-18T21:01:42.290 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-18T21:01:42.290 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-18T21:01:42.290 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-18T21:01:42.290 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-18T21:01:42.290 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-18T21:01:42.290 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T21:01:42.291 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-18T21:01:42.339 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-11-18T21:01:42.340 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-11-18T21:01:42.340 DEBUG:teuthology.orchestra.run.smithi049:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-11-18T21:01:42.953 INFO:tasks.workunit.client.0.smithi049.stderr:+ dbench 1 2023-11-18T21:01:42.963 INFO:tasks.workunit.client.0.smithi049.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-11-18T21:01:42.963 INFO:tasks.workunit.client.0.smithi049.stdout: 2023-11-18T21:01:42.963 INFO:tasks.workunit.client.0.smithi049.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-11-18T21:01:42.972 INFO:tasks.workunit.client.0.smithi049.stdout:0 of 1 processes prepared for launch 0 sec 2023-11-18T21:01:43.073 INFO:tasks.workunit.client.0.smithi049.stdout:1 of 1 processes prepared for launch 0 sec 2023-11-18T21:01:43.073 INFO:tasks.workunit.client.0.smithi049.stdout:releasing clients 2023-11-18T21:01:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: 0 7 0.00 MB/sec warmup 1 sec latency 188.843 ms 2023-11-18T21:01:45.073 INFO:tasks.workunit.client.0.smithi049.stdout: 0 10 0.00 MB/sec warmup 2 sec latency 716.760 ms 2023-11-18T21:01:46.073 INFO:tasks.workunit.client.0.smithi049.stdout: 1 31 0.35 MB/sec warmup 3 sec latency 386.984 ms 2023-11-18T21:01:47.073 INFO:tasks.workunit.client.0.smithi049.stdout: 1 63 0.67 MB/sec warmup 4 sec latency 573.660 ms 2023-11-18T21:01:48.073 INFO:tasks.workunit.client.0.smithi049.stdout: 1 91 0.84 MB/sec warmup 5 sec latency 494.636 ms 2023-11-18T21:01:49.073 INFO:tasks.workunit.client.0.smithi049.stdout: 1 113 0.87 MB/sec warmup 6 sec latency 478.976 ms 2023-11-18T21:01:50.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 129 0.82 MB/sec warmup 7 sec latency 509.381 ms 2023-11-18T21:01:51.073 INFO:tasks.workunit.client.0.smithi049.stdout: 1 147 0.79 MB/sec warmup 8 sec latency 469.790 ms 2023-11-18T21:01:52.073 INFO:tasks.workunit.client.0.smithi049.stdout: 1 155 0.73 MB/sec warmup 9 sec latency 1004.601 ms 2023-11-18T21:01:53.073 INFO:tasks.workunit.client.0.smithi049.stdout: 1 165 0.68 MB/sec warmup 10 sec latency 366.736 ms 2023-11-18T21:01:54.073 INFO:tasks.workunit.client.0.smithi049.stdout: 1 181 0.67 MB/sec warmup 11 sec latency 516.777 ms 2023-11-18T21:01:55.073 INFO:tasks.workunit.client.0.smithi049.stdout: 1 197 0.65 MB/sec warmup 12 sec latency 598.958 ms 2023-11-18T21:01:55.633 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:01:55.636 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:01:56.073 INFO:tasks.workunit.client.0.smithi049.stdout: 1 207 0.62 MB/sec warmup 13 sec latency 444.925 ms 2023-11-18T21:01:57.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 223 0.62 MB/sec warmup 14 sec latency 726.367 ms 2023-11-18T21:01:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 236 0.60 MB/sec warmup 15 sec latency 479.213 ms 2023-11-18T21:01:59.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 247 0.59 MB/sec warmup 16 sec latency 466.594 ms 2023-11-18T21:02:00.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 263 0.58 MB/sec warmup 17 sec latency 536.806 ms 2023-11-18T21:02:01.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 279 0.58 MB/sec warmup 18 sec latency 519.830 ms 2023-11-18T21:02:01.519 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-11-18T21:02:01.515+0000 d1ae640 -1 mds.0.bal find_exports balancer runs too long 2023-11-18T21:02:01.520 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-11-18T21:02:01.515+0000 d1ae640 -1 mds.0.bal find_exports balancer runs too long 2023-11-18T21:02:01.520 INFO:tasks.ceph.mds.a.smithi049.stderr:2023-11-18T21:02:01.515+0000 d1ae640 -1 mds.0.bal find_exports balancer runs too long 2023-11-18T21:02:02.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 287 0.56 MB/sec warmup 19 sec latency 759.522 ms 2023-11-18T21:02:03.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 297 0.55 MB/sec warmup 20 sec latency 631.164 ms 2023-11-18T21:02:04.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 313 0.55 MB/sec warmup 21 sec latency 740.594 ms 2023-11-18T21:02:05.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 323 0.53 MB/sec warmup 22 sec latency 487.275 ms 2023-11-18T21:02:06.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 341 0.53 MB/sec warmup 23 sec latency 577.715 ms 2023-11-18T21:02:07.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 349 0.52 MB/sec warmup 24 sec latency 552.147 ms 2023-11-18T21:02:08.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 365 0.52 MB/sec warmup 25 sec latency 634.010 ms 2023-11-18T21:02:09.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 373 0.51 MB/sec warmup 26 sec latency 510.721 ms 2023-11-18T21:02:10.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 389 0.51 MB/sec warmup 27 sec latency 751.549 ms 2023-11-18T21:02:11.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 400 0.50 MB/sec warmup 28 sec latency 556.593 ms 2023-11-18T21:02:12.074 INFO:tasks.workunit.client.0.smithi049.stdout: 1 413 0.50 MB/sec warmup 29 sec latency 459.995 ms 2023-11-18T21:02:13.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 429 0.50 MB/sec warmup 30 sec latency 647.519 ms 2023-11-18T21:02:14.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 445 0.50 MB/sec warmup 31 sec latency 562.534 ms 2023-11-18T21:02:15.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 453 0.50 MB/sec warmup 32 sec latency 609.588 ms 2023-11-18T21:02:16.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 469 0.50 MB/sec warmup 33 sec latency 553.387 ms 2023-11-18T21:02:17.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 477 0.49 MB/sec warmup 34 sec latency 882.989 ms 2023-11-18T21:02:18.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 487 0.48 MB/sec warmup 35 sec latency 652.417 ms 2023-11-18T21:02:19.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 501 0.49 MB/sec warmup 36 sec latency 481.250 ms 2023-11-18T21:02:20.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 511 0.48 MB/sec warmup 37 sec latency 588.247 ms 2023-11-18T21:02:21.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 522 0.48 MB/sec warmup 38 sec latency 672.480 ms 2023-11-18T21:02:22.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 583 0.51 MB/sec warmup 39 sec latency 510.596 ms 2023-11-18T21:02:23.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 603 0.52 MB/sec warmup 40 sec latency 757.870 ms 2023-11-18T21:02:24.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 608 0.51 MB/sec warmup 41 sec latency 856.782 ms 2023-11-18T21:02:25.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 609 0.50 MB/sec warmup 42 sec latency 831.156 ms 2023-11-18T21:02:25.924 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:02:25.927 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:02:26.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 614 0.49 MB/sec warmup 43 sec latency 1029.824 ms 2023-11-18T21:02:27.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 639 0.48 MB/sec warmup 44 sec latency 1537.197 ms 2023-11-18T21:02:28.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 644 0.47 MB/sec warmup 45 sec latency 800.746 ms 2023-11-18T21:02:29.075 INFO:tasks.workunit.client.0.smithi049.stdout: 1 645 0.46 MB/sec warmup 46 sec latency 1012.548 ms 2023-11-18T21:02:30.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 649 0.45 MB/sec warmup 47 sec latency 971.736 ms 2023-11-18T21:02:31.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 653 0.44 MB/sec warmup 48 sec latency 755.645 ms 2023-11-18T21:02:32.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 653 0.43 MB/sec warmup 49 sec latency 1074.744 ms 2023-11-18T21:02:33.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 655 0.42 MB/sec warmup 50 sec latency 1415.072 ms 2023-11-18T21:02:34.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 671 0.42 MB/sec warmup 51 sec latency 340.920 ms 2023-11-18T21:02:35.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 680 0.41 MB/sec warmup 52 sec latency 700.890 ms 2023-11-18T21:02:36.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 682 0.40 MB/sec warmup 53 sec latency 998.026 ms 2023-11-18T21:02:37.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 699 0.39 MB/sec warmup 54 sec latency 1022.298 ms 2023-11-18T21:02:38.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 706 0.39 MB/sec warmup 55 sec latency 453.537 ms 2023-11-18T21:02:39.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 711 0.38 MB/sec warmup 56 sec latency 657.760 ms 2023-11-18T21:02:40.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 712 0.37 MB/sec warmup 57 sec latency 690.212 ms 2023-11-18T21:02:41.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 735 0.37 MB/sec warmup 58 sec latency 365.356 ms 2023-11-18T21:02:42.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 744 0.36 MB/sec warmup 59 sec latency 395.817 ms 2023-11-18T21:02:43.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 746 0.36 MB/sec warmup 60 sec latency 934.220 ms 2023-11-18T21:02:44.076 INFO:tasks.workunit.client.0.smithi049.stdout: 1 747 0.35 MB/sec warmup 61 sec latency 923.251 ms 2023-11-18T21:02:45.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 771 0.34 MB/sec warmup 62 sec latency 546.152 ms 2023-11-18T21:02:46.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 778 0.34 MB/sec warmup 63 sec latency 286.179 ms 2023-11-18T21:02:47.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 779 0.33 MB/sec warmup 64 sec latency 722.757 ms 2023-11-18T21:02:48.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 796 0.33 MB/sec warmup 65 sec latency 549.017 ms 2023-11-18T21:02:49.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 811 0.33 MB/sec warmup 66 sec latency 202.243 ms 2023-11-18T21:02:50.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 812 0.32 MB/sec warmup 67 sec latency 932.178 ms 2023-11-18T21:02:51.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 813 0.32 MB/sec warmup 68 sec latency 1022.911 ms 2023-11-18T21:02:52.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 818 0.31 MB/sec warmup 69 sec latency 1020.314 ms 2023-11-18T21:02:53.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 823 0.31 MB/sec warmup 70 sec latency 986.519 ms 2023-11-18T21:02:54.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 825 0.30 MB/sec warmup 71 sec latency 972.432 ms 2023-11-18T21:02:55.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 853 0.30 MB/sec warmup 72 sec latency 703.111 ms 2023-11-18T21:02:56.056 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:02:56.058 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:02:56.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 854 0.30 MB/sec warmup 73 sec latency 998.959 ms 2023-11-18T21:02:57.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 859 0.29 MB/sec warmup 74 sec latency 1091.248 ms 2023-11-18T21:02:58.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 862 0.29 MB/sec warmup 75 sec latency 543.250 ms 2023-11-18T21:02:59.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 863 0.28 MB/sec warmup 76 sec latency 1033.051 ms 2023-11-18T21:03:00.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1 878 0.28 MB/sec warmup 77 sec latency 582.354 ms 2023-11-18T21:03:01.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 880 0.28 MB/sec warmup 78 sec latency 943.923 ms 2023-11-18T21:03:02.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 894 0.27 MB/sec warmup 79 sec latency 974.883 ms 2023-11-18T21:03:03.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 902 0.27 MB/sec warmup 80 sec latency 363.004 ms 2023-11-18T21:03:04.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 903 0.27 MB/sec warmup 81 sec latency 599.256 ms 2023-11-18T21:03:05.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 919 0.27 MB/sec warmup 82 sec latency 656.271 ms 2023-11-18T21:03:06.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 927 0.26 MB/sec warmup 83 sec latency 429.315 ms 2023-11-18T21:03:07.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 928 0.26 MB/sec warmup 84 sec latency 1089.305 ms 2023-11-18T21:03:08.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 929 0.26 MB/sec warmup 85 sec latency 983.845 ms 2023-11-18T21:03:09.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 931 0.25 MB/sec warmup 86 sec latency 554.667 ms 2023-11-18T21:03:10.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 933 0.25 MB/sec warmup 87 sec latency 987.230 ms 2023-11-18T21:03:11.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 937 0.25 MB/sec warmup 88 sec latency 520.922 ms 2023-11-18T21:03:12.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 942 0.24 MB/sec warmup 89 sec latency 1192.684 ms 2023-11-18T21:03:13.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 955 0.24 MB/sec warmup 90 sec latency 1036.244 ms 2023-11-18T21:03:14.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 964 0.24 MB/sec warmup 91 sec latency 344.517 ms 2023-11-18T21:03:15.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 970 0.24 MB/sec warmup 92 sec latency 589.581 ms 2023-11-18T21:03:16.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 977 0.24 MB/sec warmup 93 sec latency 645.686 ms 2023-11-18T21:03:17.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1 993 0.23 MB/sec warmup 94 sec latency 389.776 ms 2023-11-18T21:03:18.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 994 0.23 MB/sec warmup 95 sec latency 729.859 ms 2023-11-18T21:03:19.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1000 0.23 MB/sec warmup 96 sec latency 975.246 ms 2023-11-18T21:03:20.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1027 0.24 MB/sec warmup 97 sec latency 650.905 ms 2023-11-18T21:03:21.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1029 0.23 MB/sec warmup 98 sec latency 1015.592 ms 2023-11-18T21:03:22.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1033 0.23 MB/sec warmup 99 sec latency 580.909 ms 2023-11-18T21:03:23.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1041 0.23 MB/sec warmup 100 sec latency 1104.963 ms 2023-11-18T21:03:24.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1046 0.23 MB/sec warmup 101 sec latency 773.881 ms 2023-11-18T21:03:25.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1047 0.22 MB/sec warmup 102 sec latency 1034.224 ms 2023-11-18T21:03:26.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1048 0.22 MB/sec warmup 103 sec latency 977.086 ms 2023-11-18T21:03:26.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:03:26.324 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:03:27.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1053 0.22 MB/sec warmup 104 sec latency 874.581 ms 2023-11-18T21:03:28.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1060 0.22 MB/sec warmup 105 sec latency 498.027 ms 2023-11-18T21:03:29.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1064 0.22 MB/sec warmup 106 sec latency 482.715 ms 2023-11-18T21:03:30.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1084 0.21 MB/sec warmup 107 sec latency 524.629 ms 2023-11-18T21:03:31.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1088 0.21 MB/sec warmup 108 sec latency 460.707 ms 2023-11-18T21:03:32.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1089 0.21 MB/sec warmup 109 sec latency 1211.896 ms 2023-11-18T21:03:33.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1099 0.21 MB/sec warmup 110 sec latency 497.312 ms 2023-11-18T21:03:34.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1100 0.21 MB/sec warmup 111 sec latency 913.446 ms 2023-11-18T21:03:35.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1114 0.21 MB/sec warmup 112 sec latency 1024.275 ms 2023-11-18T21:03:36.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1118 0.20 MB/sec warmup 113 sec latency 990.500 ms 2023-11-18T21:03:37.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1132 0.20 MB/sec warmup 114 sec latency 367.356 ms 2023-11-18T21:03:38.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1138 0.20 MB/sec warmup 115 sec latency 463.262 ms 2023-11-18T21:03:39.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1148 0.20 MB/sec warmup 116 sec latency 641.898 ms 2023-11-18T21:03:40.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1157 0.20 MB/sec warmup 117 sec latency 392.980 ms 2023-11-18T21:03:41.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1161 0.20 MB/sec warmup 118 sec latency 993.099 ms 2023-11-18T21:03:42.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1168 0.19 MB/sec warmup 119 sec latency 624.884 ms 2023-11-18T21:03:44.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1170 0.00 MB/sec execute 1 sec latency 1162.622 ms 2023-11-18T21:03:45.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1172 0.00 MB/sec execute 2 sec latency 1030.113 ms 2023-11-18T21:03:46.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1175 0.00 MB/sec execute 3 sec latency 603.649 ms 2023-11-18T21:03:47.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1178 0.00 MB/sec execute 4 sec latency 585.763 ms 2023-11-18T21:03:48.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1181 0.00 MB/sec execute 5 sec latency 439.423 ms 2023-11-18T21:03:49.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1201 0.01 MB/sec execute 6 sec latency 555.764 ms 2023-11-18T21:03:50.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1204 0.01 MB/sec execute 7 sec latency 480.671 ms 2023-11-18T21:03:51.080 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1211 0.00 MB/sec execute 8 sec latency 1004.122 ms 2023-11-18T21:03:52.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1215 0.00 MB/sec execute 9 sec latency 852.173 ms 2023-11-18T21:03:53.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1227 0.01 MB/sec execute 10 sec latency 351.698 ms 2023-11-18T21:03:54.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1233 0.01 MB/sec execute 11 sec latency 464.055 ms 2023-11-18T21:03:55.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1245 0.01 MB/sec execute 12 sec latency 628.526 ms 2023-11-18T21:03:56.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1248 0.01 MB/sec execute 13 sec latency 489.571 ms 2023-11-18T21:03:56.461 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:03:56.464 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:03:57.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1252 0.01 MB/sec execute 14 sec latency 934.189 ms 2023-11-18T21:03:58.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1257 0.01 MB/sec execute 15 sec latency 338.832 ms 2023-11-18T21:03:59.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1274 0.01 MB/sec execute 16 sec latency 323.672 ms 2023-11-18T21:04:00.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1278 0.01 MB/sec execute 17 sec latency 503.457 ms 2023-11-18T21:04:01.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1280 0.01 MB/sec execute 18 sec latency 1048.754 ms 2023-11-18T21:04:02.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1281 0.01 MB/sec execute 19 sec latency 1283.723 ms 2023-11-18T21:04:03.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1284 0.01 MB/sec execute 20 sec latency 1033.488 ms 2023-11-18T21:04:04.081 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1285 0.01 MB/sec execute 21 sec latency 1033.433 ms 2023-11-18T21:04:05.082 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1376 0.14 MB/sec execute 22 sec latency 465.204 ms 2023-11-18T21:04:06.082 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1377 0.13 MB/sec execute 23 sec latency 1030.078 ms 2023-11-18T21:04:07.082 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1377 0.12 MB/sec execute 24 sec latency 1172.436 ms 2023-11-18T21:04:08.082 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1381 0.12 MB/sec execute 25 sec latency 1237.132 ms 2023-11-18T21:04:09.082 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1382 0.11 MB/sec execute 26 sec latency 1039.234 ms 2023-11-18T21:04:10.082 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1385 0.11 MB/sec execute 27 sec latency 837.023 ms 2023-11-18T21:04:11.082 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1396 0.11 MB/sec execute 28 sec latency 1029.033 ms 2023-11-18T21:04:12.082 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1397 0.10 MB/sec execute 29 sec latency 711.648 ms 2023-11-18T21:04:13.082 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1403 0.10 MB/sec execute 30 sec latency 1018.988 ms 2023-11-18T21:04:14.082 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1412 0.10 MB/sec execute 31 sec latency 609.155 ms 2023-11-18T21:04:15.082 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1417 0.09 MB/sec execute 32 sec latency 901.407 ms 2023-11-18T21:04:16.082 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1421 0.09 MB/sec execute 33 sec latency 982.791 ms 2023-11-18T21:04:17.082 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1439 0.09 MB/sec execute 34 sec latency 370.692 ms 2023-11-18T21:04:18.082 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1445 0.09 MB/sec execute 35 sec latency 388.521 ms 2023-11-18T21:04:19.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1448 0.08 MB/sec execute 36 sec latency 572.832 ms 2023-11-18T21:04:20.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1451 0.08 MB/sec execute 37 sec latency 1017.508 ms 2023-11-18T21:04:21.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1465 0.08 MB/sec execute 38 sec latency 185.933 ms 2023-11-18T21:04:22.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1466 0.08 MB/sec execute 39 sec latency 664.521 ms 2023-11-18T21:04:23.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1477 0.08 MB/sec execute 40 sec latency 1207.462 ms 2023-11-18T21:04:24.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1485 0.07 MB/sec execute 41 sec latency 719.010 ms 2023-11-18T21:04:25.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1488 0.07 MB/sec execute 42 sec latency 982.822 ms 2023-11-18T21:04:26.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1490 0.07 MB/sec execute 43 sec latency 631.496 ms 2023-11-18T21:04:26.533 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:04:26.536 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:04:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1499 0.07 MB/sec execute 44 sec latency 1004.729 ms 2023-11-18T21:04:28.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1502 0.07 MB/sec execute 45 sec latency 580.883 ms 2023-11-18T21:04:29.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1514 0.07 MB/sec execute 46 sec latency 431.719 ms 2023-11-18T21:04:30.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1523 0.07 MB/sec execute 47 sec latency 329.988 ms 2023-11-18T21:04:31.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1526 0.06 MB/sec execute 48 sec latency 569.621 ms 2023-11-18T21:04:32.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1530 0.06 MB/sec execute 49 sec latency 1030.975 ms 2023-11-18T21:04:33.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1536 0.06 MB/sec execute 50 sec latency 1140.099 ms 2023-11-18T21:04:34.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1552 0.06 MB/sec execute 51 sec latency 428.664 ms 2023-11-18T21:04:35.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1555 0.06 MB/sec execute 52 sec latency 688.720 ms 2023-11-18T21:04:36.083 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1564 0.06 MB/sec execute 53 sec latency 1047.240 ms 2023-11-18T21:04:37.084 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1578 0.06 MB/sec execute 54 sec latency 150.226 ms 2023-11-18T21:04:38.084 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1588 0.06 MB/sec execute 55 sec latency 186.676 ms 2023-11-18T21:04:39.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1589 0.06 MB/sec execute 56 sec latency 677.410 ms 2023-11-18T21:04:40.084 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1602 0.06 MB/sec execute 57 sec latency 1029.172 ms 2023-11-18T21:04:41.084 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1606 0.05 MB/sec execute 58 sec latency 496.403 ms 2023-11-18T21:04:42.084 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1610 0.05 MB/sec execute 59 sec latency 1086.209 ms 2023-11-18T21:04:43.084 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1612 0.05 MB/sec execute 60 sec latency 1020.673 ms 2023-11-18T21:04:44.084 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1617 0.05 MB/sec execute 61 sec latency 322.723 ms 2023-11-18T21:04:45.084 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1619 0.05 MB/sec execute 62 sec latency 978.503 ms 2023-11-18T21:04:46.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1641 0.05 MB/sec execute 63 sec latency 319.051 ms 2023-11-18T21:04:47.084 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1643 0.05 MB/sec execute 64 sec latency 1092.984 ms 2023-11-18T21:04:48.084 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1644 0.05 MB/sec execute 65 sec latency 624.419 ms 2023-11-18T21:04:49.084 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1653 0.05 MB/sec execute 66 sec latency 969.690 ms 2023-11-18T21:04:50.084 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1662 0.05 MB/sec execute 67 sec latency 581.560 ms 2023-11-18T21:04:51.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1682 0.05 MB/sec execute 68 sec latency 424.532 ms 2023-11-18T21:04:52.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1686 0.05 MB/sec execute 69 sec latency 699.988 ms 2023-11-18T21:04:53.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1689 0.05 MB/sec execute 70 sec latency 779.182 ms 2023-11-18T21:04:54.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1698 0.05 MB/sec execute 71 sec latency 579.849 ms 2023-11-18T21:04:55.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1701 0.04 MB/sec execute 72 sec latency 642.917 ms 2023-11-18T21:04:56.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1707 0.04 MB/sec execute 73 sec latency 1013.067 ms 2023-11-18T21:04:56.650 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:04:56.653 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:04:57.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1713 0.04 MB/sec execute 74 sec latency 1075.922 ms 2023-11-18T21:04:58.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1727 0.04 MB/sec execute 75 sec latency 144.522 ms 2023-11-18T21:04:59.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1759 0.04 MB/sec execute 76 sec latency 303.823 ms 2023-11-18T21:05:00.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1770 0.04 MB/sec execute 77 sec latency 367.107 ms 2023-11-18T21:05:01.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1772 0.04 MB/sec execute 78 sec latency 632.980 ms 2023-11-18T21:05:02.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1787 0.04 MB/sec execute 79 sec latency 1071.800 ms 2023-11-18T21:05:03.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1804 0.04 MB/sec execute 80 sec latency 193.325 ms 2023-11-18T21:05:04.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1806 0.04 MB/sec execute 81 sec latency 586.949 ms 2023-11-18T21:05:05.085 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1816 0.04 MB/sec execute 82 sec latency 1057.732 ms 2023-11-18T21:05:06.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1822 0.04 MB/sec execute 83 sec latency 405.300 ms 2023-11-18T21:05:07.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1825 0.04 MB/sec execute 84 sec latency 1086.031 ms 2023-11-18T21:05:08.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1826 0.04 MB/sec execute 85 sec latency 934.870 ms 2023-11-18T21:05:09.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1838 0.04 MB/sec execute 86 sec latency 1027.509 ms 2023-11-18T21:05:10.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1841 0.04 MB/sec execute 87 sec latency 354.530 ms 2023-11-18T21:05:11.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1843 0.04 MB/sec execute 88 sec latency 986.061 ms 2023-11-18T21:05:12.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1858 0.04 MB/sec execute 89 sec latency 400.705 ms 2023-11-18T21:05:13.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1862 0.04 MB/sec execute 90 sec latency 952.310 ms 2023-11-18T21:05:14.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1864 0.04 MB/sec execute 91 sec latency 1025.116 ms 2023-11-18T21:05:15.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1868 0.04 MB/sec execute 92 sec latency 303.271 ms 2023-11-18T21:05:16.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.04 MB/sec execute 93 sec latency 983.202 ms 2023-11-18T21:05:17.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.04 MB/sec execute 94 sec latency 1983.234 ms 2023-11-18T21:05:18.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.04 MB/sec execute 95 sec latency 2983.307 ms 2023-11-18T21:05:19.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 96 sec latency 3983.393 ms 2023-11-18T21:05:20.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 97 sec latency 4983.476 ms 2023-11-18T21:05:21.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 98 sec latency 5983.559 ms 2023-11-18T21:05:22.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 99 sec latency 6983.639 ms 2023-11-18T21:05:23.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 100 sec latency 7983.720 ms 2023-11-18T21:05:24.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 101 sec latency 8983.803 ms 2023-11-18T21:05:25.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 102 sec latency 9983.887 ms 2023-11-18T21:05:26.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 103 sec latency 10983.970 ms 2023-11-18T21:05:26.755 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:05:26.758 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:05:27.086 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 104 sec latency 11984.054 ms 2023-11-18T21:05:28.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 105 sec latency 12984.136 ms 2023-11-18T21:05:29.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 106 sec latency 13984.220 ms 2023-11-18T21:05:30.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 107 sec latency 14984.302 ms 2023-11-18T21:05:31.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 108 sec latency 15984.391 ms 2023-11-18T21:05:32.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 109 sec latency 16984.476 ms 2023-11-18T21:05:33.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 110 sec latency 17984.559 ms 2023-11-18T21:05:34.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1869 0.03 MB/sec execute 111 sec latency 18984.647 ms 2023-11-18T21:05:35.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1889 0.03 MB/sec execute 112 sec latency 19331.807 ms 2023-11-18T21:05:36.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1898 0.03 MB/sec execute 113 sec latency 772.128 ms 2023-11-18T21:05:37.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1903 0.03 MB/sec execute 114 sec latency 1045.631 ms 2023-11-18T21:05:38.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1909 0.03 MB/sec execute 115 sec latency 972.769 ms 2023-11-18T21:05:39.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1912 0.03 MB/sec execute 116 sec latency 670.682 ms 2023-11-18T21:05:40.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1920 0.03 MB/sec execute 117 sec latency 1031.864 ms 2023-11-18T21:05:41.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1940 0.03 MB/sec execute 118 sec latency 1034.695 ms 2023-11-18T21:05:42.087 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1960 0.03 MB/sec execute 119 sec latency 390.248 ms 2023-11-18T21:05:43.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1972 0.03 MB/sec execute 120 sec latency 304.807 ms 2023-11-18T21:05:44.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1975 0.03 MB/sec execute 121 sec latency 694.099 ms 2023-11-18T21:05:45.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1975 0.03 MB/sec execute 122 sec latency 1134.606 ms 2023-11-18T21:05:46.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1995 0.03 MB/sec execute 123 sec latency 1173.502 ms 2023-11-18T21:05:47.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 1997 0.03 MB/sec execute 124 sec latency 656.980 ms 2023-11-18T21:05:48.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2008 0.03 MB/sec execute 125 sec latency 1008.017 ms 2023-11-18T21:05:49.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2022 0.03 MB/sec execute 126 sec latency 162.901 ms 2023-11-18T21:05:50.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2034 0.03 MB/sec execute 127 sec latency 166.795 ms 2023-11-18T21:05:51.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2041 0.03 MB/sec execute 128 sec latency 971.251 ms 2023-11-18T21:05:52.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2043 0.03 MB/sec execute 129 sec latency 852.318 ms 2023-11-18T21:05:53.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2051 0.03 MB/sec execute 130 sec latency 1235.304 ms 2023-11-18T21:05:54.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2053 0.03 MB/sec execute 131 sec latency 962.296 ms 2023-11-18T21:05:55.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2056 0.03 MB/sec execute 132 sec latency 1173.185 ms 2023-11-18T21:05:56.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2061 0.03 MB/sec execute 133 sec latency 325.275 ms 2023-11-18T21:05:57.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:05:57.057 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:05:57.088 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2061 0.03 MB/sec execute 134 sec latency 1026.870 ms 2023-11-18T21:05:58.089 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2079 0.03 MB/sec execute 135 sec latency 1034.586 ms 2023-11-18T21:05:59.089 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2081 0.03 MB/sec execute 136 sec latency 994.573 ms 2023-11-18T21:06:00.089 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2088 0.03 MB/sec execute 137 sec latency 1004.690 ms 2023-11-18T21:06:01.089 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2093 0.03 MB/sec execute 138 sec latency 464.432 ms 2023-11-18T21:06:02.089 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2096 0.03 MB/sec execute 139 sec latency 1051.124 ms 2023-11-18T21:06:03.089 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2103 0.03 MB/sec execute 140 sec latency 1151.189 ms 2023-11-18T21:06:04.089 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2137 0.03 MB/sec execute 141 sec latency 288.178 ms 2023-11-18T21:06:05.089 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2140 0.03 MB/sec execute 142 sec latency 685.736 ms 2023-11-18T21:06:06.089 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2141 0.03 MB/sec execute 143 sec latency 1050.037 ms 2023-11-18T21:06:07.089 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2146 0.03 MB/sec execute 144 sec latency 911.911 ms 2023-11-18T21:06:08.090 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2173 0.03 MB/sec execute 145 sec latency 943.807 ms 2023-11-18T21:06:09.090 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2175 0.03 MB/sec execute 146 sec latency 980.457 ms 2023-11-18T21:06:10.089 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2176 0.03 MB/sec execute 147 sec latency 1021.272 ms 2023-11-18T21:06:11.089 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2181 0.03 MB/sec execute 148 sec latency 190.826 ms 2023-11-18T21:06:12.089 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2183 0.03 MB/sec execute 149 sec latency 823.450 ms 2023-11-18T21:06:13.090 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2198 0.02 MB/sec execute 150 sec latency 1090.844 ms 2023-11-18T21:06:14.089 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2202 0.02 MB/sec execute 151 sec latency 396.884 ms 2023-11-18T21:06:15.090 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2221 0.02 MB/sec execute 152 sec latency 355.039 ms 2023-11-18T21:06:16.090 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2232 0.02 MB/sec execute 153 sec latency 987.328 ms 2023-11-18T21:06:17.090 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2258 0.02 MB/sec execute 154 sec latency 357.933 ms 2023-11-18T21:06:18.090 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2291 0.03 MB/sec execute 155 sec latency 285.564 ms 2023-11-18T21:06:19.090 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2292 0.03 MB/sec execute 156 sec latency 678.523 ms 2023-11-18T21:06:20.090 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2297 0.03 MB/sec execute 157 sec latency 1144.780 ms 2023-11-18T21:06:21.090 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2303 0.03 MB/sec execute 158 sec latency 368.773 ms 2023-11-18T21:06:22.090 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2306 0.03 MB/sec execute 159 sec latency 1040.407 ms 2023-11-18T21:06:23.090 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2307 0.03 MB/sec execute 160 sec latency 1158.012 ms 2023-11-18T21:06:24.090 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2321 0.03 MB/sec execute 161 sec latency 1102.316 ms 2023-11-18T21:06:25.090 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2324 0.03 MB/sec execute 162 sec latency 911.916 ms 2023-11-18T21:06:26.091 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2326 0.03 MB/sec execute 163 sec latency 988.611 ms 2023-11-18T21:06:27.091 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2333 0.03 MB/sec execute 164 sec latency 518.430 ms 2023-11-18T21:06:27.186 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:06:27.189 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:06:28.091 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2335 0.03 MB/sec execute 165 sec latency 531.730 ms 2023-11-18T21:06:29.091 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2337 0.03 MB/sec execute 166 sec latency 1025.532 ms 2023-11-18T21:06:30.091 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2340 0.03 MB/sec execute 167 sec latency 735.480 ms 2023-11-18T21:06:31.091 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2350 0.03 MB/sec execute 168 sec latency 1081.104 ms 2023-11-18T21:06:32.091 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2359 0.03 MB/sec execute 169 sec latency 472.315 ms 2023-11-18T21:06:33.091 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2361 0.03 MB/sec execute 170 sec latency 598.608 ms 2023-11-18T21:06:34.091 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2362 0.03 MB/sec execute 171 sec latency 1000.132 ms 2023-11-18T21:06:35.091 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2364 0.03 MB/sec execute 172 sec latency 1108.673 ms 2023-11-18T21:06:36.092 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2366 0.03 MB/sec execute 173 sec latency 1037.016 ms 2023-11-18T21:06:37.092 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2368 0.03 MB/sec execute 174 sec latency 1132.106 ms 2023-11-18T21:06:38.092 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2371 0.03 MB/sec execute 175 sec latency 653.228 ms 2023-11-18T21:06:39.092 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2382 0.03 MB/sec execute 176 sec latency 1002.384 ms 2023-11-18T21:06:40.092 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2388 0.03 MB/sec execute 177 sec latency 342.164 ms 2023-11-18T21:06:41.092 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2391 0.03 MB/sec execute 178 sec latency 561.620 ms 2023-11-18T21:06:42.092 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2394 0.03 MB/sec execute 179 sec latency 991.097 ms 2023-11-18T21:06:43.092 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2399 0.03 MB/sec execute 180 sec latency 344.241 ms 2023-11-18T21:06:44.092 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2402 0.03 MB/sec execute 181 sec latency 567.783 ms 2023-11-18T21:06:45.092 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2410 0.03 MB/sec execute 182 sec latency 491.945 ms 2023-11-18T21:06:46.092 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2412 0.03 MB/sec execute 183 sec latency 997.713 ms 2023-11-18T21:06:47.094 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2424 0.03 MB/sec execute 184 sec latency 368.862 ms 2023-11-18T21:06:48.093 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2429 0.03 MB/sec execute 185 sec latency 589.067 ms 2023-11-18T21:06:49.093 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2431 0.03 MB/sec execute 186 sec latency 700.677 ms 2023-11-18T21:06:50.093 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2432 0.03 MB/sec execute 187 sec latency 1111.190 ms 2023-11-18T21:06:51.093 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2436 0.03 MB/sec execute 188 sec latency 1029.741 ms 2023-11-18T21:06:52.093 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2440 0.03 MB/sec execute 189 sec latency 331.251 ms 2023-11-18T21:06:53.093 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2447 0.03 MB/sec execute 190 sec latency 487.483 ms 2023-11-18T21:06:54.093 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2451 0.03 MB/sec execute 191 sec latency 567.507 ms 2023-11-18T21:06:55.093 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2454 0.03 MB/sec execute 192 sec latency 499.562 ms 2023-11-18T21:06:56.093 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2467 0.03 MB/sec execute 193 sec latency 563.964 ms 2023-11-18T21:06:57.093 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2470 0.03 MB/sec execute 194 sec latency 672.425 ms 2023-11-18T21:06:57.227 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:06:57.230 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:06:58.093 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2484 0.03 MB/sec execute 195 sec latency 933.026 ms 2023-11-18T21:06:59.093 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2489 0.03 MB/sec execute 196 sec latency 427.517 ms 2023-11-18T21:07:00.093 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2492 0.03 MB/sec execute 197 sec latency 797.419 ms 2023-11-18T21:07:01.094 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2494 0.03 MB/sec execute 198 sec latency 1011.270 ms 2023-11-18T21:07:02.094 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2497 0.03 MB/sec execute 199 sec latency 1058.681 ms 2023-11-18T21:07:03.094 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2503 0.03 MB/sec execute 200 sec latency 327.328 ms 2023-11-18T21:07:04.094 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2506 0.03 MB/sec execute 201 sec latency 842.762 ms 2023-11-18T21:07:05.095 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2549 0.03 MB/sec execute 202 sec latency 1079.867 ms 2023-11-18T21:07:06.094 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2551 0.03 MB/sec execute 203 sec latency 991.039 ms 2023-11-18T21:07:07.094 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2556 0.03 MB/sec execute 204 sec latency 1145.248 ms 2023-11-18T21:07:08.094 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2560 0.03 MB/sec execute 205 sec latency 523.073 ms 2023-11-18T21:07:09.094 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2561 0.03 MB/sec execute 206 sec latency 1022.857 ms 2023-11-18T21:07:10.095 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2566 0.03 MB/sec execute 207 sec latency 367.819 ms 2023-11-18T21:07:11.095 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2577 0.03 MB/sec execute 208 sec latency 456.396 ms 2023-11-18T21:07:12.095 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2580 0.03 MB/sec execute 209 sec latency 531.910 ms 2023-11-18T21:07:13.095 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2581 0.03 MB/sec execute 210 sec latency 1034.896 ms 2023-11-18T21:07:14.095 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2583 0.03 MB/sec execute 211 sec latency 1028.840 ms 2023-11-18T21:07:15.095 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2592 0.03 MB/sec execute 212 sec latency 415.265 ms 2023-11-18T21:07:16.095 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2597 0.03 MB/sec execute 213 sec latency 563.978 ms 2023-11-18T21:07:17.095 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2600 0.03 MB/sec execute 214 sec latency 578.779 ms 2023-11-18T21:07:18.095 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2604 0.03 MB/sec execute 215 sec latency 1033.255 ms 2023-11-18T21:07:19.095 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2608 0.03 MB/sec execute 216 sec latency 351.632 ms 2023-11-18T21:07:20.095 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2615 0.03 MB/sec execute 217 sec latency 587.497 ms 2023-11-18T21:07:21.095 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2617 0.03 MB/sec execute 218 sec latency 1063.657 ms 2023-11-18T21:07:22.096 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2618 0.03 MB/sec execute 219 sec latency 1018.141 ms 2023-11-18T21:07:23.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2618 0.03 MB/sec execute 220 sec latency 1017.624 ms 2023-11-18T21:07:24.096 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2621 0.03 MB/sec execute 221 sec latency 1020.922 ms 2023-11-18T21:07:25.096 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2717 0.04 MB/sec execute 222 sec latency 1186.563 ms 2023-11-18T21:07:26.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2718 0.04 MB/sec execute 223 sec latency 845.631 ms 2023-11-18T21:07:27.096 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2745 0.04 MB/sec execute 224 sec latency 1086.680 ms 2023-11-18T21:07:27.341 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:07:27.343 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:07:28.096 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2750 0.04 MB/sec execute 225 sec latency 955.003 ms 2023-11-18T21:07:29.096 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2759 0.04 MB/sec execute 226 sec latency 338.189 ms 2023-11-18T21:07:30.096 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2760 0.04 MB/sec execute 227 sec latency 844.574 ms 2023-11-18T21:07:31.096 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2764 0.04 MB/sec execute 228 sec latency 951.789 ms 2023-11-18T21:07:32.096 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2770 0.04 MB/sec execute 229 sec latency 457.773 ms 2023-11-18T21:07:33.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2776 0.04 MB/sec execute 230 sec latency 527.753 ms 2023-11-18T21:07:34.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2780 0.04 MB/sec execute 231 sec latency 557.158 ms 2023-11-18T21:07:34.298 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:09:34.348 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:07:34.593 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:09:34.583 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:07:34.638 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:09:34.687 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:07:34.654 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:09:34.645 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:07:34.809 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:09:34.799 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:07:34.834 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:09:34.826 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:07:35.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2793 0.04 MB/sec execute 232 sec latency 1118.901 ms 2023-11-18T21:07:35.961 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:09:36.010 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:07:36.051 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:09:36.041 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:07:36.087 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:09:36.078 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:07:36.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2826 0.04 MB/sec execute 233 sec latency 804.124 ms 2023-11-18T21:07:37.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2872 0.04 MB/sec execute 234 sec latency 1317.997 ms 2023-11-18T21:07:38.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2876 0.04 MB/sec execute 235 sec latency 834.793 ms 2023-11-18T21:07:39.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2880 0.04 MB/sec execute 236 sec latency 328.485 ms 2023-11-18T21:07:40.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2896 0.04 MB/sec execute 237 sec latency 546.232 ms 2023-11-18T21:07:41.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2900 0.04 MB/sec execute 238 sec latency 591.728 ms 2023-11-18T21:07:42.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2902 0.04 MB/sec execute 239 sec latency 389.971 ms 2023-11-18T21:07:43.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2917 0.04 MB/sec execute 240 sec latency 598.145 ms 2023-11-18T21:07:44.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2925 0.04 MB/sec execute 241 sec latency 630.945 ms 2023-11-18T21:07:45.097 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2931 0.04 MB/sec execute 242 sec latency 508.615 ms 2023-11-18T21:07:46.098 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2932 0.04 MB/sec execute 243 sec latency 595.724 ms 2023-11-18T21:07:47.098 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2938 0.04 MB/sec execute 244 sec latency 535.375 ms 2023-11-18T21:07:48.098 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2966 0.04 MB/sec execute 245 sec latency 1056.006 ms 2023-11-18T21:07:49.098 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2967 0.04 MB/sec execute 246 sec latency 1008.478 ms 2023-11-18T21:07:50.098 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2973 0.04 MB/sec execute 247 sec latency 343.728 ms 2023-11-18T21:07:51.098 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2974 0.04 MB/sec execute 248 sec latency 774.296 ms 2023-11-18T21:07:52.098 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2977 0.04 MB/sec execute 249 sec latency 1004.213 ms 2023-11-18T21:07:53.098 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2985 0.04 MB/sec execute 250 sec latency 474.608 ms 2023-11-18T21:07:54.098 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2990 0.04 MB/sec execute 251 sec latency 499.484 ms 2023-11-18T21:07:55.098 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2994 0.04 MB/sec execute 252 sec latency 505.184 ms 2023-11-18T21:07:56.098 INFO:tasks.workunit.client.0.smithi049.stdout: 1 2996 0.04 MB/sec execute 253 sec latency 1019.081 ms 2023-11-18T21:07:57.098 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3008 0.04 MB/sec execute 254 sec latency 332.930 ms 2023-11-18T21:07:57.397 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:07:57.401 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:07:58.099 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3013 0.04 MB/sec execute 255 sec latency 585.563 ms 2023-11-18T21:07:59.099 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3019 0.04 MB/sec execute 256 sec latency 490.598 ms 2023-11-18T21:08:00.099 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3024 0.04 MB/sec execute 257 sec latency 346.765 ms 2023-11-18T21:08:01.099 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3031 0.04 MB/sec execute 258 sec latency 505.652 ms 2023-11-18T21:08:02.099 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3167 0.04 MB/sec execute 259 sec latency 1168.315 ms 2023-11-18T21:08:03.099 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3167 0.04 MB/sec execute 260 sec latency 1026.292 ms 2023-11-18T21:08:04.099 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3171 0.04 MB/sec execute 261 sec latency 1057.859 ms 2023-11-18T21:08:05.099 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3176 0.04 MB/sec execute 262 sec latency 358.130 ms 2023-11-18T21:08:06.040 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:10:06.090 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:08:06.052 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:10:06.102 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:08:06.099 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3188 0.04 MB/sec execute 263 sec latency 549.917 ms 2023-11-18T21:08:06.173 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:10:06.163 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:08:06.256 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:10:06.306 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:08:06.280 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:10:06.271 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:08:06.286 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:10:06.277 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:08:06.320 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:10:06.311 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:08:06.560 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:10:06.551 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:08:06.565 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:10:06.555 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:08:07.099 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3189 0.04 MB/sec execute 264 sec latency 861.311 ms 2023-11-18T21:08:08.099 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3200 0.04 MB/sec execute 265 sec latency 444.182 ms 2023-11-18T21:08:09.099 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3209 0.04 MB/sec execute 266 sec latency 343.641 ms 2023-11-18T21:08:10.099 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3212 0.04 MB/sec execute 267 sec latency 557.834 ms 2023-11-18T21:08:11.100 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3263 0.05 MB/sec execute 268 sec latency 310.692 ms 2023-11-18T21:08:12.100 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3266 0.05 MB/sec execute 269 sec latency 964.412 ms 2023-11-18T21:08:13.100 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3268 0.05 MB/sec execute 270 sec latency 1163.036 ms 2023-11-18T21:08:14.100 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3275 0.05 MB/sec execute 271 sec latency 1006.577 ms 2023-11-18T21:08:15.100 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3280 0.05 MB/sec execute 272 sec latency 470.925 ms 2023-11-18T21:08:16.100 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3281 0.05 MB/sec execute 273 sec latency 1052.639 ms 2023-11-18T21:08:17.101 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3282 0.04 MB/sec execute 274 sec latency 986.496 ms 2023-11-18T21:08:18.100 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3283 0.04 MB/sec execute 275 sec latency 1038.923 ms 2023-11-18T21:08:19.100 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3285 0.04 MB/sec execute 276 sec latency 958.127 ms 2023-11-18T21:08:20.100 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3286 0.04 MB/sec execute 277 sec latency 984.304 ms 2023-11-18T21:08:21.100 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3287 0.04 MB/sec execute 278 sec latency 971.204 ms 2023-11-18T21:08:22.100 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3290 0.04 MB/sec execute 279 sec latency 1129.143 ms 2023-11-18T21:08:23.100 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3291 0.04 MB/sec execute 280 sec latency 1054.333 ms 2023-11-18T21:08:24.101 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3292 0.04 MB/sec execute 281 sec latency 1043.059 ms 2023-11-18T21:08:25.101 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3292 0.04 MB/sec execute 282 sec latency 1171.521 ms 2023-11-18T21:08:26.101 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3293 0.04 MB/sec execute 283 sec latency 1302.624 ms 2023-11-18T21:08:27.101 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3294 0.04 MB/sec execute 284 sec latency 983.571 ms 2023-11-18T21:08:27.546 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:08:27.549 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:08:28.101 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3295 0.04 MB/sec execute 285 sec latency 1042.753 ms 2023-11-18T21:08:29.101 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3298 0.04 MB/sec execute 286 sec latency 1034.597 ms 2023-11-18T21:08:30.101 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3299 0.04 MB/sec execute 287 sec latency 1114.540 ms 2023-11-18T21:08:31.101 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3303 0.04 MB/sec execute 288 sec latency 972.025 ms 2023-11-18T21:08:32.101 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3306 0.04 MB/sec execute 289 sec latency 1014.964 ms 2023-11-18T21:08:33.101 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3307 0.04 MB/sec execute 290 sec latency 1058.982 ms 2023-11-18T21:08:34.101 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3308 0.04 MB/sec execute 291 sec latency 1036.359 ms 2023-11-18T21:08:35.101 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3309 0.04 MB/sec execute 292 sec latency 1151.090 ms 2023-11-18T21:08:36.101 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3310 0.04 MB/sec execute 293 sec latency 978.043 ms 2023-11-18T21:08:37.102 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3311 0.04 MB/sec execute 294 sec latency 1145.847 ms 2023-11-18T21:08:38.102 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3312 0.04 MB/sec execute 295 sec latency 949.553 ms 2023-11-18T21:08:39.102 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3313 0.04 MB/sec execute 296 sec latency 1029.597 ms 2023-11-18T21:08:40.102 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3314 0.04 MB/sec execute 297 sec latency 1081.844 ms 2023-11-18T21:08:41.102 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3316 0.04 MB/sec execute 298 sec latency 933.127 ms 2023-11-18T21:08:42.102 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3317 0.04 MB/sec execute 299 sec latency 995.692 ms 2023-11-18T21:08:43.102 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3318 0.04 MB/sec execute 300 sec latency 1023.281 ms 2023-11-18T21:08:44.102 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3319 0.04 MB/sec execute 301 sec latency 1028.668 ms 2023-11-18T21:08:45.102 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3319 0.04 MB/sec execute 302 sec latency 1113.805 ms 2023-11-18T21:08:46.102 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3321 0.04 MB/sec execute 303 sec latency 1130.334 ms 2023-11-18T21:08:47.102 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3322 0.04 MB/sec execute 304 sec latency 996.623 ms 2023-11-18T21:08:48.102 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3323 0.04 MB/sec execute 305 sec latency 1019.303 ms 2023-11-18T21:08:49.103 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3324 0.04 MB/sec execute 306 sec latency 995.801 ms 2023-11-18T21:08:50.103 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3325 0.04 MB/sec execute 307 sec latency 1022.078 ms 2023-11-18T21:08:51.103 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3326 0.04 MB/sec execute 308 sec latency 1037.481 ms 2023-11-18T21:08:52.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3327 0.04 MB/sec execute 309 sec latency 1017.814 ms 2023-11-18T21:08:53.103 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3330 0.04 MB/sec execute 310 sec latency 1043.420 ms 2023-11-18T21:08:54.103 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3331 0.04 MB/sec execute 311 sec latency 994.135 ms 2023-11-18T21:08:55.103 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3332 0.04 MB/sec execute 312 sec latency 1054.244 ms 2023-11-18T21:08:56.103 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3333 0.04 MB/sec execute 313 sec latency 1037.015 ms 2023-11-18T21:08:57.103 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3334 0.04 MB/sec execute 314 sec latency 1019.437 ms 2023-11-18T21:08:57.593 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:08:57.596 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:08:58.103 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3335 0.04 MB/sec execute 315 sec latency 1019.062 ms 2023-11-18T21:08:59.103 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3336 0.04 MB/sec execute 316 sec latency 992.091 ms 2023-11-18T21:09:00.103 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3337 0.04 MB/sec execute 317 sec latency 961.557 ms 2023-11-18T21:09:01.104 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3343 0.04 MB/sec execute 318 sec latency 873.280 ms 2023-11-18T21:09:02.104 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3352 0.04 MB/sec execute 319 sec latency 369.347 ms 2023-11-18T21:09:03.104 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3359 0.04 MB/sec execute 320 sec latency 543.161 ms 2023-11-18T21:09:04.104 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3364 0.04 MB/sec execute 321 sec latency 528.682 ms 2023-11-18T21:09:05.104 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3366 0.04 MB/sec execute 322 sec latency 497.231 ms 2023-11-18T21:09:06.104 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3374 0.04 MB/sec execute 323 sec latency 538.667 ms 2023-11-18T21:09:07.104 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3378 0.04 MB/sec execute 324 sec latency 335.838 ms 2023-11-18T21:09:08.104 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3387 0.04 MB/sec execute 325 sec latency 510.647 ms 2023-11-18T21:09:09.104 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3391 0.04 MB/sec execute 326 sec latency 569.562 ms 2023-11-18T21:09:10.104 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3393 0.04 MB/sec execute 327 sec latency 1228.079 ms 2023-11-18T21:09:11.104 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3395 0.04 MB/sec execute 328 sec latency 1023.760 ms 2023-11-18T21:09:12.104 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3398 0.04 MB/sec execute 329 sec latency 1178.276 ms 2023-11-18T21:09:13.104 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3399 0.04 MB/sec execute 330 sec latency 1067.022 ms 2023-11-18T21:09:14.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3494 0.05 MB/sec execute 331 sec latency 347.988 ms 2023-11-18T21:09:15.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3501 0.05 MB/sec execute 332 sec latency 387.802 ms 2023-11-18T21:09:16.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3513 0.05 MB/sec execute 333 sec latency 335.505 ms 2023-11-18T21:09:17.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3518 0.05 MB/sec execute 334 sec latency 310.113 ms 2023-11-18T21:09:18.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3525 0.05 MB/sec execute 335 sec latency 433.063 ms 2023-11-18T21:09:19.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3531 0.05 MB/sec execute 336 sec latency 755.246 ms 2023-11-18T21:09:20.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3536 0.05 MB/sec execute 337 sec latency 900.520 ms 2023-11-18T21:09:21.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3548 0.05 MB/sec execute 338 sec latency 378.075 ms 2023-11-18T21:09:22.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3553 0.05 MB/sec execute 339 sec latency 341.497 ms 2023-11-18T21:09:23.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3557 0.05 MB/sec execute 340 sec latency 485.631 ms 2023-11-18T21:09:24.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3558 0.05 MB/sec execute 341 sec latency 1030.571 ms 2023-11-18T21:09:25.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3563 0.05 MB/sec execute 342 sec latency 621.893 ms 2023-11-18T21:09:26.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3573 0.04 MB/sec execute 343 sec latency 380.538 ms 2023-11-18T21:09:27.105 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3576 0.04 MB/sec execute 344 sec latency 1024.361 ms 2023-11-18T21:09:27.641 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:09:27.643 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:09:28.106 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3587 0.04 MB/sec execute 345 sec latency 252.806 ms 2023-11-18T21:09:29.106 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3588 0.04 MB/sec execute 346 sec latency 994.107 ms 2023-11-18T21:09:30.106 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3626 0.04 MB/sec execute 347 sec latency 1047.846 ms 2023-11-18T21:09:31.106 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3628 0.04 MB/sec execute 348 sec latency 671.734 ms 2023-11-18T21:09:32.106 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3636 0.04 MB/sec execute 349 sec latency 688.057 ms 2023-11-18T21:09:33.106 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3641 0.04 MB/sec execute 350 sec latency 437.423 ms 2023-11-18T21:09:34.106 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3644 0.04 MB/sec execute 351 sec latency 927.932 ms 2023-11-18T21:09:35.106 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3648 0.04 MB/sec execute 352 sec latency 433.707 ms 2023-11-18T21:09:36.106 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3663 0.04 MB/sec execute 353 sec latency 517.481 ms 2023-11-18T21:09:37.106 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3668 0.04 MB/sec execute 354 sec latency 354.579 ms 2023-11-18T21:09:38.107 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3672 0.04 MB/sec execute 355 sec latency 341.768 ms 2023-11-18T21:09:39.107 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3673 0.04 MB/sec execute 356 sec latency 1008.243 ms 2023-11-18T21:09:40.107 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3677 0.04 MB/sec execute 357 sec latency 621.139 ms 2023-11-18T21:09:41.107 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3686 0.04 MB/sec execute 358 sec latency 406.540 ms 2023-11-18T21:09:42.107 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3686 0.04 MB/sec execute 359 sec latency 1043.490 ms 2023-11-18T21:09:43.107 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3695 0.04 MB/sec execute 360 sec latency 1105.473 ms 2023-11-18T21:09:44.107 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3697 0.04 MB/sec execute 361 sec latency 680.978 ms 2023-11-18T21:09:45.107 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3707 0.04 MB/sec execute 362 sec latency 562.726 ms 2023-11-18T21:09:46.107 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3715 0.04 MB/sec execute 363 sec latency 523.181 ms 2023-11-18T21:09:47.107 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3720 0.04 MB/sec execute 364 sec latency 352.358 ms 2023-11-18T21:09:48.107 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3734 0.04 MB/sec execute 365 sec latency 474.840 ms 2023-11-18T21:09:49.107 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3758 0.05 MB/sec execute 366 sec latency 514.124 ms 2023-11-18T21:09:50.108 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3760 0.05 MB/sec execute 367 sec latency 1158.974 ms 2023-11-18T21:09:51.108 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3767 0.05 MB/sec execute 368 sec latency 657.236 ms 2023-11-18T21:09:52.108 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3770 0.05 MB/sec execute 369 sec latency 735.028 ms 2023-11-18T21:09:53.108 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3773 0.05 MB/sec execute 370 sec latency 516.167 ms 2023-11-18T21:09:54.108 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3778 0.05 MB/sec execute 371 sec latency 536.450 ms 2023-11-18T21:09:55.108 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3781 0.05 MB/sec execute 372 sec latency 567.037 ms 2023-11-18T21:09:56.108 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3785 0.04 MB/sec execute 373 sec latency 345.901 ms 2023-11-18T21:09:57.109 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3788 0.04 MB/sec execute 374 sec latency 836.684 ms 2023-11-18T21:09:57.718 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:09:57.721 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:09:58.108 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3790 0.04 MB/sec execute 375 sec latency 526.385 ms 2023-11-18T21:09:59.109 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3792 0.04 MB/sec execute 376 sec latency 531.922 ms 2023-11-18T21:10:00.109 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3795 0.04 MB/sec execute 377 sec latency 903.586 ms 2023-11-18T21:10:01.109 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3797 0.04 MB/sec execute 378 sec latency 546.107 ms 2023-11-18T21:10:02.109 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3800 0.04 MB/sec execute 379 sec latency 760.132 ms 2023-11-18T21:10:03.109 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3803 0.04 MB/sec execute 380 sec latency 763.827 ms 2023-11-18T21:10:04.109 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3806 0.04 MB/sec execute 381 sec latency 657.964 ms 2023-11-18T21:10:05.109 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3811 0.04 MB/sec execute 382 sec latency 330.615 ms 2023-11-18T21:10:06.109 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3814 0.04 MB/sec execute 383 sec latency 536.831 ms 2023-11-18T21:10:07.109 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3819 0.04 MB/sec execute 384 sec latency 417.226 ms 2023-11-18T21:10:08.109 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3823 0.04 MB/sec execute 385 sec latency 536.866 ms 2023-11-18T21:10:09.110 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3827 0.04 MB/sec execute 386 sec latency 332.123 ms 2023-11-18T21:10:10.110 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3829 0.04 MB/sec execute 387 sec latency 771.690 ms 2023-11-18T21:10:11.110 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3834 0.04 MB/sec execute 388 sec latency 343.822 ms 2023-11-18T21:10:12.110 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3838 0.04 MB/sec execute 389 sec latency 485.038 ms 2023-11-18T21:10:13.110 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3843 0.04 MB/sec execute 390 sec latency 368.482 ms 2023-11-18T21:10:14.110 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3846 0.04 MB/sec execute 391 sec latency 676.636 ms 2023-11-18T21:10:15.110 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3851 0.04 MB/sec execute 392 sec latency 346.019 ms 2023-11-18T21:10:16.110 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3854 0.04 MB/sec execute 393 sec latency 554.353 ms 2023-11-18T21:10:17.110 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3859 0.04 MB/sec execute 394 sec latency 420.726 ms 2023-11-18T21:10:18.110 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3862 0.04 MB/sec execute 395 sec latency 530.141 ms 2023-11-18T21:10:19.110 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3867 0.04 MB/sec execute 396 sec latency 357.444 ms 2023-11-18T21:10:20.111 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3869 0.04 MB/sec execute 397 sec latency 773.610 ms 2023-11-18T21:10:21.111 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3870 0.04 MB/sec execute 398 sec latency 936.804 ms 2023-11-18T21:10:22.111 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3874 0.04 MB/sec execute 399 sec latency 1002.700 ms 2023-11-18T21:10:23.111 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3876 0.04 MB/sec execute 400 sec latency 896.220 ms 2023-11-18T21:10:24.111 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3880 0.04 MB/sec execute 401 sec latency 1119.442 ms 2023-11-18T21:10:25.111 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3884 0.04 MB/sec execute 402 sec latency 344.338 ms 2023-11-18T21:10:26.111 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3896 0.04 MB/sec execute 403 sec latency 484.635 ms 2023-11-18T21:10:27.111 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3897 0.04 MB/sec execute 404 sec latency 1158.191 ms 2023-11-18T21:10:27.787 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:10:27.790 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:10:28.111 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3898 0.04 MB/sec execute 405 sec latency 565.063 ms 2023-11-18T21:10:29.112 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3902 0.04 MB/sec execute 406 sec latency 972.548 ms 2023-11-18T21:10:30.111 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3914 0.04 MB/sec execute 407 sec latency 498.208 ms 2023-11-18T21:10:31.112 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3917 0.04 MB/sec execute 408 sec latency 1156.257 ms 2023-11-18T21:10:32.112 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3920 0.04 MB/sec execute 409 sec latency 433.005 ms 2023-11-18T21:10:33.112 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3925 0.04 MB/sec execute 410 sec latency 567.687 ms 2023-11-18T21:10:34.112 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3928 0.04 MB/sec execute 411 sec latency 528.985 ms 2023-11-18T21:10:35.112 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3932 0.04 MB/sec execute 412 sec latency 359.938 ms 2023-11-18T21:10:36.112 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3935 0.04 MB/sec execute 413 sec latency 676.776 ms 2023-11-18T21:10:37.112 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3937 0.04 MB/sec execute 414 sec latency 604.484 ms 2023-11-18T21:10:38.112 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3939 0.04 MB/sec execute 415 sec latency 558.388 ms 2023-11-18T21:10:39.112 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3942 0.04 MB/sec execute 416 sec latency 707.145 ms 2023-11-18T21:10:40.113 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3944 0.04 MB/sec execute 417 sec latency 741.770 ms 2023-11-18T21:10:41.113 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3947 0.04 MB/sec execute 418 sec latency 742.624 ms 2023-11-18T21:10:42.113 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3950 0.04 MB/sec execute 419 sec latency 798.038 ms 2023-11-18T21:10:43.113 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3953 0.04 MB/sec execute 420 sec latency 624.048 ms 2023-11-18T21:10:44.113 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3958 0.04 MB/sec execute 421 sec latency 346.126 ms 2023-11-18T21:10:45.113 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3961 0.04 MB/sec execute 422 sec latency 559.325 ms 2023-11-18T21:10:46.113 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3966 0.04 MB/sec execute 423 sec latency 335.645 ms 2023-11-18T21:10:47.113 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3969 0.04 MB/sec execute 424 sec latency 634.869 ms 2023-11-18T21:10:48.113 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3974 0.04 MB/sec execute 425 sec latency 331.481 ms 2023-11-18T21:10:49.113 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3977 0.04 MB/sec execute 426 sec latency 558.442 ms 2023-11-18T21:10:50.113 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3982 0.04 MB/sec execute 427 sec latency 428.519 ms 2023-11-18T21:10:51.113 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3985 0.04 MB/sec execute 428 sec latency 574.421 ms 2023-11-18T21:10:52.114 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3990 0.04 MB/sec execute 429 sec latency 325.589 ms 2023-11-18T21:10:53.113 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3994 0.04 MB/sec execute 430 sec latency 547.256 ms 2023-11-18T21:10:54.114 INFO:tasks.workunit.client.0.smithi049.stdout: 1 3998 0.04 MB/sec execute 431 sec latency 326.055 ms 2023-11-18T21:10:55.114 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4002 0.04 MB/sec execute 432 sec latency 589.615 ms 2023-11-18T21:10:56.114 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4006 0.04 MB/sec execute 433 sec latency 339.186 ms 2023-11-18T21:10:57.114 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4010 0.04 MB/sec execute 434 sec latency 569.675 ms 2023-11-18T21:10:57.852 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:10:57.855 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:10:58.114 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4014 0.04 MB/sec execute 435 sec latency 313.412 ms 2023-11-18T21:10:59.114 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4018 0.04 MB/sec execute 436 sec latency 562.010 ms 2023-11-18T21:11:00.114 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4022 0.04 MB/sec execute 437 sec latency 403.269 ms 2023-11-18T21:11:01.114 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4025 0.04 MB/sec execute 438 sec latency 551.500 ms 2023-11-18T21:11:02.114 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4027 0.04 MB/sec execute 439 sec latency 609.858 ms 2023-11-18T21:11:03.114 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4028 0.04 MB/sec execute 440 sec latency 1011.448 ms 2023-11-18T21:11:04.114 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4032 0.04 MB/sec execute 441 sec latency 703.455 ms 2023-11-18T21:11:05.115 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4034 0.04 MB/sec execute 442 sec latency 1089.991 ms 2023-11-18T21:11:06.115 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4035 0.04 MB/sec execute 443 sec latency 683.674 ms 2023-11-18T21:11:07.115 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4038 0.04 MB/sec execute 444 sec latency 1024.042 ms 2023-11-18T21:11:08.115 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4044 0.04 MB/sec execute 445 sec latency 181.086 ms 2023-11-18T21:11:09.115 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4047 0.04 MB/sec execute 446 sec latency 833.744 ms 2023-11-18T21:11:10.115 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4058 0.04 MB/sec execute 447 sec latency 1105.880 ms 2023-11-18T21:11:11.115 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4060 0.04 MB/sec execute 448 sec latency 1219.629 ms 2023-11-18T21:11:12.115 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4064 0.04 MB/sec execute 449 sec latency 533.619 ms 2023-11-18T21:11:13.115 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4071 0.04 MB/sec execute 450 sec latency 180.936 ms 2023-11-18T21:11:14.115 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4076 0.04 MB/sec execute 451 sec latency 1051.452 ms 2023-11-18T21:11:15.116 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4082 0.04 MB/sec execute 452 sec latency 869.279 ms 2023-11-18T21:11:16.116 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4090 0.04 MB/sec execute 453 sec latency 1120.362 ms 2023-11-18T21:11:17.118 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4094 0.04 MB/sec execute 454 sec latency 385.730 ms 2023-11-18T21:11:18.116 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4099 0.04 MB/sec execute 455 sec latency 443.897 ms 2023-11-18T21:11:19.116 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4103 0.04 MB/sec execute 456 sec latency 401.642 ms 2023-11-18T21:11:20.116 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4108 0.04 MB/sec execute 457 sec latency 438.016 ms 2023-11-18T21:11:21.117 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4112 0.04 MB/sec execute 458 sec latency 410.048 ms 2023-11-18T21:11:22.116 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4115 0.04 MB/sec execute 459 sec latency 559.134 ms 2023-11-18T21:11:23.116 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4117 0.04 MB/sec execute 460 sec latency 547.999 ms 2023-11-18T21:11:24.116 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4121 0.04 MB/sec execute 461 sec latency 762.468 ms 2023-11-18T21:11:25.116 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4124 0.04 MB/sec execute 462 sec latency 466.091 ms 2023-11-18T21:11:26.117 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4129 0.04 MB/sec execute 463 sec latency 465.066 ms 2023-11-18T21:11:27.117 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4134 0.04 MB/sec execute 464 sec latency 542.236 ms 2023-11-18T21:11:27.909 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:11:27.912 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:11:28.117 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4138 0.04 MB/sec execute 465 sec latency 386.656 ms 2023-11-18T21:11:29.117 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4142 0.04 MB/sec execute 466 sec latency 318.172 ms 2023-11-18T21:11:30.117 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4148 0.04 MB/sec execute 467 sec latency 401.089 ms 2023-11-18T21:11:31.117 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4153 0.04 MB/sec execute 468 sec latency 416.370 ms 2023-11-18T21:11:31.605 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:13:31.653 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:11:31.706 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:13:31.754 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:11:31.768 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:13:31.759 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:11:31.777 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:13:31.768 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:11:31.850 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:13:31.839 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:11:31.856 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:13:31.845 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:11:32.117 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4157 0.04 MB/sec execute 469 sec latency 506.162 ms 2023-11-18T21:11:32.130 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:13:32.121 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:11:32.135 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:13:32.183 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:11:32.181 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:13:32.170 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:11:33.117 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4161 0.04 MB/sec execute 470 sec latency 346.534 ms 2023-11-18T21:11:34.117 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4166 0.04 MB/sec execute 471 sec latency 304.852 ms 2023-11-18T21:11:35.117 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4171 0.04 MB/sec execute 472 sec latency 498.115 ms 2023-11-18T21:11:36.118 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4173 0.04 MB/sec execute 473 sec latency 417.227 ms 2023-11-18T21:11:37.117 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4176 0.04 MB/sec execute 474 sec latency 1257.274 ms 2023-11-18T21:11:38.118 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4177 0.04 MB/sec execute 475 sec latency 1068.181 ms 2023-11-18T21:11:39.118 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4181 0.04 MB/sec execute 476 sec latency 448.798 ms 2023-11-18T21:11:40.118 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4186 0.04 MB/sec execute 477 sec latency 1025.163 ms 2023-11-18T21:11:41.118 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4216 0.04 MB/sec execute 478 sec latency 1031.042 ms 2023-11-18T21:11:42.118 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4216 0.04 MB/sec execute 479 sec latency 1039.693 ms 2023-11-18T21:11:43.118 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4217 0.04 MB/sec execute 480 sec latency 1079.506 ms 2023-11-18T21:11:44.118 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4223 0.04 MB/sec execute 481 sec latency 1048.321 ms 2023-11-18T21:11:45.118 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4225 0.04 MB/sec execute 482 sec latency 670.036 ms 2023-11-18T21:11:46.118 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4226 0.04 MB/sec execute 483 sec latency 1285.222 ms 2023-11-18T21:11:47.118 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4238 0.04 MB/sec execute 484 sec latency 572.362 ms 2023-11-18T21:11:48.119 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4252 0.04 MB/sec execute 485 sec latency 524.937 ms 2023-11-18T21:11:49.119 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4254 0.04 MB/sec execute 486 sec latency 1095.302 ms 2023-11-18T21:11:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4266 0.04 MB/sec execute 487 sec latency 989.048 ms 2023-11-18T21:11:51.119 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4276 0.04 MB/sec execute 488 sec latency 479.795 ms 2023-11-18T21:11:52.119 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4281 0.04 MB/sec execute 489 sec latency 385.411 ms 2023-11-18T21:11:53.119 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4283 0.04 MB/sec execute 490 sec latency 614.874 ms 2023-11-18T21:11:54.119 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4306 0.04 MB/sec execute 491 sec latency 354.962 ms 2023-11-18T21:11:55.119 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4315 0.04 MB/sec execute 492 sec latency 440.729 ms 2023-11-18T21:11:56.119 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4317 0.04 MB/sec execute 493 sec latency 1032.247 ms 2023-11-18T21:11:57.119 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4318 0.04 MB/sec execute 494 sec latency 995.818 ms 2023-11-18T21:11:57.982 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:11:57.985 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:11:58.119 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4340 0.04 MB/sec execute 495 sec latency 496.490 ms 2023-11-18T21:11:59.119 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4345 0.04 MB/sec execute 496 sec latency 465.330 ms 2023-11-18T21:12:00.120 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4350 0.04 MB/sec execute 497 sec latency 571.526 ms 2023-11-18T21:12:01.121 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4360 0.04 MB/sec execute 498 sec latency 637.157 ms 2023-11-18T21:12:02.120 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4382 0.04 MB/sec execute 499 sec latency 183.917 ms 2023-11-18T21:12:03.121 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4383 0.04 MB/sec execute 500 sec latency 807.228 ms 2023-11-18T21:12:04.120 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4384 0.04 MB/sec execute 501 sec latency 1039.281 ms 2023-11-18T21:12:05.120 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4387 0.04 MB/sec execute 502 sec latency 1023.898 ms 2023-11-18T21:12:06.120 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4388 0.03 MB/sec execute 503 sec latency 978.925 ms 2023-11-18T21:12:07.120 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4393 0.03 MB/sec execute 504 sec latency 1025.109 ms 2023-11-18T21:12:08.120 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4423 0.04 MB/sec execute 505 sec latency 1011.655 ms 2023-11-18T21:12:09.120 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4424 0.03 MB/sec execute 506 sec latency 1173.042 ms 2023-11-18T21:12:10.120 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4427 0.03 MB/sec execute 507 sec latency 950.397 ms 2023-11-18T21:12:11.121 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4432 0.03 MB/sec execute 508 sec latency 337.021 ms 2023-11-18T21:12:12.121 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4433 0.03 MB/sec execute 509 sec latency 1040.298 ms 2023-11-18T21:12:13.121 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4443 0.03 MB/sec execute 510 sec latency 619.373 ms 2023-11-18T21:12:14.121 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4450 0.03 MB/sec execute 511 sec latency 706.905 ms 2023-11-18T21:12:15.121 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4462 0.03 MB/sec execute 512 sec latency 989.663 ms 2023-11-18T21:12:16.121 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4469 0.03 MB/sec execute 513 sec latency 575.057 ms 2023-11-18T21:12:17.121 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4473 0.03 MB/sec execute 514 sec latency 587.713 ms 2023-11-18T21:12:18.121 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4480 0.03 MB/sec execute 515 sec latency 641.127 ms 2023-11-18T21:12:19.121 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4497 0.03 MB/sec execute 516 sec latency 400.056 ms 2023-11-18T21:12:20.121 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4497 0.03 MB/sec execute 517 sec latency 1009.226 ms 2023-11-18T21:12:21.121 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4498 0.03 MB/sec execute 518 sec latency 1207.364 ms 2023-11-18T21:12:22.121 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4500 0.03 MB/sec execute 519 sec latency 981.116 ms 2023-11-18T21:12:23.122 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4501 0.03 MB/sec execute 520 sec latency 770.728 ms 2023-11-18T21:12:24.122 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4505 0.03 MB/sec execute 521 sec latency 1031.322 ms 2023-11-18T21:12:25.122 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4506 0.03 MB/sec execute 522 sec latency 894.526 ms 2023-11-18T21:12:26.122 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4511 0.03 MB/sec execute 523 sec latency 1181.068 ms 2023-11-18T21:12:27.122 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4528 0.03 MB/sec execute 524 sec latency 1000.199 ms 2023-11-18T21:12:28.122 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4536 0.03 MB/sec execute 525 sec latency 349.935 ms 2023-11-18T21:12:28.313 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:12:28.315 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:12:29.122 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4539 0.03 MB/sec execute 526 sec latency 546.490 ms 2023-11-18T21:12:30.122 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4552 0.03 MB/sec execute 527 sec latency 596.410 ms 2023-11-18T21:12:31.122 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4563 0.03 MB/sec execute 528 sec latency 281.038 ms 2023-11-18T21:12:32.122 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4567 0.03 MB/sec execute 529 sec latency 1059.950 ms 2023-11-18T21:12:33.122 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4596 0.04 MB/sec execute 530 sec latency 593.411 ms 2023-11-18T21:12:34.122 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4600 0.04 MB/sec execute 531 sec latency 1111.379 ms 2023-11-18T21:12:35.122 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4602 0.04 MB/sec execute 532 sec latency 860.136 ms 2023-11-18T21:12:36.123 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4614 0.04 MB/sec execute 533 sec latency 1202.351 ms 2023-11-18T21:12:37.123 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4614 0.04 MB/sec execute 534 sec latency 1000.876 ms 2023-11-18T21:12:38.123 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4615 0.04 MB/sec execute 535 sec latency 1036.738 ms 2023-11-18T21:12:39.123 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4616 0.04 MB/sec execute 536 sec latency 1240.550 ms 2023-11-18T21:12:40.123 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4619 0.04 MB/sec execute 537 sec latency 1039.648 ms 2023-11-18T21:12:41.123 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4628 0.04 MB/sec execute 538 sec latency 365.872 ms 2023-11-18T21:12:42.123 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4632 0.04 MB/sec execute 539 sec latency 555.483 ms 2023-11-18T21:12:43.123 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4652 0.04 MB/sec execute 540 sec latency 527.015 ms 2023-11-18T21:12:44.123 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4656 0.04 MB/sec execute 541 sec latency 433.022 ms 2023-11-18T21:12:45.123 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4656 0.04 MB/sec execute 542 sec latency 1153.142 ms 2023-11-18T21:12:46.123 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4667 0.04 MB/sec execute 543 sec latency 1176.852 ms 2023-11-18T21:12:47.123 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4670 0.04 MB/sec execute 544 sec latency 966.406 ms 2023-11-18T21:12:48.123 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4681 0.03 MB/sec execute 545 sec latency 673.823 ms 2023-11-18T21:12:49.124 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4690 0.03 MB/sec execute 546 sec latency 998.215 ms 2023-11-18T21:12:50.124 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4701 0.03 MB/sec execute 547 sec latency 343.269 ms 2023-11-18T21:12:51.124 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4710 0.03 MB/sec execute 548 sec latency 456.959 ms 2023-11-18T21:12:52.124 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4715 0.03 MB/sec execute 549 sec latency 617.752 ms 2023-11-18T21:12:53.124 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4724 0.03 MB/sec execute 550 sec latency 425.292 ms 2023-11-18T21:12:54.124 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4727 0.03 MB/sec execute 551 sec latency 1060.762 ms 2023-11-18T21:12:55.124 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4734 0.03 MB/sec execute 552 sec latency 623.737 ms 2023-11-18T21:12:56.124 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4735 0.03 MB/sec execute 553 sec latency 1244.256 ms 2023-11-18T21:12:57.124 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4736 0.03 MB/sec execute 554 sec latency 1041.106 ms 2023-11-18T21:12:58.125 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4738 0.03 MB/sec execute 555 sec latency 1060.377 ms 2023-11-18T21:12:58.436 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:12:58.439 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:12:59.124 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4742 0.03 MB/sec execute 556 sec latency 545.948 ms 2023-11-18T21:13:00.124 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4746 0.03 MB/sec execute 557 sec latency 516.929 ms 2023-11-18T21:13:01.124 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4759 0.03 MB/sec execute 558 sec latency 523.434 ms 2023-11-18T21:13:02.124 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4767 0.03 MB/sec execute 559 sec latency 632.118 ms 2023-11-18T21:13:03.125 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4770 0.03 MB/sec execute 560 sec latency 724.597 ms 2023-11-18T21:13:04.125 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4780 0.03 MB/sec execute 561 sec latency 972.378 ms 2023-11-18T21:13:05.125 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4786 0.03 MB/sec execute 562 sec latency 623.499 ms 2023-11-18T21:13:06.125 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4797 0.03 MB/sec execute 563 sec latency 424.182 ms 2023-11-18T21:13:07.125 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4810 0.03 MB/sec execute 564 sec latency 488.310 ms 2023-11-18T21:13:08.125 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4812 0.03 MB/sec execute 565 sec latency 551.791 ms 2023-11-18T21:13:09.125 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4814 0.03 MB/sec execute 566 sec latency 980.202 ms 2023-11-18T21:13:10.125 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4820 0.03 MB/sec execute 567 sec latency 1034.765 ms 2023-11-18T21:13:11.125 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4829 0.03 MB/sec execute 568 sec latency 326.124 ms 2023-11-18T21:13:12.125 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4843 0.03 MB/sec execute 569 sec latency 391.132 ms 2023-11-18T21:13:13.125 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4844 0.03 MB/sec execute 570 sec latency 722.963 ms 2023-11-18T21:13:14.126 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4846 0.03 MB/sec execute 571 sec latency 1016.159 ms 2023-11-18T21:13:15.126 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4847 0.03 MB/sec execute 572 sec latency 955.469 ms 2023-11-18T21:13:16.126 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4850 0.03 MB/sec execute 573 sec latency 957.219 ms 2023-11-18T21:13:17.126 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4942 0.04 MB/sec execute 574 sec latency 1028.968 ms 2023-11-18T21:13:18.126 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4943 0.04 MB/sec execute 575 sec latency 1090.223 ms 2023-11-18T21:13:19.126 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4944 0.04 MB/sec execute 576 sec latency 997.952 ms 2023-11-18T21:13:20.126 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4947 0.04 MB/sec execute 577 sec latency 629.130 ms 2023-11-18T21:13:21.126 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4951 0.04 MB/sec execute 578 sec latency 1386.873 ms 2023-11-18T21:13:22.126 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4951 0.04 MB/sec execute 579 sec latency 1012.895 ms 2023-11-18T21:13:23.126 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4961 0.04 MB/sec execute 580 sec latency 1281.693 ms 2023-11-18T21:13:24.126 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4963 0.04 MB/sec execute 581 sec latency 523.734 ms 2023-11-18T21:13:25.126 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4969 0.04 MB/sec execute 582 sec latency 1032.187 ms 2023-11-18T21:13:26.126 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4983 0.04 MB/sec execute 583 sec latency 546.380 ms 2023-11-18T21:13:27.126 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4984 0.04 MB/sec execute 584 sec latency 1040.578 ms 2023-11-18T21:13:28.127 INFO:tasks.workunit.client.0.smithi049.stdout: 1 4987 0.04 MB/sec execute 585 sec latency 495.586 ms 2023-11-18T21:13:28.541 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:13:28.544 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:13:29.127 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5007 0.04 MB/sec execute 586 sec latency 353.894 ms 2023-11-18T21:13:30.127 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5012 0.04 MB/sec execute 587 sec latency 377.013 ms 2023-11-18T21:13:31.127 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5014 0.04 MB/sec execute 588 sec latency 602.494 ms 2023-11-18T21:13:32.127 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5027 0.04 MB/sec execute 589 sec latency 987.657 ms 2023-11-18T21:13:33.127 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5031 0.04 MB/sec execute 590 sec latency 364.374 ms 2023-11-18T21:13:34.127 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5032 0.04 MB/sec execute 591 sec latency 996.491 ms 2023-11-18T21:13:35.127 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5051 0.04 MB/sec execute 592 sec latency 1034.173 ms 2023-11-18T21:13:36.127 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5052 0.04 MB/sec execute 593 sec latency 1059.058 ms 2023-11-18T21:13:37.127 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5055 0.04 MB/sec execute 594 sec latency 423.016 ms 2023-11-18T21:13:38.127 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5056 0.04 MB/sec execute 595 sec latency 675.915 ms 2023-11-18T21:13:39.127 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5065 0.04 MB/sec execute 596 sec latency 908.169 ms 2023-11-18T21:13:40.128 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5070 0.04 MB/sec execute 597 sec latency 452.351 ms 2023-11-18T21:13:41.128 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5082 0.04 MB/sec execute 598 sec latency 476.912 ms 2023-11-18T21:13:42.128 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5089 0.04 MB/sec execute 599 sec latency 381.076 ms 2023-11-18T21:13:43.128 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 600 sec 2023-11-18T21:13:44.128 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 601 sec 2023-11-18T21:13:45.128 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 602 sec 2023-11-18T21:13:46.128 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 603 sec 2023-11-18T21:13:47.128 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 604 sec 2023-11-18T21:13:48.128 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 605 sec 2023-11-18T21:13:49.128 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 606 sec 2023-11-18T21:13:50.128 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 607 sec 2023-11-18T21:13:51.128 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 608 sec 2023-11-18T21:13:52.128 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 609 sec 2023-11-18T21:13:53.129 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 610 sec 2023-11-18T21:13:54.129 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 611 sec 2023-11-18T21:13:55.129 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 612 sec 2023-11-18T21:13:56.129 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 613 sec 2023-11-18T21:13:57.129 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 614 sec 2023-11-18T21:13:58.129 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 615 sec 2023-11-18T21:13:58.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:13:58.685 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:13:59.129 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 616 sec 2023-11-18T21:14:00.129 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 617 sec 2023-11-18T21:14:01.129 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 618 sec 2023-11-18T21:14:02.129 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 619 sec 2023-11-18T21:14:03.129 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 620 sec 2023-11-18T21:14:04.129 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 621 sec 2023-11-18T21:14:05.129 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 622 sec 2023-11-18T21:14:06.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 623 sec 2023-11-18T21:14:07.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 624 sec 2023-11-18T21:14:08.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 625 sec 2023-11-18T21:14:09.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 626 sec 2023-11-18T21:14:10.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 627 sec 2023-11-18T21:14:11.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 628 sec 2023-11-18T21:14:12.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 629 sec 2023-11-18T21:14:13.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 630 sec 2023-11-18T21:14:14.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 631 sec 2023-11-18T21:14:15.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 632 sec 2023-11-18T21:14:16.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 633 sec 2023-11-18T21:14:17.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 634 sec 2023-11-18T21:14:18.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 635 sec 2023-11-18T21:14:19.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 636 sec 2023-11-18T21:14:20.130 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 637 sec 2023-11-18T21:14:21.131 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 638 sec 2023-11-18T21:14:22.131 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 639 sec 2023-11-18T21:14:23.131 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 640 sec 2023-11-18T21:14:23.817 INFO:tasks.workunit.client.0.smithi049.stdout: 0 cleanup 641 sec 2023-11-18T21:14:23.817 INFO:tasks.workunit.client.0.smithi049.stdout: 2023-11-18T21:14:23.817 INFO:tasks.workunit.client.0.smithi049.stdout: Operation Count AvgLat MaxLat 2023-11-18T21:14:23.817 INFO:tasks.workunit.client.0.smithi049.stdout: ---------------------------------------- 2023-11-18T21:14:23.818 INFO:tasks.workunit.client.0.smithi049.stdout: NTCreateX 671 237.085 903.578 2023-11-18T21:14:23.818 INFO:tasks.workunit.client.0.smithi049.stdout: Close 494 3.630 36.548 2023-11-18T21:14:23.818 INFO:tasks.workunit.client.0.smithi049.stdout: Rename 29 543.699 797.403 2023-11-18T21:14:23.818 INFO:tasks.workunit.client.0.smithi049.stdout: Unlink 132 280.515 559.116 2023-11-18T21:14:23.818 INFO:tasks.workunit.client.0.smithi049.stdout: Qpathinfo 633 178.059 852.157 2023-11-18T21:14:23.818 INFO:tasks.workunit.client.0.smithi049.stdout: Qfileinfo 108 3.037 7.833 2023-11-18T21:14:23.818 INFO:tasks.workunit.client.0.smithi049.stdout: Qfsinfo 108 36.247 1317.987 2023-11-18T21:14:23.818 INFO:tasks.workunit.client.0.smithi049.stdout: Sfileinfo 59 71.531 368.850 2023-11-18T21:14:23.818 INFO:tasks.workunit.client.0.smithi049.stdout: Find 234 1103.147 19331.794 2023-11-18T21:14:23.818 INFO:tasks.workunit.client.0.smithi049.stdout: WriteX 330 10.998 151.364 2023-11-18T21:14:23.818 INFO:tasks.workunit.client.0.smithi049.stdout: ReadX 1078 0.088 6.599 2023-11-18T21:14:23.818 INFO:tasks.workunit.client.0.smithi049.stdout: LockX 2 64.208 93.601 2023-11-18T21:14:23.819 INFO:tasks.workunit.client.0.smithi049.stdout: UnlockX 2 42.867 52.546 2023-11-18T21:14:23.819 INFO:tasks.workunit.client.0.smithi049.stdout: Flush 44 82.221 123.803 2023-11-18T21:14:23.819 INFO:tasks.workunit.client.0.smithi049.stdout: 2023-11-18T21:14:23.819 INFO:tasks.workunit.client.0.smithi049.stdout:Throughput 0.0370598 MB/sec 1 clients 1 procs max_latency=19331.807 ms 2023-11-18T21:14:23.819 INFO:tasks.workunit.client.0.smithi049.stderr:+ dbench 10 2023-11-18T21:14:23.819 INFO:tasks.workunit.client.0.smithi049.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-11-18T21:14:23.820 INFO:tasks.workunit.client.0.smithi049.stdout: 2023-11-18T21:14:23.820 INFO:tasks.workunit.client.0.smithi049.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-11-18T21:14:23.820 INFO:tasks.workunit.client.0.smithi049.stdout:8 of 10 processes prepared for launch 0 sec 2023-11-18T21:14:23.919 INFO:tasks.workunit.client.0.smithi049.stdout:10 of 10 processes prepared for launch 0 sec 2023-11-18T21:14:23.920 INFO:tasks.workunit.client.0.smithi049.stdout:releasing clients 2023-11-18T21:14:24.920 INFO:tasks.workunit.client.0.smithi049.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.884 ms 2023-11-18T21:14:25.920 INFO:tasks.workunit.client.0.smithi049.stdout: 0 2 0.00 MB/sec warmup 2 sec latency 1999.981 ms 2023-11-18T21:14:26.921 INFO:tasks.workunit.client.0.smithi049.stdout: 0 3 0.00 MB/sec warmup 3 sec latency 3000.074 ms 2023-11-18T21:14:27.920 INFO:tasks.workunit.client.0.smithi049.stdout: 0 4 0.00 MB/sec warmup 4 sec latency 4000.135 ms 2023-11-18T21:14:28.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:14:28.791 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:14:28.920 INFO:tasks.workunit.client.0.smithi049.stdout: 1 5 0.00 MB/sec warmup 5 sec latency 4739.327 ms 2023-11-18T21:14:29.920 INFO:tasks.workunit.client.0.smithi049.stdout: 1 8 0.17 MB/sec warmup 6 sec latency 5684.133 ms 2023-11-18T21:14:30.920 INFO:tasks.workunit.client.0.smithi049.stdout: 1 9 0.15 MB/sec warmup 7 sec latency 1551.808 ms 2023-11-18T21:14:31.920 INFO:tasks.workunit.client.0.smithi049.stdout: 2 13 0.29 MB/sec warmup 8 sec latency 1700.665 ms 2023-11-18T21:14:32.920 INFO:tasks.workunit.client.0.smithi049.stdout: 3 15 0.36 MB/sec warmup 9 sec latency 1243.856 ms 2023-11-18T21:14:33.920 INFO:tasks.workunit.client.0.smithi049.stdout: 4 20 0.52 MB/sec warmup 10 sec latency 1715.855 ms 2023-11-18T21:14:34.920 INFO:tasks.workunit.client.0.smithi049.stdout: 7 28 0.81 MB/sec warmup 11 sec latency 1762.409 ms 2023-11-18T21:14:35.920 INFO:tasks.workunit.client.0.smithi049.stdout: 9 32 0.91 MB/sec warmup 12 sec latency 2075.905 ms 2023-11-18T21:14:36.921 INFO:tasks.workunit.client.0.smithi049.stdout: 10 38 1.09 MB/sec warmup 13 sec latency 1745.662 ms 2023-11-18T21:14:37.921 INFO:tasks.workunit.client.0.smithi049.stdout: 10 44 1.21 MB/sec warmup 14 sec latency 1834.285 ms 2023-11-18T21:14:38.921 INFO:tasks.workunit.client.0.smithi049.stdout: 10 50 1.37 MB/sec warmup 15 sec latency 1857.314 ms 2023-11-18T21:14:39.921 INFO:tasks.workunit.client.0.smithi049.stdout: 10 56 1.48 MB/sec warmup 16 sec latency 1998.996 ms 2023-11-18T21:14:40.921 INFO:tasks.workunit.client.0.smithi049.stdout: 10 62 1.58 MB/sec warmup 17 sec latency 1834.949 ms 2023-11-18T21:14:41.921 INFO:tasks.workunit.client.0.smithi049.stdout: 10 67 1.64 MB/sec warmup 18 sec latency 2835.013 ms 2023-11-18T21:14:42.921 INFO:tasks.workunit.client.0.smithi049.stdout: 10 72 1.68 MB/sec warmup 19 sec latency 3514.339 ms 2023-11-18T21:14:43.921 INFO:tasks.workunit.client.0.smithi049.stdout: 10 78 1.77 MB/sec warmup 20 sec latency 2902.096 ms 2023-11-18T21:14:44.921 INFO:tasks.workunit.client.0.smithi049.stdout: 10 82 1.78 MB/sec warmup 21 sec latency 3323.362 ms 2023-11-18T21:14:45.921 INFO:tasks.workunit.client.0.smithi049.stdout: 10 85 1.75 MB/sec warmup 22 sec latency 4293.500 ms 2023-11-18T21:14:46.921 INFO:tasks.workunit.client.0.smithi049.stdout: 10 89 1.75 MB/sec warmup 23 sec latency 4860.692 ms 2023-11-18T21:14:47.922 INFO:tasks.workunit.client.0.smithi049.stdout: 10 97 1.87 MB/sec warmup 24 sec latency 3562.059 ms 2023-11-18T21:14:48.177 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:16:48.225 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:14:48.268 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:16:48.316 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:14:48.365 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:16:48.355 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:14:48.373 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:16:48.363 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:14:48.460 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:16:48.448 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:14:48.477 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:16:48.465 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:14:48.705 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:16:48.753 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:14:48.706 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:16:48.696 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:14:48.821 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:16:48.809 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:14:48.921 INFO:tasks.workunit.client.0.smithi049.stdout: 10 103 1.91 MB/sec warmup 25 sec latency 1875.163 ms 2023-11-18T21:14:49.921 INFO:tasks.workunit.client.0.smithi049.stdout: 10 107 1.90 MB/sec warmup 26 sec latency 2181.232 ms 2023-11-18T21:14:50.921 INFO:tasks.workunit.client.0.smithi049.stdout: 10 117 2.00 MB/sec warmup 27 sec latency 2294.923 ms 2023-11-18T21:14:51.922 INFO:tasks.workunit.client.0.smithi049.stdout: 10 120 1.97 MB/sec warmup 28 sec latency 2067.400 ms 2023-11-18T21:14:52.922 INFO:tasks.workunit.client.0.smithi049.stdout: 10 122 1.91 MB/sec warmup 29 sec latency 3067.454 ms 2023-11-18T21:14:53.922 INFO:tasks.workunit.client.0.smithi049.stdout: 10 125 1.88 MB/sec warmup 30 sec latency 3282.832 ms 2023-11-18T21:14:54.922 INFO:tasks.workunit.client.0.smithi049.stdout: 10 129 1.85 MB/sec warmup 31 sec latency 3136.118 ms 2023-11-18T21:14:55.922 INFO:tasks.workunit.client.0.smithi049.stdout: 10 132 1.83 MB/sec warmup 32 sec latency 2000.646 ms 2023-11-18T21:14:56.922 INFO:tasks.workunit.client.0.smithi049.stdout: 10 135 1.80 MB/sec warmup 33 sec latency 2056.051 ms 2023-11-18T21:14:57.922 INFO:tasks.workunit.client.0.smithi049.stdout: 10 138 1.78 MB/sec warmup 34 sec latency 2312.034 ms 2023-11-18T21:14:58.902 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:14:58.904 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:14:58.922 INFO:tasks.workunit.client.0.smithi049.stdout: 10 141 1.75 MB/sec warmup 35 sec latency 2585.463 ms 2023-11-18T21:14:59.922 INFO:tasks.workunit.client.0.smithi049.stdout: 10 146 1.74 MB/sec warmup 36 sec latency 1935.498 ms 2023-11-18T21:15:00.922 INFO:tasks.workunit.client.0.smithi049.stdout: 10 149 1.71 MB/sec warmup 37 sec latency 1795.287 ms 2023-11-18T21:15:01.922 INFO:tasks.workunit.client.0.smithi049.stdout: 10 152 1.69 MB/sec warmup 38 sec latency 2467.882 ms 2023-11-18T21:15:02.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 155 1.68 MB/sec warmup 39 sec latency 3106.681 ms 2023-11-18T21:15:03.922 INFO:tasks.workunit.client.0.smithi049.stdout: 10 159 1.66 MB/sec warmup 40 sec latency 3483.339 ms 2023-11-18T21:15:04.922 INFO:tasks.workunit.client.0.smithi049.stdout: 10 162 1.64 MB/sec warmup 41 sec latency 1654.819 ms 2023-11-18T21:15:05.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 164 1.62 MB/sec warmup 42 sec latency 2141.686 ms 2023-11-18T21:15:06.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 168 1.61 MB/sec warmup 43 sec latency 2146.303 ms 2023-11-18T21:15:07.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 170 1.59 MB/sec warmup 44 sec latency 2043.625 ms 2023-11-18T21:15:08.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 174 1.58 MB/sec warmup 45 sec latency 2218.394 ms 2023-11-18T21:15:09.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 177 1.57 MB/sec warmup 46 sec latency 1900.439 ms 2023-11-18T21:15:10.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 180 1.55 MB/sec warmup 47 sec latency 2218.029 ms 2023-11-18T21:15:11.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 183 1.54 MB/sec warmup 48 sec latency 2190.061 ms 2023-11-18T21:15:12.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 187 1.53 MB/sec warmup 49 sec latency 2076.359 ms 2023-11-18T21:15:13.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 190 1.52 MB/sec warmup 50 sec latency 2160.255 ms 2023-11-18T21:15:14.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 193 1.51 MB/sec warmup 51 sec latency 2017.877 ms 2023-11-18T21:15:15.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 196 1.50 MB/sec warmup 52 sec latency 2222.282 ms 2023-11-18T21:15:16.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 198 1.48 MB/sec warmup 53 sec latency 2402.845 ms 2023-11-18T21:15:17.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 202 1.48 MB/sec warmup 54 sec latency 2083.662 ms 2023-11-18T21:15:18.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 205 1.47 MB/sec warmup 55 sec latency 2156.905 ms 2023-11-18T21:15:19.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 209 1.46 MB/sec warmup 56 sec latency 1749.551 ms 2023-11-18T21:15:20.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 213 1.46 MB/sec warmup 57 sec latency 1901.794 ms 2023-11-18T21:15:21.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 215 1.44 MB/sec warmup 58 sec latency 2629.613 ms 2023-11-18T21:15:22.923 INFO:tasks.workunit.client.0.smithi049.stdout: 10 219 1.44 MB/sec warmup 59 sec latency 1873.970 ms 2023-11-18T21:15:23.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 221 1.43 MB/sec warmup 60 sec latency 1891.757 ms 2023-11-18T21:15:24.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 226 1.43 MB/sec warmup 61 sec latency 2167.647 ms 2023-11-18T21:15:25.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 228 1.42 MB/sec warmup 62 sec latency 2104.086 ms 2023-11-18T21:15:26.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 231 1.40 MB/sec warmup 63 sec latency 2389.962 ms 2023-11-18T21:15:27.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 235 1.41 MB/sec warmup 64 sec latency 2267.449 ms 2023-11-18T21:15:28.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 237 1.40 MB/sec warmup 65 sec latency 1780.118 ms 2023-11-18T21:15:29.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:15:29.012 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:15:29.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 242 1.40 MB/sec warmup 66 sec latency 2244.597 ms 2023-11-18T21:15:30.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 245 1.40 MB/sec warmup 67 sec latency 2311.082 ms 2023-11-18T21:15:31.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 246 1.38 MB/sec warmup 68 sec latency 2261.196 ms 2023-11-18T21:15:32.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 251 1.38 MB/sec warmup 69 sec latency 2411.539 ms 2023-11-18T21:15:33.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 253 1.37 MB/sec warmup 70 sec latency 2507.772 ms 2023-11-18T21:15:34.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 258 1.38 MB/sec warmup 71 sec latency 1993.690 ms 2023-11-18T21:15:35.924 INFO:tasks.workunit.client.0.smithi049.stdout: 10 260 1.36 MB/sec warmup 72 sec latency 2247.337 ms 2023-11-18T21:15:36.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 261 1.35 MB/sec warmup 73 sec latency 2319.554 ms 2023-11-18T21:15:37.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 266 1.35 MB/sec warmup 74 sec latency 2443.362 ms 2023-11-18T21:15:38.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 268 1.35 MB/sec warmup 75 sec latency 2198.780 ms 2023-11-18T21:15:39.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 270 1.33 MB/sec warmup 76 sec latency 2363.020 ms 2023-11-18T21:15:40.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 275 1.34 MB/sec warmup 77 sec latency 2863.753 ms 2023-11-18T21:15:41.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 276 1.32 MB/sec warmup 78 sec latency 2236.861 ms 2023-11-18T21:15:42.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 280 1.32 MB/sec warmup 79 sec latency 2352.767 ms 2023-11-18T21:15:43.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 283 1.32 MB/sec warmup 80 sec latency 1683.336 ms 2023-11-18T21:15:44.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 284 1.31 MB/sec warmup 81 sec latency 2436.405 ms 2023-11-18T21:15:45.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 289 1.31 MB/sec warmup 82 sec latency 2398.747 ms 2023-11-18T21:15:46.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 290 1.30 MB/sec warmup 83 sec latency 1819.228 ms 2023-11-18T21:15:47.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 293 1.30 MB/sec warmup 84 sec latency 2607.961 ms 2023-11-18T21:15:48.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 297 1.29 MB/sec warmup 85 sec latency 2645.095 ms 2023-11-18T21:15:49.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 299 1.29 MB/sec warmup 86 sec latency 1985.633 ms 2023-11-18T21:15:50.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 302 1.28 MB/sec warmup 87 sec latency 2091.394 ms 2023-11-18T21:15:51.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 304 1.27 MB/sec warmup 88 sec latency 1738.263 ms 2023-11-18T21:15:52.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 308 1.27 MB/sec warmup 89 sec latency 1972.635 ms 2023-11-18T21:15:53.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 311 1.27 MB/sec warmup 90 sec latency 2084.334 ms 2023-11-18T21:15:54.925 INFO:tasks.workunit.client.0.smithi049.stdout: 10 315 1.27 MB/sec warmup 91 sec latency 1559.468 ms 2023-11-18T21:15:55.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 319 1.27 MB/sec warmup 92 sec latency 1846.256 ms 2023-11-18T21:15:56.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 321 1.26 MB/sec warmup 93 sec latency 2213.583 ms 2023-11-18T21:15:57.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 324 1.25 MB/sec warmup 94 sec latency 2098.713 ms 2023-11-18T21:15:58.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 328 1.26 MB/sec warmup 95 sec latency 1936.597 ms 2023-11-18T21:15:59.275 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:15:59.277 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:15:59.332 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:17:59.380 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:15:59.342 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:17:59.391 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:15:59.503 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:17:59.492 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:15:59.508 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:17:59.556 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:15:59.512 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:17:59.500 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:15:59.523 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:17:59.511 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:15:59.541 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:17:59.531 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:15:59.678 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:17:59.666 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:15:59.682 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:17:59.671 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:15:59.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 334 1.26 MB/sec warmup 96 sec latency 1800.995 ms 2023-11-18T21:16:00.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 340 1.27 MB/sec warmup 97 sec latency 915.252 ms 2023-11-18T21:16:01.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 346 1.27 MB/sec warmup 98 sec latency 1198.514 ms 2023-11-18T21:16:02.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 347 1.26 MB/sec warmup 99 sec latency 1960.924 ms 2023-11-18T21:16:03.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 352 1.26 MB/sec warmup 100 sec latency 2137.927 ms 2023-11-18T21:16:04.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 354 1.26 MB/sec warmup 101 sec latency 1861.510 ms 2023-11-18T21:16:05.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 357 1.26 MB/sec warmup 102 sec latency 2234.637 ms 2023-11-18T21:16:06.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 360 1.25 MB/sec warmup 103 sec latency 1879.528 ms 2023-11-18T21:16:07.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 363 1.25 MB/sec warmup 104 sec latency 1971.034 ms 2023-11-18T21:16:08.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 366 1.25 MB/sec warmup 105 sec latency 2170.533 ms 2023-11-18T21:16:09.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 370 1.25 MB/sec warmup 106 sec latency 2297.344 ms 2023-11-18T21:16:10.926 INFO:tasks.workunit.client.0.smithi049.stdout: 10 374 1.25 MB/sec warmup 107 sec latency 1886.946 ms 2023-11-18T21:16:11.927 INFO:tasks.workunit.client.0.smithi049.stdout: 10 376 1.24 MB/sec warmup 108 sec latency 2007.323 ms 2023-11-18T21:16:12.927 INFO:tasks.workunit.client.0.smithi049.stdout: 10 379 1.24 MB/sec warmup 109 sec latency 2213.639 ms 2023-11-18T21:16:13.927 INFO:tasks.workunit.client.0.smithi049.stdout: 10 383 1.24 MB/sec warmup 110 sec latency 2069.154 ms 2023-11-18T21:16:14.927 INFO:tasks.workunit.client.0.smithi049.stdout: 10 386 1.24 MB/sec warmup 111 sec latency 2126.575 ms 2023-11-18T21:16:15.927 INFO:tasks.workunit.client.0.smithi049.stdout: 10 389 1.24 MB/sec warmup 112 sec latency 2608.492 ms 2023-11-18T21:16:16.927 INFO:tasks.workunit.client.0.smithi049.stdout: 10 391 1.23 MB/sec warmup 113 sec latency 2307.280 ms 2023-11-18T21:16:17.927 INFO:tasks.workunit.client.0.smithi049.stdout: 10 395 1.23 MB/sec warmup 114 sec latency 2146.168 ms 2023-11-18T21:16:18.927 INFO:tasks.workunit.client.0.smithi049.stdout: 10 398 1.23 MB/sec warmup 115 sec latency 2239.206 ms 2023-11-18T21:16:19.927 INFO:tasks.workunit.client.0.smithi049.stdout: 10 402 1.23 MB/sec warmup 116 sec latency 1995.336 ms 2023-11-18T21:16:20.927 INFO:tasks.workunit.client.0.smithi049.stdout: 10 404 1.22 MB/sec warmup 117 sec latency 2078.101 ms 2023-11-18T21:16:21.927 INFO:tasks.workunit.client.0.smithi049.stdout: 10 407 1.22 MB/sec warmup 118 sec latency 2414.715 ms 2023-11-18T21:16:22.927 INFO:tasks.workunit.client.0.smithi049.stdout: 10 410 1.22 MB/sec warmup 119 sec latency 2617.105 ms 2023-11-18T21:16:24.927 INFO:tasks.workunit.client.0.smithi049.stdout: 10 415 0.71 MB/sec execute 1 sec latency 2670.789 ms 2023-11-18T21:16:25.928 INFO:tasks.workunit.client.0.smithi049.stdout: 10 420 1.20 MB/sec execute 2 sec latency 2253.384 ms 2023-11-18T21:16:26.928 INFO:tasks.workunit.client.0.smithi049.stdout: 10 422 1.08 MB/sec execute 3 sec latency 2099.819 ms 2023-11-18T21:16:27.928 INFO:tasks.workunit.client.0.smithi049.stdout: 10 424 0.91 MB/sec execute 4 sec latency 2253.618 ms 2023-11-18T21:16:28.928 INFO:tasks.workunit.client.0.smithi049.stdout: 10 428 1.01 MB/sec execute 5 sec latency 2178.126 ms 2023-11-18T21:16:29.339 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:16:29.342 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:16:29.928 INFO:tasks.workunit.client.0.smithi049.stdout: 10 430 0.98 MB/sec execute 6 sec latency 2370.601 ms 2023-11-18T21:16:30.928 INFO:tasks.workunit.client.0.smithi049.stdout: 10 435 1.09 MB/sec execute 7 sec latency 2555.827 ms 2023-11-18T21:16:34.712 INFO:tasks.workunit.client.0.smithi049.stdout: 10 437 1.00 MB/sec execute 8 sec latency 1934.513 ms 2023-11-18T21:16:34.712 INFO:tasks.workunit.client.0.smithi049.stdout: 10 439 0.94 MB/sec execute 9 sec latency 2287.035 ms 2023-11-18T21:16:34.713 INFO:tasks.workunit.client.0.smithi049.stdout: 10 443 1.00 MB/sec execute 10 sec latency 2563.959 ms 2023-11-18T21:16:34.928 INFO:tasks.workunit.client.0.smithi049.stdout: 10 446 1.00 MB/sec execute 11 sec latency 2315.010 ms 2023-11-18T21:16:35.928 INFO:tasks.workunit.client.0.smithi049.stdout: 10 449 0.96 MB/sec execute 12 sec latency 2253.159 ms 2023-11-18T21:16:36.928 INFO:tasks.workunit.client.0.smithi049.stdout: 10 452 0.98 MB/sec execute 13 sec latency 2693.774 ms 2023-11-18T21:16:37.928 INFO:tasks.workunit.client.0.smithi049.stdout: 10 454 0.97 MB/sec execute 14 sec latency 2912.301 ms 2023-11-18T21:16:38.928 INFO:tasks.workunit.client.0.smithi049.stdout: 10 457 0.95 MB/sec execute 15 sec latency 2394.808 ms 2023-11-18T21:16:39.928 INFO:tasks.workunit.client.0.smithi049.stdout: 10 459 0.94 MB/sec execute 16 sec latency 2413.033 ms 2023-11-18T21:16:40.929 INFO:tasks.workunit.client.0.smithi049.stdout: 10 461 0.93 MB/sec execute 17 sec latency 2467.953 ms 2023-11-18T21:16:41.929 INFO:tasks.workunit.client.0.smithi049.stdout: 10 464 0.93 MB/sec execute 18 sec latency 2412.785 ms 2023-11-18T21:16:42.929 INFO:tasks.workunit.client.0.smithi049.stdout: 10 467 0.93 MB/sec execute 19 sec latency 2492.250 ms 2023-11-18T21:16:43.929 INFO:tasks.workunit.client.0.smithi049.stdout: 10 469 0.92 MB/sec execute 20 sec latency 2842.426 ms 2023-11-18T21:16:44.929 INFO:tasks.workunit.client.0.smithi049.stdout: 10 472 0.91 MB/sec execute 21 sec latency 3000.681 ms 2023-11-18T21:16:45.929 INFO:tasks.workunit.client.0.smithi049.stdout: 10 475 0.91 MB/sec execute 22 sec latency 2519.138 ms 2023-11-18T21:16:46.929 INFO:tasks.workunit.client.0.smithi049.stdout: 10 476 0.90 MB/sec execute 23 sec latency 2650.288 ms 2023-11-18T21:16:47.929 INFO:tasks.workunit.client.0.smithi049.stdout: 10 479 0.90 MB/sec execute 24 sec latency 2468.548 ms 2023-11-18T21:16:48.929 INFO:tasks.workunit.client.0.smithi049.stdout: 10 483 0.91 MB/sec execute 25 sec latency 2445.185 ms 2023-11-18T21:16:49.929 INFO:tasks.workunit.client.0.smithi049.stdout: 10 485 0.90 MB/sec execute 26 sec latency 2302.628 ms 2023-11-18T21:16:50.929 INFO:tasks.workunit.client.0.smithi049.stdout: 10 488 0.91 MB/sec execute 27 sec latency 2477.166 ms 2023-11-18T21:16:51.929 INFO:tasks.workunit.client.0.smithi049.stdout: 10 493 0.94 MB/sec execute 28 sec latency 2415.064 ms 2023-11-18T21:16:52.929 INFO:tasks.workunit.client.0.smithi049.stdout: 10 494 0.92 MB/sec execute 29 sec latency 2052.813 ms 2023-11-18T21:16:53.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 497 0.92 MB/sec execute 30 sec latency 2313.310 ms 2023-11-18T21:16:54.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 501 0.91 MB/sec execute 31 sec latency 2287.306 ms 2023-11-18T21:16:55.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 504 0.90 MB/sec execute 32 sec latency 2102.447 ms 2023-11-18T21:16:56.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 509 0.93 MB/sec execute 33 sec latency 2500.570 ms 2023-11-18T21:16:57.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 511 0.93 MB/sec execute 34 sec latency 2314.935 ms 2023-11-18T21:16:58.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 514 0.93 MB/sec execute 35 sec latency 2184.509 ms 2023-11-18T21:16:59.444 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:16:59.446 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:16:59.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 519 0.96 MB/sec execute 36 sec latency 2415.385 ms 2023-11-18T21:17:00.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 520 0.95 MB/sec execute 37 sec latency 2284.426 ms 2023-11-18T21:17:01.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 522 0.93 MB/sec execute 38 sec latency 2685.211 ms 2023-11-18T21:17:02.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 528 0.95 MB/sec execute 39 sec latency 2669.541 ms 2023-11-18T21:17:03.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 532 0.97 MB/sec execute 40 sec latency 1915.473 ms 2023-11-18T21:17:04.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 536 0.98 MB/sec execute 41 sec latency 1894.100 ms 2023-11-18T21:17:05.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 542 1.00 MB/sec execute 42 sec latency 2010.273 ms 2023-11-18T21:17:06.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 547 1.00 MB/sec execute 43 sec latency 2954.349 ms 2023-11-18T21:17:07.930 INFO:tasks.workunit.client.0.smithi049.stdout: 10 553 1.02 MB/sec execute 44 sec latency 3061.967 ms 2023-11-18T21:17:08.931 INFO:tasks.workunit.client.0.smithi049.stdout: 10 558 1.05 MB/sec execute 45 sec latency 2506.932 ms 2023-11-18T21:17:09.931 INFO:tasks.workunit.client.0.smithi049.stdout: 10 563 1.06 MB/sec execute 46 sec latency 2073.045 ms 2023-11-18T21:17:10.931 INFO:tasks.workunit.client.0.smithi049.stdout: 10 569 1.08 MB/sec execute 47 sec latency 3000.267 ms 2023-11-18T21:17:11.931 INFO:tasks.workunit.client.0.smithi049.stdout: 10 578 1.12 MB/sec execute 48 sec latency 2552.324 ms 2023-11-18T21:17:12.931 INFO:tasks.workunit.client.0.smithi049.stdout: 10 582 1.14 MB/sec execute 49 sec latency 2443.296 ms 2023-11-18T21:17:13.931 INFO:tasks.workunit.client.0.smithi049.stdout: 10 585 1.13 MB/sec execute 50 sec latency 2643.483 ms 2023-11-18T21:17:14.931 INFO:tasks.workunit.client.0.smithi049.stdout: 10 590 1.11 MB/sec execute 51 sec latency 3044.071 ms 2023-11-18T21:17:15.931 INFO:tasks.workunit.client.0.smithi049.stdout: 10 596 1.11 MB/sec execute 52 sec latency 2709.547 ms 2023-11-18T21:17:16.931 INFO:tasks.workunit.client.0.smithi049.stdout: 10 602 1.13 MB/sec execute 53 sec latency 2957.454 ms 2023-11-18T21:17:17.931 INFO:tasks.workunit.client.0.smithi049.stdout: 10 607 1.15 MB/sec execute 54 sec latency 3345.268 ms 2023-11-18T21:17:18.931 INFO:tasks.workunit.client.0.smithi049.stdout: 10 610 1.16 MB/sec execute 55 sec latency 3771.159 ms 2023-11-18T21:17:19.931 INFO:tasks.workunit.client.0.smithi049.stdout: 10 613 1.14 MB/sec execute 56 sec latency 3636.130 ms 2023-11-18T21:17:20.932 INFO:tasks.workunit.client.0.smithi049.stdout: 10 614 1.12 MB/sec execute 57 sec latency 3433.786 ms 2023-11-18T21:17:21.931 INFO:tasks.workunit.client.0.smithi049.stdout: 10 615 1.10 MB/sec execute 58 sec latency 3627.361 ms 2023-11-18T21:17:22.932 INFO:tasks.workunit.client.0.smithi049.stdout: 10 618 1.09 MB/sec execute 59 sec latency 3507.930 ms 2023-11-18T21:17:23.932 INFO:tasks.workunit.client.0.smithi049.stdout: 10 620 1.07 MB/sec execute 60 sec latency 3356.230 ms 2023-11-18T21:17:24.932 INFO:tasks.workunit.client.0.smithi049.stdout: 10 624 1.05 MB/sec execute 61 sec latency 2649.342 ms 2023-11-18T21:17:25.932 INFO:tasks.workunit.client.0.smithi049.stdout: 10 625 1.03 MB/sec execute 62 sec latency 2980.657 ms 2023-11-18T21:17:26.932 INFO:tasks.workunit.client.0.smithi049.stdout: 10 627 1.02 MB/sec execute 63 sec latency 3028.567 ms 2023-11-18T21:17:27.932 INFO:tasks.workunit.client.0.smithi049.stdout: 10 628 1.00 MB/sec execute 64 sec latency 3771.415 ms 2023-11-18T21:17:28.932 INFO:tasks.workunit.client.0.smithi049.stdout: 10 632 0.99 MB/sec execute 65 sec latency 3703.958 ms 2023-11-18T21:17:29.535 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:17:29.538 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:17:29.932 INFO:tasks.workunit.client.0.smithi049.stdout: 10 633 0.98 MB/sec execute 66 sec latency 3669.132 ms 2023-11-18T21:17:30.932 INFO:tasks.workunit.client.0.smithi049.stdout: 10 634 0.96 MB/sec execute 67 sec latency 3557.466 ms 2023-11-18T21:17:31.932 INFO:tasks.workunit.client.0.smithi049.stdout: 10 637 0.95 MB/sec execute 68 sec latency 3848.478 ms 2023-11-18T21:17:32.932 INFO:tasks.workunit.client.0.smithi049.stdout: 10 640 0.94 MB/sec execute 69 sec latency 3120.443 ms 2023-11-18T21:17:33.932 INFO:tasks.workunit.client.0.smithi049.stdout: 10 642 0.92 MB/sec execute 70 sec latency 3819.705 ms 2023-11-18T21:17:34.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 648 0.91 MB/sec execute 71 sec latency 3684.776 ms 2023-11-18T21:17:35.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 649 0.90 MB/sec execute 72 sec latency 3544.309 ms 2023-11-18T21:17:36.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 650 0.89 MB/sec execute 73 sec latency 3296.518 ms 2023-11-18T21:17:37.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 651 0.88 MB/sec execute 74 sec latency 3368.079 ms 2023-11-18T21:17:38.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 652 0.87 MB/sec execute 75 sec latency 3713.849 ms 2023-11-18T21:17:39.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 653 0.85 MB/sec execute 76 sec latency 3830.568 ms 2023-11-18T21:17:40.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 655 0.84 MB/sec execute 77 sec latency 3746.193 ms 2023-11-18T21:17:41.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 656 0.83 MB/sec execute 78 sec latency 3173.695 ms 2023-11-18T21:17:42.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 658 0.82 MB/sec execute 79 sec latency 3165.123 ms 2023-11-18T21:17:43.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 661 0.81 MB/sec execute 80 sec latency 2757.152 ms 2023-11-18T21:17:44.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 664 0.81 MB/sec execute 81 sec latency 3000.945 ms 2023-11-18T21:17:45.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 666 0.80 MB/sec execute 82 sec latency 3092.190 ms 2023-11-18T21:17:46.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 667 0.79 MB/sec execute 83 sec latency 3239.655 ms 2023-11-18T21:17:47.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 669 0.78 MB/sec execute 84 sec latency 2510.303 ms 2023-11-18T21:17:48.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 671 0.77 MB/sec execute 85 sec latency 3353.369 ms 2023-11-18T21:17:49.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 673 0.76 MB/sec execute 86 sec latency 3426.039 ms 2023-11-18T21:17:50.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 675 0.75 MB/sec execute 87 sec latency 3267.311 ms 2023-11-18T21:17:51.933 INFO:tasks.workunit.client.0.smithi049.stdout: 10 677 0.75 MB/sec execute 88 sec latency 3215.652 ms 2023-11-18T21:17:52.934 INFO:tasks.workunit.client.0.smithi049.stdout: 10 679 0.74 MB/sec execute 89 sec latency 2835.122 ms 2023-11-18T21:17:53.934 INFO:tasks.workunit.client.0.smithi049.stdout: 10 681 0.73 MB/sec execute 90 sec latency 2881.769 ms 2023-11-18T21:17:54.934 INFO:tasks.workunit.client.0.smithi049.stdout: 10 685 0.73 MB/sec execute 91 sec latency 2908.564 ms 2023-11-18T21:17:55.934 INFO:tasks.workunit.client.0.smithi049.stdout: 10 691 0.72 MB/sec execute 92 sec latency 2683.480 ms 2023-11-18T21:17:56.934 INFO:tasks.workunit.client.0.smithi049.stdout: 10 694 0.71 MB/sec execute 93 sec latency 1129.701 ms 2023-11-18T21:17:57.934 INFO:tasks.workunit.client.0.smithi049.stdout: 10 696 0.70 MB/sec execute 94 sec latency 2129.796 ms 2023-11-18T21:17:58.934 INFO:tasks.workunit.client.0.smithi049.stdout: 10 698 0.70 MB/sec execute 95 sec latency 2968.401 ms 2023-11-18T21:17:59.667 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:17:59.669 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:17:59.934 INFO:tasks.workunit.client.0.smithi049.stdout: 10 700 0.69 MB/sec execute 96 sec latency 3268.914 ms 2023-11-18T21:18:00.934 INFO:tasks.workunit.client.0.smithi049.stdout: 10 701 0.68 MB/sec execute 97 sec latency 2317.851 ms 2023-11-18T21:18:01.934 INFO:tasks.workunit.client.0.smithi049.stdout: 10 703 0.68 MB/sec execute 98 sec latency 3317.915 ms 2023-11-18T21:18:02.935 INFO:tasks.workunit.client.0.smithi049.stdout: 10 704 0.67 MB/sec execute 99 sec latency 3466.890 ms 2023-11-18T21:18:03.934 INFO:tasks.workunit.client.0.smithi049.stdout: 10 706 0.66 MB/sec execute 100 sec latency 3122.912 ms 2023-11-18T21:18:04.934 INFO:tasks.workunit.client.0.smithi049.stdout: 10 709 0.66 MB/sec execute 101 sec latency 2786.778 ms 2023-11-18T21:18:05.935 INFO:tasks.workunit.client.0.smithi049.stdout: 10 711 0.65 MB/sec execute 102 sec latency 3168.232 ms 2023-11-18T21:18:06.935 INFO:tasks.workunit.client.0.smithi049.stdout: 10 714 0.65 MB/sec execute 103 sec latency 2543.760 ms 2023-11-18T21:18:07.935 INFO:tasks.workunit.client.0.smithi049.stdout: 10 719 0.64 MB/sec execute 104 sec latency 2148.928 ms 2023-11-18T21:18:08.935 INFO:tasks.workunit.client.0.smithi049.stdout: 10 721 0.64 MB/sec execute 105 sec latency 2142.317 ms 2023-11-18T21:18:09.935 INFO:tasks.workunit.client.0.smithi049.stdout: 10 725 0.63 MB/sec execute 106 sec latency 2461.468 ms 2023-11-18T21:18:10.935 INFO:tasks.workunit.client.0.smithi049.stdout: 10 727 0.62 MB/sec execute 107 sec latency 2511.505 ms 2023-11-18T21:18:11.935 INFO:tasks.workunit.client.0.smithi049.stdout: 10 730 0.62 MB/sec execute 108 sec latency 3010.923 ms 2023-11-18T21:18:12.935 INFO:tasks.workunit.client.0.smithi049.stdout: 10 733 0.61 MB/sec execute 109 sec latency 1402.966 ms 2023-11-18T21:18:13.935 INFO:tasks.workunit.client.0.smithi049.stdout: 10 734 0.61 MB/sec execute 110 sec latency 2403.060 ms 2023-11-18T21:18:14.935 INFO:tasks.workunit.client.0.smithi049.stdout: 10 736 0.60 MB/sec execute 111 sec latency 3013.696 ms 2023-11-18T21:18:15.935 INFO:tasks.workunit.client.0.smithi049.stdout: 10 738 0.60 MB/sec execute 112 sec latency 3225.364 ms 2023-11-18T21:18:16.936 INFO:tasks.workunit.client.0.smithi049.stdout: 10 739 0.59 MB/sec execute 113 sec latency 2712.704 ms 2023-11-18T21:18:17.936 INFO:tasks.workunit.client.0.smithi049.stdout: 10 740 0.59 MB/sec execute 114 sec latency 2941.906 ms 2023-11-18T21:18:18.936 INFO:tasks.workunit.client.0.smithi049.stdout: 10 741 0.58 MB/sec execute 115 sec latency 3124.222 ms 2023-11-18T21:18:19.936 INFO:tasks.workunit.client.0.smithi049.stdout: 10 745 0.58 MB/sec execute 116 sec latency 2745.879 ms 2023-11-18T21:18:20.936 INFO:tasks.workunit.client.0.smithi049.stdout: 10 749 0.58 MB/sec execute 117 sec latency 3069.342 ms 2023-11-18T21:18:21.937 INFO:tasks.workunit.client.0.smithi049.stdout: 10 754 0.57 MB/sec execute 118 sec latency 1678.352 ms 2023-11-18T21:18:22.937 INFO:tasks.workunit.client.0.smithi049.stdout: 10 756 0.57 MB/sec execute 119 sec latency 2678.462 ms 2023-11-18T21:18:23.937 INFO:tasks.workunit.client.0.smithi049.stdout: 10 758 0.56 MB/sec execute 120 sec latency 2755.433 ms 2023-11-18T21:18:24.937 INFO:tasks.workunit.client.0.smithi049.stdout: 10 763 0.56 MB/sec execute 121 sec latency 2304.982 ms 2023-11-18T21:18:25.937 INFO:tasks.workunit.client.0.smithi049.stdout: 10 766 0.55 MB/sec execute 122 sec latency 1208.274 ms 2023-11-18T21:18:26.937 INFO:tasks.workunit.client.0.smithi049.stdout: 10 768 0.55 MB/sec execute 123 sec latency 1621.274 ms 2023-11-18T21:18:27.937 INFO:tasks.workunit.client.0.smithi049.stdout: 10 770 0.55 MB/sec execute 124 sec latency 2499.041 ms 2023-11-18T21:18:28.937 INFO:tasks.workunit.client.0.smithi049.stdout: 10 772 0.54 MB/sec execute 125 sec latency 2400.984 ms 2023-11-18T21:18:29.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:18:29.761 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:18:29.937 INFO:tasks.workunit.client.0.smithi049.stdout: 10 773 0.54 MB/sec execute 126 sec latency 2628.231 ms 2023-11-18T21:18:30.937 INFO:tasks.workunit.client.0.smithi049.stdout: 10 774 0.53 MB/sec execute 127 sec latency 2949.734 ms 2023-11-18T21:18:31.937 INFO:tasks.workunit.client.0.smithi049.stdout: 10 776 0.53 MB/sec execute 128 sec latency 3390.107 ms 2023-11-18T21:18:32.937 INFO:tasks.workunit.client.0.smithi049.stdout: 10 780 0.53 MB/sec execute 129 sec latency 3746.242 ms 2023-11-18T21:18:33.937 INFO:tasks.workunit.client.0.smithi049.stdout: 10 783 0.52 MB/sec execute 130 sec latency 2277.256 ms 2023-11-18T21:18:34.937 INFO:tasks.workunit.client.0.smithi049.stdout: 10 785 0.52 MB/sec execute 131 sec latency 3166.721 ms 2023-11-18T21:18:35.938 INFO:tasks.workunit.client.0.smithi049.stdout: 10 788 0.52 MB/sec execute 132 sec latency 2080.891 ms 2023-11-18T21:18:36.938 INFO:tasks.workunit.client.0.smithi049.stdout: 10 791 0.51 MB/sec execute 133 sec latency 2694.712 ms 2023-11-18T21:18:37.938 INFO:tasks.workunit.client.0.smithi049.stdout: 10 794 0.51 MB/sec execute 134 sec latency 3144.335 ms 2023-11-18T21:18:38.938 INFO:tasks.workunit.client.0.smithi049.stdout: 10 797 0.51 MB/sec execute 135 sec latency 2386.439 ms 2023-11-18T21:18:39.938 INFO:tasks.workunit.client.0.smithi049.stdout: 10 799 0.50 MB/sec execute 136 sec latency 3094.821 ms 2023-11-18T21:18:40.938 INFO:tasks.workunit.client.0.smithi049.stdout: 10 800 0.50 MB/sec execute 137 sec latency 2771.274 ms 2023-11-18T21:18:41.938 INFO:tasks.workunit.client.0.smithi049.stdout: 10 802 0.50 MB/sec execute 138 sec latency 3085.193 ms 2023-11-18T21:18:42.938 INFO:tasks.workunit.client.0.smithi049.stdout: 10 805 0.49 MB/sec execute 139 sec latency 2789.876 ms 2023-11-18T21:18:43.938 INFO:tasks.workunit.client.0.smithi049.stdout: 10 806 0.49 MB/sec execute 140 sec latency 3168.144 ms 2023-11-18T21:18:44.938 INFO:tasks.workunit.client.0.smithi049.stdout: 10 807 0.49 MB/sec execute 141 sec latency 3000.390 ms 2023-11-18T21:18:45.939 INFO:tasks.workunit.client.0.smithi049.stdout: 10 808 0.48 MB/sec execute 142 sec latency 3341.851 ms 2023-11-18T21:18:46.939 INFO:tasks.workunit.client.0.smithi049.stdout: 10 809 0.48 MB/sec execute 143 sec latency 3048.187 ms 2023-11-18T21:18:47.939 INFO:tasks.workunit.client.0.smithi049.stdout: 10 810 0.48 MB/sec execute 144 sec latency 3132.746 ms 2023-11-18T21:18:48.939 INFO:tasks.workunit.client.0.smithi049.stdout: 10 811 0.47 MB/sec execute 145 sec latency 3436.808 ms 2023-11-18T21:18:49.939 INFO:tasks.workunit.client.0.smithi049.stdout: 10 813 0.47 MB/sec execute 146 sec latency 3462.283 ms 2023-11-18T21:18:50.939 INFO:tasks.workunit.client.0.smithi049.stdout: 10 817 0.47 MB/sec execute 147 sec latency 3585.446 ms 2023-11-18T21:18:51.939 INFO:tasks.workunit.client.0.smithi049.stdout: 10 819 0.47 MB/sec execute 148 sec latency 3070.349 ms 2023-11-18T21:18:52.939 INFO:tasks.workunit.client.0.smithi049.stdout: 10 821 0.46 MB/sec execute 149 sec latency 2775.022 ms 2023-11-18T21:18:53.939 INFO:tasks.workunit.client.0.smithi049.stdout: 10 823 0.46 MB/sec execute 150 sec latency 2872.692 ms 2023-11-18T21:18:54.939 INFO:tasks.workunit.client.0.smithi049.stdout: 10 828 0.46 MB/sec execute 151 sec latency 2560.521 ms 2023-11-18T21:18:55.940 INFO:tasks.workunit.client.0.smithi049.stdout: 10 830 0.46 MB/sec execute 152 sec latency 3138.453 ms 2023-11-18T21:18:56.940 INFO:tasks.workunit.client.0.smithi049.stdout: 10 834 0.45 MB/sec execute 153 sec latency 3185.778 ms 2023-11-18T21:18:57.940 INFO:tasks.workunit.client.0.smithi049.stdout: 10 835 0.45 MB/sec execute 154 sec latency 2624.465 ms 2023-11-18T21:18:58.940 INFO:tasks.workunit.client.0.smithi049.stdout: 10 835 0.45 MB/sec execute 155 sec latency 3131.919 ms 2023-11-18T21:18:59.806 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:18:59.808 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:18:59.940 INFO:tasks.workunit.client.0.smithi049.stdout: 10 836 0.44 MB/sec execute 156 sec latency 3601.447 ms 2023-11-18T21:19:00.940 INFO:tasks.workunit.client.0.smithi049.stdout: 10 841 0.44 MB/sec execute 157 sec latency 3821.230 ms 2023-11-18T21:19:01.940 INFO:tasks.workunit.client.0.smithi049.stdout: 10 843 0.44 MB/sec execute 158 sec latency 3622.246 ms 2023-11-18T21:19:02.940 INFO:tasks.workunit.client.0.smithi049.stdout: 10 844 0.44 MB/sec execute 159 sec latency 3170.606 ms 2023-11-18T21:19:03.940 INFO:tasks.workunit.client.0.smithi049.stdout: 10 845 0.44 MB/sec execute 160 sec latency 4065.011 ms 2023-11-18T21:19:04.940 INFO:tasks.workunit.client.0.smithi049.stdout: 10 846 0.43 MB/sec execute 161 sec latency 4101.991 ms 2023-11-18T21:19:05.941 INFO:tasks.workunit.client.0.smithi049.stdout: 10 846 0.43 MB/sec execute 162 sec latency 4080.016 ms 2023-11-18T21:19:06.940 INFO:tasks.workunit.client.0.smithi049.stdout: 10 847 0.43 MB/sec execute 163 sec latency 3677.038 ms 2023-11-18T21:19:07.941 INFO:tasks.workunit.client.0.smithi049.stdout: 10 849 0.42 MB/sec execute 164 sec latency 3749.564 ms 2023-11-18T21:19:08.941 INFO:tasks.workunit.client.0.smithi049.stdout: 10 850 0.42 MB/sec execute 165 sec latency 2984.573 ms 2023-11-18T21:19:09.941 INFO:tasks.workunit.client.0.smithi049.stdout: 10 851 0.42 MB/sec execute 166 sec latency 3084.447 ms 2023-11-18T21:19:10.941 INFO:tasks.workunit.client.0.smithi049.stdout: 10 852 0.42 MB/sec execute 167 sec latency 3258.732 ms 2023-11-18T21:19:11.941 INFO:tasks.workunit.client.0.smithi049.stdout: 10 856 0.42 MB/sec execute 168 sec latency 3510.598 ms 2023-11-18T21:19:12.941 INFO:tasks.workunit.client.0.smithi049.stdout: 10 857 0.41 MB/sec execute 169 sec latency 3034.645 ms 2023-11-18T21:19:13.941 INFO:tasks.workunit.client.0.smithi049.stdout: 10 858 0.41 MB/sec execute 170 sec latency 3205.361 ms 2023-11-18T21:19:14.941 INFO:tasks.workunit.client.0.smithi049.stdout: 10 860 0.41 MB/sec execute 171 sec latency 3061.678 ms 2023-11-18T21:19:15.941 INFO:tasks.workunit.client.0.smithi049.stdout: 10 862 0.41 MB/sec execute 172 sec latency 3328.290 ms 2023-11-18T21:19:16.941 INFO:tasks.workunit.client.0.smithi049.stdout: 10 866 0.41 MB/sec execute 173 sec latency 3148.227 ms 2023-11-18T21:19:17.942 INFO:tasks.workunit.client.0.smithi049.stdout: 10 869 0.40 MB/sec execute 174 sec latency 3231.740 ms 2023-11-18T21:19:18.942 INFO:tasks.workunit.client.0.smithi049.stdout: 10 871 0.40 MB/sec execute 175 sec latency 1798.652 ms 2023-11-18T21:19:19.942 INFO:tasks.workunit.client.0.smithi049.stdout: 10 874 0.40 MB/sec execute 176 sec latency 2798.703 ms 2023-11-18T21:19:20.942 INFO:tasks.workunit.client.0.smithi049.stdout: 10 875 0.40 MB/sec execute 177 sec latency 3431.784 ms 2023-11-18T21:19:21.942 INFO:tasks.workunit.client.0.smithi049.stdout: 10 878 0.40 MB/sec execute 178 sec latency 3040.666 ms 2023-11-18T21:19:22.942 INFO:tasks.workunit.client.0.smithi049.stdout: 10 880 0.39 MB/sec execute 179 sec latency 3046.439 ms 2023-11-18T21:19:23.942 INFO:tasks.workunit.client.0.smithi049.stdout: 10 881 0.39 MB/sec execute 180 sec latency 3066.958 ms 2023-11-18T21:19:24.942 INFO:tasks.workunit.client.0.smithi049.stdout: 10 882 0.39 MB/sec execute 181 sec latency 3466.902 ms 2023-11-18T21:19:25.942 INFO:tasks.workunit.client.0.smithi049.stdout: 10 885 0.39 MB/sec execute 182 sec latency 3576.499 ms 2023-11-18T21:19:26.942 INFO:tasks.workunit.client.0.smithi049.stdout: 10 888 0.39 MB/sec execute 183 sec latency 2600.226 ms 2023-11-18T21:19:27.942 INFO:tasks.workunit.client.0.smithi049.stdout: 10 890 0.38 MB/sec execute 184 sec latency 3039.543 ms 2023-11-18T21:19:28.942 INFO:tasks.workunit.client.0.smithi049.stdout: 10 892 0.38 MB/sec execute 185 sec latency 2053.550 ms 2023-11-18T21:19:29.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:19:29.871 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:19:29.942 INFO:tasks.workunit.client.0.smithi049.stdout: 10 893 0.38 MB/sec execute 186 sec latency 2840.527 ms 2023-11-18T21:19:30.942 INFO:tasks.workunit.client.0.smithi049.stdout: 10 894 0.38 MB/sec execute 187 sec latency 2389.375 ms 2023-11-18T21:19:31.943 INFO:tasks.workunit.client.0.smithi049.stdout: 10 896 0.38 MB/sec execute 188 sec latency 2828.568 ms 2023-11-18T21:19:32.943 INFO:tasks.workunit.client.0.smithi049.stdout: 10 898 0.38 MB/sec execute 189 sec latency 2962.557 ms 2023-11-18T21:19:33.943 INFO:tasks.workunit.client.0.smithi049.stdout: 10 900 0.37 MB/sec execute 190 sec latency 2290.884 ms 2023-11-18T21:19:34.943 INFO:tasks.workunit.client.0.smithi049.stdout: 10 902 0.37 MB/sec execute 191 sec latency 3085.634 ms 2023-11-18T21:19:35.943 INFO:tasks.workunit.client.0.smithi049.stdout: 10 903 0.37 MB/sec execute 192 sec latency 3029.745 ms 2023-11-18T21:19:36.943 INFO:tasks.workunit.client.0.smithi049.stdout: 10 905 0.37 MB/sec execute 193 sec latency 3063.575 ms 2023-11-18T21:19:37.943 INFO:tasks.workunit.client.0.smithi049.stdout: 10 908 0.37 MB/sec execute 194 sec latency 1966.328 ms 2023-11-18T21:19:38.943 INFO:tasks.workunit.client.0.smithi049.stdout: 10 910 0.37 MB/sec execute 195 sec latency 2966.393 ms 2023-11-18T21:19:39.944 INFO:tasks.workunit.client.0.smithi049.stdout: 10 912 0.36 MB/sec execute 196 sec latency 3125.277 ms 2023-11-18T21:19:40.944 INFO:tasks.workunit.client.0.smithi049.stdout: 10 913 0.36 MB/sec execute 197 sec latency 3062.142 ms 2023-11-18T21:19:41.944 INFO:tasks.workunit.client.0.smithi049.stdout: 10 914 0.36 MB/sec execute 198 sec latency 3396.231 ms 2023-11-18T21:19:42.944 INFO:tasks.workunit.client.0.smithi049.stdout: 10 916 0.36 MB/sec execute 199 sec latency 3289.149 ms 2023-11-18T21:19:43.944 INFO:tasks.workunit.client.0.smithi049.stdout: 10 917 0.36 MB/sec execute 200 sec latency 2841.106 ms 2023-11-18T21:19:44.944 INFO:tasks.workunit.client.0.smithi049.stdout: 10 918 0.36 MB/sec execute 201 sec latency 3109.910 ms 2023-11-18T21:19:45.944 INFO:tasks.workunit.client.0.smithi049.stdout: 10 919 0.35 MB/sec execute 202 sec latency 3106.879 ms 2023-11-18T21:19:46.944 INFO:tasks.workunit.client.0.smithi049.stdout: 10 920 0.35 MB/sec execute 203 sec latency 3844.913 ms 2023-11-18T21:19:47.944 INFO:tasks.workunit.client.0.smithi049.stdout: 10 921 0.35 MB/sec execute 204 sec latency 3457.449 ms 2023-11-18T21:19:48.944 INFO:tasks.workunit.client.0.smithi049.stdout: 10 922 0.35 MB/sec execute 205 sec latency 2302.105 ms 2023-11-18T21:19:49.945 INFO:tasks.workunit.client.0.smithi049.stdout: 10 922 0.35 MB/sec execute 206 sec latency 3154.004 ms 2023-11-18T21:19:50.945 INFO:tasks.workunit.client.0.smithi049.stdout: 10 924 0.35 MB/sec execute 207 sec latency 3181.370 ms 2023-11-18T21:19:51.945 INFO:tasks.workunit.client.0.smithi049.stdout: 10 926 0.34 MB/sec execute 208 sec latency 3113.214 ms 2023-11-18T21:19:52.945 INFO:tasks.workunit.client.0.smithi049.stdout: 10 927 0.34 MB/sec execute 209 sec latency 2938.546 ms 2023-11-18T21:19:53.945 INFO:tasks.workunit.client.0.smithi049.stdout: 10 929 0.34 MB/sec execute 210 sec latency 3151.239 ms 2023-11-18T21:19:54.945 INFO:tasks.workunit.client.0.smithi049.stdout: 10 930 0.34 MB/sec execute 211 sec latency 1766.096 ms 2023-11-18T21:19:55.945 INFO:tasks.workunit.client.0.smithi049.stdout: 10 931 0.34 MB/sec execute 212 sec latency 2648.743 ms 2023-11-18T21:19:56.945 INFO:tasks.workunit.client.0.smithi049.stdout: 10 933 0.34 MB/sec execute 213 sec latency 3121.145 ms 2023-11-18T21:19:57.945 INFO:tasks.workunit.client.0.smithi049.stdout: 10 934 0.34 MB/sec execute 214 sec latency 3087.471 ms 2023-11-18T21:19:58.945 INFO:tasks.workunit.client.0.smithi049.stdout: 10 936 0.33 MB/sec execute 215 sec latency 2653.693 ms 2023-11-18T21:19:59.927 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:19:59.929 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:19:59.945 INFO:tasks.workunit.client.0.smithi049.stdout: 10 938 0.33 MB/sec execute 216 sec latency 3629.032 ms 2023-11-18T21:20:00.945 INFO:tasks.workunit.client.0.smithi049.stdout: 10 939 0.33 MB/sec execute 217 sec latency 2888.733 ms 2023-11-18T21:20:01.945 INFO:tasks.workunit.client.0.smithi049.stdout: 10 941 0.33 MB/sec execute 218 sec latency 3561.443 ms 2023-11-18T21:20:02.946 INFO:tasks.workunit.client.0.smithi049.stdout: 10 943 0.33 MB/sec execute 219 sec latency 3580.240 ms 2023-11-18T21:20:03.946 INFO:tasks.workunit.client.0.smithi049.stdout: 10 947 0.33 MB/sec execute 220 sec latency 3349.810 ms 2023-11-18T21:20:04.946 INFO:tasks.workunit.client.0.smithi049.stdout: 10 948 0.33 MB/sec execute 221 sec latency 1686.563 ms 2023-11-18T21:20:05.946 INFO:tasks.workunit.client.0.smithi049.stdout: 10 950 0.32 MB/sec execute 222 sec latency 2335.848 ms 2023-11-18T21:20:06.946 INFO:tasks.workunit.client.0.smithi049.stdout: 10 951 0.32 MB/sec execute 223 sec latency 3133.524 ms 2023-11-18T21:20:07.946 INFO:tasks.workunit.client.0.smithi049.stdout: 10 954 0.32 MB/sec execute 224 sec latency 3355.843 ms 2023-11-18T21:20:08.946 INFO:tasks.workunit.client.0.smithi049.stdout: 10 956 0.32 MB/sec execute 225 sec latency 2596.612 ms 2023-11-18T21:20:09.946 INFO:tasks.workunit.client.0.smithi049.stdout: 10 957 0.32 MB/sec execute 226 sec latency 3576.044 ms 2023-11-18T21:20:10.946 INFO:tasks.workunit.client.0.smithi049.stdout: 10 959 0.32 MB/sec execute 227 sec latency 3465.019 ms 2023-11-18T21:20:11.946 INFO:tasks.workunit.client.0.smithi049.stdout: 10 960 0.32 MB/sec execute 228 sec latency 2712.726 ms 2023-11-18T21:20:12.946 INFO:tasks.workunit.client.0.smithi049.stdout: 10 961 0.32 MB/sec execute 229 sec latency 3142.517 ms 2023-11-18T21:20:13.946 INFO:tasks.workunit.client.0.smithi049.stdout: 10 965 0.32 MB/sec execute 230 sec latency 3052.259 ms 2023-11-18T21:20:14.947 INFO:tasks.workunit.client.0.smithi049.stdout: 10 966 0.32 MB/sec execute 231 sec latency 2403.656 ms 2023-11-18T21:20:15.947 INFO:tasks.workunit.client.0.smithi049.stdout: 10 970 0.32 MB/sec execute 232 sec latency 2416.406 ms 2023-11-18T21:20:16.947 INFO:tasks.workunit.client.0.smithi049.stdout: 10 971 0.32 MB/sec execute 233 sec latency 2970.612 ms 2023-11-18T21:20:17.947 INFO:tasks.workunit.client.0.smithi049.stdout: 10 973 0.31 MB/sec execute 234 sec latency 3026.416 ms 2023-11-18T21:20:18.947 INFO:tasks.workunit.client.0.smithi049.stdout: 10 975 0.31 MB/sec execute 235 sec latency 2685.200 ms 2023-11-18T21:20:19.947 INFO:tasks.workunit.client.0.smithi049.stdout: 10 977 0.31 MB/sec execute 236 sec latency 3077.815 ms 2023-11-18T21:20:20.947 INFO:tasks.workunit.client.0.smithi049.stdout: 10 981 0.32 MB/sec execute 237 sec latency 3225.923 ms 2023-11-18T21:20:21.947 INFO:tasks.workunit.client.0.smithi049.stdout: 10 982 0.31 MB/sec execute 238 sec latency 3302.156 ms 2023-11-18T21:20:22.947 INFO:tasks.workunit.client.0.smithi049.stdout: 10 984 0.31 MB/sec execute 239 sec latency 3249.654 ms 2023-11-18T21:20:23.947 INFO:tasks.workunit.client.0.smithi049.stdout: 10 987 0.31 MB/sec execute 240 sec latency 3308.630 ms 2023-11-18T21:20:24.947 INFO:tasks.workunit.client.0.smithi049.stdout: 10 989 0.31 MB/sec execute 241 sec latency 2832.837 ms 2023-11-18T21:20:25.947 INFO:tasks.workunit.client.0.smithi049.stdout: 10 992 0.31 MB/sec execute 242 sec latency 2095.912 ms 2023-11-18T21:20:26.948 INFO:tasks.workunit.client.0.smithi049.stdout: 10 995 0.32 MB/sec execute 243 sec latency 2920.746 ms 2023-11-18T21:20:27.948 INFO:tasks.workunit.client.0.smithi049.stdout: 10 997 0.31 MB/sec execute 244 sec latency 3315.550 ms 2023-11-18T21:20:28.948 INFO:tasks.workunit.client.0.smithi049.stdout: 10 998 0.31 MB/sec execute 245 sec latency 2933.731 ms 2023-11-18T21:20:29.948 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1000 0.31 MB/sec execute 246 sec latency 3384.280 ms 2023-11-18T21:20:29.975 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:20:29.978 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:20:30.948 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1004 0.32 MB/sec execute 247 sec latency 3562.133 ms 2023-11-18T21:20:31.948 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1008 0.32 MB/sec execute 248 sec latency 3274.560 ms 2023-11-18T21:20:32.948 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1010 0.32 MB/sec execute 249 sec latency 1821.152 ms 2023-11-18T21:20:33.950 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1014 0.32 MB/sec execute 250 sec latency 2821.231 ms 2023-11-18T21:20:34.948 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1014 0.32 MB/sec execute 251 sec latency 3146.976 ms 2023-11-18T21:20:35.948 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1015 0.32 MB/sec execute 252 sec latency 3377.261 ms 2023-11-18T21:20:36.948 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1017 0.32 MB/sec execute 253 sec latency 3355.238 ms 2023-11-18T21:20:37.949 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1018 0.31 MB/sec execute 254 sec latency 3694.844 ms 2023-11-18T21:20:38.949 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1020 0.31 MB/sec execute 255 sec latency 2422.118 ms 2023-11-18T21:20:39.949 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1021 0.31 MB/sec execute 256 sec latency 2887.720 ms 2023-11-18T21:20:40.949 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1023 0.31 MB/sec execute 257 sec latency 3288.724 ms 2023-11-18T21:20:41.949 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1023 0.31 MB/sec execute 258 sec latency 3659.526 ms 2023-11-18T21:20:42.949 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1024 0.31 MB/sec execute 259 sec latency 2923.129 ms 2023-11-18T21:20:43.949 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1026 0.31 MB/sec execute 260 sec latency 3474.724 ms 2023-11-18T21:20:44.949 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1028 0.31 MB/sec execute 261 sec latency 1478.061 ms 2023-11-18T21:20:45.949 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1030 0.31 MB/sec execute 262 sec latency 2450.457 ms 2023-11-18T21:20:46.949 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1033 0.31 MB/sec execute 263 sec latency 3445.759 ms 2023-11-18T21:20:47.949 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1036 0.31 MB/sec execute 264 sec latency 3225.067 ms 2023-11-18T21:20:48.949 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1038 0.31 MB/sec execute 265 sec latency 3344.176 ms 2023-11-18T21:20:49.949 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1039 0.30 MB/sec execute 266 sec latency 3030.245 ms 2023-11-18T21:20:50.950 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1040 0.30 MB/sec execute 267 sec latency 3265.154 ms 2023-11-18T21:20:51.950 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1040 0.30 MB/sec execute 268 sec latency 3406.375 ms 2023-11-18T21:20:52.950 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1041 0.30 MB/sec execute 269 sec latency 3667.035 ms 2023-11-18T21:20:53.950 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1044 0.30 MB/sec execute 270 sec latency 2494.576 ms 2023-11-18T21:20:54.950 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1046 0.30 MB/sec execute 271 sec latency 3494.631 ms 2023-11-18T21:20:55.950 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1048 0.30 MB/sec execute 272 sec latency 3741.802 ms 2023-11-18T21:20:56.950 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1050 0.30 MB/sec execute 273 sec latency 2902.137 ms 2023-11-18T21:20:57.950 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1052 0.30 MB/sec execute 274 sec latency 2943.948 ms 2023-11-18T21:20:58.950 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1054 0.30 MB/sec execute 275 sec latency 2269.821 ms 2023-11-18T21:20:59.950 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1059 0.30 MB/sec execute 276 sec latency 3006.991 ms 2023-11-18T21:21:00.048 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:21:00.051 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:21:00.950 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1062 0.30 MB/sec execute 277 sec latency 986.874 ms 2023-11-18T21:21:01.951 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1064 0.30 MB/sec execute 278 sec latency 1864.889 ms 2023-11-18T21:21:02.951 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1064 0.30 MB/sec execute 279 sec latency 2864.958 ms 2023-11-18T21:21:03.951 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1065 0.30 MB/sec execute 280 sec latency 3215.532 ms 2023-11-18T21:21:04.951 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1068 0.30 MB/sec execute 281 sec latency 3217.023 ms 2023-11-18T21:21:05.951 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1070 0.30 MB/sec execute 282 sec latency 2934.757 ms 2023-11-18T21:21:06.951 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1074 0.29 MB/sec execute 283 sec latency 2389.107 ms 2023-11-18T21:21:07.951 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1075 0.29 MB/sec execute 284 sec latency 3177.244 ms 2023-11-18T21:21:08.951 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1076 0.29 MB/sec execute 285 sec latency 2939.433 ms 2023-11-18T21:21:09.951 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1077 0.29 MB/sec execute 286 sec latency 3456.801 ms 2023-11-18T21:21:10.951 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1079 0.29 MB/sec execute 287 sec latency 3158.390 ms 2023-11-18T21:21:11.951 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1081 0.29 MB/sec execute 288 sec latency 2264.517 ms 2023-11-18T21:21:12.952 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1082 0.29 MB/sec execute 289 sec latency 3264.597 ms 2023-11-18T21:21:13.951 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1085 0.29 MB/sec execute 290 sec latency 3383.204 ms 2023-11-18T21:21:14.952 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1086 0.29 MB/sec execute 291 sec latency 3048.872 ms 2023-11-18T21:21:15.952 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1087 0.29 MB/sec execute 292 sec latency 2881.622 ms 2023-11-18T21:21:16.952 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1088 0.28 MB/sec execute 293 sec latency 3881.708 ms 2023-11-18T21:21:17.952 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1090 0.28 MB/sec execute 294 sec latency 3963.455 ms 2023-11-18T21:21:18.952 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1091 0.28 MB/sec execute 295 sec latency 1958.669 ms 2023-11-18T21:21:19.952 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1093 0.28 MB/sec execute 296 sec latency 2958.768 ms 2023-11-18T21:21:20.952 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1096 0.28 MB/sec execute 297 sec latency 3322.201 ms 2023-11-18T21:21:21.952 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1097 0.28 MB/sec execute 298 sec latency 3252.968 ms 2023-11-18T21:21:22.952 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1099 0.28 MB/sec execute 299 sec latency 3314.983 ms 2023-11-18T21:21:23.952 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1102 0.28 MB/sec execute 300 sec latency 3791.028 ms 2023-11-18T21:21:24.952 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1104 0.28 MB/sec execute 301 sec latency 1409.340 ms 2023-11-18T21:21:25.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1104 0.28 MB/sec execute 302 sec latency 2130.565 ms 2023-11-18T21:21:26.937 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:23:26.984 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:21:26.952 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1107 0.28 MB/sec execute 303 sec latency 2761.052 ms 2023-11-18T21:21:26.958 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:23:27.006 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:21:27.134 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:23:27.123 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:21:27.146 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:23:27.137 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:21:27.151 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:23:27.140 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:21:27.248 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:23:27.239 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:21:27.585 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:23:27.633 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:21:27.762 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:23:27.752 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:21:27.844 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:23:27.835 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:21:27.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1110 0.28 MB/sec execute 304 sec latency 2772.391 ms 2023-11-18T21:21:28.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1115 0.27 MB/sec execute 305 sec latency 1438.702 ms 2023-11-18T21:21:29.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1116 0.27 MB/sec execute 306 sec latency 1548.802 ms 2023-11-18T21:21:30.104 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:21:30.107 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:21:30.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1122 0.27 MB/sec execute 307 sec latency 1438.070 ms 2023-11-18T21:21:31.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1126 0.27 MB/sec execute 308 sec latency 874.022 ms 2023-11-18T21:21:32.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1128 0.27 MB/sec execute 309 sec latency 1396.381 ms 2023-11-18T21:21:33.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1129 0.27 MB/sec execute 310 sec latency 2396.453 ms 2023-11-18T21:21:34.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1130 0.27 MB/sec execute 311 sec latency 2811.458 ms 2023-11-18T21:21:35.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1133 0.27 MB/sec execute 312 sec latency 2771.250 ms 2023-11-18T21:21:36.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1136 0.27 MB/sec execute 313 sec latency 1996.759 ms 2023-11-18T21:21:37.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1138 0.27 MB/sec execute 314 sec latency 2777.875 ms 2023-11-18T21:21:38.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1139 0.27 MB/sec execute 315 sec latency 2965.440 ms 2023-11-18T21:21:39.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1139 0.27 MB/sec execute 316 sec latency 3353.977 ms 2023-11-18T21:21:40.953 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1140 0.26 MB/sec execute 317 sec latency 3661.581 ms 2023-11-18T21:21:41.954 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1143 0.26 MB/sec execute 318 sec latency 3450.703 ms 2023-11-18T21:21:42.954 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1145 0.26 MB/sec execute 319 sec latency 2214.321 ms 2023-11-18T21:21:43.954 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1147 0.26 MB/sec execute 320 sec latency 2809.728 ms 2023-11-18T21:21:44.954 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1149 0.26 MB/sec execute 321 sec latency 1909.747 ms 2023-11-18T21:21:45.954 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1149 0.26 MB/sec execute 322 sec latency 2909.796 ms 2023-11-18T21:21:46.954 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1150 0.26 MB/sec execute 323 sec latency 3846.851 ms 2023-11-18T21:21:47.954 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1152 0.26 MB/sec execute 324 sec latency 4023.207 ms 2023-11-18T21:21:48.954 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1154 0.26 MB/sec execute 325 sec latency 1747.986 ms 2023-11-18T21:21:49.954 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1156 0.26 MB/sec execute 326 sec latency 2748.082 ms 2023-11-18T21:21:50.954 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1158 0.26 MB/sec execute 327 sec latency 2838.611 ms 2023-11-18T21:21:51.954 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1159 0.26 MB/sec execute 328 sec latency 2474.228 ms 2023-11-18T21:21:52.954 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1160 0.26 MB/sec execute 329 sec latency 3266.073 ms 2023-11-18T21:21:53.954 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1162 0.26 MB/sec execute 330 sec latency 3409.124 ms 2023-11-18T21:21:54.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1163 0.25 MB/sec execute 331 sec latency 2085.422 ms 2023-11-18T21:21:55.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1164 0.25 MB/sec execute 332 sec latency 2483.526 ms 2023-11-18T21:21:56.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1166 0.25 MB/sec execute 333 sec latency 3483.585 ms 2023-11-18T21:21:57.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1167 0.25 MB/sec execute 334 sec latency 3712.275 ms 2023-11-18T21:21:58.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1168 0.25 MB/sec execute 335 sec latency 2944.521 ms 2023-11-18T21:21:59.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1170 0.25 MB/sec execute 336 sec latency 2868.736 ms 2023-11-18T21:22:00.142 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:22:00.144 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:22:00.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1172 0.25 MB/sec execute 337 sec latency 2901.319 ms 2023-11-18T21:22:01.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1174 0.25 MB/sec execute 338 sec latency 1841.271 ms 2023-11-18T21:22:02.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1176 0.25 MB/sec execute 339 sec latency 2178.951 ms 2023-11-18T21:22:03.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1177 0.25 MB/sec execute 340 sec latency 2865.191 ms 2023-11-18T21:22:04.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1181 0.25 MB/sec execute 341 sec latency 3170.356 ms 2023-11-18T21:22:05.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1182 0.25 MB/sec execute 342 sec latency 1000.752 ms 2023-11-18T21:22:06.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1184 0.25 MB/sec execute 343 sec latency 1531.990 ms 2023-11-18T21:22:07.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1186 0.25 MB/sec execute 344 sec latency 1848.594 ms 2023-11-18T21:22:08.955 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1189 0.24 MB/sec execute 345 sec latency 2772.703 ms 2023-11-18T21:22:09.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1191 0.24 MB/sec execute 346 sec latency 2328.016 ms 2023-11-18T21:22:10.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1193 0.24 MB/sec execute 347 sec latency 3328.084 ms 2023-11-18T21:22:11.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1195 0.24 MB/sec execute 348 sec latency 3379.904 ms 2023-11-18T21:22:12.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1197 0.24 MB/sec execute 349 sec latency 2386.458 ms 2023-11-18T21:22:13.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1199 0.24 MB/sec execute 350 sec latency 3246.891 ms 2023-11-18T21:22:14.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1201 0.24 MB/sec execute 351 sec latency 2332.965 ms 2023-11-18T21:22:15.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1201 0.24 MB/sec execute 352 sec latency 3013.687 ms 2023-11-18T21:22:16.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1203 0.24 MB/sec execute 353 sec latency 2780.432 ms 2023-11-18T21:22:17.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1205 0.24 MB/sec execute 354 sec latency 3229.200 ms 2023-11-18T21:22:18.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1207 0.24 MB/sec execute 355 sec latency 3319.551 ms 2023-11-18T21:22:19.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1209 0.24 MB/sec execute 356 sec latency 3388.147 ms 2023-11-18T21:22:20.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1210 0.24 MB/sec execute 357 sec latency 3053.594 ms 2023-11-18T21:22:21.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1211 0.24 MB/sec execute 358 sec latency 3097.801 ms 2023-11-18T21:22:22.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1213 0.24 MB/sec execute 359 sec latency 3120.756 ms 2023-11-18T21:22:23.956 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1215 0.24 MB/sec execute 360 sec latency 3158.157 ms 2023-11-18T21:22:24.957 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1218 0.23 MB/sec execute 361 sec latency 2199.125 ms 2023-11-18T21:22:25.957 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1220 0.23 MB/sec execute 362 sec latency 2777.538 ms 2023-11-18T21:22:26.957 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1223 0.23 MB/sec execute 363 sec latency 3112.251 ms 2023-11-18T21:22:27.957 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1224 0.23 MB/sec execute 364 sec latency 1632.901 ms 2023-11-18T21:22:28.957 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1226 0.23 MB/sec execute 365 sec latency 1827.549 ms 2023-11-18T21:22:29.957 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1228 0.23 MB/sec execute 366 sec latency 2045.742 ms 2023-11-18T21:22:30.199 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:22:30.201 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:22:30.957 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1232 0.23 MB/sec execute 367 sec latency 2405.812 ms 2023-11-18T21:22:31.957 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1234 0.23 MB/sec execute 368 sec latency 2383.492 ms 2023-11-18T21:22:32.957 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1235 0.23 MB/sec execute 369 sec latency 1708.982 ms 2023-11-18T21:22:33.957 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1236 0.23 MB/sec execute 370 sec latency 2452.026 ms 2023-11-18T21:22:34.494 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:24:34.541 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:22:34.587 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:24:34.634 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:22:34.786 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:24:34.833 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:22:34.787 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:24:34.775 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:22:34.789 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:24:34.779 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:22:34.804 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:24:34.795 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:22:34.810 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:24:34.799 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:22:34.957 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1239 0.23 MB/sec execute 371 sec latency 3028.171 ms 2023-11-18T21:22:34.982 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:24:34.972 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:22:34.990 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:24:34.979 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:22:35.957 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1240 0.23 MB/sec execute 372 sec latency 1832.837 ms 2023-11-18T21:22:36.957 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1246 0.23 MB/sec execute 373 sec latency 2326.305 ms 2023-11-18T21:22:37.958 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1248 0.23 MB/sec execute 374 sec latency 1411.481 ms 2023-11-18T21:22:38.957 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1251 0.23 MB/sec execute 375 sec latency 1831.852 ms 2023-11-18T21:22:39.958 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1256 0.23 MB/sec execute 376 sec latency 2229.765 ms 2023-11-18T21:22:40.958 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1264 0.23 MB/sec execute 377 sec latency 2552.066 ms 2023-11-18T21:22:41.958 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1265 0.23 MB/sec execute 378 sec latency 2885.878 ms 2023-11-18T21:22:42.958 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1266 0.23 MB/sec execute 379 sec latency 3571.174 ms 2023-11-18T21:22:43.958 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1267 0.23 MB/sec execute 380 sec latency 3370.292 ms 2023-11-18T21:22:44.958 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1269 0.23 MB/sec execute 381 sec latency 3503.772 ms 2023-11-18T21:22:45.958 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1272 0.23 MB/sec execute 382 sec latency 2590.556 ms 2023-11-18T21:22:46.958 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1280 0.24 MB/sec execute 383 sec latency 2888.178 ms 2023-11-18T21:22:47.958 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1281 0.24 MB/sec execute 384 sec latency 2866.425 ms 2023-11-18T21:22:48.958 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1282 0.24 MB/sec execute 385 sec latency 2618.748 ms 2023-11-18T21:22:49.959 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1283 0.24 MB/sec execute 386 sec latency 3160.430 ms 2023-11-18T21:22:50.958 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1285 0.24 MB/sec execute 387 sec latency 3134.706 ms 2023-11-18T21:22:51.959 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1289 0.24 MB/sec execute 388 sec latency 3292.430 ms 2023-11-18T21:22:52.959 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1304 0.25 MB/sec execute 389 sec latency 3353.877 ms 2023-11-18T21:22:53.959 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1305 0.25 MB/sec execute 390 sec latency 2986.448 ms 2023-11-18T21:22:54.959 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1307 0.25 MB/sec execute 391 sec latency 3502.611 ms 2023-11-18T21:22:55.959 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1307 0.25 MB/sec execute 392 sec latency 3080.306 ms 2023-11-18T21:22:56.959 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1308 0.25 MB/sec execute 393 sec latency 3332.199 ms 2023-11-18T21:22:57.959 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1310 0.25 MB/sec execute 394 sec latency 3458.478 ms 2023-11-18T21:22:58.959 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1312 0.25 MB/sec execute 395 sec latency 3425.914 ms 2023-11-18T21:22:59.959 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1321 0.25 MB/sec execute 396 sec latency 3463.474 ms 2023-11-18T21:23:00.256 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:23:00.258 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:23:00.960 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1325 0.25 MB/sec execute 397 sec latency 1650.640 ms 2023-11-18T21:23:01.959 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1332 0.26 MB/sec execute 398 sec latency 2650.702 ms 2023-11-18T21:23:02.959 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1333 0.26 MB/sec execute 399 sec latency 3318.823 ms 2023-11-18T21:23:03.959 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1334 0.26 MB/sec execute 400 sec latency 3221.836 ms 2023-11-18T21:23:04.959 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1335 0.26 MB/sec execute 401 sec latency 3345.044 ms 2023-11-18T21:23:05.960 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1336 0.26 MB/sec execute 402 sec latency 3332.155 ms 2023-11-18T21:23:06.961 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1336 0.25 MB/sec execute 403 sec latency 3581.779 ms 2023-11-18T21:23:07.960 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1337 0.25 MB/sec execute 404 sec latency 3795.598 ms 2023-11-18T21:23:08.960 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1338 0.25 MB/sec execute 405 sec latency 3801.259 ms 2023-11-18T21:23:09.960 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1340 0.25 MB/sec execute 406 sec latency 3402.131 ms 2023-11-18T21:23:10.960 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1341 0.25 MB/sec execute 407 sec latency 2714.783 ms 2023-11-18T21:23:11.960 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1345 0.25 MB/sec execute 408 sec latency 3327.072 ms 2023-11-18T21:23:12.960 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1352 0.26 MB/sec execute 409 sec latency 3423.806 ms 2023-11-18T21:23:13.960 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1353 0.26 MB/sec execute 410 sec latency 3464.832 ms 2023-11-18T21:23:14.960 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1355 0.26 MB/sec execute 411 sec latency 3107.316 ms 2023-11-18T21:23:15.960 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1356 0.26 MB/sec execute 412 sec latency 3225.240 ms 2023-11-18T21:23:16.960 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1357 0.26 MB/sec execute 413 sec latency 3526.099 ms 2023-11-18T21:23:17.961 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1359 0.25 MB/sec execute 414 sec latency 3154.575 ms 2023-11-18T21:23:18.961 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1361 0.25 MB/sec execute 415 sec latency 3203.849 ms 2023-11-18T21:23:19.961 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1362 0.25 MB/sec execute 416 sec latency 3185.052 ms 2023-11-18T21:23:20.961 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1365 0.25 MB/sec execute 417 sec latency 2923.295 ms 2023-11-18T21:23:21.961 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1367 0.25 MB/sec execute 418 sec latency 3100.910 ms 2023-11-18T21:23:22.961 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1370 0.25 MB/sec execute 419 sec latency 2310.507 ms 2023-11-18T21:23:23.961 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1377 0.26 MB/sec execute 420 sec latency 3310.584 ms 2023-11-18T21:23:24.961 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1378 0.26 MB/sec execute 421 sec latency 3371.479 ms 2023-11-18T21:23:25.961 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1380 0.26 MB/sec execute 422 sec latency 3706.064 ms 2023-11-18T21:23:26.962 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1381 0.26 MB/sec execute 423 sec latency 3921.327 ms 2023-11-18T21:23:27.961 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1382 0.26 MB/sec execute 424 sec latency 2692.426 ms 2023-11-18T21:23:28.961 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1383 0.26 MB/sec execute 425 sec latency 3665.700 ms 2023-11-18T21:23:29.962 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1384 0.25 MB/sec execute 426 sec latency 3917.143 ms 2023-11-18T21:23:30.606 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:23:30.609 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:23:30.962 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1385 0.25 MB/sec execute 427 sec latency 3638.495 ms 2023-11-18T21:23:31.962 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1386 0.25 MB/sec execute 428 sec latency 2539.265 ms 2023-11-18T21:23:32.962 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1389 0.25 MB/sec execute 429 sec latency 3539.324 ms 2023-11-18T21:23:33.962 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1392 0.25 MB/sec execute 430 sec latency 3545.532 ms 2023-11-18T21:23:34.962 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1396 0.25 MB/sec execute 431 sec latency 4011.072 ms 2023-11-18T21:23:35.962 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1402 0.26 MB/sec execute 432 sec latency 3066.736 ms 2023-11-18T21:23:36.962 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1403 0.26 MB/sec execute 433 sec latency 3636.641 ms 2023-11-18T21:23:37.962 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1406 0.26 MB/sec execute 434 sec latency 3686.134 ms 2023-11-18T21:23:38.962 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1408 0.26 MB/sec execute 435 sec latency 3454.177 ms 2023-11-18T21:23:39.962 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1411 0.26 MB/sec execute 436 sec latency 3427.934 ms 2023-11-18T21:23:40.962 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1418 0.26 MB/sec execute 437 sec latency 2930.841 ms 2023-11-18T21:23:41.962 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1419 0.26 MB/sec execute 438 sec latency 3298.489 ms 2023-11-18T21:23:42.963 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1420 0.26 MB/sec execute 439 sec latency 3620.611 ms 2023-11-18T21:23:43.963 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1422 0.26 MB/sec execute 440 sec latency 3745.064 ms 2023-11-18T21:23:44.963 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1424 0.26 MB/sec execute 441 sec latency 3908.394 ms 2023-11-18T21:23:45.963 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1425 0.26 MB/sec execute 442 sec latency 3160.117 ms 2023-11-18T21:23:46.963 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1427 0.26 MB/sec execute 443 sec latency 3520.964 ms 2023-11-18T21:23:47.963 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1429 0.26 MB/sec execute 444 sec latency 3202.617 ms 2023-11-18T21:23:48.963 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1430 0.26 MB/sec execute 445 sec latency 3265.947 ms 2023-11-18T21:23:49.963 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1431 0.26 MB/sec execute 446 sec latency 3539.020 ms 2023-11-18T21:23:50.963 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1433 0.26 MB/sec execute 447 sec latency 3616.897 ms 2023-11-18T21:23:51.964 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1434 0.26 MB/sec execute 448 sec latency 2828.906 ms 2023-11-18T21:23:52.963 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1435 0.25 MB/sec execute 449 sec latency 3496.329 ms 2023-11-18T21:23:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1437 0.25 MB/sec execute 450 sec latency 2812.869 ms 2023-11-18T21:23:54.963 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1439 0.25 MB/sec execute 451 sec latency 2977.581 ms 2023-11-18T21:23:55.963 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1440 0.25 MB/sec execute 452 sec latency 2426.871 ms 2023-11-18T21:23:56.963 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1441 0.25 MB/sec execute 453 sec latency 2879.069 ms 2023-11-18T21:23:57.964 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1444 0.25 MB/sec execute 454 sec latency 3046.093 ms 2023-11-18T21:23:58.964 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1446 0.25 MB/sec execute 455 sec latency 3218.725 ms 2023-11-18T21:23:59.964 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1447 0.25 MB/sec execute 456 sec latency 2602.581 ms 2023-11-18T21:24:02.209 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:24:02.210 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1449 0.25 MB/sec execute 457 sec latency 3184.148 ms 2023-11-18T21:24:02.210 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1450 0.25 MB/sec execute 458 sec latency 2593.683 ms 2023-11-18T21:24:02.212 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:24:02.964 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1451 0.25 MB/sec execute 459 sec latency 3266.950 ms 2023-11-18T21:24:03.964 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1452 0.25 MB/sec execute 460 sec latency 3074.387 ms 2023-11-18T21:24:04.964 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1453 0.25 MB/sec execute 461 sec latency 3475.281 ms 2023-11-18T21:24:05.964 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1455 0.25 MB/sec execute 462 sec latency 3755.750 ms 2023-11-18T21:24:06.964 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1457 0.25 MB/sec execute 463 sec latency 3169.333 ms 2023-11-18T21:24:07.964 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1458 0.25 MB/sec execute 464 sec latency 3018.241 ms 2023-11-18T21:24:08.964 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1459 0.25 MB/sec execute 465 sec latency 3473.487 ms 2023-11-18T21:24:09.964 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1461 0.25 MB/sec execute 466 sec latency 1568.232 ms 2023-11-18T21:24:10.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1463 0.25 MB/sec execute 467 sec latency 1330.027 ms 2023-11-18T21:24:11.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1465 0.24 MB/sec execute 468 sec latency 2106.679 ms 2023-11-18T21:24:12.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1468 0.24 MB/sec execute 469 sec latency 3005.255 ms 2023-11-18T21:24:13.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1469 0.24 MB/sec execute 470 sec latency 2762.591 ms 2023-11-18T21:24:14.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1470 0.24 MB/sec execute 471 sec latency 2786.423 ms 2023-11-18T21:24:15.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1471 0.24 MB/sec execute 472 sec latency 3145.945 ms 2023-11-18T21:24:16.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1472 0.24 MB/sec execute 473 sec latency 3759.747 ms 2023-11-18T21:24:17.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1474 0.24 MB/sec execute 474 sec latency 2770.123 ms 2023-11-18T21:24:18.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1474 0.24 MB/sec execute 475 sec latency 3770.199 ms 2023-11-18T21:24:19.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1475 0.24 MB/sec execute 476 sec latency 3866.164 ms 2023-11-18T21:24:20.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1476 0.24 MB/sec execute 477 sec latency 3403.310 ms 2023-11-18T21:24:21.084 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:26:21.132 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:21.093 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:26:21.140 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:21.261 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:26:21.250 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:21.267 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:26:21.257 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:21.278 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:26:21.266 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:21.286 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:26:21.274 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:21.294 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:26:21.341 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:21.484 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:26:21.474 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:21.488 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:26:21.476 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:21.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1478 0.24 MB/sec execute 478 sec latency 3524.145 ms 2023-11-18T21:24:22.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1481 0.24 MB/sec execute 479 sec latency 2845.757 ms 2023-11-18T21:24:23.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1486 0.24 MB/sec execute 480 sec latency 2632.400 ms 2023-11-18T21:24:24.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1489 0.24 MB/sec execute 481 sec latency 1555.506 ms 2023-11-18T21:24:25.965 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1491 0.24 MB/sec execute 482 sec latency 2359.222 ms 2023-11-18T21:24:26.966 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1493 0.24 MB/sec execute 483 sec latency 3048.796 ms 2023-11-18T21:24:27.966 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1494 0.24 MB/sec execute 484 sec latency 1486.810 ms 2023-11-18T21:24:28.966 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1495 0.24 MB/sec execute 485 sec latency 1678.626 ms 2023-11-18T21:24:29.966 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1497 0.24 MB/sec execute 486 sec latency 1590.620 ms 2023-11-18T21:24:30.966 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1498 0.24 MB/sec execute 487 sec latency 1950.606 ms 2023-11-18T21:24:31.966 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1500 0.24 MB/sec execute 488 sec latency 2929.920 ms 2023-11-18T21:24:32.336 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:24:32.338 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:24:32.966 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1501 0.23 MB/sec execute 489 sec latency 3227.217 ms 2023-11-18T21:24:33.966 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1502 0.23 MB/sec execute 490 sec latency 3179.549 ms 2023-11-18T21:24:34.966 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1503 0.23 MB/sec execute 491 sec latency 3617.092 ms 2023-11-18T21:24:35.966 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1506 0.23 MB/sec execute 492 sec latency 2511.299 ms 2023-11-18T21:24:36.966 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1508 0.23 MB/sec execute 493 sec latency 3368.978 ms 2023-11-18T21:24:37.966 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1509 0.23 MB/sec execute 494 sec latency 2870.794 ms 2023-11-18T21:24:38.967 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1510 0.23 MB/sec execute 495 sec latency 3205.607 ms 2023-11-18T21:24:39.959 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:26:40.006 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:39.966 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1512 0.23 MB/sec execute 496 sec latency 3331.156 ms 2023-11-18T21:24:39.983 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:26:40.030 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:40.078 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:26:40.068 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:40.192 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:26:40.180 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:40.274 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:26:40.263 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:40.289 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:26:40.276 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:40.314 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:26:40.361 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:40.394 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:26:40.382 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:40.422 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:26:40.412 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:24:40.967 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1515 0.23 MB/sec execute 497 sec latency 1784.159 ms 2023-11-18T21:24:41.966 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1517 0.23 MB/sec execute 498 sec latency 2459.276 ms 2023-11-18T21:24:42.967 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1521 0.23 MB/sec execute 499 sec latency 2294.814 ms 2023-11-18T21:24:43.967 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1523 0.23 MB/sec execute 500 sec latency 1891.333 ms 2023-11-18T21:24:44.967 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1524 0.23 MB/sec execute 501 sec latency 1710.582 ms 2023-11-18T21:24:45.967 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1525 0.23 MB/sec execute 502 sec latency 2710.653 ms 2023-11-18T21:24:46.967 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1527 0.23 MB/sec execute 503 sec latency 3575.872 ms 2023-11-18T21:24:47.967 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1529 0.23 MB/sec execute 504 sec latency 3889.883 ms 2023-11-18T21:24:48.967 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1531 0.23 MB/sec execute 505 sec latency 3309.683 ms 2023-11-18T21:24:49.967 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1533 0.23 MB/sec execute 506 sec latency 3709.503 ms 2023-11-18T21:24:50.967 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1536 0.23 MB/sec execute 507 sec latency 2806.240 ms 2023-11-18T21:24:51.967 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1538 0.23 MB/sec execute 508 sec latency 1753.285 ms 2023-11-18T21:24:52.967 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1539 0.23 MB/sec execute 509 sec latency 2753.388 ms 2023-11-18T21:24:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1540 0.23 MB/sec execute 510 sec latency 2957.482 ms 2023-11-18T21:24:54.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1541 0.23 MB/sec execute 511 sec latency 3054.317 ms 2023-11-18T21:24:55.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1542 0.22 MB/sec execute 512 sec latency 3262.140 ms 2023-11-18T21:24:56.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1544 0.22 MB/sec execute 513 sec latency 2799.259 ms 2023-11-18T21:24:57.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1546 0.22 MB/sec execute 514 sec latency 3329.020 ms 2023-11-18T21:24:58.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1549 0.22 MB/sec execute 515 sec latency 1269.754 ms 2023-11-18T21:24:59.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1552 0.22 MB/sec execute 516 sec latency 1532.770 ms 2023-11-18T21:25:00.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1554 0.22 MB/sec execute 517 sec latency 2532.868 ms 2023-11-18T21:25:01.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1556 0.22 MB/sec execute 518 sec latency 2814.621 ms 2023-11-18T21:25:02.474 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:25:02.477 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:25:02.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1558 0.22 MB/sec execute 519 sec latency 2412.557 ms 2023-11-18T21:25:03.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1559 0.22 MB/sec execute 520 sec latency 1533.102 ms 2023-11-18T21:25:04.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1560 0.22 MB/sec execute 521 sec latency 2533.161 ms 2023-11-18T21:25:05.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1561 0.22 MB/sec execute 522 sec latency 3407.995 ms 2023-11-18T21:25:06.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1562 0.22 MB/sec execute 523 sec latency 2490.758 ms 2023-11-18T21:25:07.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1563 0.22 MB/sec execute 524 sec latency 3167.702 ms 2023-11-18T21:25:08.968 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1565 0.22 MB/sec execute 525 sec latency 3239.864 ms 2023-11-18T21:25:09.969 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1566 0.22 MB/sec execute 526 sec latency 3131.581 ms 2023-11-18T21:25:10.969 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1568 0.22 MB/sec execute 527 sec latency 3102.201 ms 2023-11-18T21:25:11.969 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1571 0.22 MB/sec execute 528 sec latency 1658.700 ms 2023-11-18T21:25:12.969 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1573 0.22 MB/sec execute 529 sec latency 2658.773 ms 2023-11-18T21:25:13.969 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1574 0.22 MB/sec execute 530 sec latency 3271.755 ms 2023-11-18T21:25:14.969 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1576 0.22 MB/sec execute 531 sec latency 2062.507 ms 2023-11-18T21:25:15.969 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1577 0.22 MB/sec execute 532 sec latency 2965.117 ms 2023-11-18T21:25:16.969 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1579 0.22 MB/sec execute 533 sec latency 3434.978 ms 2023-11-18T21:25:17.969 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1580 0.22 MB/sec execute 534 sec latency 3158.327 ms 2023-11-18T21:25:18.969 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1581 0.22 MB/sec execute 535 sec latency 3377.794 ms 2023-11-18T21:25:19.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1583 0.22 MB/sec execute 536 sec latency 3363.508 ms 2023-11-18T21:25:20.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1584 0.22 MB/sec execute 537 sec latency 3833.673 ms 2023-11-18T21:25:21.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1586 0.21 MB/sec execute 538 sec latency 3292.527 ms 2023-11-18T21:25:22.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1587 0.21 MB/sec execute 539 sec latency 3454.567 ms 2023-11-18T21:25:23.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1588 0.21 MB/sec execute 540 sec latency 3183.892 ms 2023-11-18T21:25:24.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1589 0.21 MB/sec execute 541 sec latency 3235.328 ms 2023-11-18T21:25:25.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1590 0.21 MB/sec execute 542 sec latency 3543.195 ms 2023-11-18T21:25:26.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1591 0.21 MB/sec execute 543 sec latency 3600.457 ms 2023-11-18T21:25:27.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1592 0.21 MB/sec execute 544 sec latency 3694.088 ms 2023-11-18T21:25:28.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1593 0.21 MB/sec execute 545 sec latency 3025.367 ms 2023-11-18T21:25:29.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1595 0.21 MB/sec execute 546 sec latency 3212.626 ms 2023-11-18T21:25:30.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1596 0.21 MB/sec execute 547 sec latency 3137.639 ms 2023-11-18T21:25:31.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1598 0.21 MB/sec execute 548 sec latency 3359.870 ms 2023-11-18T21:25:32.523 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:25:32.526 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:25:32.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1600 0.21 MB/sec execute 549 sec latency 3310.398 ms 2023-11-18T21:25:33.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1603 0.21 MB/sec execute 550 sec latency 3029.985 ms 2023-11-18T21:25:34.970 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1605 0.21 MB/sec execute 551 sec latency 1568.502 ms 2023-11-18T21:25:35.971 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1607 0.21 MB/sec execute 552 sec latency 2568.559 ms 2023-11-18T21:25:36.971 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1608 0.21 MB/sec execute 553 sec latency 3568.610 ms 2023-11-18T21:25:37.971 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1611 0.21 MB/sec execute 554 sec latency 3647.108 ms 2023-11-18T21:25:38.971 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1613 0.21 MB/sec execute 555 sec latency 1821.175 ms 2023-11-18T21:25:39.971 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1614 0.21 MB/sec execute 556 sec latency 2821.242 ms 2023-11-18T21:25:40.971 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1616 0.21 MB/sec execute 557 sec latency 3281.626 ms 2023-11-18T21:25:41.971 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1618 0.21 MB/sec execute 558 sec latency 3414.747 ms 2023-11-18T21:25:42.971 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1620 0.21 MB/sec execute 559 sec latency 3706.332 ms 2023-11-18T21:25:43.971 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1621 0.21 MB/sec execute 560 sec latency 1497.433 ms 2023-11-18T21:25:44.971 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1622 0.21 MB/sec execute 561 sec latency 2497.496 ms 2023-11-18T21:25:45.971 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1624 0.21 MB/sec execute 562 sec latency 3028.086 ms 2023-11-18T21:25:46.971 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1625 0.21 MB/sec execute 563 sec latency 3311.891 ms 2023-11-18T21:25:47.971 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1628 0.21 MB/sec execute 564 sec latency 2826.286 ms 2023-11-18T21:25:48.972 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1629 0.21 MB/sec execute 565 sec latency 3465.764 ms 2023-11-18T21:25:49.972 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1630 0.20 MB/sec execute 566 sec latency 3264.964 ms 2023-11-18T21:25:50.972 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1633 0.20 MB/sec execute 567 sec latency 3563.725 ms 2023-11-18T21:25:51.972 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1636 0.20 MB/sec execute 568 sec latency 1761.882 ms 2023-11-18T21:25:52.972 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1637 0.20 MB/sec execute 569 sec latency 1772.494 ms 2023-11-18T21:25:53.972 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1638 0.20 MB/sec execute 570 sec latency 2772.578 ms 2023-11-18T21:25:54.972 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1641 0.20 MB/sec execute 571 sec latency 3404.364 ms 2023-11-18T21:25:55.974 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1645 0.20 MB/sec execute 572 sec latency 2391.223 ms 2023-11-18T21:25:56.972 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1648 0.20 MB/sec execute 573 sec latency 1327.609 ms 2023-11-18T21:25:57.972 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1649 0.20 MB/sec execute 574 sec latency 2213.767 ms 2023-11-18T21:25:58.972 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1650 0.20 MB/sec execute 575 sec latency 3213.865 ms 2023-11-18T21:25:59.973 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1652 0.20 MB/sec execute 576 sec latency 3285.097 ms 2023-11-18T21:26:00.973 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1653 0.20 MB/sec execute 577 sec latency 3370.764 ms 2023-11-18T21:26:01.973 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1654 0.20 MB/sec execute 578 sec latency 3845.390 ms 2023-11-18T21:26:02.595 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:26:02.598 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:26:02.973 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1656 0.20 MB/sec execute 579 sec latency 2196.127 ms 2023-11-18T21:26:03.973 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1658 0.20 MB/sec execute 580 sec latency 2420.779 ms 2023-11-18T21:26:04.974 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1659 0.20 MB/sec execute 581 sec latency 2915.095 ms 2023-11-18T21:26:05.973 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1660 0.20 MB/sec execute 582 sec latency 3770.372 ms 2023-11-18T21:26:06.973 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1662 0.20 MB/sec execute 583 sec latency 4041.410 ms 2023-11-18T21:26:07.973 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1664 0.20 MB/sec execute 584 sec latency 3515.576 ms 2023-11-18T21:26:08.974 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1665 0.20 MB/sec execute 585 sec latency 3768.171 ms 2023-11-18T21:26:09.974 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1667 0.20 MB/sec execute 586 sec latency 2490.922 ms 2023-11-18T21:26:10.974 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1669 0.20 MB/sec execute 587 sec latency 3241.918 ms 2023-11-18T21:26:11.974 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1670 0.20 MB/sec execute 588 sec latency 3038.612 ms 2023-11-18T21:26:12.974 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1671 0.20 MB/sec execute 589 sec latency 3144.923 ms 2023-11-18T21:26:13.974 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1673 0.20 MB/sec execute 590 sec latency 2940.457 ms 2023-11-18T21:26:14.974 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1675 0.20 MB/sec execute 591 sec latency 3419.874 ms 2023-11-18T21:26:15.974 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1677 0.20 MB/sec execute 592 sec latency 3536.761 ms 2023-11-18T21:26:16.974 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1678 0.20 MB/sec execute 593 sec latency 3067.732 ms 2023-11-18T21:26:17.974 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1679 0.20 MB/sec execute 594 sec latency 3417.146 ms 2023-11-18T21:26:18.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1681 0.20 MB/sec execute 595 sec latency 2979.907 ms 2023-11-18T21:26:19.975 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1684 0.20 MB/sec execute 596 sec latency 2923.079 ms 2023-11-18T21:26:20.975 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1686 0.19 MB/sec execute 597 sec latency 2843.698 ms 2023-11-18T21:26:21.975 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1688 0.19 MB/sec execute 598 sec latency 2672.041 ms 2023-11-18T21:26:22.975 INFO:tasks.workunit.client.0.smithi049.stdout: 10 1690 0.19 MB/sec execute 599 sec latency 3199.198 ms 2023-11-18T21:26:23.975 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 600 sec 2023-11-18T21:26:24.975 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 601 sec 2023-11-18T21:26:25.975 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 602 sec 2023-11-18T21:26:26.975 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 603 sec 2023-11-18T21:26:27.975 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 604 sec 2023-11-18T21:26:28.975 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 605 sec 2023-11-18T21:26:29.975 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 606 sec 2023-11-18T21:26:30.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 607 sec 2023-11-18T21:26:31.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 608 sec 2023-11-18T21:26:32.642 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:26:32.645 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:26:32.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 609 sec 2023-11-18T21:26:33.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 610 sec 2023-11-18T21:26:34.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 611 sec 2023-11-18T21:26:35.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 612 sec 2023-11-18T21:26:36.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 613 sec 2023-11-18T21:26:37.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 614 sec 2023-11-18T21:26:38.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 615 sec 2023-11-18T21:26:39.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 616 sec 2023-11-18T21:26:40.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 617 sec 2023-11-18T21:26:41.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 618 sec 2023-11-18T21:26:42.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 619 sec 2023-11-18T21:26:43.976 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 620 sec 2023-11-18T21:26:44.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 621 sec 2023-11-18T21:26:45.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 622 sec 2023-11-18T21:26:46.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 623 sec 2023-11-18T21:26:47.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 624 sec 2023-11-18T21:26:48.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 625 sec 2023-11-18T21:26:49.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 626 sec 2023-11-18T21:26:50.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 627 sec 2023-11-18T21:26:51.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 628 sec 2023-11-18T21:26:52.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 629 sec 2023-11-18T21:26:53.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 630 sec 2023-11-18T21:26:54.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 631 sec 2023-11-18T21:26:55.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 632 sec 2023-11-18T21:26:56.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 633 sec 2023-11-18T21:26:57.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 634 sec 2023-11-18T21:26:58.977 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 635 sec 2023-11-18T21:26:59.978 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 636 sec 2023-11-18T21:27:00.978 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 637 sec 2023-11-18T21:27:01.978 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 638 sec 2023-11-18T21:27:02.691 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:27:02.693 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:27:02.978 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 639 sec 2023-11-18T21:27:03.978 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 640 sec 2023-11-18T21:27:04.978 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 641 sec 2023-11-18T21:27:05.978 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 642 sec 2023-11-18T21:27:06.978 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 643 sec 2023-11-18T21:27:07.979 INFO:tasks.workunit.client.0.smithi049.stdout: 10 cleanup 644 sec 2023-11-18T21:27:08.978 INFO:tasks.workunit.client.0.smithi049.stdout: 8 cleanup 645 sec 2023-11-18T21:27:09.978 INFO:tasks.workunit.client.0.smithi049.stdout: 8 cleanup 646 sec 2023-11-18T21:27:10.979 INFO:tasks.workunit.client.0.smithi049.stdout: 8 cleanup 647 sec 2023-11-18T21:27:11.979 INFO:tasks.workunit.client.0.smithi049.stdout: 7 cleanup 648 sec 2023-11-18T21:27:12.979 INFO:tasks.workunit.client.0.smithi049.stdout: 6 cleanup 649 sec 2023-11-18T21:27:13.979 INFO:tasks.workunit.client.0.smithi049.stdout: 6 cleanup 650 sec 2023-11-18T21:27:14.979 INFO:tasks.workunit.client.0.smithi049.stdout: 6 cleanup 651 sec 2023-11-18T21:27:15.979 INFO:tasks.workunit.client.0.smithi049.stdout: 4 cleanup 652 sec 2023-11-18T21:27:16.979 INFO:tasks.workunit.client.0.smithi049.stdout: 3 cleanup 653 sec 2023-11-18T21:27:17.979 INFO:tasks.workunit.client.0.smithi049.stdout: 3 cleanup 654 sec 2023-11-18T21:27:18.979 INFO:tasks.workunit.client.0.smithi049.stdout: 3 cleanup 655 sec 2023-11-18T21:27:19.980 INFO:tasks.workunit.client.0.smithi049.stdout: 3 cleanup 656 sec 2023-11-18T21:27:20.979 INFO:tasks.workunit.client.0.smithi049.stdout: 3 cleanup 657 sec 2023-11-18T21:27:21.979 INFO:tasks.workunit.client.0.smithi049.stdout: 3 cleanup 658 sec 2023-11-18T21:27:22.980 INFO:tasks.workunit.client.0.smithi049.stdout: 2 cleanup 659 sec 2023-11-18T21:27:23.979 INFO:tasks.workunit.client.0.smithi049.stdout: 2 cleanup 660 sec 2023-11-18T21:27:24.980 INFO:tasks.workunit.client.0.smithi049.stdout: 1 cleanup 661 sec 2023-11-18T21:27:25.742 INFO:tasks.workunit.client.0.smithi049.stdout: 0 cleanup 662 sec 2023-11-18T21:27:25.742 INFO:tasks.workunit.client.0.smithi049.stdout: 2023-11-18T21:27:25.742 INFO:tasks.workunit.client.0.smithi049.stdout: Operation Count AvgLat MaxLat 2023-11-18T21:27:25.742 INFO:tasks.workunit.client.0.smithi049.stdout: ---------------------------------------- 2023-11-18T21:27:25.742 INFO:tasks.workunit.client.0.smithi049.stdout: NTCreateX 2076 1077.176 3000.670 2023-11-18T21:27:25.742 INFO:tasks.workunit.client.0.smithi049.stdout: Close 1740 15.692 121.383 2023-11-18T21:27:25.742 INFO:tasks.workunit.client.0.smithi049.stdout: Rename 107 2236.276 3693.697 2023-11-18T21:27:25.743 INFO:tasks.workunit.client.0.smithi049.stdout: Unlink 219 895.947 1389.735 2023-11-18T21:27:25.743 INFO:tasks.workunit.client.0.smithi049.stdout: Qpathinfo 1547 578.099 2458.687 2023-11-18T21:27:25.743 INFO:tasks.workunit.client.0.smithi049.stdout: Qfileinfo 588 59.445 504.067 2023-11-18T21:27:25.743 INFO:tasks.workunit.client.0.smithi049.stdout: Qfsinfo 330 136.941 1438.695 2023-11-18T21:27:25.743 INFO:tasks.workunit.client.0.smithi049.stdout: Sfileinfo 340 380.247 1483.581 2023-11-18T21:27:25.743 INFO:tasks.workunit.client.0.smithi049.stdout: Find 616 3165.100 4101.967 2023-11-18T21:27:25.743 INFO:tasks.workunit.client.0.smithi049.stdout: WriteX 2367 84.990 342.202 2023-11-18T21:27:25.743 INFO:tasks.workunit.client.0.smithi049.stdout: ReadX 2597 1.057 496.811 2023-11-18T21:27:25.743 INFO:tasks.workunit.client.0.smithi049.stdout: Flush 266 214.421 1092.882 2023-11-18T21:27:25.743 INFO:tasks.workunit.client.0.smithi049.stdout: 2023-11-18T21:27:25.743 INFO:tasks.workunit.client.0.smithi049.stdout:Throughput 0.194134 MB/sec 10 clients 10 procs max_latency=4101.991 ms 2023-11-18T21:27:25.744 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-18T21:27:25.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-18T21:27:32.765 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:27:32.768 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:27:58.675 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:29:58.721 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:27:58.899 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:29:58.945 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:27:59.006 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:29:58.993 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:27:59.029 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:29:59.018 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:27:59.036 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:29:59.024 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:27:59.217 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:29:59.206 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:27:59.464 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:29:59.510 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:27:59.583 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:29:59.572 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:27:59.596 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:29:59.583 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:28:02.829 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:28:02.832 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:28:31.872 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-11-18T21:28:31.872 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-18T21:28:32.168 DEBUG:teuthology.parallel:result is None 2023-11-18T21:28:32.169 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-11-18T21:28:32.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:28:32.888 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:28:32.970 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-11-18T21:28:32.970 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-18T21:28:32.982 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-18T21:28:32.983 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T21:28:32.983 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T21:28:33.018 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T21:28:33.019 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T21:28:33.066 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T21:28:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.239+0000 7f95d32d7640 1 Processor -- start 2023-11-18T21:28:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.243+0000 7f95d32d7640 1 -- start start 2023-11-18T21:28:33.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.243+0000 7f95d32d7640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95cc06b210 0x7f95cc0c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:33.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.243+0000 7f95d32d7640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc15ca10 con 0x7f95cc153390 2023-11-18T21:28:33.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.243+0000 7f95d32d7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc159f90 con 0x7f95cc15d740 2023-11-18T21:28:33.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.243+0000 7f95d32d7640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc15a250 con 0x7f95cc06b210 2023-11-18T21:28:33.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.243+0000 7f95d0872640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f95cc15d740 0x7f95cc159420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:35066/0 (socket says 172.21.15.49:35066) 2023-11-18T21:28:33.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.243+0000 7f95d0872640 1 -- 172.21.15.49:0/3624364853 learned_addr learned my addr 172.21.15.49:0/3624364853 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:33.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.243+0000 7f95d1874640 1 --2- 172.21.15.49:0/3624364853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95cc06b210 0x7f95cc0c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:33.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.251+0000 7f95d1874640 1 -- 172.21.15.49:0/3624364853 >> v1:172.21.15.106:6789/0 conn(0x7f95cc15d740 legacy=0x7f95cc159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:33.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.251+0000 7f95d1874640 1 -- 172.21.15.49:0/3624364853 >> v1:172.21.15.49:6789/0 conn(0x7f95cc153390 legacy=0x7f95cc0c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:33.252 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.251+0000 7f95d1874640 1 -- 172.21.15.49:0/3624364853 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc15cc60 con 0x7f95cc06b210 2023-11-18T21:28:33.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.259+0000 7f95d1874640 1 --2- 172.21.15.49:0/3624364853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95cc06b210 0x7f95cc0c7cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f95c4009df0 tx=0x7f95c401c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bab06eb43fb4314 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.399+0000 7f95c3fff640 1 -- 172.21.15.49:0/3624364853 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c40a5870 con 0x7f95cc06b210 2023-11-18T21:28:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.399+0000 7f95c3fff640 1 -- 172.21.15.49:0/3624364853 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c40a59d0 con 0x7f95cc06b210 2023-11-18T21:28:33.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.399+0000 7f95c3fff640 1 -- 172.21.15.49:0/3624364853 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c40a5d60 con 0x7f95cc06b210 2023-11-18T21:28:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.399+0000 7f95d32d7640 1 -- 172.21.15.49:0/3624364853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95cc06b210 msgr2=0x7f95cc0c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.399+0000 7f95d32d7640 1 --2- 172.21.15.49:0/3624364853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95cc06b210 0x7f95cc0c7cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f95c4009df0 tx=0x7f95c401c8a0 comp rx=0 tx=0).stop 2023-11-18T21:28:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.399+0000 7f95d32d7640 1 -- 172.21.15.49:0/3624364853 shutdown_connections 2023-11-18T21:28:33.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.399+0000 7f95d32d7640 1 --2- 172.21.15.49:0/3624364853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95cc06b210 0x7f95cc0c7cc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:33.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.399+0000 7f95d32d7640 1 -- 172.21.15.49:0/3624364853 >> 172.21.15.49:0/3624364853 conn(0x7f95cc0713a0 msgr2=0x7f95cc0717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:33.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.399+0000 7f95d32d7640 1 -- 172.21.15.49:0/3624364853 shutdown_connections 2023-11-18T21:28:33.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.399+0000 7f95d32d7640 1 -- 172.21.15.49:0/3624364853 wait complete. 2023-11-18T21:28:33.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.403+0000 7f95d32d7640 1 Processor -- start 2023-11-18T21:28:33.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.403+0000 7f95d32d7640 1 -- start start 2023-11-18T21:28:33.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.403+0000 7f95d32d7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95cc06b210 0x7f95cc15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:33.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.403+0000 7f95d32d7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95cc153390 0x7f95cc1f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:33.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.403+0000 7f95d32d7640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95cc15d740 0x7f95cc1f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:33.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.403+0000 7f95d32d7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0c9970 con 0x7f95cc153390 2023-11-18T21:28:33.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.403+0000 7f95d32d7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0c7cb0 con 0x7f95cc06b210 2023-11-18T21:28:33.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.403+0000 7f95d32d7640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc14bc10 con 0x7f95cc15d740 2023-11-18T21:28:33.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.403+0000 7f95d0872640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95cc153390 0x7f95cc1f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:33.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.403+0000 7f95d0872640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95cc153390 0x7f95cc1f2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49134/0 (socket says 172.21.15.49:49134) 2023-11-18T21:28:33.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.403+0000 7f95d0872640 1 -- 172.21.15.49:0/3180418888 learned_addr learned my addr 172.21.15.49:0/3180418888 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:33.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.407+0000 7f95d0872640 1 -- 172.21.15.49:0/3180418888 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95cc15d740 msgr2=0x7f95cc1f2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:33.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.407+0000 7f95d0872640 1 --2- 172.21.15.49:0/3180418888 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95cc15d740 0x7f95cc1f2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:33.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.407+0000 7f95d0872640 1 -- 172.21.15.49:0/3180418888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95cc06b210 msgr2=0x7f95cc15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:33.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.407+0000 7f95d0872640 1 --2- 172.21.15.49:0/3180418888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95cc06b210 0x7f95cc15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:33.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.407+0000 7f95d0872640 1 -- 172.21.15.49:0/3180418888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c4009a70 con 0x7f95cc153390 2023-11-18T21:28:33.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.411+0000 7f95d0872640 1 --2- 172.21.15.49:0/3180418888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95cc153390 0x7f95cc1f2a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f95bc001ec0 tx=0x7f95bc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:33.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.419+0000 7f95c1ffb640 1 -- 172.21.15.49:0/3180418888 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc005cf0 con 0x7f95cc153390 2023-11-18T21:28:33.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.419+0000 7f95c1ffb640 1 -- 172.21.15.49:0/3180418888 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc005e50 con 0x7f95cc153390 2023-11-18T21:28:33.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.419+0000 7f95c1ffb640 1 -- 172.21.15.49:0/3180418888 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc0072d0 con 0x7f95cc153390 2023-11-18T21:28:33.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.419+0000 7f95d32d7640 1 -- 172.21.15.49:0/3180418888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95cc1f67e0 con 0x7f95cc153390 2023-11-18T21:28:33.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.419+0000 7f95d32d7640 1 -- 172.21.15.49:0/3180418888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95cc14c190 con 0x7f95cc153390 2023-11-18T21:28:33.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.423+0000 7f95d32d7640 1 -- 172.21.15.49:0/3180418888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95cc073e70 con 0x7f95cc153390 2023-11-18T21:28:33.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.447+0000 7f95c1ffb640 1 -- 172.21.15.49:0/3180418888 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f95bc007430 con 0x7f95cc153390 2023-11-18T21:28:33.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.447+0000 7f95c1ffb640 1 --2- 172.21.15.49:0/3180418888 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f95b0066470 0x7f95b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:33.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.447+0000 7f95d1073640 1 --2- 172.21.15.49:0/3180418888 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f95b0066470 0x7f95b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:33.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.447+0000 7f95d1073640 1 --2- 172.21.15.49:0/3180418888 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f95b0066470 0x7f95b0068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f95c8007fd0 tx=0x7f95c80079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:33.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.455+0000 7f95c1ffb640 1 -- 172.21.15.49:0/3180418888 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f95bc054910 con 0x7f95cc153390 2023-11-18T21:28:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:33.867+0000 7f95c1ffb640 1 -- 172.21.15.49:0/3180418888 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f95bc050c50 con 0x7f95cc153390 2023-11-18T21:28:34.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.051+0000 7f95d32d7640 1 -- 172.21.15.49:0/3180418888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95cc1f26c0 con 0x7f95cc153390 2023-11-18T21:28:34.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.195+0000 7f95c1ffb640 1 -- 172.21.15.49:0/3180418888 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18408 (secure 0 0 0) 0x7f95bc017090 con 0x7f95cc153390 2023-11-18T21:28:34.198 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:28:34.198 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":31,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T21:00:28.529922+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T21:28:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.203+0000 7f95d32d7640 1 -- 172.21.15.49:0/3180418888 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f95b0066470 msgr2=0x7f95b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.203+0000 7f95d32d7640 1 --2- 172.21.15.49:0/3180418888 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f95b0066470 0x7f95b0068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f95c8007fd0 tx=0x7f95c80079a0 comp rx=0 tx=0).stop 2023-11-18T21:28:34.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.203+0000 7f95d32d7640 1 -- 172.21.15.49:0/3180418888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95cc153390 msgr2=0x7f95cc1f2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:34.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.203+0000 7f95d32d7640 1 --2- 172.21.15.49:0/3180418888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95cc153390 0x7f95cc1f2a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f95bc001ec0 tx=0x7f95bc00c890 comp rx=0 tx=0).stop 2023-11-18T21:28:34.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.203+0000 7f95d32d7640 1 -- 172.21.15.49:0/3180418888 shutdown_connections 2023-11-18T21:28:34.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.203+0000 7f95d32d7640 1 --2- 172.21.15.49:0/3180418888 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f95b0066470 0x7f95b0068930 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:34.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.203+0000 7f95d32d7640 1 --2- 172.21.15.49:0/3180418888 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95cc15d740 0x7f95cc1f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:34.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.203+0000 7f95d32d7640 1 --2- 172.21.15.49:0/3180418888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95cc153390 0x7f95cc1f2a10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:34.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.203+0000 7f95d32d7640 1 --2- 172.21.15.49:0/3180418888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95cc06b210 0x7f95cc15bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.203+0000 7f95d32d7640 1 -- 172.21.15.49:0/3180418888 >> 172.21.15.49:0/3180418888 conn(0x7f95cc0713a0 msgr2=0x7f95cc06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.203+0000 7f95d32d7640 1 -- 172.21.15.49:0/3180418888 shutdown_connections 2023-11-18T21:28:34.204 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.203+0000 7f95d32d7640 1 -- 172.21.15.49:0/3180418888 wait complete. 2023-11-18T21:28:34.230 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:58:42.362631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:59:22.756454+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:59:25.252588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-18T20:59:33.423071+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-18T21:28:34.231 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T21:28:34.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.363+0000 7f574bb6d640 1 Processor -- start 2023-11-18T21:28:34.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.363+0000 7f574bb6d640 1 -- start start 2023-11-18T21:28:34.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.363+0000 7f574bb6d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f574415c5a0 0x7f5744159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:34.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.363+0000 7f574bb6d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f574415b620 0x7f57440cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:34.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.363+0000 7f574bb6d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574415a4a0 con 0x7f574415c1c0 2023-11-18T21:28:34.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.363+0000 7f574bb6d640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574406d560 con 0x7f574415c5a0 2023-11-18T21:28:34.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.363+0000 7f574bb6d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574406cc00 con 0x7f574415b620 2023-11-18T21:28:34.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.367+0000 7f5749909640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f574415c1c0 0x7f574415af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50598/0 (socket says 172.21.15.49:50598) 2023-11-18T21:28:34.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.367+0000 7f5749909640 1 -- 172.21.15.49:0/704570267 learned_addr learned my addr 172.21.15.49:0/704570267 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:34.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.367+0000 7f5749108640 1 --2- 172.21.15.49:0/704570267 >> v2:172.21.15.49:3300/0 conn(0x7f574415c5a0 0x7f5744159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:34.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.371+0000 7f5749108640 1 -- 172.21.15.49:0/704570267 >> v2:172.21.15.106:3300/0 conn(0x7f574415b620 msgr2=0x7f57440cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:34.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.371+0000 7f5749108640 1 --2- 172.21.15.49:0/704570267 >> v2:172.21.15.106:3300/0 conn(0x7f574415b620 0x7f57440cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:34.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.371+0000 7f5749108640 1 -- 172.21.15.49:0/704570267 >> v1:172.21.15.49:6789/0 conn(0x7f574415c1c0 legacy=0x7f574415af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:34.372 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.371+0000 7f5749108640 1 -- 172.21.15.49:0/704570267 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574406c680 con 0x7f574415c5a0 2023-11-18T21:28:34.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.375+0000 7f5749108640 1 --2- 172.21.15.49:0/704570267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574415c5a0 0x7f5744159f60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f57440cf9b0 tx=0x7f574001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968031a89a79fa20 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:34.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.379+0000 7f5748907640 1 -- 172.21.15.49:0/704570267 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57400a7070 con 0x7f574415c5a0 2023-11-18T21:28:34.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.379+0000 7f5748907640 1 -- 172.21.15.49:0/704570267 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57400ab430 con 0x7f574415c5a0 2023-11-18T21:28:34.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.379+0000 7f5748907640 1 -- 172.21.15.49:0/704570267 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57400ab7c0 con 0x7f574415c5a0 2023-11-18T21:28:34.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 -- 172.21.15.49:0/704570267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574415c5a0 msgr2=0x7f5744159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:34.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 --2- 172.21.15.49:0/704570267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574415c5a0 0x7f5744159f60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f57440cf9b0 tx=0x7f574001c430 comp rx=0 tx=0).stop 2023-11-18T21:28:34.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 -- 172.21.15.49:0/704570267 shutdown_connections 2023-11-18T21:28:34.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 --2- 172.21.15.49:0/704570267 >> v2:172.21.15.106:3300/0 conn(0x7f574415b620 0x7f57440cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:34.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 --2- 172.21.15.49:0/704570267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574415c5a0 0x7f5744159f60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:34.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 -- 172.21.15.49:0/704570267 >> 172.21.15.49:0/704570267 conn(0x7f5744060fd0 msgr2=0x7f57440613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:34.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 -- 172.21.15.49:0/704570267 shutdown_connections 2023-11-18T21:28:34.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 -- 172.21.15.49:0/704570267 wait complete. 2023-11-18T21:28:34.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 Processor -- start 2023-11-18T21:28:34.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 -- start start 2023-11-18T21:28:34.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574415b620 0x7f5744152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:34.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f574415c1c0 0x7f57440c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:34.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f574415c5a0 0x7f574414cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:34.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57441544a0 con 0x7f574415b620 2023-11-18T21:28:34.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57440c12b0 con 0x7f574415c1c0 2023-11-18T21:28:34.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f574bb6d640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57440bf8c0 con 0x7f574415c5a0 2023-11-18T21:28:34.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f5749909640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574415b620 0x7f5744152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:34.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f5749909640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574415b620 0x7f5744152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49142/0 (socket says 172.21.15.49:49142) 2023-11-18T21:28:34.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.383+0000 7f5749909640 1 -- 172.21.15.49:0/3828332845 learned_addr learned my addr 172.21.15.49:0/3828332845 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:34.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.387+0000 7f5749909640 1 -- 172.21.15.49:0/3828332845 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f574415c5a0 msgr2=0x7f574414cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:34.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.387+0000 7f5749909640 1 --2- 172.21.15.49:0/3828332845 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f574415c5a0 0x7f574414cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:34.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.387+0000 7f5749909640 1 -- 172.21.15.49:0/3828332845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f574415c1c0 msgr2=0x7f57440c05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:34.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.387+0000 7f5749909640 1 --2- 172.21.15.49:0/3828332845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f574415c1c0 0x7f57440c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:34.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.387+0000 7f5749909640 1 -- 172.21.15.49:0/3828332845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5740009420 con 0x7f574415b620 2023-11-18T21:28:34.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.391+0000 7f5749909640 1 --2- 172.21.15.49:0/3828332845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574415b620 0x7f5744152fe0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f573400c420 tx=0x7f573400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:34.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.395+0000 7f573a7fc640 1 -- 172.21.15.49:0/3828332845 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5734005cf0 con 0x7f574415b620 2023-11-18T21:28:34.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.395+0000 7f573a7fc640 1 -- 172.21.15.49:0/3828332845 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5734005e50 con 0x7f574415b620 2023-11-18T21:28:34.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.395+0000 7f573a7fc640 1 -- 172.21.15.49:0/3828332845 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57340072f0 con 0x7f574415b620 2023-11-18T21:28:34.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.395+0000 7f574bb6d640 1 -- 172.21.15.49:0/3828332845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57441f1ea0 con 0x7f574415b620 2023-11-18T21:28:34.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.395+0000 7f574bb6d640 1 -- 172.21.15.49:0/3828332845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5744151a20 con 0x7f574415b620 2023-11-18T21:28:34.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.395+0000 7f574bb6d640 1 -- 172.21.15.49:0/3828332845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5744067d50 con 0x7f574415b620 2023-11-18T21:28:34.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.687+0000 7f573a7fc640 1 -- 172.21.15.49:0/3828332845 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5734007450 con 0x7f574415b620 2023-11-18T21:28:34.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.687+0000 7f573a7fc640 1 --2- 172.21.15.49:0/3828332845 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f57280664c0 0x7f5728068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:34.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.687+0000 7f5749108640 1 --2- 172.21.15.49:0/3828332845 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f57280664c0 0x7f5728068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:34.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.687+0000 7f5749108640 1 --2- 172.21.15.49:0/3828332845 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f57280664c0 0x7f5728068980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f57400af000 tx=0x7f5740004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:34.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.727+0000 7f573a7fc640 1 -- 172.21.15.49:0/3828332845 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f5734054f70 con 0x7f574415b620 2023-11-18T21:28:34.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.743+0000 7f573a7fc640 1 -- 172.21.15.49:0/3828332845 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5734050bb0 con 0x7f574415b620 2023-11-18T21:28:34.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:34.919+0000 7f574bb6d640 1 -- 172.21.15.49:0/3828332845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f574415a4a0 con 0x7f574415b620 2023-11-18T21:28:35.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.015+0000 7f573a7fc640 1 -- 172.21.15.49:0/3828332845 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f574415a4a0 con 0x7f574415b620 2023-11-18T21:28:35.016 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-18T21:28:35.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.019+0000 7f574bb6d640 1 -- 172.21.15.49:0/3828332845 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f57280664c0 msgr2=0x7f5728068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:35.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.019+0000 7f574bb6d640 1 --2- 172.21.15.49:0/3828332845 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f57280664c0 0x7f5728068980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f57400af000 tx=0x7f5740004740 comp rx=0 tx=0).stop 2023-11-18T21:28:35.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.019+0000 7f574bb6d640 1 -- 172.21.15.49:0/3828332845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574415b620 msgr2=0x7f5744152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:35.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.019+0000 7f574bb6d640 1 --2- 172.21.15.49:0/3828332845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574415b620 0x7f5744152fe0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f573400c420 tx=0x7f573400c8e0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.019+0000 7f574bb6d640 1 -- 172.21.15.49:0/3828332845 shutdown_connections 2023-11-18T21:28:35.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.019+0000 7f574bb6d640 1 --2- 172.21.15.49:0/3828332845 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f57280664c0 0x7f5728068980 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.019+0000 7f574bb6d640 1 --2- 172.21.15.49:0/3828332845 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f574415c5a0 0x7f574414cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.019+0000 7f574bb6d640 1 --2- 172.21.15.49:0/3828332845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f574415c1c0 0x7f57440c05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.019+0000 7f574bb6d640 1 --2- 172.21.15.49:0/3828332845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574415b620 0x7f5744152fe0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.019+0000 7f574bb6d640 1 -- 172.21.15.49:0/3828332845 >> 172.21.15.49:0/3828332845 conn(0x7f5744060fd0 msgr2=0x7f57441582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:35.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.019+0000 7f574bb6d640 1 -- 172.21.15.49:0/3828332845 shutdown_connections 2023-11-18T21:28:35.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.019+0000 7f574bb6d640 1 -- 172.21.15.49:0/3828332845 wait complete. 2023-11-18T21:28:35.039 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T21:28:35.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.171+0000 7f0db04a1640 1 Processor -- start 2023-11-18T21:28:35.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.171+0000 7f0db04a1640 1 -- start start 2023-11-18T21:28:35.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.171+0000 7f0db04a1640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0da8151600 0x7f0da8157200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:35.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.171+0000 7f0db04a1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0da80c6fb0 0x7f0da80c5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:35.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.171+0000 7f0db04a1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da815a7f0 con 0x7f0da815b520 2023-11-18T21:28:35.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.171+0000 7f0db04a1640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da806ac90 con 0x7f0da8151600 2023-11-18T21:28:35.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.171+0000 7f0db04a1640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da806af70 con 0x7f0da80c6fb0 2023-11-18T21:28:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.171+0000 7f0daea3e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0da80c6fb0 0x7f0da80c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.175+0000 7f0dae23d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0da8151600 0x7f0da8157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.175+0000 7f0dae23d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0da8151600 0x7f0da8157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49156/0 (socket says 172.21.15.49:49156) 2023-11-18T21:28:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.175+0000 7f0dae23d640 1 -- 172.21.15.49:0/2045277526 learned_addr learned my addr 172.21.15.49:0/2045277526 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.175+0000 7f0dae23d640 1 -- 172.21.15.49:0/2045277526 >> v2:172.21.15.106:3300/0 conn(0x7f0da80c6fb0 msgr2=0x7f0da80c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.175+0000 7f0dae23d640 1 --2- 172.21.15.49:0/2045277526 >> v2:172.21.15.106:3300/0 conn(0x7f0da80c6fb0 0x7f0da80c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.175+0000 7f0dae23d640 1 -- 172.21.15.49:0/2045277526 >> v1:172.21.15.106:6789/0 conn(0x7f0da815b520 legacy=0x7f0da80c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.175+0000 7f0dae23d640 1 -- 172.21.15.49:0/2045277526 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da815aa40 con 0x7f0da8151600 2023-11-18T21:28:35.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.179+0000 7f0dae23d640 1 --2- 172.21.15.49:0/2045277526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8151600 0x7f0da8157200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0da806d300 tx=0x7f0da001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b98f1087db1eee server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.187+0000 7f0dad23b640 1 -- 172.21.15.49:0/2045277526 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da00a5690 con 0x7f0da8151600 2023-11-18T21:28:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.187+0000 7f0dad23b640 1 -- 172.21.15.49:0/2045277526 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da00a57f0 con 0x7f0da8151600 2023-11-18T21:28:35.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.187+0000 7f0dad23b640 1 -- 172.21.15.49:0/2045277526 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da00a5b80 con 0x7f0da8151600 2023-11-18T21:28:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.187+0000 7f0db04a1640 1 -- 172.21.15.49:0/2045277526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8151600 msgr2=0x7f0da8157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.187+0000 7f0db04a1640 1 --2- 172.21.15.49:0/2045277526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8151600 0x7f0da8157200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0da806d300 tx=0x7f0da001c9d0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.187+0000 7f0db04a1640 1 -- 172.21.15.49:0/2045277526 shutdown_connections 2023-11-18T21:28:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.187+0000 7f0db04a1640 1 --2- 172.21.15.49:0/2045277526 >> v2:172.21.15.106:3300/0 conn(0x7f0da80c6fb0 0x7f0da80c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.187+0000 7f0db04a1640 1 --2- 172.21.15.49:0/2045277526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8151600 0x7f0da8157200 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.187+0000 7f0db04a1640 1 -- 172.21.15.49:0/2045277526 >> 172.21.15.49:0/2045277526 conn(0x7f0da8070160 msgr2=0x7f0da806b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:35.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.187+0000 7f0db04a1640 1 -- 172.21.15.49:0/2045277526 shutdown_connections 2023-11-18T21:28:35.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.187+0000 7f0db04a1640 1 -- 172.21.15.49:0/2045277526 wait complete. 2023-11-18T21:28:35.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.187+0000 7f0db04a1640 1 Processor -- start 2023-11-18T21:28:35.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.187+0000 7f0db04a1640 1 -- start start 2023-11-18T21:28:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.191+0000 7f0db04a1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0da80c6fb0 0x7f0da8148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.191+0000 7f0db04a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8151600 0x7f0da80cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.191+0000 7f0db04a1640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0da815b520 0x7f0da80cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.191+0000 7f0db04a1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da80cb630 con 0x7f0da8151600 2023-11-18T21:28:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.191+0000 7f0db04a1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da8156a20 con 0x7f0da80c6fb0 2023-11-18T21:28:35.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.191+0000 7f0db04a1640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da8156cc0 con 0x7f0da815b520 2023-11-18T21:28:35.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.191+0000 7f0dada3c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8151600 0x7f0da80cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:35.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.191+0000 7f0dada3c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8151600 0x7f0da80cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49172/0 (socket says 172.21.15.49:49172) 2023-11-18T21:28:35.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.191+0000 7f0dada3c640 1 -- 172.21.15.49:0/1438630215 learned_addr learned my addr 172.21.15.49:0/1438630215 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:35.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.191+0000 7f0daea3e640 1 --2- 172.21.15.49:0/1438630215 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0da815b520 0x7f0da80cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:35.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.191+0000 7f0dae23d640 1 --2- 172.21.15.49:0/1438630215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0da80c6fb0 0x7f0da8148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:35.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.195+0000 7f0dada3c640 1 -- 172.21.15.49:0/1438630215 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0da815b520 msgr2=0x7f0da80cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:35.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.195+0000 7f0dada3c640 1 --2- 172.21.15.49:0/1438630215 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0da815b520 0x7f0da80cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.195+0000 7f0dada3c640 1 -- 172.21.15.49:0/1438630215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0da80c6fb0 msgr2=0x7f0da8148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:35.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.195+0000 7f0dada3c640 1 --2- 172.21.15.49:0/1438630215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0da80c6fb0 0x7f0da8148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.195+0000 7f0dada3c640 1 -- 172.21.15.49:0/1438630215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da0009b30 con 0x7f0da8151600 2023-11-18T21:28:35.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.195+0000 7f0dada3c640 1 --2- 172.21.15.49:0/1438630215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8151600 0x7f0da80cbac0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800c370 tx=0x7f0d9800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:35.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.199+0000 7f0d9effd640 1 -- 172.21.15.49:0/1438630215 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d980052d0 con 0x7f0da8151600 2023-11-18T21:28:35.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.199+0000 7f0d9effd640 1 -- 172.21.15.49:0/1438630215 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d98005430 con 0x7f0da8151600 2023-11-18T21:28:35.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.199+0000 7f0db04a1640 1 -- 172.21.15.49:0/1438630215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da80cafe0 con 0x7f0da8151600 2023-11-18T21:28:35.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.199+0000 7f0d9effd640 1 -- 172.21.15.49:0/1438630215 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98007260 con 0x7f0da8151600 2023-11-18T21:28:35.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.199+0000 7f0db04a1640 1 -- 172.21.15.49:0/1438630215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da80741f0 con 0x7f0da8151600 2023-11-18T21:28:35.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.199+0000 7f0db04a1640 1 -- 172.21.15.49:0/1438630215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da80cb7a0 con 0x7f0da8151600 2023-11-18T21:28:35.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.495+0000 7f0d9effd640 1 -- 172.21.15.49:0/1438630215 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0d980073c0 con 0x7f0da8151600 2023-11-18T21:28:35.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.495+0000 7f0d9effd640 1 --2- 172.21.15.49:0/1438630215 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0d8c0664c0 0x7f0d8c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:35.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.495+0000 7f0dae23d640 1 --2- 172.21.15.49:0/1438630215 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0d8c0664c0 0x7f0d8c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:35.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.499+0000 7f0dae23d640 1 --2- 172.21.15.49:0/1438630215 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0d8c0664c0 0x7f0d8c068980 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0da00ae000 tx=0x7f0da00a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:35.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.535+0000 7f0d9effd640 1 -- 172.21.15.49:0/1438630215 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f0d98007670 con 0x7f0da8151600 2023-11-18T21:28:35.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.535+0000 7f0d9effd640 1 -- 172.21.15.49:0/1438630215 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0d98050b90 con 0x7f0da8151600 2023-11-18T21:28:35.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.703+0000 7f0db04a1640 1 -- 172.21.15.49:0/1438630215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0da806bb60 con 0x7f0da8151600 2023-11-18T21:28:35.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.795+0000 7f0d9effd640 1 -- 172.21.15.49:0/1438630215 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0d98020020 con 0x7f0da8151600 2023-11-18T21:28:35.797 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-11-18T21:28:35.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.799+0000 7f0db04a1640 1 -- 172.21.15.49:0/1438630215 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0d8c0664c0 msgr2=0x7f0d8c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:35.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.799+0000 7f0db04a1640 1 --2- 172.21.15.49:0/1438630215 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0d8c0664c0 0x7f0d8c068980 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0da00ae000 tx=0x7f0da00a7070 comp rx=0 tx=0).stop 2023-11-18T21:28:35.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.799+0000 7f0db04a1640 1 -- 172.21.15.49:0/1438630215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8151600 msgr2=0x7f0da80cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:35.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.799+0000 7f0db04a1640 1 --2- 172.21.15.49:0/1438630215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8151600 0x7f0da80cbac0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800c370 tx=0x7f0d9800c830 comp rx=0 tx=0).stop 2023-11-18T21:28:35.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.799+0000 7f0db04a1640 1 -- 172.21.15.49:0/1438630215 shutdown_connections 2023-11-18T21:28:35.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.799+0000 7f0db04a1640 1 --2- 172.21.15.49:0/1438630215 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0d8c0664c0 0x7f0d8c068980 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.799+0000 7f0db04a1640 1 --2- 172.21.15.49:0/1438630215 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0da815b520 0x7f0da80cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.799+0000 7f0db04a1640 1 --2- 172.21.15.49:0/1438630215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8151600 0x7f0da80cbac0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.799+0000 7f0db04a1640 1 --2- 172.21.15.49:0/1438630215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0da80c6fb0 0x7f0da8148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.799+0000 7f0db04a1640 1 -- 172.21.15.49:0/1438630215 >> 172.21.15.49:0/1438630215 conn(0x7f0da8070160 msgr2=0x7f0da814a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:35.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.799+0000 7f0db04a1640 1 -- 172.21.15.49:0/1438630215 shutdown_connections 2023-11-18T21:28:35.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.799+0000 7f0db04a1640 1 -- 172.21.15.49:0/1438630215 wait complete. 2023-11-18T21:28:35.825 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T21:28:35.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.959+0000 7f771c63a640 1 Processor -- start 2023-11-18T21:28:35.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.959+0000 7f771c63a640 1 -- start start 2023-11-18T21:28:35.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.959+0000 7f771c63a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f77140ce0c0 0x7f77140ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:35.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.959+0000 7f771c63a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77140cc3c0 0x7f7714159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:35.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.959+0000 7f771c63a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f77140cdb70 0x7f771415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:35.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.959+0000 7f771c63a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77140ca550 con 0x7f77140ce0c0 2023-11-18T21:28:35.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.959+0000 7f771c63a640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77140ce9e0 con 0x7f77140cdb70 2023-11-18T21:28:35.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.959+0000 7f771c63a640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77140cd9a0 con 0x7f77140cc3c0 2023-11-18T21:28:35.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.967+0000 7f7719bd5640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77140cc3c0 0x7f7714159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:35.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.967+0000 7f7719bd5640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77140cc3c0 0x7f7714159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:54276/0 (socket says 172.21.15.49:54276) 2023-11-18T21:28:35.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.967+0000 7f7719bd5640 1 -- 172.21.15.49:0/2449056415 learned_addr learned my addr 172.21.15.49:0/2449056415 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:35.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.975+0000 7f771abd7640 1 --2- 172.21.15.49:0/2449056415 >> v2:172.21.15.106:3300/0 conn(0x7f77140cdb70 0x7f771415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:35.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.983+0000 7f771abd7640 1 -- 172.21.15.49:0/2449056415 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77140cc3c0 msgr2=0x7f7714159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:35.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.983+0000 7f771abd7640 1 --2- 172.21.15.49:0/2449056415 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77140cc3c0 0x7f7714159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.983+0000 7f771abd7640 1 -- 172.21.15.49:0/2449056415 >> v2:172.21.15.49:3300/0 conn(0x7f77140ce0c0 msgr2=0x7f77140ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:35.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.983+0000 7f771abd7640 1 --2- 172.21.15.49:0/2449056415 >> v2:172.21.15.49:3300/0 conn(0x7f77140ce0c0 0x7f77140ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:35.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:35.983+0000 7f771abd7640 1 -- 172.21.15.49:0/2449056415 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77141596c0 con 0x7f77140cdb70 2023-11-18T21:28:36.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.079+0000 7f771abd7640 1 --2- 172.21.15.49:0/2449056415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77140cdb70 0x7f771415a0b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f771406cf50 tx=0x7f770c01c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a7f6fa1def78e41 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:36.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.091+0000 7f77193d4640 1 -- 172.21.15.49:0/2449056415 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0a59b0 con 0x7f77140cdb70 2023-11-18T21:28:36.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.091+0000 7f77193d4640 1 -- 172.21.15.49:0/2449056415 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c0a5b10 con 0x7f77140cdb70 2023-11-18T21:28:36.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.091+0000 7f77193d4640 1 -- 172.21.15.49:0/2449056415 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0a5ea0 con 0x7f77140cdb70 2023-11-18T21:28:36.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.091+0000 7f771c63a640 1 -- 172.21.15.49:0/2449056415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77140cdb70 msgr2=0x7f771415a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:36.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.091+0000 7f771c63a640 1 --2- 172.21.15.49:0/2449056415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77140cdb70 0x7f771415a0b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f771406cf50 tx=0x7f770c01c910 comp rx=0 tx=0).stop 2023-11-18T21:28:36.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.091+0000 7f771c63a640 1 -- 172.21.15.49:0/2449056415 shutdown_connections 2023-11-18T21:28:36.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.091+0000 7f771c63a640 1 --2- 172.21.15.49:0/2449056415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77140cdb70 0x7f771415a0b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.091+0000 7f771c63a640 1 --2- 172.21.15.49:0/2449056415 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77140cc3c0 0x7f7714159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.091+0000 7f771c63a640 1 --2- 172.21.15.49:0/2449056415 >> v2:172.21.15.49:3300/0 conn(0x7f77140ce0c0 0x7f77140ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.091+0000 7f771c63a640 1 -- 172.21.15.49:0/2449056415 >> 172.21.15.49:0/2449056415 conn(0x7f77140b07c0 msgr2=0x7f77140b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:36.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.091+0000 7f771c63a640 1 -- 172.21.15.49:0/2449056415 shutdown_connections 2023-11-18T21:28:36.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.091+0000 7f771c63a640 1 -- 172.21.15.49:0/2449056415 wait complete. 2023-11-18T21:28:36.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.095+0000 7f771c63a640 1 Processor -- start 2023-11-18T21:28:36.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.095+0000 7f771c63a640 1 -- start start 2023-11-18T21:28:36.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.095+0000 7f771c63a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77140cc3c0 0x7f771414b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:36.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.095+0000 7f771c63a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77140cdb70 0x7f77140b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:36.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.095+0000 7f771c63a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77140ce0c0 0x7f77140b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:36.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.095+0000 7f771c63a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77140b19c0 con 0x7f77140ce0c0 2023-11-18T21:28:36.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.095+0000 7f771c63a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7714150a70 con 0x7f77140cc3c0 2023-11-18T21:28:36.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.095+0000 7f771c63a640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77141f3260 con 0x7f77140cdb70 2023-11-18T21:28:36.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.095+0000 7f771abd7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77140ce0c0 0x7f77140b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:36.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.095+0000 7f771abd7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77140ce0c0 0x7f77140b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40216/0 (socket says 172.21.15.49:40216) 2023-11-18T21:28:36.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.099+0000 7f771abd7640 1 -- 172.21.15.49:0/4238777933 learned_addr learned my addr 172.21.15.49:0/4238777933 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:36.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.099+0000 7f7719bd5640 1 --2- 172.21.15.49:0/4238777933 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77140cdb70 0x7f77140b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:36.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.099+0000 7f771a3d6640 1 --2- 172.21.15.49:0/4238777933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77140cc3c0 0x7f771414b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:36.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.099+0000 7f771abd7640 1 -- 172.21.15.49:0/4238777933 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77140cdb70 msgr2=0x7f77140b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:36.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.099+0000 7f771abd7640 1 --2- 172.21.15.49:0/4238777933 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77140cdb70 0x7f77140b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.099+0000 7f771abd7640 1 -- 172.21.15.49:0/4238777933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77140cc3c0 msgr2=0x7f771414b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:36.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.099+0000 7f771abd7640 1 --2- 172.21.15.49:0/4238777933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77140cc3c0 0x7f771414b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.099+0000 7f771abd7640 1 -- 172.21.15.49:0/4238777933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c009a70 con 0x7f77140ce0c0 2023-11-18T21:28:36.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.103+0000 7f771abd7640 1 --2- 172.21.15.49:0/4238777933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77140ce0c0 0x7f77140b2320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f770c01afc0 tx=0x7f770c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:36.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.107+0000 7f770affd640 1 -- 172.21.15.49:0/4238777933 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0adad0 con 0x7f77140ce0c0 2023-11-18T21:28:36.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.107+0000 7f770affd640 1 -- 172.21.15.49:0/4238777933 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c0adc30 con 0x7f77140ce0c0 2023-11-18T21:28:36.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.107+0000 7f770affd640 1 -- 172.21.15.49:0/4238777933 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0b8420 con 0x7f77140ce0c0 2023-11-18T21:28:36.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.107+0000 7f771c63a640 1 -- 172.21.15.49:0/4238777933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77141f26e0 con 0x7f77140ce0c0 2023-11-18T21:28:36.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.107+0000 7f771c63a640 1 -- 172.21.15.49:0/4238777933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77141f2ca0 con 0x7f77140ce0c0 2023-11-18T21:28:36.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.111+0000 7f771c63a640 1 -- 172.21.15.49:0/4238777933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77140b1b00 con 0x7f77140ce0c0 2023-11-18T21:28:36.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.411+0000 7f770affd640 1 -- 172.21.15.49:0/4238777933 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f770c0b8580 con 0x7f77140ce0c0 2023-11-18T21:28:36.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.411+0000 7f770affd640 1 --2- 172.21.15.49:0/4238777933 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f76f80664f0 0x7f76f80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.415+0000 7f771a3d6640 1 --2- 172.21.15.49:0/4238777933 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f76f80664f0 0x7f76f80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:36.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.415+0000 7f771a3d6640 1 --2- 172.21.15.49:0/4238777933 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f76f80664f0 0x7f76f80689b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f77040098f0 tx=0x7f7704006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:36.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.447+0000 7f770affd640 1 -- 172.21.15.49:0/4238777933 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f770c0f0750 con 0x7f77140ce0c0 2023-11-18T21:28:36.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.447+0000 7f770affd640 1 -- 172.21.15.49:0/4238777933 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f770c0eca90 con 0x7f77140ce0c0 2023-11-18T21:28:36.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.627+0000 7f771c63a640 1 -- 172.21.15.49:0/4238777933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77140b1b00 con 0x7f77140ce0c0 2023-11-18T21:28:36.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.647+0000 7f770affd640 1 -- 172.21.15.49:0/4238777933 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77140b1b00 con 0x7f77140ce0c0 2023-11-18T21:28:36.646 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-18T21:28:36.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.647+0000 7f771c63a640 1 -- 172.21.15.49:0/4238777933 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f76f80664f0 msgr2=0x7f76f80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:36.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.647+0000 7f771c63a640 1 --2- 172.21.15.49:0/4238777933 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f76f80664f0 0x7f76f80689b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f77040098f0 tx=0x7f7704006f90 comp rx=0 tx=0).stop 2023-11-18T21:28:36.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.647+0000 7f771c63a640 1 -- 172.21.15.49:0/4238777933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77140ce0c0 msgr2=0x7f77140b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:36.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.647+0000 7f771c63a640 1 --2- 172.21.15.49:0/4238777933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77140ce0c0 0x7f77140b2320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f770c01afc0 tx=0x7f770c0196b0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.647+0000 7f771c63a640 1 -- 172.21.15.49:0/4238777933 shutdown_connections 2023-11-18T21:28:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.647+0000 7f771c63a640 1 --2- 172.21.15.49:0/4238777933 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f76f80664f0 0x7f76f80689b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.647+0000 7f771c63a640 1 --2- 172.21.15.49:0/4238777933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77140ce0c0 0x7f77140b2320 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.647+0000 7f771c63a640 1 --2- 172.21.15.49:0/4238777933 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77140cdb70 0x7f77140b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.647+0000 7f771c63a640 1 --2- 172.21.15.49:0/4238777933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77140cc3c0 0x7f771414b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.647+0000 7f771c63a640 1 -- 172.21.15.49:0/4238777933 >> 172.21.15.49:0/4238777933 conn(0x7f77140b07c0 msgr2=0x7f77140ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.647+0000 7f771c63a640 1 -- 172.21.15.49:0/4238777933 shutdown_connections 2023-11-18T21:28:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.647+0000 7f771c63a640 1 -- 172.21.15.49:0/4238777933 wait complete. 2023-11-18T21:28:36.668 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-18T21:28:36.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.795+0000 7fc685438640 1 Processor -- start 2023-11-18T21:28:36.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.795+0000 7fc685438640 1 -- start start 2023-11-18T21:28:36.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.799+0000 7fc685438640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc68014fc10 0x7fc6801559e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:36.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.799+0000 7fc685438640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6800c6540 0x7fc68006b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:36.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.799+0000 7fc685438640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68006afb0 con 0x7fc6800c6960 2023-11-18T21:28:36.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.799+0000 7fc685438640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68006b980 con 0x7fc68014fc10 2023-11-18T21:28:36.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.799+0000 7fc685438640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800c6ed0 con 0x7fc6800c6540 2023-11-18T21:28:36.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.799+0000 7fc67f7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc6800c6960 0x7fc6800cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36476/0 (socket says 172.21.15.49:36476) 2023-11-18T21:28:36.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.799+0000 7fc67f7fe640 1 -- 172.21.15.49:0/703596724 learned_addr learned my addr 172.21.15.49:0/703596724 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:36.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.799+0000 7fc67effd640 1 --2- 172.21.15.49:0/703596724 >> v2:172.21.15.106:3300/0 conn(0x7fc68014fc10 0x7fc6801559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:36.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.799+0000 7fc677fff640 1 --2- 172.21.15.49:0/703596724 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6800c6540 0x7fc68006b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:36.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.803+0000 7fc67e7fc640 1 -- 172.21.15.49:0/703596724 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015071593 0 0) 0x7fc68006afb0 con 0x7fc6800c6960 2023-11-18T21:28:36.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.803+0000 7fc67e7fc640 1 -- 172.21.15.49:0/703596724 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc66c003530 con 0x7fc6800c6960 2023-11-18T21:28:36.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.807+0000 7fc67e7fc640 1 -- 172.21.15.49:0/703596724 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1713196030 0 0) 0x7fc66c003530 con 0x7fc6800c6960 2023-11-18T21:28:36.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.807+0000 7fc67e7fc640 1 -- 172.21.15.49:0/703596724 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6800c6540 msgr2=0x7fc68006b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:36.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.807+0000 7fc67e7fc640 1 --2- 172.21.15.49:0/703596724 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6800c6540 0x7fc68006b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.807+0000 7fc67e7fc640 1 -- 172.21.15.49:0/703596724 >> v2:172.21.15.106:3300/0 conn(0x7fc68014fc10 msgr2=0x7fc6801559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:36.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.807+0000 7fc67e7fc640 1 --2- 172.21.15.49:0/703596724 >> v2:172.21.15.106:3300/0 conn(0x7fc68014fc10 0x7fc6801559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.807+0000 7fc67e7fc640 1 -- 172.21.15.49:0/703596724 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800c7170 con 0x7fc6800c6960 2023-11-18T21:28:36.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.807+0000 7fc67e7fc640 1 -- 172.21.15.49:0/703596724 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7fc678001a00 con 0x7fc6800c6960 2023-11-18T21:28:36.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.807+0000 7fc67e7fc640 1 -- 172.21.15.49:0/703596724 >> v1:172.21.15.49:6789/0 conn(0x7fc6800c6960 legacy=0x7fc6800cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:36.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.807+0000 7fc67e7fc640 1 --2- 172.21.15.49:0/703596724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc66c0039f0 0x7fc66c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:36.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.807+0000 7fc67e7fc640 1 --2- 172.21.15.49:0/703596724 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc66c0047d0 0x7fc66c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:36.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.807+0000 7fc67e7fc640 1 --2- 172.21.15.49:0/703596724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc66c005150 0x7fc66c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:36.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.807+0000 7fc67e7fc640 1 -- 172.21.15.49:0/703596724 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800c6ed0 con 0x7fc66c0039f0 2023-11-18T21:28:36.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.807+0000 7fc67e7fc640 1 -- 172.21.15.49:0/703596724 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c00bed0 con 0x7fc66c005150 2023-11-18T21:28:36.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.807+0000 7fc67e7fc640 1 -- 172.21.15.49:0/703596724 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c00c010 con 0x7fc66c0047d0 2023-11-18T21:28:36.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.811+0000 7fc67effd640 1 --2- 172.21.15.49:0/703596724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc66c0039f0 0x7fc66c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:36.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.815+0000 7fc67effd640 1 -- 172.21.15.49:0/703596724 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc66c0047d0 msgr2=0x7fc66c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:36.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.815+0000 7fc67effd640 1 --2- 172.21.15.49:0/703596724 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc66c0047d0 0x7fc66c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.815+0000 7fc67effd640 1 -- 172.21.15.49:0/703596724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc66c005150 msgr2=0x7fc66c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:36.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.815+0000 7fc67effd640 1 --2- 172.21.15.49:0/703596724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc66c005150 0x7fc66c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.815+0000 7fc67effd640 1 -- 172.21.15.49:0/703596724 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66c003530 con 0x7fc66c0039f0 2023-11-18T21:28:36.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.819+0000 7fc67effd640 1 --2- 172.21.15.49:0/703596724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc66c0039f0 0x7fc66c003e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc670009ae0 tx=0x7fc67001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a497ee1dd2c6a30c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:36.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.819+0000 7fc67e7fc640 1 -- 172.21.15.49:0/703596724 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6700a5680 con 0x7fc66c0039f0 2023-11-18T21:28:36.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.823+0000 7fc67e7fc640 1 -- 172.21.15.49:0/703596724 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6700a57e0 con 0x7fc66c0039f0 2023-11-18T21:28:36.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.823+0000 7fc67e7fc640 1 -- 172.21.15.49:0/703596724 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6700a5b90 con 0x7fc66c0039f0 2023-11-18T21:28:36.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.823+0000 7fc685438640 1 -- 172.21.15.49:0/703596724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc66c0039f0 msgr2=0x7fc66c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:36.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.823+0000 7fc685438640 1 --2- 172.21.15.49:0/703596724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc66c0039f0 0x7fc66c003e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc670009ae0 tx=0x7fc67001ca90 comp rx=0 tx=0).stop 2023-11-18T21:28:36.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.823+0000 7fc67f7fe640 1 -- 172.21.15.49:0/703596724 reap_dead start 2023-11-18T21:28:36.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.823+0000 7fc685438640 1 -- 172.21.15.49:0/703596724 shutdown_connections 2023-11-18T21:28:36.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.823+0000 7fc685438640 1 -- 172.21.15.49:0/703596724 >> 172.21.15.49:0/703596724 conn(0x7fc68006d220 msgr2=0x7fc68006d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:36.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.823+0000 7fc685438640 1 -- 172.21.15.49:0/703596724 shutdown_connections 2023-11-18T21:28:36.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.823+0000 7fc685438640 1 -- 172.21.15.49:0/703596724 wait complete. 2023-11-18T21:28:36.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.827+0000 7fc685438640 1 Processor -- start 2023-11-18T21:28:36.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.827+0000 7fc685438640 1 -- start start 2023-11-18T21:28:36.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.827+0000 7fc685438640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc66c0039f0 0x7fc6801f0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:36.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.827+0000 7fc685438640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc680152740 0x7fc6801ece70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:36.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.827+0000 7fc685438640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc680159740 0x7fc6801e93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:36.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.827+0000 7fc685438640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6801eca50 con 0x7fc680159740 2023-11-18T21:28:36.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.827+0000 7fc685438640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc680152430 con 0x7fc680152740 2023-11-18T21:28:36.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.827+0000 7fc685438640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6801f0990 con 0x7fc66c0039f0 2023-11-18T21:28:36.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.827+0000 7fc67f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc680159740 0x7fc6801e93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:36.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.827+0000 7fc67f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc680159740 0x7fc6801e93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40234/0 (socket says 172.21.15.49:40234) 2023-11-18T21:28:36.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.827+0000 7fc67f7fe640 1 -- 172.21.15.49:0/1717467088 learned_addr learned my addr 172.21.15.49:0/1717467088 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:36.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.827+0000 7fc677fff640 1 --2- 172.21.15.49:0/1717467088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc680152740 0x7fc6801ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:36.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.827+0000 7fc67effd640 1 --2- 172.21.15.49:0/1717467088 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc66c0039f0 0x7fc6801f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:36.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.831+0000 7fc67f7fe640 1 -- 172.21.15.49:0/1717467088 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc66c0039f0 msgr2=0x7fc6801f0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:36.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.831+0000 7fc67f7fe640 1 --2- 172.21.15.49:0/1717467088 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc66c0039f0 0x7fc6801f0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.831+0000 7fc67f7fe640 1 -- 172.21.15.49:0/1717467088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc680152740 msgr2=0x7fc6801ece70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:36.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.831+0000 7fc67f7fe640 1 --2- 172.21.15.49:0/1717467088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc680152740 0x7fc6801ece70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:36.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.831+0000 7fc67f7fe640 1 -- 172.21.15.49:0/1717467088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc680148d60 con 0x7fc680159740 2023-11-18T21:28:36.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.835+0000 7fc67f7fe640 1 --2- 172.21.15.49:0/1717467088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc680159740 0x7fc6801e93a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc680070a70 tx=0x7fc67800fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:36.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.839+0000 7fc6777fe640 1 -- 172.21.15.49:0/1717467088 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67800da20 con 0x7fc680159740 2023-11-18T21:28:36.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.839+0000 7fc6777fe640 1 -- 172.21.15.49:0/1717467088 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67800dba0 con 0x7fc680159740 2023-11-18T21:28:36.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.839+0000 7fc6777fe640 1 -- 172.21.15.49:0/1717467088 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678017420 con 0x7fc680159740 2023-11-18T21:28:36.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.839+0000 7fc685438640 1 -- 172.21.15.49:0/1717467088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6801484c0 con 0x7fc680159740 2023-11-18T21:28:36.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.839+0000 7fc685438640 1 -- 172.21.15.49:0/1717467088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc680148a80 con 0x7fc680159740 2023-11-18T21:28:36.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.839+0000 7fc685438640 1 -- 172.21.15.49:0/1717467088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6801ecb90 con 0x7fc680159740 2023-11-18T21:28:36.860 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.859+0000 7fc6777fe640 1 -- 172.21.15.49:0/1717467088 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc678021470 con 0x7fc680159740 2023-11-18T21:28:36.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.859+0000 7fc6777fe640 1 --2- 172.21.15.49:0/1717467088 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc6600664c0 0x7fc660068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:36.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.863+0000 7fc67effd640 1 --2- 172.21.15.49:0/1717467088 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc6600664c0 0x7fc660068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.863+0000 7fc67effd640 1 --2- 172.21.15.49:0/1717467088 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc6600664c0 0x7fc660068980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc6700af000 tx=0x7fc6700046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:36.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:36.863+0000 7fc6777fe640 1 -- 172.21.15.49:0/1717467088 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fc6780584b0 con 0x7fc680159740 2023-11-18T21:28:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.159+0000 7fc6777fe640 1 -- 172.21.15.49:0/1717467088 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc6780540f0 con 0x7fc680159740 2023-11-18T21:28:37.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.323+0000 7fc685438640 1 -- 172.21.15.49:0/1717467088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc6801ecb90 con 0x7fc680159740 2023-11-18T21:28:37.352 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.351+0000 7fc6777fe640 1 -- 172.21.15.49:0/1717467088 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc6801ecb90 con 0x7fc680159740 2023-11-18T21:28:37.353 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-11-18T21:28:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.355+0000 7fc685438640 1 -- 172.21.15.49:0/1717467088 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc6600664c0 msgr2=0x7fc660068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.355+0000 7fc685438640 1 --2- 172.21.15.49:0/1717467088 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc6600664c0 0x7fc660068980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc6700af000 tx=0x7fc6700046d0 comp rx=0 tx=0).stop 2023-11-18T21:28:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.355+0000 7fc685438640 1 -- 172.21.15.49:0/1717467088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc680159740 msgr2=0x7fc6801e93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.355+0000 7fc685438640 1 --2- 172.21.15.49:0/1717467088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc680159740 0x7fc6801e93a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc680070a70 tx=0x7fc67800fe40 comp rx=0 tx=0).stop 2023-11-18T21:28:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.355+0000 7fc685438640 1 -- 172.21.15.49:0/1717467088 shutdown_connections 2023-11-18T21:28:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.355+0000 7fc685438640 1 --2- 172.21.15.49:0/1717467088 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fc6600664c0 0x7fc660068980 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.355+0000 7fc685438640 1 --2- 172.21.15.49:0/1717467088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc680159740 0x7fc6801e93a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.355+0000 7fc685438640 1 --2- 172.21.15.49:0/1717467088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc680152740 0x7fc6801ece70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.355+0000 7fc685438640 1 --2- 172.21.15.49:0/1717467088 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc66c0039f0 0x7fc6801f0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.355+0000 7fc685438640 1 -- 172.21.15.49:0/1717467088 >> 172.21.15.49:0/1717467088 conn(0x7fc68006d220 msgr2=0x7fc6800c9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:37.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.355+0000 7fc685438640 1 -- 172.21.15.49:0/1717467088 shutdown_connections 2023-11-18T21:28:37.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.355+0000 7fc685438640 1 -- 172.21.15.49:0/1717467088 wait complete. 2023-11-18T21:28:37.376 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T21:28:37.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.503+0000 7ff20030a640 1 Processor -- start 2023-11-18T21:28:37.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.503+0000 7ff20030a640 1 -- start start 2023-11-18T21:28:37.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.503+0000 7ff20030a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff1f814fc10 0x7ff1f81559e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:37.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.503+0000 7ff20030a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f806afb0 con 0x7ff1f80c6960 2023-11-18T21:28:37.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.503+0000 7ff20030a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f80c6ed0 con 0x7ff1f80c6540 2023-11-18T21:28:37.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.503+0000 7ff20030a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f80c7170 con 0x7ff1f814fc10 2023-11-18T21:28:37.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.503+0000 7ff1fe0a6640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff1f814fc10 0x7ff1f81559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.503+0000 7ff1fe8a7640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff1f80c6960 0x7ff1f8160360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36486/0 (socket says 172.21.15.49:36486) 2023-11-18T21:28:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.503+0000 7ff1fe8a7640 1 -- 172.21.15.49:0/2347390910 learned_addr learned my addr 172.21.15.49:0/2347390910 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:37.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.507+0000 7ff1fe0a6640 1 -- 172.21.15.49:0/2347390910 >> v1:172.21.15.106:6789/0 conn(0x7ff1f80c6540 legacy=0x7ff1f80cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:37.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.507+0000 7ff1fe0a6640 1 -- 172.21.15.49:0/2347390910 >> v1:172.21.15.49:6789/0 conn(0x7ff1f80c6960 legacy=0x7ff1f8160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:37.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.507+0000 7ff1fe0a6640 1 -- 172.21.15.49:0/2347390910 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f80c28d0 con 0x7ff1f814fc10 2023-11-18T21:28:37.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.515+0000 7ff1fe0a6640 1 --2- 172.21.15.49:0/2347390910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f814fc10 0x7ff1f81559e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40097c0 tx=0x7ff1f401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977cac101618538e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:37.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.519+0000 7ff1fd0a4640 1 -- 172.21.15.49:0/2347390910 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f40a8930 con 0x7ff1f814fc10 2023-11-18T21:28:37.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.519+0000 7ff1fd0a4640 1 -- 172.21.15.49:0/2347390910 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f40a8a90 con 0x7ff1f814fc10 2023-11-18T21:28:37.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.519+0000 7ff1fd0a4640 1 -- 172.21.15.49:0/2347390910 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f40a8e20 con 0x7ff1f814fc10 2023-11-18T21:28:37.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.519+0000 7ff20030a640 1 -- 172.21.15.49:0/2347390910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f814fc10 msgr2=0x7ff1f81559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:37.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.519+0000 7ff20030a640 1 --2- 172.21.15.49:0/2347390910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f814fc10 0x7ff1f81559e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40097c0 tx=0x7ff1f401ec30 comp rx=0 tx=0).stop 2023-11-18T21:28:37.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.519+0000 7ff20030a640 1 -- 172.21.15.49:0/2347390910 shutdown_connections 2023-11-18T21:28:37.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.519+0000 7ff20030a640 1 --2- 172.21.15.49:0/2347390910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f814fc10 0x7ff1f81559e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:37.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.519+0000 7ff20030a640 1 -- 172.21.15.49:0/2347390910 >> 172.21.15.49:0/2347390910 conn(0x7ff1f806d220 msgr2=0x7ff1f806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:37.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.519+0000 7ff20030a640 1 -- 172.21.15.49:0/2347390910 shutdown_connections 2023-11-18T21:28:37.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.519+0000 7ff20030a640 1 -- 172.21.15.49:0/2347390910 wait complete. 2023-11-18T21:28:37.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.523+0000 7ff20030a640 1 Processor -- start 2023-11-18T21:28:37.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.523+0000 7ff20030a640 1 -- start start 2023-11-18T21:28:37.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.523+0000 7ff20030a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1f80c6960 0x7ff1f80c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:37.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.523+0000 7ff20030a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1f814fc10 0x7ff1f8148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:37.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.523+0000 7ff20030a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f80c8890 0x7ff1f8149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:37.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.523+0000 7ff20030a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f81489c0 con 0x7ff1f80c8890 2023-11-18T21:28:37.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.523+0000 7ff20030a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f8159230 con 0x7ff1f80c6960 2023-11-18T21:28:37.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.523+0000 7ff20030a640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f81483d0 con 0x7ff1f814fc10 2023-11-18T21:28:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.523+0000 7ff1fe8a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f80c8890 0x7ff1f8149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.523+0000 7ff1fe8a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f80c8890 0x7ff1f8149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40250/0 (socket says 172.21.15.49:40250) 2023-11-18T21:28:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.523+0000 7ff1fe8a7640 1 -- 172.21.15.49:0/1195254408 learned_addr learned my addr 172.21.15.49:0/1195254408 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.523+0000 7ff1fd8a5640 1 --2- 172.21.15.49:0/1195254408 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1f814fc10 0x7ff1f8148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.527+0000 7ff1fe8a7640 1 -- 172.21.15.49:0/1195254408 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1f814fc10 msgr2=0x7ff1f8148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.527+0000 7ff1fe8a7640 1 --2- 172.21.15.49:0/1195254408 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1f814fc10 0x7ff1f8148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.527+0000 7ff1fe8a7640 1 -- 172.21.15.49:0/1195254408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1f80c6960 msgr2=0x7ff1f80c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.527+0000 7ff1fe8a7640 1 --2- 172.21.15.49:0/1195254408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1f80c6960 0x7ff1f80c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.527+0000 7ff1fe8a7640 1 -- 172.21.15.49:0/1195254408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f4009420 con 0x7ff1f80c8890 2023-11-18T21:28:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.527+0000 7ff1fe8a7640 1 --2- 172.21.15.49:0/1195254408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f80c8890 0x7ff1f8149320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000cbf0 tx=0x7ff1f000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:37.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.555+0000 7ff1eeffd640 1 -- 172.21.15.49:0/1195254408 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f000ad40 con 0x7ff1f80c8890 2023-11-18T21:28:37.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.555+0000 7ff1eeffd640 1 -- 172.21.15.49:0/1195254408 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f0012400 con 0x7ff1f80c8890 2023-11-18T21:28:37.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.555+0000 7ff1eeffd640 1 -- 172.21.15.49:0/1195254408 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f000aea0 con 0x7ff1f80c8890 2023-11-18T21:28:37.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.555+0000 7ff20030a640 1 -- 172.21.15.49:0/1195254408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f8158c70 con 0x7ff1f80c8890 2023-11-18T21:28:37.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.559+0000 7ff20030a640 1 -- 172.21.15.49:0/1195254408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f81485e0 con 0x7ff1f80c8890 2023-11-18T21:28:37.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.559+0000 7ff20030a640 1 -- 172.21.15.49:0/1195254408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f8073e70 con 0x7ff1f80c8890 2023-11-18T21:28:37.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.935+0000 7ff1eeffd640 1 -- 172.21.15.49:0/1195254408 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff1f0007070 con 0x7ff1f80c8890 2023-11-18T21:28:37.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.935+0000 7ff1eeffd640 1 --2- 172.21.15.49:0/1195254408 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff1dc0664f0 0x7ff1dc0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.935+0000 7ff1fe0a6640 1 --2- 172.21.15.49:0/1195254408 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff1dc0664f0 0x7ff1dc0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.935+0000 7ff1fe0a6640 1 --2- 172.21.15.49:0/1195254408 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff1dc0664f0 0x7ff1dc0689b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40b2000 tx=0x7ff1f4004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:37.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.967+0000 7ff1eeffd640 1 -- 172.21.15.49:0/1195254408 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff1f0055420 con 0x7ff1f80c8890 2023-11-18T21:28:37.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:37.967+0000 7ff1eeffd640 1 -- 172.21.15.49:0/1195254408 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff1f0051760 con 0x7ff1f80c8890 2023-11-18T21:28:38.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.163+0000 7ff20030a640 1 -- 172.21.15.49:0/1195254408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff1f806bad0 con 0x7ff1f80c8890 2023-11-18T21:28:38.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.175+0000 7ff1eeffd640 1 -- 172.21.15.49:0/1195254408 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff1f0054d80 con 0x7ff1f80c8890 2023-11-18T21:28:38.174 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-11-18T21:28:38.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.175+0000 7ff20030a640 1 -- 172.21.15.49:0/1195254408 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff1dc0664f0 msgr2=0x7ff1dc0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:38.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.175+0000 7ff20030a640 1 --2- 172.21.15.49:0/1195254408 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff1dc0664f0 0x7ff1dc0689b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40b2000 tx=0x7ff1f4004740 comp rx=0 tx=0).stop 2023-11-18T21:28:38.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.175+0000 7ff20030a640 1 -- 172.21.15.49:0/1195254408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f80c8890 msgr2=0x7ff1f8149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:38.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.175+0000 7ff20030a640 1 --2- 172.21.15.49:0/1195254408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f80c8890 0x7ff1f8149320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000cbf0 tx=0x7ff1f000a430 comp rx=0 tx=0).stop 2023-11-18T21:28:38.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.175+0000 7ff20030a640 1 -- 172.21.15.49:0/1195254408 shutdown_connections 2023-11-18T21:28:38.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.175+0000 7ff20030a640 1 --2- 172.21.15.49:0/1195254408 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff1dc0664f0 0x7ff1dc0689b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:38.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.175+0000 7ff20030a640 1 --2- 172.21.15.49:0/1195254408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1f80c8890 0x7ff1f8149320 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:38.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.175+0000 7ff20030a640 1 --2- 172.21.15.49:0/1195254408 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1f814fc10 0x7ff1f8148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:38.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.175+0000 7ff20030a640 1 --2- 172.21.15.49:0/1195254408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1f80c6960 0x7ff1f80c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:38.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.175+0000 7ff20030a640 1 -- 172.21.15.49:0/1195254408 >> 172.21.15.49:0/1195254408 conn(0x7ff1f806d220 msgr2=0x7ff1f814edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:38.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.175+0000 7ff20030a640 1 -- 172.21.15.49:0/1195254408 shutdown_connections 2023-11-18T21:28:38.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.175+0000 7ff20030a640 1 -- 172.21.15.49:0/1195254408 wait complete. 2023-11-18T21:28:38.195 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-11-18T21:28:38.196 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T21:28:38.201 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T21:28:38.376 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.375+0000 7f2fa097a640 1 Processor -- start 2023-11-18T21:28:38.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.375+0000 7f2fa097a640 1 -- start start 2023-11-18T21:28:38.377 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.379+0000 7f2fa097a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f9c151340 0x7f2f9c06ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:38.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.379+0000 7f2fa097a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2f9c151720 0x7f2f9c157c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:38.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.379+0000 7f2fa097a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9c06f4a0 con 0x7f2f9c0c40e0 2023-11-18T21:28:38.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.379+0000 7f2fa097a640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9c072570 con 0x7f2f9c151720 2023-11-18T21:28:38.378 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.379+0000 7f2fa097a640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c070be0 con 0x7f2f9c151340 2023-11-18T21:28:38.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.379+0000 7f2f99d9b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2f9c151720 0x7f2f9c157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:38.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.379+0000 7f2f9a59c640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f9c151340 0x7f2f9c06ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:38.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.379+0000 7f2f99d9b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2f9c151720 0x7f2f9c157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:36692/0 (socket says 172.21.15.49:36692) 2023-11-18T21:28:38.380 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.379+0000 7f2f99d9b640 1 -- 172.21.15.49:0/2130551615 learned_addr learned my addr 172.21.15.49:0/2130551615 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:38.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.387+0000 7f2f99d9b640 1 -- 172.21.15.49:0/2130551615 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f9c151340 msgr2=0x7f2f9c06ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:38.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.387+0000 7f2f99d9b640 1 --2- 172.21.15.49:0/2130551615 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f9c151340 0x7f2f9c06ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:38.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.387+0000 7f2f99d9b640 1 -- 172.21.15.49:0/2130551615 >> v1:172.21.15.106:6789/0 conn(0x7f2f9c0c40e0 legacy=0x7f2f9c0c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:38.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.387+0000 7f2f99d9b640 1 -- 172.21.15.49:0/2130551615 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c158190 con 0x7f2f9c151720 2023-11-18T21:28:38.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.399+0000 7f2f99d9b640 1 --2- 172.21.15.49:0/2130551615 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f9c151720 0x7f2f9c157c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009870 tx=0x7f2f9001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3d277ba8e1ec73c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:38.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.407+0000 7f2f9959a640 1 -- 172.21.15.49:0/2130551615 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900ac600 con 0x7f2f9c151720 2023-11-18T21:28:38.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.407+0000 7f2f9959a640 1 -- 172.21.15.49:0/2130551615 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f900a8050 con 0x7f2f9c151720 2023-11-18T21:28:38.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.407+0000 7f2f9959a640 1 -- 172.21.15.49:0/2130551615 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900ac980 con 0x7f2f9c151720 2023-11-18T21:28:38.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.407+0000 7f2fa097a640 1 -- 172.21.15.49:0/2130551615 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f9c151720 msgr2=0x7f2f9c157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.407+0000 7f2fa097a640 1 --2- 172.21.15.49:0/2130551615 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f9c151720 0x7f2f9c157c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009870 tx=0x7f2f9001c4d0 comp rx=0 tx=0).stop 2023-11-18T21:28:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.407+0000 7f2fa097a640 1 -- 172.21.15.49:0/2130551615 shutdown_connections 2023-11-18T21:28:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.407+0000 7f2fa097a640 1 --2- 172.21.15.49:0/2130551615 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f9c151720 0x7f2f9c157c50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.407+0000 7f2fa097a640 1 --2- 172.21.15.49:0/2130551615 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f9c151340 0x7f2f9c06ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.407+0000 7f2fa097a640 1 -- 172.21.15.49:0/2130551615 >> 172.21.15.49:0/2130551615 conn(0x7f2f9c06c6a0 msgr2=0x7f2f9c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.407+0000 7f2fa097a640 1 -- 172.21.15.49:0/2130551615 shutdown_connections 2023-11-18T21:28:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.407+0000 7f2fa097a640 1 -- 172.21.15.49:0/2130551615 wait complete. 2023-11-18T21:28:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.411+0000 7f2fa097a640 1 Processor -- start 2023-11-18T21:28:38.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.411+0000 7f2fa097a640 1 -- start start 2023-11-18T21:28:38.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.411+0000 7f2fa097a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f9c0c40e0 0x7f2f9c1fa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:38.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.411+0000 7f2fa097a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c151340 0x7f2f9c0c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:38.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.411+0000 7f2fa097a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f9c151720 0x7f2f9c1f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:38.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.411+0000 7f2fa097a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c0ca7e0 con 0x7f2f9c151340 2023-11-18T21:28:38.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.411+0000 7f2fa097a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c0c8eb0 con 0x7f2f9c0c40e0 2023-11-18T21:28:38.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.411+0000 7f2fa097a640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c158920 con 0x7f2f9c151720 2023-11-18T21:28:38.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.411+0000 7f2f99d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c151340 0x7f2f9c0c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:38.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.411+0000 7f2f99d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c151340 0x7f2f9c0c5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40252/0 (socket says 172.21.15.49:40252) 2023-11-18T21:28:38.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.411+0000 7f2f99d9b640 1 -- 172.21.15.49:0/4282109769 learned_addr learned my addr 172.21.15.49:0/4282109769 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:38.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.411+0000 7f2f9ad9d640 1 --2- 172.21.15.49:0/4282109769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f9c151720 0x7f2f9c1f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:38.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.411+0000 7f2f9a59c640 1 --2- 172.21.15.49:0/4282109769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f9c0c40e0 0x7f2f9c1fa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:38.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.415+0000 7f2f99d9b640 1 -- 172.21.15.49:0/4282109769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f9c151720 msgr2=0x7f2f9c1f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:38.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.415+0000 7f2f99d9b640 1 --2- 172.21.15.49:0/4282109769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f9c151720 0x7f2f9c1f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:38.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.415+0000 7f2f99d9b640 1 -- 172.21.15.49:0/4282109769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f9c0c40e0 msgr2=0x7f2f9c1fa3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:38.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.415+0000 7f2f99d9b640 1 --2- 172.21.15.49:0/4282109769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f9c0c40e0 0x7f2f9c1fa3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:38.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.415+0000 7f2f99d9b640 1 -- 172.21.15.49:0/4282109769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f900094d0 con 0x7f2f9c151340 2023-11-18T21:28:38.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.419+0000 7f2f99d9b640 1 --2- 172.21.15.49:0/4282109769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c151340 0x7f2f9c0c5e60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2f9001ab80 tx=0x7f2f90019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.423+0000 7f2f8affd640 1 -- 172.21.15.49:0/4282109769 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900b6440 con 0x7f2f9c151340 2023-11-18T21:28:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.423+0000 7f2f8affd640 1 -- 172.21.15.49:0/4282109769 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f900b65a0 con 0x7f2f9c151340 2023-11-18T21:28:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.423+0000 7f2f8affd640 1 -- 172.21.15.49:0/4282109769 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900b6950 con 0x7f2f9c151340 2023-11-18T21:28:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.423+0000 7f2fa097a640 1 -- 172.21.15.49:0/4282109769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c1fa920 con 0x7f2f9c151340 2023-11-18T21:28:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.423+0000 7f2fa097a640 1 -- 172.21.15.49:0/4282109769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9c1f6700 con 0x7f2f9c151340 2023-11-18T21:28:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.423+0000 7f2fa097a640 1 -- 172.21.15.49:0/4282109769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9c1f6890 con 0x7f2f9c151340 2023-11-18T21:28:38.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.443+0000 7f2f8affd640 1 -- 172.21.15.49:0/4282109769 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2f900b6ab0 con 0x7f2f9c151340 2023-11-18T21:28:38.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.443+0000 7f2f8affd640 1 --2- 172.21.15.49:0/4282109769 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2f7c0664f0 0x7f2f7c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:38.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.447+0000 7f2f9a59c640 1 --2- 172.21.15.49:0/4282109769 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2f7c0664f0 0x7f2f7c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:38.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.447+0000 7f2f9a59c640 1 --2- 172.21.15.49:0/4282109769 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2f7c0664f0 0x7f2f7c0689b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009b60 tx=0x7f2f8c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:38.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.447+0000 7f2f8affd640 1 -- 172.21.15.49:0/4282109769 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f2f900efa30 con 0x7f2f9c151340 2023-11-18T21:28:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.727+0000 7f2f8affd640 1 -- 172.21.15.49:0/4282109769 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2f900ebd70 con 0x7f2f9c151340 2023-11-18T21:28:38.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:38.895+0000 7f2fa097a640 1 -- 172.21.15.49:0/4282109769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f9c1fa920 con 0x7f2f9c151340 2023-11-18T21:28:39.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.115+0000 7f2f8affd640 1 -- 172.21.15.49:0/4282109769 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18408 (secure 0 0 0) 0x7f2f9c1fa920 con 0x7f2f9c151340 2023-11-18T21:28:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:28:39.114 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":31,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T21:00:28.529922+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T21:28:39.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.119+0000 7f2fa097a640 1 -- 172.21.15.49:0/4282109769 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2f7c0664f0 msgr2=0x7f2f7c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.119+0000 7f2fa097a640 1 --2- 172.21.15.49:0/4282109769 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2f7c0664f0 0x7f2f7c0689b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009b60 tx=0x7f2f8c009190 comp rx=0 tx=0).stop 2023-11-18T21:28:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.119+0000 7f2fa097a640 1 -- 172.21.15.49:0/4282109769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c151340 msgr2=0x7f2f9c0c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.119+0000 7f2fa097a640 1 --2- 172.21.15.49:0/4282109769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c151340 0x7f2f9c0c5e60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2f9001ab80 tx=0x7f2f90019270 comp rx=0 tx=0).stop 2023-11-18T21:28:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.119+0000 7f2fa097a640 1 -- 172.21.15.49:0/4282109769 shutdown_connections 2023-11-18T21:28:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.119+0000 7f2fa097a640 1 --2- 172.21.15.49:0/4282109769 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2f7c0664f0 0x7f2f7c0689b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.119+0000 7f2fa097a640 1 --2- 172.21.15.49:0/4282109769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f9c151720 0x7f2f9c1f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.119+0000 7f2fa097a640 1 --2- 172.21.15.49:0/4282109769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c151340 0x7f2f9c0c5e60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.119+0000 7f2fa097a640 1 --2- 172.21.15.49:0/4282109769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f9c0c40e0 0x7f2f9c1fa3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.119+0000 7f2fa097a640 1 -- 172.21.15.49:0/4282109769 >> 172.21.15.49:0/4282109769 conn(0x7f2f9c06c6a0 msgr2=0x7f2f9c161420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.119+0000 7f2fa097a640 1 -- 172.21.15.49:0/4282109769 shutdown_connections 2023-11-18T21:28:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.119+0000 7f2fa097a640 1 -- 172.21.15.49:0/4282109769 wait complete. 2023-11-18T21:28:39.142 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T20:58:42.362631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T20:59:22.756454+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T20:59:25.252588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-18T20:59:33.423071+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-18T21:28:39.143 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T21:28:39.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.271+0000 7f254f1c5640 1 Processor -- start 2023-11-18T21:28:39.269 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.271+0000 7f254f1c5640 1 -- start start 2023-11-18T21:28:39.270 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.271+0000 7f254f1c5640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25480722f0 0x7f25480726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:39.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.271+0000 7f254f1c5640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2548159590 con 0x7f254815a130 2023-11-18T21:28:39.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.271+0000 7f254f1c5640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2548156190 con 0x7f25480c66d0 2023-11-18T21:28:39.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.271+0000 7f254f1c5640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2548155fa0 con 0x7f25480722f0 2023-11-18T21:28:39.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.279+0000 7f254d762640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f254815a130 0x7f2548160920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36502/0 (socket says 172.21.15.49:36502) 2023-11-18T21:28:39.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.279+0000 7f254d762640 1 -- 172.21.15.49:0/1911258142 learned_addr learned my addr 172.21.15.49:0/1911258142 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:39.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.279+0000 7f25477fe640 1 -- 172.21.15.49:0/1911258142 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173029405 0 0) 0x7f2548159590 con 0x7f254815a130 2023-11-18T21:28:39.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.279+0000 7f25477fe640 1 -- 172.21.15.49:0/1911258142 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2538003530 con 0x7f254815a130 2023-11-18T21:28:39.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.287+0000 7f25477fe640 1 -- 172.21.15.49:0/1911258142 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 362142807 0 0) 0x7f2538003530 con 0x7f254815a130 2023-11-18T21:28:39.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.287+0000 7f25477fe640 1 -- 172.21.15.49:0/1911258142 >> v2:172.21.15.106:3300/0 conn(0x7f25480722f0 msgr2=0x7f25480726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:39.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.287+0000 7f25477fe640 1 --2- 172.21.15.49:0/1911258142 >> v2:172.21.15.106:3300/0 conn(0x7f25480722f0 0x7f25480726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.287+0000 7f25477fe640 1 -- 172.21.15.49:0/1911258142 >> v1:172.21.15.106:6789/0 conn(0x7f25480c66d0 legacy=0x7f2548159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:39.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.287+0000 7f25477fe640 1 -- 172.21.15.49:0/1911258142 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2548156470 con 0x7f254815a130 2023-11-18T21:28:39.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.287+0000 7f25477fe640 1 -- 172.21.15.49:0/1911258142 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7f2540001a00 con 0x7f254815a130 2023-11-18T21:28:39.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.287+0000 7f25477fe640 1 -- 172.21.15.49:0/1911258142 >> v1:172.21.15.49:6789/0 conn(0x7f254815a130 legacy=0x7f2548160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:39.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.287+0000 7f25477fe640 1 --2- 172.21.15.49:0/1911258142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2538003a40 0x7f2538003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:39.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.287+0000 7f25477fe640 1 --2- 172.21.15.49:0/1911258142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25380047d0 0x7f2538004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:39.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.287+0000 7f25477fe640 1 --2- 172.21.15.49:0/1911258142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25380053e0 0x7f253800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:39.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.287+0000 7f25477fe640 1 -- 172.21.15.49:0/1911258142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253800c2c0 con 0x7f25380053e0 2023-11-18T21:28:39.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.287+0000 7f25477fe640 1 -- 172.21.15.49:0/1911258142 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253800c430 con 0x7f25380047d0 2023-11-18T21:28:39.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.287+0000 7f25477fe640 1 -- 172.21.15.49:0/1911258142 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253800c5f0 con 0x7f2538003a40 2023-11-18T21:28:39.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.291+0000 7f254d762640 1 --2- 172.21.15.49:0/1911258142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25380053e0 0x7f253800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:39.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.295+0000 7f254d762640 1 -- 172.21.15.49:0/1911258142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2538003a40 msgr2=0x7f2538003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:39.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.295+0000 7f254d762640 1 --2- 172.21.15.49:0/1911258142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2538003a40 0x7f2538003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.295+0000 7f254d762640 1 -- 172.21.15.49:0/1911258142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25380047d0 msgr2=0x7f2538004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:39.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.295+0000 7f254d762640 1 --2- 172.21.15.49:0/1911258142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25380047d0 0x7f2538004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.295+0000 7f254d762640 1 -- 172.21.15.49:0/1911258142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2538003530 con 0x7f25380053e0 2023-11-18T21:28:39.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.299+0000 7f254d762640 1 -- 172.21.15.49:0/1911258142 reap_dead start 2023-11-18T21:28:39.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.299+0000 7f254d762640 1 --2- 172.21.15.49:0/1911258142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25380053e0 0x7f253800ba10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f254000a810 tx=0x7f254001fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d8d34522cd1183 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:39.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.307+0000 7f25477fe640 1 -- 172.21.15.49:0/1911258142 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25400aa620 con 0x7f25380053e0 2023-11-18T21:28:39.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.307+0000 7f25477fe640 1 -- 172.21.15.49:0/1911258142 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25400aa7c0 con 0x7f25380053e0 2023-11-18T21:28:39.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.307+0000 7f25477fe640 1 -- 172.21.15.49:0/1911258142 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25400aab70 con 0x7f25380053e0 2023-11-18T21:28:39.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 -- 172.21.15.49:0/1911258142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25380053e0 msgr2=0x7f253800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:39.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 --2- 172.21.15.49:0/1911258142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25380053e0 0x7f253800ba10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f254000a810 tx=0x7f254001fa80 comp rx=0 tx=0).stop 2023-11-18T21:28:39.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 -- 172.21.15.49:0/1911258142 shutdown_connections 2023-11-18T21:28:39.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 --2- 172.21.15.49:0/1911258142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25380053e0 0x7f253800ba10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 -- 172.21.15.49:0/1911258142 >> 172.21.15.49:0/1911258142 conn(0x7f254806b670 msgr2=0x7f254806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:39.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 -- 172.21.15.49:0/1911258142 shutdown_connections 2023-11-18T21:28:39.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 -- 172.21.15.49:0/1911258142 wait complete. 2023-11-18T21:28:39.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 Processor -- start 2023-11-18T21:28:39.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 -- start start 2023-11-18T21:28:39.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25380053e0 0x7f2548145770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2548155af0 0x7f2548145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f254814b480 0x7f254814b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2548144680 con 0x7f25380053e0 2023-11-18T21:28:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2548142f80 con 0x7f254814b480 2023-11-18T21:28:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.311+0000 7f254f1c5640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254814be40 con 0x7f2548155af0 2023-11-18T21:28:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.315+0000 7f254cf61640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25380053e0 0x7f2548145770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.315+0000 7f254cf61640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25380053e0 0x7f2548145770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40274/0 (socket says 172.21.15.49:40274) 2023-11-18T21:28:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.315+0000 7f254cf61640 1 -- 172.21.15.49:0/823222112 learned_addr learned my addr 172.21.15.49:0/823222112 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.315+0000 7f254cf61640 1 -- 172.21.15.49:0/823222112 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2548155af0 msgr2=0x7f2548145cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.315+0000 7f254cf61640 1 --2- 172.21.15.49:0/823222112 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2548155af0 0x7f2548145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.315+0000 7f254cf61640 1 -- 172.21.15.49:0/823222112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f254814b480 msgr2=0x7f254814b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.315+0000 7f254cf61640 1 --2- 172.21.15.49:0/823222112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f254814b480 0x7f254814b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.315+0000 7f254cf61640 1 -- 172.21.15.49:0/823222112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25481431d0 con 0x7f25380053e0 2023-11-18T21:28:39.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.319+0000 7f254cf61640 1 --2- 172.21.15.49:0/823222112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25380053e0 0x7f2548145770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f253c00b3c0 tx=0x7f253c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:39.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.323+0000 7f25457fa640 1 -- 172.21.15.49:0/823222112 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c011830 con 0x7f25380053e0 2023-11-18T21:28:39.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.323+0000 7f25457fa640 1 -- 172.21.15.49:0/823222112 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253c011990 con 0x7f25380053e0 2023-11-18T21:28:39.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.323+0000 7f254f1c5640 1 -- 172.21.15.49:0/823222112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25481434b0 con 0x7f25380053e0 2023-11-18T21:28:39.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.323+0000 7f25457fa640 1 -- 172.21.15.49:0/823222112 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c011d40 con 0x7f25380053e0 2023-11-18T21:28:39.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.323+0000 7f254f1c5640 1 -- 172.21.15.49:0/823222112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2548143a70 con 0x7f25380053e0 2023-11-18T21:28:39.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.327+0000 7f254f1c5640 1 -- 172.21.15.49:0/823222112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2548073e70 con 0x7f25380053e0 2023-11-18T21:28:39.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.347+0000 7f25457fa640 1 -- 172.21.15.49:0/823222112 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f253c01b460 con 0x7f25380053e0 2023-11-18T21:28:39.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.347+0000 7f25457fa640 1 --2- 172.21.15.49:0/823222112 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f252c0664f0 0x7f252c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.347+0000 7f2547fff640 1 --2- 172.21.15.49:0/823222112 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f252c0664f0 0x7f252c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.347+0000 7f2547fff640 1 --2- 172.21.15.49:0/823222112 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f252c0664f0 0x7f252c0689b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2534007fd0 tx=0x7f25340079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.347+0000 7f25457fa640 1 -- 172.21.15.49:0/823222112 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f253c055f10 con 0x7f25380053e0 2023-11-18T21:28:39.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.615+0000 7f25457fa640 1 -- 172.21.15.49:0/823222112 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f253c051b50 con 0x7f25380053e0 2023-11-18T21:28:39.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.795+0000 7f254f1c5640 1 -- 172.21.15.49:0/823222112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25480c64b0 con 0x7f25380053e0 2023-11-18T21:28:39.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.823+0000 7f25457fa640 1 -- 172.21.15.49:0/823222112 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f253c055170 con 0x7f25380053e0 2023-11-18T21:28:39.825 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-11-18T21:28:39.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.827+0000 7f254f1c5640 1 -- 172.21.15.49:0/823222112 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f252c0664f0 msgr2=0x7f252c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:39.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.827+0000 7f254f1c5640 1 --2- 172.21.15.49:0/823222112 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f252c0664f0 0x7f252c0689b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2534007fd0 tx=0x7f25340079a0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.827+0000 7f254f1c5640 1 -- 172.21.15.49:0/823222112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25380053e0 msgr2=0x7f2548145770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:39.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.827+0000 7f254f1c5640 1 --2- 172.21.15.49:0/823222112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25380053e0 0x7f2548145770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f253c00b3c0 tx=0x7f253c00b880 comp rx=0 tx=0).stop 2023-11-18T21:28:39.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.827+0000 7f254f1c5640 1 -- 172.21.15.49:0/823222112 shutdown_connections 2023-11-18T21:28:39.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.827+0000 7f254f1c5640 1 --2- 172.21.15.49:0/823222112 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f252c0664f0 0x7f252c0689b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.827+0000 7f254f1c5640 1 --2- 172.21.15.49:0/823222112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f254814b480 0x7f254814b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.827+0000 7f254f1c5640 1 --2- 172.21.15.49:0/823222112 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2548155af0 0x7f2548145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.827+0000 7f254f1c5640 1 --2- 172.21.15.49:0/823222112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25380053e0 0x7f2548145770 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:39.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.827+0000 7f254f1c5640 1 -- 172.21.15.49:0/823222112 >> 172.21.15.49:0/823222112 conn(0x7f254806b670 msgr2=0x7f25480c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:39.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.827+0000 7f254f1c5640 1 -- 172.21.15.49:0/823222112 shutdown_connections 2023-11-18T21:28:39.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.827+0000 7f254f1c5640 1 -- 172.21.15.49:0/823222112 wait complete. 2023-11-18T21:28:39.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T21:28:39.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.983+0000 7f534eaf0640 1 Processor -- start 2023-11-18T21:28:39.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.983+0000 7f534eaf0640 1 -- start start 2023-11-18T21:28:39.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.983+0000 7f534eaf0640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53481515c0 0x7f53480c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:39.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.983+0000 7f534eaf0640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5348157450 con 0x7f534806b7a0 2023-11-18T21:28:39.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.983+0000 7f534eaf0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5348158290 con 0x7f53481511e0 2023-11-18T21:28:39.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:39.983+0000 7f534eaf0640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5348157710 con 0x7f53481515c0 2023-11-18T21:28:40.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.007+0000 7f534d08d640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f534806b7a0 0x7f534815ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36514/0 (socket says 172.21.15.49:36514) 2023-11-18T21:28:40.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.007+0000 7f534d08d640 1 -- 172.21.15.49:0/1737269497 learned_addr learned my addr 172.21.15.49:0/1737269497 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:40.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.011+0000 7f53477fe640 1 -- 172.21.15.49:0/1737269497 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545741371 0 0) 0x7f5348157450 con 0x7f534806b7a0 2023-11-18T21:28:40.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.011+0000 7f53477fe640 1 -- 172.21.15.49:0/1737269497 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5330003530 con 0x7f534806b7a0 2023-11-18T21:28:40.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.019+0000 7f53477fe640 1 -- 172.21.15.49:0/1737269497 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1243596821 0 0) 0x7f5330003530 con 0x7f534806b7a0 2023-11-18T21:28:40.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.019+0000 7f53477fe640 1 -- 172.21.15.49:0/1737269497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53481515c0 msgr2=0x7f53480c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:40.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.019+0000 7f53477fe640 1 --2- 172.21.15.49:0/1737269497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53481515c0 0x7f53480c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.019+0000 7f53477fe640 1 -- 172.21.15.49:0/1737269497 >> v1:172.21.15.106:6789/0 conn(0x7f53481511e0 legacy=0x7f534806a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:40.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.019+0000 7f53477fe640 1 -- 172.21.15.49:0/1737269497 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53481579f0 con 0x7f534806b7a0 2023-11-18T21:28:40.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.019+0000 7f53477fe640 1 -- 172.21.15.49:0/1737269497 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7f5340001a00 con 0x7f534806b7a0 2023-11-18T21:28:40.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.019+0000 7f53477fe640 1 -- 172.21.15.49:0/1737269497 >> v1:172.21.15.49:6789/0 conn(0x7f534806b7a0 legacy=0x7f534815ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:40.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.019+0000 7f53477fe640 1 --2- 172.21.15.49:0/1737269497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5330003a20 0x7f5330003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:40.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.019+0000 7f53477fe640 1 --2- 172.21.15.49:0/1737269497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53481515c0 0x7f53300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:40.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.019+0000 7f53477fe640 1 --2- 172.21.15.49:0/1737269497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5330004e30 0x7f533000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:40.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.019+0000 7f53477fe640 1 -- 172.21.15.49:0/1737269497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5348157710 con 0x7f5330003a20 2023-11-18T21:28:40.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.019+0000 7f53477fe640 1 -- 172.21.15.49:0/1737269497 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53300055e0 con 0x7f5330004e30 2023-11-18T21:28:40.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.019+0000 7f53477fe640 1 -- 172.21.15.49:0/1737269497 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533000bed0 con 0x7f53481515c0 2023-11-18T21:28:40.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.027+0000 7f534c88c640 1 --2- 172.21.15.49:0/1737269497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5330003a20 0x7f5330003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:40.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.031+0000 7f534c88c640 1 -- 172.21.15.49:0/1737269497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53481515c0 msgr2=0x7f53300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:40.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.031+0000 7f534c88c640 1 --2- 172.21.15.49:0/1737269497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53481515c0 0x7f53300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.031+0000 7f534c88c640 1 -- 172.21.15.49:0/1737269497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5330004e30 msgr2=0x7f533000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:40.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.031+0000 7f534c88c640 1 --2- 172.21.15.49:0/1737269497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5330004e30 0x7f533000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.031+0000 7f534c88c640 1 -- 172.21.15.49:0/1737269497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5330003530 con 0x7f5330003a20 2023-11-18T21:28:40.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.043+0000 7f534c88c640 1 --2- 172.21.15.49:0/1737269497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5330003a20 0x7f5330003e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5338001680 tx=0x7f533801c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3530b6cb4dc8795 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:40.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.047+0000 7f53477fe640 1 -- 172.21.15.49:0/1737269497 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338005270 con 0x7f5330003a20 2023-11-18T21:28:40.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.047+0000 7f53477fe640 1 -- 172.21.15.49:0/1737269497 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53380a7070 con 0x7f5330003a20 2023-11-18T21:28:40.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.047+0000 7f53477fe640 1 -- 172.21.15.49:0/1737269497 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338003620 con 0x7f5330003a20 2023-11-18T21:28:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.051+0000 7f534eaf0640 1 -- 172.21.15.49:0/1737269497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5330003a20 msgr2=0x7f5330003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.051+0000 7f534eaf0640 1 --2- 172.21.15.49:0/1737269497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5330003a20 0x7f5330003e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5338001680 tx=0x7f533801c2e0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.051+0000 7f534d08d640 1 -- 172.21.15.49:0/1737269497 reap_dead start 2023-11-18T21:28:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.051+0000 7f534eaf0640 1 -- 172.21.15.49:0/1737269497 shutdown_connections 2023-11-18T21:28:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.051+0000 7f534eaf0640 1 -- 172.21.15.49:0/1737269497 >> 172.21.15.49:0/1737269497 conn(0x7f534806d220 msgr2=0x7f534806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.051+0000 7f534eaf0640 1 -- 172.21.15.49:0/1737269497 shutdown_connections 2023-11-18T21:28:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.051+0000 7f534eaf0640 1 -- 172.21.15.49:0/1737269497 wait complete. 2023-11-18T21:28:40.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.051+0000 7f534eaf0640 1 Processor -- start 2023-11-18T21:28:40.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.051+0000 7f534eaf0640 1 -- start start 2023-11-18T21:28:40.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.055+0000 7f534eaf0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53481556d0 0x7f534813c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:40.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.055+0000 7f534eaf0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5348155ab0 0x7f534813b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:40.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.055+0000 7f534eaf0640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f534813b730 0x7f5348141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:40.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.055+0000 7f534eaf0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5348156240 con 0x7f5348155ab0 2023-11-18T21:28:40.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.055+0000 7f534eaf0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534813bbb0 con 0x7f53481556d0 2023-11-18T21:28:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.055+0000 7f534eaf0640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5348155fa0 con 0x7f534813b730 2023-11-18T21:28:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.055+0000 7f5347fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5348155ab0 0x7f534813b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.055+0000 7f5347fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5348155ab0 0x7f534813b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40280/0 (socket says 172.21.15.49:40280) 2023-11-18T21:28:40.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.055+0000 7f5347fff640 1 -- 172.21.15.49:0/1473621498 learned_addr learned my addr 172.21.15.49:0/1473621498 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:40.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.055+0000 7f534c88c640 1 --2- 172.21.15.49:0/1473621498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53481556d0 0x7f534813c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:40.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.059+0000 7f5347fff640 1 -- 172.21.15.49:0/1473621498 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f534813b730 msgr2=0x7f5348141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:40.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.059+0000 7f5347fff640 1 --2- 172.21.15.49:0/1473621498 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f534813b730 0x7f5348141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.059+0000 7f5347fff640 1 -- 172.21.15.49:0/1473621498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53481556d0 msgr2=0x7f534813c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:40.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.059+0000 7f5347fff640 1 --2- 172.21.15.49:0/1473621498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53481556d0 0x7f534813c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.059+0000 7f5347fff640 1 -- 172.21.15.49:0/1473621498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53480cc0b0 con 0x7f5348155ab0 2023-11-18T21:28:40.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.059+0000 7f5347fff640 1 --2- 172.21.15.49:0/1473621498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5348155ab0 0x7f534813b1f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f533c00b500 tx=0x7f533c00b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:40.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.063+0000 7f53457fa640 1 -- 172.21.15.49:0/1473621498 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c010870 con 0x7f5348155ab0 2023-11-18T21:28:40.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.063+0000 7f53457fa640 1 -- 172.21.15.49:0/1473621498 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c0109d0 con 0x7f5348155ab0 2023-11-18T21:28:40.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.063+0000 7f534eaf0640 1 -- 172.21.15.49:0/1473621498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53481ed8f0 con 0x7f5348155ab0 2023-11-18T21:28:40.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.063+0000 7f53457fa640 1 -- 172.21.15.49:0/1473621498 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c010d60 con 0x7f5348155ab0 2023-11-18T21:28:40.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.063+0000 7f534eaf0640 1 -- 172.21.15.49:0/1473621498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534813a730 con 0x7f5348155ab0 2023-11-18T21:28:40.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.067+0000 7f534eaf0640 1 -- 172.21.15.49:0/1473621498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5348073e70 con 0x7f5348155ab0 2023-11-18T21:28:40.087 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.087+0000 7f53457fa640 1 -- 172.21.15.49:0/1473621498 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f533c023480 con 0x7f5348155ab0 2023-11-18T21:28:40.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.087+0000 7f53457fa640 1 --2- 172.21.15.49:0/1473621498 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f53340664f0 0x7f53340689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:40.088 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.087+0000 7f534c88c640 1 --2- 172.21.15.49:0/1473621498 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f53340664f0 0x7f53340689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:40.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.087+0000 7f534c88c640 1 --2- 172.21.15.49:0/1473621498 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f53340664f0 0x7f53340689b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f53380aa000 tx=0x7f5338005040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:40.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.399+0000 7f53457fa640 1 -- 172.21.15.49:0/1473621498 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f533c055400 con 0x7f5348155ab0 2023-11-18T21:28:40.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.399+0000 7f53457fa640 1 -- 172.21.15.49:0/1473621498 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f533c051740 con 0x7f5348155ab0 2023-11-18T21:28:40.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.575+0000 7f534eaf0640 1 -- 172.21.15.49:0/1473621498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53480c8660 con 0x7f5348155ab0 2023-11-18T21:28:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.595+0000 7f53457fa640 1 -- 172.21.15.49:0/1473621498 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f533c0140a0 con 0x7f5348155ab0 2023-11-18T21:28:40.597 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-11-18T21:28:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.599+0000 7f534eaf0640 1 -- 172.21.15.49:0/1473621498 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f53340664f0 msgr2=0x7f53340689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.599+0000 7f534eaf0640 1 --2- 172.21.15.49:0/1473621498 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f53340664f0 0x7f53340689b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f53380aa000 tx=0x7f5338005040 comp rx=0 tx=0).stop 2023-11-18T21:28:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.599+0000 7f534eaf0640 1 -- 172.21.15.49:0/1473621498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5348155ab0 msgr2=0x7f534813b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.599+0000 7f534eaf0640 1 --2- 172.21.15.49:0/1473621498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5348155ab0 0x7f534813b1f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f533c00b500 tx=0x7f533c00b9c0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.599+0000 7f534eaf0640 1 -- 172.21.15.49:0/1473621498 shutdown_connections 2023-11-18T21:28:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.599+0000 7f534eaf0640 1 --2- 172.21.15.49:0/1473621498 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f53340664f0 0x7f53340689b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.599+0000 7f534eaf0640 1 --2- 172.21.15.49:0/1473621498 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f534813b730 0x7f5348141800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.599+0000 7f534eaf0640 1 --2- 172.21.15.49:0/1473621498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5348155ab0 0x7f534813b1f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.599+0000 7f534eaf0640 1 --2- 172.21.15.49:0/1473621498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53481556d0 0x7f534813c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.599+0000 7f534eaf0640 1 -- 172.21.15.49:0/1473621498 >> 172.21.15.49:0/1473621498 conn(0x7f534806d220 msgr2=0x7f534814f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.599+0000 7f534eaf0640 1 -- 172.21.15.49:0/1473621498 shutdown_connections 2023-11-18T21:28:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.599+0000 7f534eaf0640 1 -- 172.21.15.49:0/1473621498 wait complete. 2023-11-18T21:28:40.621 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T21:28:40.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.751+0000 7f3819b82640 1 Processor -- start 2023-11-18T21:28:40.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.751+0000 7f3819b82640 1 -- start start 2023-11-18T21:28:40.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.751+0000 7f3819b82640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f38140ccd30 0x7f38140c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:40.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.751+0000 7f3819b82640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f381415c9e0 0x7f38141532b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:40.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.751+0000 7f3819b82640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38140c92c0 con 0x7f38140cd110 2023-11-18T21:28:40.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.751+0000 7f3819b82640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381406ec00 con 0x7f38140ccd30 2023-11-18T21:28:40.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.751+0000 7f3819b82640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38141593f0 con 0x7f381415c9e0 2023-11-18T21:28:40.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.751+0000 7f38137fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f38140ccd30 0x7f38140c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:40.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.751+0000 7f38137fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f38140ccd30 0x7f38140c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40294/0 (socket says 172.21.15.49:40294) 2023-11-18T21:28:40.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.751+0000 7f38137fe640 1 -- 172.21.15.49:0/1309736167 learned_addr learned my addr 172.21.15.49:0/1309736167 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:40.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.751+0000 7f3813fff640 1 --2- 172.21.15.49:0/1309736167 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f381415c9e0 0x7f38141532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:40.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.755+0000 7f38137fe640 1 -- 172.21.15.49:0/1309736167 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f381415c9e0 msgr2=0x7f38141532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:40.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.755+0000 7f38137fe640 1 --2- 172.21.15.49:0/1309736167 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f381415c9e0 0x7f38141532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.755+0000 7f38137fe640 1 -- 172.21.15.49:0/1309736167 >> v1:172.21.15.106:6789/0 conn(0x7f38140cd110 legacy=0x7f3814159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:40.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.755+0000 7f38137fe640 1 -- 172.21.15.49:0/1309736167 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381415cf20 con 0x7f38140ccd30 2023-11-18T21:28:40.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.759+0000 7f38137fe640 1 --2- 172.21.15.49:0/1309736167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38140ccd30 0x7f38140c8d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3804009870 tx=0x7f380401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f5fbe14501a769 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:40.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.763+0000 7f38127fc640 1 -- 172.21.15.49:0/1309736167 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040ab600 con 0x7f38140ccd30 2023-11-18T21:28:40.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.763+0000 7f38127fc640 1 -- 172.21.15.49:0/1309736167 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38040a7050 con 0x7f38140ccd30 2023-11-18T21:28:40.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.763+0000 7f38127fc640 1 -- 172.21.15.49:0/1309736167 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040ab980 con 0x7f38140ccd30 2023-11-18T21:28:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 -- 172.21.15.49:0/1309736167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38140ccd30 msgr2=0x7f38140c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 --2- 172.21.15.49:0/1309736167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38140ccd30 0x7f38140c8d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3804009870 tx=0x7f380401c540 comp rx=0 tx=0).stop 2023-11-18T21:28:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 -- 172.21.15.49:0/1309736167 shutdown_connections 2023-11-18T21:28:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 --2- 172.21.15.49:0/1309736167 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f381415c9e0 0x7f38141532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 --2- 172.21.15.49:0/1309736167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38140ccd30 0x7f38140c8d80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 -- 172.21.15.49:0/1309736167 >> 172.21.15.49:0/1309736167 conn(0x7f38140708a0 msgr2=0x7f3814070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:40.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 -- 172.21.15.49:0/1309736167 shutdown_connections 2023-11-18T21:28:40.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 -- 172.21.15.49:0/1309736167 wait complete. 2023-11-18T21:28:40.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 Processor -- start 2023-11-18T21:28:40.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 -- start start 2023-11-18T21:28:40.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38140ccd30 0x7f38140cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:40.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38140cd110 0x7f3814150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:40.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f381415c9e0 0x7f381415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:40.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38141f2dc0 con 0x7f381415c9e0 2023-11-18T21:28:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3814145fb0 con 0x7f38140ccd30 2023-11-18T21:28:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3819b82640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381415c440 con 0x7f38140cd110 2023-11-18T21:28:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3813fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f381415c9e0 0x7f381415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3813fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f381415c9e0 0x7f381415a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40304/0 (socket says 172.21.15.49:40304) 2023-11-18T21:28:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.767+0000 7f3813fff640 1 -- 172.21.15.49:0/4177526156 learned_addr learned my addr 172.21.15.49:0/4177526156 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:40.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.771+0000 7f38137fe640 1 --2- 172.21.15.49:0/4177526156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38140ccd30 0x7f38140cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:40.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.771+0000 7f3812ffd640 1 --2- 172.21.15.49:0/4177526156 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38140cd110 0x7f3814150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:40.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.771+0000 7f3813fff640 1 -- 172.21.15.49:0/4177526156 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38140cd110 msgr2=0x7f3814150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:40.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.771+0000 7f3813fff640 1 --2- 172.21.15.49:0/4177526156 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38140cd110 0x7f3814150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.771+0000 7f3813fff640 1 -- 172.21.15.49:0/4177526156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38140ccd30 msgr2=0x7f38140cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:40.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.771+0000 7f3813fff640 1 --2- 172.21.15.49:0/4177526156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38140ccd30 0x7f38140cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:40.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.771+0000 7f3813fff640 1 -- 172.21.15.49:0/4177526156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38040094d0 con 0x7f381415c9e0 2023-11-18T21:28:40.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.775+0000 7f3813fff640 1 --2- 172.21.15.49:0/4177526156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f381415c9e0 0x7f381415a5b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f380c007e40 tx=0x7f380c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:40.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.779+0000 7f37fbfff640 1 -- 172.21.15.49:0/4177526156 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c014620 con 0x7f381415c9e0 2023-11-18T21:28:40.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.779+0000 7f37fbfff640 1 -- 172.21.15.49:0/4177526156 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c00ee90 con 0x7f381415c9e0 2023-11-18T21:28:40.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.779+0000 7f37fbfff640 1 -- 172.21.15.49:0/4177526156 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c0149e0 con 0x7f381415c9e0 2023-11-18T21:28:40.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.779+0000 7f3819b82640 1 -- 172.21.15.49:0/4177526156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38141f2420 con 0x7f381415c9e0 2023-11-18T21:28:40.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.779+0000 7f3819b82640 1 -- 172.21.15.49:0/4177526156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38141f29e0 con 0x7f381415c9e0 2023-11-18T21:28:40.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.783+0000 7f3819b82640 1 -- 172.21.15.49:0/4177526156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38141f2ba0 con 0x7f381415c9e0 2023-11-18T21:28:40.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.803+0000 7f37fbfff640 1 -- 172.21.15.49:0/4177526156 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f380c014b40 con 0x7f381415c9e0 2023-11-18T21:28:40.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.803+0000 7f37fbfff640 1 --2- 172.21.15.49:0/4177526156 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f38000664f0 0x7f38000689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:40.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.803+0000 7f38137fe640 1 --2- 172.21.15.49:0/4177526156 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f38000664f0 0x7f38000689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:40.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:40.803+0000 7f38137fe640 1 --2- 172.21.15.49:0/4177526156 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f38000664f0 0x7f38000689b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f38140cd7a0 tx=0x7f38040a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:41.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.163+0000 7f37fbfff640 1 -- 172.21.15.49:0/4177526156 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f380c0567a0 con 0x7f381415c9e0 2023-11-18T21:28:41.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.163+0000 7f37fbfff640 1 -- 172.21.15.49:0/4177526156 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f380c052ae0 con 0x7f381415c9e0 2023-11-18T21:28:41.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.355+0000 7f3819b82640 1 -- 172.21.15.49:0/4177526156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38141f2f00 con 0x7f381415c9e0 2023-11-18T21:28:41.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.363+0000 7f37fbfff640 1 -- 172.21.15.49:0/4177526156 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38141f2f00 con 0x7f381415c9e0 2023-11-18T21:28:41.362 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2023-11-18T21:28:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.363+0000 7f3819b82640 1 -- 172.21.15.49:0/4177526156 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f38000664f0 msgr2=0x7f38000689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.363+0000 7f3819b82640 1 --2- 172.21.15.49:0/4177526156 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f38000664f0 0x7f38000689b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f38140cd7a0 tx=0x7f38040a6000 comp rx=0 tx=0).stop 2023-11-18T21:28:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.363+0000 7f3819b82640 1 -- 172.21.15.49:0/4177526156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f381415c9e0 msgr2=0x7f381415a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.363+0000 7f3819b82640 1 --2- 172.21.15.49:0/4177526156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f381415c9e0 0x7f381415a5b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f380c007e40 tx=0x7f380c00e4b0 comp rx=0 tx=0).stop 2023-11-18T21:28:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.363+0000 7f3819b82640 1 -- 172.21.15.49:0/4177526156 shutdown_connections 2023-11-18T21:28:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.363+0000 7f3819b82640 1 --2- 172.21.15.49:0/4177526156 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f38000664f0 0x7f38000689b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.363+0000 7f3819b82640 1 --2- 172.21.15.49:0/4177526156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f381415c9e0 0x7f381415a5b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.363+0000 7f3819b82640 1 --2- 172.21.15.49:0/4177526156 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38140cd110 0x7f3814150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.363+0000 7f3819b82640 1 --2- 172.21.15.49:0/4177526156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38140ccd30 0x7f38140cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.363+0000 7f3819b82640 1 -- 172.21.15.49:0/4177526156 >> 172.21.15.49:0/4177526156 conn(0x7f38140708a0 msgr2=0x7f3814070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.363+0000 7f3819b82640 1 -- 172.21.15.49:0/4177526156 shutdown_connections 2023-11-18T21:28:41.365 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.363+0000 7f3819b82640 1 -- 172.21.15.49:0/4177526156 wait complete. 2023-11-18T21:28:41.384 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-18T21:28:41.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.511+0000 7f807d595640 1 Processor -- start 2023-11-18T21:28:41.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.511+0000 7f807d595640 1 -- start start 2023-11-18T21:28:41.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.511+0000 7f807d595640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f807814f850 0x7f80780c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:41.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.511+0000 7f807d595640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8078070ab0 0x7f8078160180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:41.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.511+0000 7f807d595640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80780c3b10 con 0x7f80780c1ed0 2023-11-18T21:28:41.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.511+0000 7f807d595640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807814fc30 con 0x7f8078070ab0 2023-11-18T21:28:41.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.511+0000 7f807d595640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80780c11e0 con 0x7f807814f850 2023-11-18T21:28:41.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.511+0000 7f80777fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8078070ab0 0x7f8078160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:41.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.511+0000 7f80777fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8078070ab0 0x7f8078160180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40316/0 (socket says 172.21.15.49:40316) 2023-11-18T21:28:41.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.511+0000 7f80777fe640 1 -- 172.21.15.49:0/2665361398 learned_addr learned my addr 172.21.15.49:0/2665361398 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:41.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.515+0000 7f80777fe640 1 -- 172.21.15.49:0/2665361398 >> v2:172.21.15.106:3300/0 conn(0x7f807814f850 msgr2=0x7f80780c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:41.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.515+0000 7f80777fe640 1 --2- 172.21.15.49:0/2665361398 >> v2:172.21.15.106:3300/0 conn(0x7f807814f850 0x7f80780c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:41.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.515+0000 7f80777fe640 1 -- 172.21.15.49:0/2665361398 >> v1:172.21.15.106:6789/0 conn(0x7f80780c1ed0 legacy=0x7f807806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:41.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.515+0000 7f80777fe640 1 -- 172.21.15.49:0/2665361398 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80780c2410 con 0x7f8078070ab0 2023-11-18T21:28:41.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.515+0000 7f80777fe640 1 --2- 172.21.15.49:0/2665361398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8078070ab0 0x7f8078160180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f807806f120 tx=0x7f807001da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e985b5116c520d3b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:41.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f8075ffb640 1 -- 172.21.15.49:0/2665361398 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807000a2d0 con 0x7f8078070ab0 2023-11-18T21:28:41.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f8075ffb640 1 -- 172.21.15.49:0/2665361398 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80700a6920 con 0x7f8078070ab0 2023-11-18T21:28:41.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f8075ffb640 1 -- 172.21.15.49:0/2665361398 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80700a6cb0 con 0x7f8078070ab0 2023-11-18T21:28:41.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 -- 172.21.15.49:0/2665361398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8078070ab0 msgr2=0x7f8078160180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:41.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 --2- 172.21.15.49:0/2665361398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8078070ab0 0x7f8078160180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f807806f120 tx=0x7f807001da60 comp rx=0 tx=0).stop 2023-11-18T21:28:41.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 -- 172.21.15.49:0/2665361398 shutdown_connections 2023-11-18T21:28:41.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 --2- 172.21.15.49:0/2665361398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8078070ab0 0x7f8078160180 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:41.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 --2- 172.21.15.49:0/2665361398 >> v2:172.21.15.106:3300/0 conn(0x7f807814f850 0x7f80780c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:41.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 -- 172.21.15.49:0/2665361398 >> 172.21.15.49:0/2665361398 conn(0x7f807806c6a0 msgr2=0x7f807806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:41.522 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 -- 172.21.15.49:0/2665361398 shutdown_connections 2023-11-18T21:28:41.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 -- 172.21.15.49:0/2665361398 wait complete. 2023-11-18T21:28:41.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 Processor -- start 2023-11-18T21:28:41.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 -- start start 2023-11-18T21:28:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8078070ab0 0x7f80780c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80780c1ed0 0x7f807814c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f807814f850 0x7f807814d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80781f28a0 con 0x7f80780c1ed0 2023-11-18T21:28:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80781f2d90 con 0x7f807814f850 2023-11-18T21:28:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f807d595640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8078147fb0 con 0x7f8078070ab0 2023-11-18T21:28:41.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f80767fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80780c1ed0 0x7f807814c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:41.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f80767fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80780c1ed0 0x7f807814c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40328/0 (socket says 172.21.15.49:40328) 2023-11-18T21:28:41.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.523+0000 7f80767fc640 1 -- 172.21.15.49:0/2842236880 learned_addr learned my addr 172.21.15.49:0/2842236880 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:41.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.527+0000 7f80767fc640 1 -- 172.21.15.49:0/2842236880 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8078070ab0 msgr2=0x7f80780c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:41.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.527+0000 7f80767fc640 1 --2- 172.21.15.49:0/2842236880 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8078070ab0 0x7f80780c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.527+0000 7f80767fc640 1 -- 172.21.15.49:0/2842236880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f807814f850 msgr2=0x7f807814d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.527+0000 7f80767fc640 1 --2- 172.21.15.49:0/2842236880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f807814f850 0x7f807814d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:41.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.527+0000 7f80767fc640 1 -- 172.21.15.49:0/2842236880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807000ac40 con 0x7f80780c1ed0 2023-11-18T21:28:41.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.531+0000 7f80767fc640 1 --2- 172.21.15.49:0/2842236880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80780c1ed0 0x7f807814c5c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f806c00b3e0 tx=0x7f806c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:41.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.535+0000 7f805f7fe640 1 -- 172.21.15.49:0/2842236880 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c011830 con 0x7f80780c1ed0 2023-11-18T21:28:41.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.535+0000 7f805f7fe640 1 -- 172.21.15.49:0/2842236880 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c011990 con 0x7f80780c1ed0 2023-11-18T21:28:41.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.535+0000 7f805f7fe640 1 -- 172.21.15.49:0/2842236880 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c011d60 con 0x7f80780c1ed0 2023-11-18T21:28:41.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.535+0000 7f807d595640 1 -- 172.21.15.49:0/2842236880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80781f2ab0 con 0x7f80780c1ed0 2023-11-18T21:28:41.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.535+0000 7f807d595640 1 -- 172.21.15.49:0/2842236880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8078148530 con 0x7f80780c1ed0 2023-11-18T21:28:41.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.535+0000 7f807d595640 1 -- 172.21.15.49:0/2842236880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8078067520 con 0x7f80780c1ed0 2023-11-18T21:28:41.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.555+0000 7f805f7fe640 1 -- 172.21.15.49:0/2842236880 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f806c01a400 con 0x7f80780c1ed0 2023-11-18T21:28:41.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.555+0000 7f805f7fe640 1 --2- 172.21.15.49:0/2842236880 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f80640664c0 0x7f8064068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:41.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.555+0000 7f8076ffd640 1 --2- 172.21.15.49:0/2842236880 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f80640664c0 0x7f8064068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:41.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.559+0000 7f8076ffd640 1 --2- 172.21.15.49:0/2842236880 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f80640664c0 0x7f8064068980 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8068009730 tx=0x7f8068006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:41.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.911+0000 7f805f7fe640 1 -- 172.21.15.49:0/2842236880 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f806c055e20 con 0x7f80780c1ed0 2023-11-18T21:28:41.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:41.911+0000 7f805f7fe640 1 -- 172.21.15.49:0/2842236880 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f806c051a60 con 0x7f80780c1ed0 2023-11-18T21:28:42.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.079+0000 7f807d595640 1 -- 172.21.15.49:0/2842236880 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f807806cc00 con 0x7f80780c1ed0 2023-11-18T21:28:42.090 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.091+0000 7f805f7fe640 1 -- 172.21.15.49:0/2842236880 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f806c055080 con 0x7f80780c1ed0 2023-11-18T21:28:42.091 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-11-18T21:28:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.095+0000 7f807d595640 1 -- 172.21.15.49:0/2842236880 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f80640664c0 msgr2=0x7f8064068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.095+0000 7f807d595640 1 --2- 172.21.15.49:0/2842236880 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f80640664c0 0x7f8064068980 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8068009730 tx=0x7f8068006ca0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.095+0000 7f807d595640 1 -- 172.21.15.49:0/2842236880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80780c1ed0 msgr2=0x7f807814c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.095+0000 7f807d595640 1 --2- 172.21.15.49:0/2842236880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80780c1ed0 0x7f807814c5c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f806c00b3e0 tx=0x7f806c00b8a0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.095+0000 7f807d595640 1 -- 172.21.15.49:0/2842236880 shutdown_connections 2023-11-18T21:28:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.095+0000 7f807d595640 1 --2- 172.21.15.49:0/2842236880 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f80640664c0 0x7f8064068980 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.095+0000 7f807d595640 1 --2- 172.21.15.49:0/2842236880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f807814f850 0x7f807814d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.095+0000 7f807d595640 1 --2- 172.21.15.49:0/2842236880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80780c1ed0 0x7f807814c5c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.095+0000 7f807d595640 1 --2- 172.21.15.49:0/2842236880 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8078070ab0 0x7f80780c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.095+0000 7f807d595640 1 -- 172.21.15.49:0/2842236880 >> 172.21.15.49:0/2842236880 conn(0x7f807806c6a0 msgr2=0x7f8078153810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.095+0000 7f807d595640 1 -- 172.21.15.49:0/2842236880 shutdown_connections 2023-11-18T21:28:42.094 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.095+0000 7f807d595640 1 -- 172.21.15.49:0/2842236880 wait complete. 2023-11-18T21:28:42.112 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T21:28:42.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.235+0000 7f885dd52640 1 Processor -- start 2023-11-18T21:28:42.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.235+0000 7f885dd52640 1 -- start start 2023-11-18T21:28:42.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.235+0000 7f885dd52640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8858156220 0x7f885806b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.235+0000 7f885dd52640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88580c7400 0x7f88580cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.235+0000 7f885dd52640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8858159cb0 con 0x7f8858150380 2023-11-18T21:28:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.235+0000 7f885dd52640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88580c4010 con 0x7f8858156220 2023-11-18T21:28:42.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.235+0000 7f885dd52640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580c6770 con 0x7f88580c7400 2023-11-18T21:28:42.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.239+0000 7f8856ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8858156220 0x7f885806b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:42.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.239+0000 7f8857fff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88580c7400 0x7f88580cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:42.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.239+0000 7f8857fff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88580c7400 0x7f88580cb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:54404/0 (socket says 172.21.15.49:54404) 2023-11-18T21:28:42.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.239+0000 7f8857fff640 1 -- 172.21.15.49:0/2900189793 learned_addr learned my addr 172.21.15.49:0/2900189793 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.243+0000 7f8857fff640 1 -- 172.21.15.49:0/2900189793 >> v2:172.21.15.106:3300/0 conn(0x7f8858156220 msgr2=0x7f885806b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.243+0000 7f8857fff640 1 --2- 172.21.15.49:0/2900189793 >> v2:172.21.15.106:3300/0 conn(0x7f8858156220 0x7f885806b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.243+0000 7f8857fff640 1 -- 172.21.15.49:0/2900189793 >> v1:172.21.15.49:6789/0 conn(0x7f8858150380 legacy=0x7f885815a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:42.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.243+0000 7f8857fff640 1 -- 172.21.15.49:0/2900189793 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580c7b70 con 0x7f88580c7400 2023-11-18T21:28:42.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.251+0000 7f8857fff640 1 --2- 172.21.15.49:0/2900189793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88580c7400 0x7f88580cb2c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8850009e50 tx=0x7f885001ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3784d2f68459db00 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:42.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.275+0000 7f88567fc640 1 -- 172.21.15.49:0/2900189793 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88500a7850 con 0x7f88580c7400 2023-11-18T21:28:42.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.275+0000 7f88567fc640 1 -- 172.21.15.49:0/2900189793 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88500a79b0 con 0x7f88580c7400 2023-11-18T21:28:42.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.275+0000 7f88567fc640 1 -- 172.21.15.49:0/2900189793 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88500a7d40 con 0x7f88580c7400 2023-11-18T21:28:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.275+0000 7f885dd52640 1 -- 172.21.15.49:0/2900189793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88580c7400 msgr2=0x7f88580cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.275+0000 7f885dd52640 1 --2- 172.21.15.49:0/2900189793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88580c7400 0x7f88580cb2c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8850009e50 tx=0x7f885001ebb0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.275+0000 7f885dd52640 1 -- 172.21.15.49:0/2900189793 shutdown_connections 2023-11-18T21:28:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.275+0000 7f885dd52640 1 --2- 172.21.15.49:0/2900189793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88580c7400 0x7f88580cb2c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.275+0000 7f885dd52640 1 --2- 172.21.15.49:0/2900189793 >> v2:172.21.15.106:3300/0 conn(0x7f8858156220 0x7f885806b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.275+0000 7f885dd52640 1 -- 172.21.15.49:0/2900189793 >> 172.21.15.49:0/2900189793 conn(0x7f885806d200 msgr2=0x7f885806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.275+0000 7f885dd52640 1 -- 172.21.15.49:0/2900189793 shutdown_connections 2023-11-18T21:28:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.275+0000 7f885dd52640 1 -- 172.21.15.49:0/2900189793 wait complete. 2023-11-18T21:28:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.279+0000 7f885dd52640 1 Processor -- start 2023-11-18T21:28:42.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.279+0000 7f885dd52640 1 -- start start 2023-11-18T21:28:42.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.279+0000 7f885dd52640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88580c7400 0x7f88581588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:42.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.279+0000 7f885dd52640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8858150380 0x7f88581553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:42.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.279+0000 7f885dd52640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8858156220 0x7f8858155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:42.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.279+0000 7f885dd52640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8858148bd0 con 0x7f8858150380 2023-11-18T21:28:42.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.279+0000 7f885dd52640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8858149470 con 0x7f8858156220 2023-11-18T21:28:42.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.279+0000 7f885dd52640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885813e800 con 0x7f88580c7400 2023-11-18T21:28:42.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.311+0000 7f8857fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8858156220 0x7f8858155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:42.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.311+0000 7f8857fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8858156220 0x7f8858155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:36808/0 (socket says 172.21.15.49:36808) 2023-11-18T21:28:42.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.311+0000 7f8857fff640 1 -- 172.21.15.49:0/1454435845 learned_addr learned my addr 172.21.15.49:0/1454435845 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:42.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.319+0000 7f88577fe640 1 --2- 172.21.15.49:0/1454435845 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88580c7400 0x7f88581588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:42.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.323+0000 7f8857fff640 1 -- 172.21.15.49:0/1454435845 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88580c7400 msgr2=0x7f88581588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:42.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.323+0000 7f8857fff640 1 --2- 172.21.15.49:0/1454435845 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88580c7400 0x7f88581588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.323+0000 7f8857fff640 1 -- 172.21.15.49:0/1454435845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8858150380 msgr2=0x7f88581553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:42.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.323+0000 7f8857fff640 1 --2- 172.21.15.49:0/1454435845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8858150380 0x7f88581553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.323+0000 7f8857fff640 1 -- 172.21.15.49:0/1454435845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8850009b30 con 0x7f8858156220 2023-11-18T21:28:42.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.427+0000 7f8857fff640 1 --2- 172.21.15.49:0/1454435845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8858156220 0x7f8858155910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f88500b1040 tx=0x7f885001b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:42.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.435+0000 7f883ffff640 1 -- 172.21.15.49:0/1454435845 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885000e150 con 0x7f8858156220 2023-11-18T21:28:42.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.435+0000 7f883ffff640 1 -- 172.21.15.49:0/1454435845 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88500073f0 con 0x7f8858156220 2023-11-18T21:28:42.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.435+0000 7f883ffff640 1 -- 172.21.15.49:0/1454435845 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850007760 con 0x7f8858156220 2023-11-18T21:28:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.435+0000 7f885dd52640 1 -- 172.21.15.49:0/1454435845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88581f2700 con 0x7f8858156220 2023-11-18T21:28:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.435+0000 7f885dd52640 1 -- 172.21.15.49:0/1454435845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8858148e20 con 0x7f8858156220 2023-11-18T21:28:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.435+0000 7f885dd52640 1 -- 172.21.15.49:0/1454435845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8858073e70 con 0x7f8858156220 2023-11-18T21:28:42.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.715+0000 7f883ffff640 1 -- 172.21.15.49:0/1454435845 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f88500078c0 con 0x7f8858156220 2023-11-18T21:28:42.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.719+0000 7f883ffff640 1 --2- 172.21.15.49:0/1454435845 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f88440664c0 0x7f8844068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:42.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.719+0000 7f88577fe640 1 --2- 172.21.15.49:0/1454435845 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f88440664c0 0x7f8844068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:42.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.719+0000 7f883ffff640 1 -- 172.21.15.49:0/1454435845 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f88500efbd0 con 0x7f8858156220 2023-11-18T21:28:42.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.719+0000 7f88577fe640 1 --2- 172.21.15.49:0/1454435845 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f88440664c0 0x7f8844068980 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f88480016c0 tx=0x7f8848009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:42.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.731+0000 7f883ffff640 1 -- 172.21.15.49:0/1454435845 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88500eb810 con 0x7f8858156220 2023-11-18T21:28:42.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.931+0000 7f885dd52640 1 -- 172.21.15.49:0/1454435845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f88581495b0 con 0x7f8858156220 2023-11-18T21:28:42.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.939+0000 7f883ffff640 1 -- 172.21.15.49:0/1454435845 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f88500be020 con 0x7f8858156220 2023-11-18T21:28:42.940 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2023-11-18T21:28:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.943+0000 7f885dd52640 1 -- 172.21.15.49:0/1454435845 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f88440664c0 msgr2=0x7f8844068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.943+0000 7f885dd52640 1 --2- 172.21.15.49:0/1454435845 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f88440664c0 0x7f8844068980 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f88480016c0 tx=0x7f8848009040 comp rx=0 tx=0).stop 2023-11-18T21:28:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.943+0000 7f885dd52640 1 -- 172.21.15.49:0/1454435845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8858156220 msgr2=0x7f8858155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.943+0000 7f885dd52640 1 --2- 172.21.15.49:0/1454435845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8858156220 0x7f8858155910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f88500b1040 tx=0x7f885001b950 comp rx=0 tx=0).stop 2023-11-18T21:28:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.943+0000 7f885dd52640 1 -- 172.21.15.49:0/1454435845 shutdown_connections 2023-11-18T21:28:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.943+0000 7f885dd52640 1 --2- 172.21.15.49:0/1454435845 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f88440664c0 0x7f8844068980 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.943+0000 7f885dd52640 1 --2- 172.21.15.49:0/1454435845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8858156220 0x7f8858155910 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.943+0000 7f885dd52640 1 --2- 172.21.15.49:0/1454435845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8858150380 0x7f88581553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.943+0000 7f885dd52640 1 --2- 172.21.15.49:0/1454435845 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88580c7400 0x7f88581588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:42.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.943+0000 7f885dd52640 1 -- 172.21.15.49:0/1454435845 >> 172.21.15.49:0/1454435845 conn(0x7f885806d200 msgr2=0x7f885814cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:42.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.943+0000 7f885dd52640 1 -- 172.21.15.49:0/1454435845 shutdown_connections 2023-11-18T21:28:42.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:42.943+0000 7f885dd52640 1 -- 172.21.15.49:0/1454435845 wait complete. 2023-11-18T21:28:42.961 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2023-11-18T21:28:42.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:28:42.962 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-18T21:28:42.975 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:28:43.001 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[46081]: fuse finished with error 0 and tester_r 0 2023-11-18T21:28:43.986 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:==00:00:28:01.381 46081== 2023-11-18T21:28:43.986 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:==00:00:28:01.381 46081== Exit program on first error (--exit-on-first-error=yes) 2023-11-18T21:28:44.148 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:daemon-helper: command failed with exit status 42 2023-11-18T21:28:49.077 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-18T21:28:49.077 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-11-18T21:28:49.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:28:49.078 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-18T21:28:49.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:28:49.085 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-11-18T21:28:49.134 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-18T21:28:49.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:28:49.134 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T21:28:49.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T21:28:49.195 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2023-11-18T21:28:49.351 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-18T21:28:49.360 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-18T21:28:49.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T21:28:49.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.482+0000 7f078559b640 1 Processor -- start 2023-11-18T21:28:49.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.482+0000 7f078559b640 1 -- start start 2023-11-18T21:28:49.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.486+0000 7f078559b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07801512d0 0x7f078006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:49.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.486+0000 7f078559b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07800c7760 0x7f07800c8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:49.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.486+0000 7f078559b640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07800c1d10 con 0x7f07800c2a40 2023-11-18T21:28:49.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.486+0000 7f078559b640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07801516b0 con 0x7f07801512d0 2023-11-18T21:28:49.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.486+0000 7f078559b640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07800c8840 con 0x7f07800c7760 2023-11-18T21:28:49.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.486+0000 7f077effd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07801512d0 0x7f078006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:49.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.486+0000 7f077f7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f07800c2a40 0x7f078006e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55460/0 (socket says 172.21.15.49:55460) 2023-11-18T21:28:49.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.486+0000 7f077f7fe640 1 -- 172.21.15.49:0/396425573 learned_addr learned my addr 172.21.15.49:0/396425573 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:49.488 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.486+0000 7f077e7fc640 1 --2- 172.21.15.49:0/396425573 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07800c7760 0x7f07800c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:49.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.490+0000 7f077effd640 1 -- 172.21.15.49:0/396425573 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07800c7760 msgr2=0x7f07800c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:49.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.490+0000 7f077effd640 1 --2- 172.21.15.49:0/396425573 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07800c7760 0x7f07800c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:49.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.490+0000 7f077effd640 1 -- 172.21.15.49:0/396425573 >> v1:172.21.15.49:6789/0 conn(0x7f07800c2a40 legacy=0x7f078006e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:49.491 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.490+0000 7f077effd640 1 -- 172.21.15.49:0/396425573 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0780157d40 con 0x7f07801512d0 2023-11-18T21:28:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.494+0000 7f077effd640 1 --2- 172.21.15.49:0/396425573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07801512d0 0x7f078006fc90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f07700097c0 tx=0x7f077001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8033de8499de6ed9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.498+0000 7f077dffb640 1 -- 172.21.15.49:0/396425573 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07700a8970 con 0x7f07801512d0 2023-11-18T21:28:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.498+0000 7f077dffb640 1 -- 172.21.15.49:0/396425573 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07700a8ad0 con 0x7f07801512d0 2023-11-18T21:28:49.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.498+0000 7f077dffb640 1 -- 172.21.15.49:0/396425573 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07700a8e60 con 0x7f07801512d0 2023-11-18T21:28:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 -- 172.21.15.49:0/396425573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07801512d0 msgr2=0x7f078006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 --2- 172.21.15.49:0/396425573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07801512d0 0x7f078006fc90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f07700097c0 tx=0x7f077001ec70 comp rx=0 tx=0).stop 2023-11-18T21:28:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 -- 172.21.15.49:0/396425573 shutdown_connections 2023-11-18T21:28:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 --2- 172.21.15.49:0/396425573 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07800c7760 0x7f07800c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 --2- 172.21.15.49:0/396425573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07801512d0 0x7f078006fc90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 -- 172.21.15.49:0/396425573 >> 172.21.15.49:0/396425573 conn(0x7f07800616e0 msgr2=0x7f0780070900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 -- 172.21.15.49:0/396425573 shutdown_connections 2023-11-18T21:28:49.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 -- 172.21.15.49:0/396425573 wait complete. 2023-11-18T21:28:49.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 Processor -- start 2023-11-18T21:28:49.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 -- start start 2023-11-18T21:28:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07800c2a40 0x7f07800ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07800c7760 0x7f078014af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07801512d0 0x7f078014fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0780158370 con 0x7f07800c7760 2023-11-18T21:28:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07801f2da0 con 0x7f07801512d0 2023-11-18T21:28:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f078559b640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07801585c0 con 0x7f07800c2a40 2023-11-18T21:28:49.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f077e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07800c7760 0x7f078014af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:49.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.502+0000 7f077effd640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07800c2a40 0x7f07800ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:49.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.506+0000 7f077e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07800c7760 0x7f078014af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40576/0 (socket says 172.21.15.49:40576) 2023-11-18T21:28:49.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.506+0000 7f077e7fc640 1 -- 172.21.15.49:0/2126323376 learned_addr learned my addr 172.21.15.49:0/2126323376 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:49.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.510+0000 7f077e7fc640 1 -- 172.21.15.49:0/2126323376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07800c2a40 msgr2=0x7f07800ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:49.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.510+0000 7f077e7fc640 1 --2- 172.21.15.49:0/2126323376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07800c2a40 0x7f07800ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:49.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.510+0000 7f077e7fc640 1 -- 172.21.15.49:0/2126323376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07801512d0 msgr2=0x7f078014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:49.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.510+0000 7f077e7fc640 1 --2- 172.21.15.49:0/2126323376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07801512d0 0x7f078014fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:49.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.510+0000 7f077e7fc640 1 -- 172.21.15.49:0/2126323376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0770009420 con 0x7f07800c7760 2023-11-18T21:28:49.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.510+0000 7f077e7fc640 1 --2- 172.21.15.49:0/2126323376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07800c7760 0x7f078014af50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f077800efc0 tx=0x7f077800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:49.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.514+0000 7f07777fe640 1 -- 172.21.15.49:0/2126323376 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0778014480 con 0x7f07800c7760 2023-11-18T21:28:49.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.514+0000 7f07777fe640 1 -- 172.21.15.49:0/2126323376 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077800f040 con 0x7f07800c7760 2023-11-18T21:28:49.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.514+0000 7f078559b640 1 -- 172.21.15.49:0/2126323376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07801588a0 con 0x7f07800c7760 2023-11-18T21:28:49.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.514+0000 7f07777fe640 1 -- 172.21.15.49:0/2126323376 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0778014800 con 0x7f07800c7760 2023-11-18T21:28:49.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.514+0000 7f078559b640 1 -- 172.21.15.49:0/2126323376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0780158e60 con 0x7f07800c7760 2023-11-18T21:28:49.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.514+0000 7f078559b640 1 -- 172.21.15.49:0/2126323376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0780073e70 con 0x7f07800c7760 2023-11-18T21:28:49.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.538+0000 7f07777fe640 1 -- 172.21.15.49:0/2126323376 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0778014960 con 0x7f07800c7760 2023-11-18T21:28:49.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.538+0000 7f07777fe640 1 --2- 172.21.15.49:0/2126323376 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f07600664c0 0x7f0760068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:49.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.538+0000 7f077effd640 1 --2- 172.21.15.49:0/2126323376 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f07600664c0 0x7f0760068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:49.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.538+0000 7f077effd640 1 --2- 172.21.15.49:0/2126323376 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f07600664c0 0x7f0760068980 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f07700b2000 tx=0x7f07700aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.542+0000 7f07777fe640 1 -- 172.21.15.49:0/2126323376 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f07780569a0 con 0x7f07800c7760 2023-11-18T21:28:49.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.818+0000 7f07777fe640 1 -- 172.21.15.49:0/2126323376 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f07780525e0 con 0x7f07800c7760 2023-11-18T21:28:49.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:49.982+0000 7f078559b640 1 -- 172.21.15.49:0/2126323376 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0780158730 con 0x7f07600664c0 2023-11-18T21:28:50.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.014+0000 7f07777fe640 1 -- 172.21.15.49:0/2126323376 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368739 (secure 0 0 0) 0x7f0780158730 con 0x7f07600664c0 2023-11-18T21:28:50.018 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:28:50.020 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-18T21:28:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.018+0000 7f078559b640 1 -- 172.21.15.49:0/2126323376 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f07600664c0 msgr2=0x7f0760068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.018+0000 7f078559b640 1 --2- 172.21.15.49:0/2126323376 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f07600664c0 0x7f0760068980 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f07700b2000 tx=0x7f07700aa070 comp rx=0 tx=0).stop 2023-11-18T21:28:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.018+0000 7f078559b640 1 -- 172.21.15.49:0/2126323376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07800c7760 msgr2=0x7f078014af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.018+0000 7f078559b640 1 --2- 172.21.15.49:0/2126323376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07800c7760 0x7f078014af50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f077800efc0 tx=0x7f077800c490 comp rx=0 tx=0).stop 2023-11-18T21:28:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.018+0000 7f078559b640 1 -- 172.21.15.49:0/2126323376 shutdown_connections 2023-11-18T21:28:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.018+0000 7f078559b640 1 --2- 172.21.15.49:0/2126323376 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f07600664c0 0x7f0760068980 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.018+0000 7f078559b640 1 --2- 172.21.15.49:0/2126323376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07801512d0 0x7f078014fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.018+0000 7f078559b640 1 --2- 172.21.15.49:0/2126323376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07800c7760 0x7f078014af50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.018+0000 7f078559b640 1 --2- 172.21.15.49:0/2126323376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07800c2a40 0x7f07800ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.018+0000 7f078559b640 1 -- 172.21.15.49:0/2126323376 >> 172.21.15.49:0/2126323376 conn(0x7f07800616e0 msgr2=0x7f078014d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.018+0000 7f078559b640 1 -- 172.21.15.49:0/2126323376 shutdown_connections 2023-11-18T21:28:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.018+0000 7f078559b640 1 -- 172.21.15.49:0/2126323376 wait complete. 2023-11-18T21:28:50.036 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":932,"stamp":"2023-11-18T21:28:48.538437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24262386,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":804,"num_read_kb":1243,"num_write":12291,"num_write_kb":281645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14773,"ondisk_log_size":14773,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":388472,"kb_used_data":50232,"kb_used_omap":12,"kb_used_meta":338163,"kb_avail":754586248,"statfs":{"total":773094113280,"available":772696317952,"internally_reserved":0,"allocated":51437568,"data_stored":49613892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":346279473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,20,19],"upper_bound":512},"perf_stat":{"commit_latency_ms":199,"apply_latency_ms":199,"commit_latency_ns":199000000,"apply_latency_ns":199000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10264,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":35,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004886"},"pg_stats":[{"pgid":"2.1f","version":"31'73","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:35.344676+0000","last_change":"2023-11-18T20:59:25.350113+0000","last_active":"2023-11-18T21:28:35.344676+0000","last_peered":"2023-11-18T21:28:35.344676+0000","last_clean":"2023-11-18T21:28:35.344676+0000","last_became_active":"2023-11-18T20:59:25.349869+0000","last_became_peered":"2023-11-18T20:59:25.349869+0000","last_unstale":"2023-11-18T21:28:35.344676+0000","last_undegraded":"2023-11-18T21:28:35.344676+0000","last_fullsized":"2023-11-18T21:28:35.344676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:56:07.719325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'45","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.673746+0000","last_change":"2023-11-18T20:59:27.895973+0000","last_active":"2023-11-18T21:28:43.673746+0000","last_peered":"2023-11-18T21:28:43.673746+0000","last_clean":"2023-11-18T21:28:43.673746+0000","last_became_active":"2023-11-18T20:59:27.895678+0000","last_became_peered":"2023-11-18T20:59:27.895678+0000","last_unstale":"2023-11-18T21:28:43.673746+0000","last_undegraded":"2023-11-18T21:28:43.673746+0000","last_fullsized":"2023-11-18T21:28:43.673746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"31'87","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.055420+0000","last_change":"2023-11-18T20:59:35.848621+0000","last_active":"2023-11-18T21:27:28.055420+0000","last_peered":"2023-11-18T21:27:28.055420+0000","last_clean":"2023-11-18T21:27:28.055420+0000","last_became_active":"2023-11-18T20:59:35.848140+0000","last_became_peered":"2023-11-18T20:59:35.848140+0000","last_unstale":"2023-11-18T21:27:28.055420+0000","last_undegraded":"2023-11-18T21:27:28.055420+0000","last_fullsized":"2023-11-18T21:27:28.055420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:12.962470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:59.358340+0000","last_change":"2023-11-18T20:59:25.463657+0000","last_active":"2023-11-18T21:27:59.358340+0000","last_peered":"2023-11-18T21:27:59.358340+0000","last_clean":"2023-11-18T21:27:59.358340+0000","last_became_active":"2023-11-18T20:59:25.463001+0000","last_became_peered":"2023-11-18T20:59:25.463001+0000","last_unstale":"2023-11-18T21:27:59.358340+0000","last_undegraded":"2023-11-18T21:27:59.358340+0000","last_fullsized":"2023-11-18T21:27:59.358340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"31'59","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630833+0000","last_change":"2023-11-18T20:59:27.837801+0000","last_active":"2023-11-18T21:28:43.630833+0000","last_peered":"2023-11-18T21:28:43.630833+0000","last_clean":"2023-11-18T21:28:43.630833+0000","last_became_active":"2023-11-18T20:59:27.836937+0000","last_became_peered":"2023-11-18T20:59:27.836937+0000","last_unstale":"2023-11-18T21:28:43.630833+0000","last_undegraded":"2023-11-18T21:28:43.630833+0000","last_fullsized":"2023-11-18T21:28:43.630833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"31'91","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.094446+0000","last_change":"2023-11-18T20:59:35.843015+0000","last_active":"2023-11-18T21:27:28.094446+0000","last_peered":"2023-11-18T21:27:28.094446+0000","last_clean":"2023-11-18T21:27:28.094446+0000","last_became_active":"2023-11-18T20:59:35.842552+0000","last_became_peered":"2023-11-18T20:59:35.842552+0000","last_unstale":"2023-11-18T21:27:28.094446+0000","last_undegraded":"2023-11-18T21:27:28.094446+0000","last_fullsized":"2023-11-18T21:27:28.094446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:17.222664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"31'175","reported_seq":208,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:29.248169+0000","last_change":"2023-11-18T20:59:25.497907+0000","last_active":"2023-11-18T21:28:29.248169+0000","last_peered":"2023-11-18T21:28:29.248169+0000","last_clean":"2023-11-18T21:28:29.248169+0000","last_became_active":"2023-11-18T20:59:25.497070+0000","last_became_peered":"2023-11-18T20:59:25.497070+0000","last_unstale":"2023-11-18T21:28:29.248169+0000","last_undegraded":"2023-11-18T21:28:29.248169+0000","last_fullsized":"2023-11-18T21:28:29.248169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"31'56","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.671790+0000","last_change":"2023-11-18T20:59:27.868161+0000","last_active":"2023-11-18T21:28:43.671790+0000","last_peered":"2023-11-18T21:28:43.671790+0000","last_clean":"2023-11-18T21:28:43.671790+0000","last_became_active":"2023-11-18T20:59:27.867021+0000","last_became_peered":"2023-11-18T20:59:27.867021+0000","last_unstale":"2023-11-18T21:28:43.671790+0000","last_undegraded":"2023-11-18T21:28:43.671790+0000","last_fullsized":"2023-11-18T21:28:43.671790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'88","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:22.937522+0000","last_change":"2023-11-18T20:59:35.830210+0000","last_active":"2023-11-18T21:27:22.937522+0000","last_peered":"2023-11-18T21:27:22.937522+0000","last_clean":"2023-11-18T21:27:22.937522+0000","last_became_active":"2023-11-18T20:59:35.829636+0000","last_became_peered":"2023-11-18T20:59:35.829636+0000","last_unstale":"2023-11-18T21:27:22.937522+0000","last_undegraded":"2023-11-18T21:27:22.937522+0000","last_fullsized":"2023-11-18T21:27:22.937522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":32,"num_write":84,"num_write_kb":9481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"31'10","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.072620+0000","last_change":"2023-11-18T20:59:25.493859+0000","last_active":"2023-11-18T21:28:26.072620+0000","last_peered":"2023-11-18T21:28:26.072620+0000","last_clean":"2023-11-18T21:28:26.072620+0000","last_became_active":"2023-11-18T20:59:25.493087+0000","last_became_peered":"2023-11-18T20:59:25.493087+0000","last_unstale":"2023-11-18T21:28:26.072620+0000","last_undegraded":"2023-11-18T21:28:26.072620+0000","last_fullsized":"2023-11-18T21:28:26.072620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"31'65","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.677740+0000","last_change":"2023-11-18T20:59:27.871929+0000","last_active":"2023-11-18T21:28:43.677740+0000","last_peered":"2023-11-18T21:28:43.677740+0000","last_clean":"2023-11-18T21:28:43.677740+0000","last_became_active":"2023-11-18T20:59:27.871076+0000","last_became_peered":"2023-11-18T20:59:27.871076+0000","last_unstale":"2023-11-18T21:28:43.677740+0000","last_undegraded":"2023-11-18T21:28:43.677740+0000","last_fullsized":"2023-11-18T21:28:43.677740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:24:09.546791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"31'63","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.541263+0000","last_change":"2023-11-18T20:59:35.833547+0000","last_active":"2023-11-18T21:27:18.541263+0000","last_peered":"2023-11-18T21:27:18.541263+0000","last_clean":"2023-11-18T21:27:18.541263+0000","last_became_active":"2023-11-18T20:59:35.833016+0000","last_became_peered":"2023-11-18T20:59:35.833016+0000","last_unstale":"2023-11-18T21:27:18.541263+0000","last_undegraded":"2023-11-18T21:27:18.541263+0000","last_fullsized":"2023-11-18T21:27:18.541263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:58.416590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":5002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"31'56","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.634810+0000","last_change":"2023-11-18T20:59:27.682005+0000","last_active":"2023-11-18T21:28:43.634810+0000","last_peered":"2023-11-18T21:28:43.634810+0000","last_clean":"2023-11-18T21:28:43.634810+0000","last_became_active":"2023-11-18T20:59:27.681154+0000","last_became_peered":"2023-11-18T20:59:27.681154+0000","last_unstale":"2023-11-18T21:28:43.634810+0000","last_undegraded":"2023-11-18T21:28:43.634810+0000","last_fullsized":"2023-11-18T21:28:43.634810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:10.426499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"31'142","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.042960+0000","last_change":"2023-11-18T20:59:25.339269+0000","last_active":"2023-11-18T21:28:43.042960+0000","last_peered":"2023-11-18T21:28:43.042960+0000","last_clean":"2023-11-18T21:28:43.042960+0000","last_became_active":"2023-11-18T20:59:25.338067+0000","last_became_peered":"2023-11-18T20:59:25.338067+0000","last_unstale":"2023-11-18T21:28:43.042960+0000","last_undegraded":"2023-11-18T21:28:43.042960+0000","last_fullsized":"2023-11-18T21:28:43.042960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395570,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'89","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:23.791465+0000","last_change":"2023-11-18T21:00:28.755990+0000","last_active":"2023-11-18T21:27:23.791465+0000","last_peered":"2023-11-18T21:27:23.791465+0000","last_clean":"2023-11-18T21:27:23.791465+0000","last_became_active":"2023-11-18T21:00:28.755606+0000","last_became_peered":"2023-11-18T21:00:28.755606+0000","last_unstale":"2023-11-18T21:27:23.791465+0000","last_undegraded":"2023-11-18T21:27:23.791465+0000","last_fullsized":"2023-11-18T21:27:23.791465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:06.870579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":4704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'54","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.476664+0000","last_change":"2023-11-18T20:59:27.861550+0000","last_active":"2023-11-18T21:28:43.476664+0000","last_peered":"2023-11-18T21:28:43.476664+0000","last_clean":"2023-11-18T21:28:43.476664+0000","last_became_active":"2023-11-18T20:59:27.861045+0000","last_became_peered":"2023-11-18T20:59:27.861045+0000","last_unstale":"2023-11-18T21:28:43.476664+0000","last_undegraded":"2023-11-18T21:28:43.476664+0000","last_fullsized":"2023-11-18T21:28:43.476664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"31'407","reported_seq":442,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:37.390812+0000","last_change":"2023-11-18T20:59:25.458601+0000","last_active":"2023-11-18T21:28:37.390812+0000","last_peered":"2023-11-18T21:28:37.390812+0000","last_clean":"2023-11-18T21:28:37.390812+0000","last_became_active":"2023-11-18T20:59:25.457871+0000","last_became_peered":"2023-11-18T20:59:25.457871+0000","last_unstale":"2023-11-18T21:28:37.390812+0000","last_undegraded":"2023-11-18T21:28:37.390812+0000","last_fullsized":"2023-11-18T21:28:37.390812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:09.387812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":996,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"31'93","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:24.972970+0000","last_change":"2023-11-18T20:59:35.842967+0000","last_active":"2023-11-18T21:27:24.972970+0000","last_peered":"2023-11-18T21:27:24.972970+0000","last_clean":"2023-11-18T21:27:24.972970+0000","last_became_active":"2023-11-18T20:59:35.842583+0000","last_became_peered":"2023-11-18T20:59:35.842583+0000","last_unstale":"2023-11-18T21:27:24.972970+0000","last_undegraded":"2023-11-18T21:27:24.972970+0000","last_fullsized":"2023-11-18T21:27:24.972970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:40.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'46","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.574354+0000","last_change":"2023-11-18T20:59:27.688043+0000","last_active":"2023-11-18T21:28:43.574354+0000","last_peered":"2023-11-18T21:28:43.574354+0000","last_clean":"2023-11-18T21:28:43.574354+0000","last_became_active":"2023-11-18T20:59:27.687250+0000","last_became_peered":"2023-11-18T20:59:27.687250+0000","last_unstale":"2023-11-18T21:28:43.574354+0000","last_undegraded":"2023-11-18T21:28:43.574354+0000","last_fullsized":"2023-11-18T21:28:43.574354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:16:48.432607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"31'202","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:29.201820+0000","last_change":"2023-11-18T20:59:25.351927+0000","last_active":"2023-11-18T21:28:29.201820+0000","last_peered":"2023-11-18T21:28:29.201820+0000","last_clean":"2023-11-18T21:28:29.201820+0000","last_became_active":"2023-11-18T20:59:25.351318+0000","last_became_peered":"2023-11-18T20:59:25.351318+0000","last_unstale":"2023-11-18T21:28:29.201820+0000","last_undegraded":"2023-11-18T21:28:29.201820+0000","last_fullsized":"2023-11-18T21:28:29.201820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:20:38.006315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'80","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.908455+0000","last_change":"2023-11-18T20:59:35.835375+0000","last_active":"2023-11-18T21:27:18.908455+0000","last_peered":"2023-11-18T21:27:18.908455+0000","last_clean":"2023-11-18T21:27:18.908455+0000","last_became_active":"2023-11-18T20:59:35.834894+0000","last_became_peered":"2023-11-18T20:59:35.834894+0000","last_unstale":"2023-11-18T21:27:18.908455+0000","last_undegraded":"2023-11-18T21:27:18.908455+0000","last_fullsized":"2023-11-18T21:27:18.908455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:33.448377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":144,"num_write":72,"num_write_kb":6857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"31'48","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.628688+0000","last_change":"2023-11-18T20:59:27.687356+0000","last_active":"2023-11-18T21:28:43.628688+0000","last_peered":"2023-11-18T21:28:43.628688+0000","last_clean":"2023-11-18T21:28:43.628688+0000","last_became_active":"2023-11-18T20:59:27.686692+0000","last_became_peered":"2023-11-18T20:59:27.686692+0000","last_unstale":"2023-11-18T21:28:43.628688+0000","last_undegraded":"2023-11-18T21:28:43.628688+0000","last_fullsized":"2023-11-18T21:28:43.628688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:20:58.633153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:18.661759+0000","last_change":"2023-11-18T20:59:25.347589+0000","last_active":"2023-11-18T21:28:18.661759+0000","last_peered":"2023-11-18T21:28:18.661759+0000","last_clean":"2023-11-18T21:28:18.661759+0000","last_became_active":"2023-11-18T20:59:25.347022+0000","last_became_peered":"2023-11-18T20:59:25.347022+0000","last_unstale":"2023-11-18T21:28:18.661759+0000","last_undegraded":"2023-11-18T21:28:18.661759+0000","last_fullsized":"2023-11-18T21:28:18.661759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'120","reported_seq":147,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.477259+0000","last_change":"2023-11-18T20:59:35.771398+0000","last_active":"2023-11-18T21:27:18.477259+0000","last_peered":"2023-11-18T21:27:18.477259+0000","last_clean":"2023-11-18T21:27:18.477259+0000","last_became_active":"2023-11-18T20:59:35.770923+0000","last_became_peered":"2023-11-18T20:59:35.770923+0000","last_unstale":"2023-11-18T21:27:18.477259+0000","last_undegraded":"2023-11-18T21:27:18.477259+0000","last_fullsized":"2023-11-18T21:27:18.477259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'44","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.574046+0000","last_change":"2023-11-18T20:59:27.689972+0000","last_active":"2023-11-18T21:28:43.574046+0000","last_peered":"2023-11-18T21:28:43.574046+0000","last_clean":"2023-11-18T21:28:43.574046+0000","last_became_active":"2023-11-18T20:59:27.689156+0000","last_became_peered":"2023-11-18T20:59:27.689156+0000","last_unstale":"2023-11-18T21:28:43.574046+0000","last_undegraded":"2023-11-18T21:28:43.574046+0000","last_fullsized":"2023-11-18T21:28:43.574046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:58.264895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"31'12","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:18.009596+0000","last_change":"2023-11-18T20:59:25.348005+0000","last_active":"2023-11-18T21:28:18.009596+0000","last_peered":"2023-11-18T21:28:18.009596+0000","last_clean":"2023-11-18T21:28:18.009596+0000","last_became_active":"2023-11-18T20:59:25.346318+0000","last_became_peered":"2023-11-18T20:59:25.346318+0000","last_unstale":"2023-11-18T21:28:18.009596+0000","last_undegraded":"2023-11-18T21:28:18.009596+0000","last_fullsized":"2023-11-18T21:28:18.009596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:37.045716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"31'81","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.069352+0000","last_change":"2023-11-18T20:59:35.833754+0000","last_active":"2023-11-18T21:27:27.069352+0000","last_peered":"2023-11-18T21:27:27.069352+0000","last_clean":"2023-11-18T21:27:27.069352+0000","last_became_active":"2023-11-18T20:59:35.833407+0000","last_became_peered":"2023-11-18T20:59:35.833407+0000","last_unstale":"2023-11-18T21:27:27.069352+0000","last_undegraded":"2023-11-18T21:27:27.069352+0000","last_fullsized":"2023-11-18T21:27:27.069352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:38:06.355389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":9489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'53","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.574066+0000","last_change":"2023-11-18T20:59:27.863887+0000","last_active":"2023-11-18T21:28:43.574066+0000","last_peered":"2023-11-18T21:28:43.574066+0000","last_clean":"2023-11-18T21:28:43.574066+0000","last_became_active":"2023-11-18T20:59:27.863358+0000","last_became_peered":"2023-11-18T20:59:27.863358+0000","last_unstale":"2023-11-18T21:28:43.574066+0000","last_undegraded":"2023-11-18T21:28:43.574066+0000","last_fullsized":"2023-11-18T21:28:43.574066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:50.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"31'150","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:36.791102+0000","last_change":"2023-11-18T20:59:25.351394+0000","last_active":"2023-11-18T21:28:36.791102+0000","last_peered":"2023-11-18T21:28:36.791102+0000","last_clean":"2023-11-18T21:28:36.791102+0000","last_became_active":"2023-11-18T20:59:25.350705+0000","last_became_peered":"2023-11-18T20:59:25.350705+0000","last_unstale":"2023-11-18T21:28:36.791102+0000","last_undegraded":"2023-11-18T21:28:36.791102+0000","last_fullsized":"2023-11-18T21:28:36.791102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:01:57.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"31'89","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.136525+0000","last_change":"2023-11-18T20:59:35.840991+0000","last_active":"2023-11-18T21:27:28.136525+0000","last_peered":"2023-11-18T21:27:28.136525+0000","last_clean":"2023-11-18T21:27:28.136525+0000","last_became_active":"2023-11-18T20:59:35.840533+0000","last_became_peered":"2023-11-18T20:59:35.840533+0000","last_unstale":"2023-11-18T21:27:28.136525+0000","last_undegraded":"2023-11-18T21:27:28.136525+0000","last_fullsized":"2023-11-18T21:27:28.136525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:06:47.876845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":9026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"31'60","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.582868+0000","last_change":"2023-11-18T20:59:27.869100+0000","last_active":"2023-11-18T21:28:43.582868+0000","last_peered":"2023-11-18T21:28:43.582868+0000","last_clean":"2023-11-18T21:28:43.582868+0000","last_became_active":"2023-11-18T20:59:27.868355+0000","last_became_peered":"2023-11-18T20:59:27.868355+0000","last_unstale":"2023-11-18T21:28:43.582868+0000","last_undegraded":"2023-11-18T21:28:43.582868+0000","last_fullsized":"2023-11-18T21:28:43.582868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:25.235096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"31'94","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:19.874168+0000","last_change":"2023-11-18T20:59:25.350304+0000","last_active":"2023-11-18T21:28:19.874168+0000","last_peered":"2023-11-18T21:28:19.874168+0000","last_clean":"2023-11-18T21:28:19.874168+0000","last_became_active":"2023-11-18T20:59:25.349346+0000","last_became_peered":"2023-11-18T20:59:25.349346+0000","last_unstale":"2023-11-18T21:28:19.874168+0000","last_undegraded":"2023-11-18T21:28:19.874168+0000","last_fullsized":"2023-11-18T21:28:19.874168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:41.179268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"31'98","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.020859+0000","last_change":"2023-11-18T20:59:35.847005+0000","last_active":"2023-11-18T21:27:27.020859+0000","last_peered":"2023-11-18T21:27:27.020859+0000","last_clean":"2023-11-18T21:27:27.020859+0000","last_became_active":"2023-11-18T20:59:35.846458+0000","last_became_peered":"2023-11-18T20:59:35.846458+0000","last_unstale":"2023-11-18T21:27:27.020859+0000","last_undegraded":"2023-11-18T21:27:27.020859+0000","last_fullsized":"2023-11-18T21:27:27.020859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":10588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"31'50","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.667381+0000","last_change":"2023-11-18T20:59:27.889369+0000","last_active":"2023-11-18T21:28:43.667381+0000","last_peered":"2023-11-18T21:28:43.667381+0000","last_clean":"2023-11-18T21:28:43.667381+0000","last_became_active":"2023-11-18T20:59:27.887876+0000","last_became_peered":"2023-11-18T20:59:27.887876+0000","last_unstale":"2023-11-18T21:28:43.667381+0000","last_undegraded":"2023-11-18T21:28:43.667381+0000","last_fullsized":"2023-11-18T21:28:43.667381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:38.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"31'6","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:18.000761+0000","last_change":"2023-11-18T20:59:25.459620+0000","last_active":"2023-11-18T21:28:18.000761+0000","last_peered":"2023-11-18T21:28:18.000761+0000","last_clean":"2023-11-18T21:28:18.000761+0000","last_became_active":"2023-11-18T20:59:25.459235+0000","last_became_peered":"2023-11-18T20:59:25.459235+0000","last_unstale":"2023-11-18T21:28:18.000761+0000","last_undegraded":"2023-11-18T21:28:18.000761+0000","last_fullsized":"2023-11-18T21:28:18.000761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:02.325885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:20.899113+0000","last_change":"2023-11-18T20:59:35.835800+0000","last_active":"2023-11-18T21:27:20.899113+0000","last_peered":"2023-11-18T21:27:20.899113+0000","last_clean":"2023-11-18T21:27:20.899113+0000","last_became_active":"2023-11-18T20:59:35.834275+0000","last_became_peered":"2023-11-18T20:59:35.834275+0000","last_unstale":"2023-11-18T21:27:20.899113+0000","last_undegraded":"2023-11-18T21:27:20.899113+0000","last_fullsized":"2023-11-18T21:27:20.899113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'61","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.476976+0000","last_change":"2023-11-18T21:00:28.721070+0000","last_active":"2023-11-18T21:28:43.476976+0000","last_peered":"2023-11-18T21:28:43.476976+0000","last_clean":"2023-11-18T21:28:43.476976+0000","last_became_active":"2023-11-18T21:00:28.720412+0000","last_became_peered":"2023-11-18T21:00:28.720412+0000","last_unstale":"2023-11-18T21:28:43.476976+0000","last_undegraded":"2023-11-18T21:28:43.476976+0000","last_fullsized":"2023-11-18T21:28:43.476976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"31'655","reported_seq":691,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.048563+0000","last_change":"2023-11-18T20:59:25.355096+0000","last_active":"2023-11-18T21:28:43.048563+0000","last_peered":"2023-11-18T21:28:43.048563+0000","last_clean":"2023-11-18T21:28:43.048563+0000","last_became_active":"2023-11-18T20:59:25.354716+0000","last_became_peered":"2023-11-18T20:59:25.354716+0000","last_unstale":"2023-11-18T21:28:43.048563+0000","last_undegraded":"2023-11-18T21:28:43.048563+0000","last_fullsized":"2023-11-18T21:28:43.048563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:51.039181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":3369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'79","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.120724+0000","last_change":"2023-11-18T20:59:35.839218+0000","last_active":"2023-11-18T21:27:28.120724+0000","last_peered":"2023-11-18T21:27:28.120724+0000","last_clean":"2023-11-18T21:27:28.120724+0000","last_became_active":"2023-11-18T20:59:35.838732+0000","last_became_peered":"2023-11-18T20:59:35.838732+0000","last_unstale":"2023-11-18T21:27:28.120724+0000","last_undegraded":"2023-11-18T21:27:28.120724+0000","last_fullsized":"2023-11-18T21:27:28.120724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:50.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"31'54","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.634030+0000","last_change":"2023-11-18T20:59:27.839403+0000","last_active":"2023-11-18T21:28:43.634030+0000","last_peered":"2023-11-18T21:28:43.634030+0000","last_clean":"2023-11-18T21:28:43.634030+0000","last_became_active":"2023-11-18T20:59:27.838664+0000","last_became_peered":"2023-11-18T20:59:27.838664+0000","last_unstale":"2023-11-18T21:28:43.634030+0000","last_undegraded":"2023-11-18T21:28:43.634030+0000","last_fullsized":"2023-11-18T21:28:43.634030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"31'164","reported_seq":273,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:38.912485+0000","last_change":"2023-11-18T20:59:25.458840+0000","last_active":"2023-11-18T21:28:38.912485+0000","last_peered":"2023-11-18T21:28:38.912485+0000","last_clean":"2023-11-18T21:28:38.912485+0000","last_became_active":"2023-11-18T20:59:25.458075+0000","last_became_peered":"2023-11-18T20:59:25.458075+0000","last_unstale":"2023-11-18T21:28:38.912485+0000","last_undegraded":"2023-11-18T21:28:38.912485+0000","last_fullsized":"2023-11-18T21:28:38.912485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:48.644992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18647,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":79,"num_write":158,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"31'81","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:24.941939+0000","last_change":"2023-11-18T20:59:35.833736+0000","last_active":"2023-11-18T21:27:24.941939+0000","last_peered":"2023-11-18T21:27:24.941939+0000","last_clean":"2023-11-18T21:27:24.941939+0000","last_became_active":"2023-11-18T20:59:35.832891+0000","last_became_peered":"2023-11-18T20:59:35.832891+0000","last_unstale":"2023-11-18T21:27:24.941939+0000","last_undegraded":"2023-11-18T21:27:24.941939+0000","last_fullsized":"2023-11-18T21:27:24.941939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:12.929672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"31'58","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.597860+0000","last_change":"2023-11-18T20:59:27.889690+0000","last_active":"2023-11-18T21:28:43.597860+0000","last_peered":"2023-11-18T21:28:43.597860+0000","last_clean":"2023-11-18T21:28:43.597860+0000","last_became_active":"2023-11-18T20:59:27.889115+0000","last_became_peered":"2023-11-18T20:59:27.889115+0000","last_unstale":"2023-11-18T21:28:43.597860+0000","last_undegraded":"2023-11-18T21:28:43.597860+0000","last_fullsized":"2023-11-18T21:28:43.597860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:57:08.995074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:10.915862+0000","last_change":"2023-11-18T20:59:25.460190+0000","last_active":"2023-11-18T21:28:10.915862+0000","last_peered":"2023-11-18T21:28:10.915862+0000","last_clean":"2023-11-18T21:28:10.915862+0000","last_became_active":"2023-11-18T20:59:25.459405+0000","last_became_peered":"2023-11-18T20:59:25.459405+0000","last_unstale":"2023-11-18T21:28:10.915862+0000","last_undegraded":"2023-11-18T21:28:10.915862+0000","last_fullsized":"2023-11-18T21:28:10.915862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"31'64","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:25.970399+0000","last_change":"2023-11-18T20:59:35.842229+0000","last_active":"2023-11-18T21:27:25.970399+0000","last_peered":"2023-11-18T21:27:25.970399+0000","last_clean":"2023-11-18T21:27:25.970399+0000","last_became_active":"2023-11-18T20:59:35.835644+0000","last_became_peered":"2023-11-18T20:59:35.835644+0000","last_unstale":"2023-11-18T21:27:25.970399+0000","last_undegraded":"2023-11-18T21:27:25.970399+0000","last_fullsized":"2023-11-18T21:27:25.970399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:28.212029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"31'47","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.613220+0000","last_change":"2023-11-18T20:59:27.890885+0000","last_active":"2023-11-18T21:28:43.613220+0000","last_peered":"2023-11-18T21:28:43.613220+0000","last_clean":"2023-11-18T21:28:43.613220+0000","last_became_active":"2023-11-18T20:59:27.890499+0000","last_became_peered":"2023-11-18T20:59:27.890499+0000","last_unstale":"2023-11-18T21:28:43.613220+0000","last_undegraded":"2023-11-18T21:28:43.613220+0000","last_fullsized":"2023-11-18T21:28:43.613220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:33:26.362872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:04.464620+0000","last_change":"2023-11-18T20:59:25.339255+0000","last_active":"2023-11-18T21:28:04.464620+0000","last_peered":"2023-11-18T21:28:04.464620+0000","last_clean":"2023-11-18T21:28:04.464620+0000","last_became_active":"2023-11-18T20:59:25.338020+0000","last_became_peered":"2023-11-18T20:59:25.338020+0000","last_unstale":"2023-11-18T21:28:04.464620+0000","last_undegraded":"2023-11-18T21:28:04.464620+0000","last_fullsized":"2023-11-18T21:28:04.464620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:07.183625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:24:52.449457+0000","last_change":"2023-11-18T20:58:44.731742+0000","last_active":"2023-11-18T21:24:52.449457+0000","last_peered":"2023-11-18T21:24:52.449457+0000","last_clean":"2023-11-18T21:24:52.449457+0000","last_became_active":"2023-11-18T20:58:44.731076+0000","last_became_peered":"2023-11-18T20:58:44.731076+0000","last_unstale":"2023-11-18T21:24:52.449457+0000","last_undegraded":"2023-11-18T21:24:52.449457+0000","last_fullsized":"2023-11-18T21:24:52.449457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:58:42.561435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:58:42.561435+0000","last_clean_scrub_stamp":"2023-11-18T20:58:42.561435+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:48:40.458317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'66","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.824052+0000","last_change":"2023-11-18T20:59:35.771637+0000","last_active":"2023-11-18T21:27:18.824052+0000","last_peered":"2023-11-18T21:27:18.824052+0000","last_clean":"2023-11-18T21:27:18.824052+0000","last_became_active":"2023-11-18T20:59:35.771146+0000","last_became_peered":"2023-11-18T20:59:35.771146+0000","last_unstale":"2023-11-18T21:27:18.824052+0000","last_undegraded":"2023-11-18T21:27:18.824052+0000","last_fullsized":"2023-11-18T21:27:18.824052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:15.290602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":6116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"31'58","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.654090+0000","last_change":"2023-11-18T20:59:27.684091+0000","last_active":"2023-11-18T21:28:43.654090+0000","last_peered":"2023-11-18T21:28:43.654090+0000","last_clean":"2023-11-18T21:28:43.654090+0000","last_became_active":"2023-11-18T20:59:27.683316+0000","last_became_peered":"2023-11-18T20:59:27.683316+0000","last_unstale":"2023-11-18T21:28:43.654090+0000","last_undegraded":"2023-11-18T21:28:43.654090+0000","last_fullsized":"2023-11-18T21:28:43.654090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:52:02.757528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"31'666","reported_seq":701,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.066698+0000","last_change":"2023-11-18T20:59:25.357198+0000","last_active":"2023-11-18T21:28:43.066698+0000","last_peered":"2023-11-18T21:28:43.066698+0000","last_clean":"2023-11-18T21:28:43.066698+0000","last_became_active":"2023-11-18T20:59:25.356883+0000","last_became_peered":"2023-11-18T20:59:25.356883+0000","last_unstale":"2023-11-18T21:28:43.066698+0000","last_undegraded":"2023-11-18T21:28:43.066698+0000","last_fullsized":"2023-11-18T21:28:43.066698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:09.508737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3370313,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"31'82","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:25.976634+0000","last_change":"2023-11-18T20:59:35.834266+0000","last_active":"2023-11-18T21:27:25.976634+0000","last_peered":"2023-11-18T21:27:25.976634+0000","last_clean":"2023-11-18T21:27:25.976634+0000","last_became_active":"2023-11-18T20:59:35.833790+0000","last_became_peered":"2023-11-18T20:59:35.833790+0000","last_unstale":"2023-11-18T21:27:25.976634+0000","last_undegraded":"2023-11-18T21:27:25.976634+0000","last_fullsized":"2023-11-18T21:27:25.976634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:08.464650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":7460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'56","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678848+0000","last_change":"2023-11-18T20:59:27.873828+0000","last_active":"2023-11-18T21:28:43.678848+0000","last_peered":"2023-11-18T21:28:43.678848+0000","last_clean":"2023-11-18T21:28:43.678848+0000","last_became_active":"2023-11-18T20:59:27.872733+0000","last_became_peered":"2023-11-18T20:59:27.872733+0000","last_unstale":"2023-11-18T21:28:43.678848+0000","last_undegraded":"2023-11-18T21:28:43.678848+0000","last_fullsized":"2023-11-18T21:28:43.678848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"31'7","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.098478+0000","last_change":"2023-11-18T20:59:25.497529+0000","last_active":"2023-11-18T21:28:26.098478+0000","last_peered":"2023-11-18T21:28:26.098478+0000","last_clean":"2023-11-18T21:28:26.098478+0000","last_became_active":"2023-11-18T20:59:25.496694+0000","last_became_peered":"2023-11-18T20:59:25.496694+0000","last_unstale":"2023-11-18T21:28:26.098478+0000","last_undegraded":"2023-11-18T21:28:26.098478+0000","last_fullsized":"2023-11-18T21:28:26.098478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'95","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:24.986581+0000","last_change":"2023-11-18T20:59:35.829393+0000","last_active":"2023-11-18T21:27:24.986581+0000","last_peered":"2023-11-18T21:27:24.986581+0000","last_clean":"2023-11-18T21:27:24.986581+0000","last_became_active":"2023-11-18T20:59:35.828446+0000","last_became_peered":"2023-11-18T20:59:35.828446+0000","last_unstale":"2023-11-18T21:27:24.986581+0000","last_undegraded":"2023-11-18T21:27:24.986581+0000","last_fullsized":"2023-11-18T21:27:24.986581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:33.544336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":11010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"31'55","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678331+0000","last_change":"2023-11-18T20:59:27.875122+0000","last_active":"2023-11-18T21:28:43.678331+0000","last_peered":"2023-11-18T21:28:43.678331+0000","last_clean":"2023-11-18T21:28:43.678331+0000","last_became_active":"2023-11-18T20:59:27.870220+0000","last_became_peered":"2023-11-18T20:59:27.870220+0000","last_unstale":"2023-11-18T21:28:43.678331+0000","last_undegraded":"2023-11-18T21:28:43.678331+0000","last_fullsized":"2023-11-18T21:28:43.678331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:39.557454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"31'12","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:27.050057+0000","last_change":"2023-11-18T20:59:25.457826+0000","last_active":"2023-11-18T21:28:27.050057+0000","last_peered":"2023-11-18T21:28:27.050057+0000","last_clean":"2023-11-18T21:28:27.050057+0000","last_became_active":"2023-11-18T20:59:25.457392+0000","last_became_peered":"2023-11-18T20:59:25.457392+0000","last_unstale":"2023-11-18T21:28:27.050057+0000","last_undegraded":"2023-11-18T21:28:27.050057+0000","last_fullsized":"2023-11-18T21:28:27.050057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:07:56.724852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"31'70","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.074726+0000","last_change":"2023-11-18T20:59:35.831579+0000","last_active":"2023-11-18T21:27:28.074726+0000","last_peered":"2023-11-18T21:27:28.074726+0000","last_clean":"2023-11-18T21:27:28.074726+0000","last_became_active":"2023-11-18T20:59:35.831147+0000","last_became_peered":"2023-11-18T20:59:35.831147+0000","last_unstale":"2023-11-18T21:27:28.074726+0000","last_undegraded":"2023-11-18T21:27:28.074726+0000","last_fullsized":"2023-11-18T21:27:28.074726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:08.730686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"31'58","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.688733+0000","last_change":"2023-11-18T20:59:27.895618+0000","last_active":"2023-11-18T21:28:43.688733+0000","last_peered":"2023-11-18T21:28:43.688733+0000","last_clean":"2023-11-18T21:28:43.688733+0000","last_became_active":"2023-11-18T20:59:27.894931+0000","last_became_peered":"2023-11-18T20:59:27.894931+0000","last_unstale":"2023-11-18T21:28:43.688733+0000","last_undegraded":"2023-11-18T21:28:43.688733+0000","last_fullsized":"2023-11-18T21:28:43.688733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:33.165546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"31'206","reported_seq":241,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.287261+0000","last_change":"2023-11-18T20:59:25.458603+0000","last_active":"2023-11-18T21:28:32.287261+0000","last_peered":"2023-11-18T21:28:32.287261+0000","last_clean":"2023-11-18T21:28:32.287261+0000","last_became_active":"2023-11-18T20:59:25.457932+0000","last_became_peered":"2023-11-18T20:59:25.457932+0000","last_unstale":"2023-11-18T21:28:32.287261+0000","last_undegraded":"2023-11-18T21:28:32.287261+0000","last_fullsized":"2023-11-18T21:28:32.287261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":499,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"31'58","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.099951+0000","last_change":"2023-11-18T20:59:35.832209+0000","last_active":"2023-11-18T21:27:28.099951+0000","last_peered":"2023-11-18T21:27:28.099951+0000","last_clean":"2023-11-18T21:27:28.099951+0000","last_became_active":"2023-11-18T20:59:35.831804+0000","last_became_peered":"2023-11-18T20:59:35.831804+0000","last_unstale":"2023-11-18T21:27:28.099951+0000","last_undegraded":"2023-11-18T21:27:28.099951+0000","last_fullsized":"2023-11-18T21:27:28.099951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:13.050905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":9539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'55","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.664165+0000","last_change":"2023-11-18T20:59:27.884733+0000","last_active":"2023-11-18T21:28:43.664165+0000","last_peered":"2023-11-18T21:28:43.664165+0000","last_clean":"2023-11-18T21:28:43.664165+0000","last_became_active":"2023-11-18T20:59:27.884143+0000","last_became_peered":"2023-11-18T20:59:27.884143+0000","last_unstale":"2023-11-18T21:28:43.664165+0000","last_undegraded":"2023-11-18T21:28:43.664165+0000","last_fullsized":"2023-11-18T21:28:43.664165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:32.466816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"31'147","reported_seq":181,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:11.998500+0000","last_change":"2023-11-18T20:59:25.362761+0000","last_active":"2023-11-18T21:28:11.998500+0000","last_peered":"2023-11-18T21:28:11.998500+0000","last_clean":"2023-11-18T21:28:11.998500+0000","last_became_active":"2023-11-18T20:59:25.362350+0000","last_became_peered":"2023-11-18T20:59:25.362350+0000","last_unstale":"2023-11-18T21:28:11.998500+0000","last_undegraded":"2023-11-18T21:28:11.998500+0000","last_fullsized":"2023-11-18T21:28:11.998500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:32:54.741681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"31'80","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.936662+0000","last_change":"2023-11-18T20:59:35.836797+0000","last_active":"2023-11-18T21:27:27.936662+0000","last_peered":"2023-11-18T21:27:27.936662+0000","last_clean":"2023-11-18T21:27:27.936662+0000","last_became_active":"2023-11-18T20:59:35.834153+0000","last_became_peered":"2023-11-18T20:59:35.834153+0000","last_unstale":"2023-11-18T21:27:27.936662+0000","last_undegraded":"2023-11-18T21:27:27.936662+0000","last_fullsized":"2023-11-18T21:27:27.936662+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:18.639780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'47","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.626927+0000","last_change":"2023-11-18T20:59:27.841401+0000","last_active":"2023-11-18T21:28:43.626927+0000","last_peered":"2023-11-18T21:28:43.626927+0000","last_clean":"2023-11-18T21:28:43.626927+0000","last_became_active":"2023-11-18T20:59:27.840852+0000","last_became_peered":"2023-11-18T20:59:27.840852+0000","last_unstale":"2023-11-18T21:28:43.626927+0000","last_undegraded":"2023-11-18T21:28:43.626927+0000","last_fullsized":"2023-11-18T21:28:43.626927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"31'840","reported_seq":874,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.081381+0000","last_change":"2023-11-18T20:59:25.351707+0000","last_active":"2023-11-18T21:28:43.081381+0000","last_peered":"2023-11-18T21:28:43.081381+0000","last_clean":"2023-11-18T21:28:43.081381+0000","last_became_active":"2023-11-18T20:59:25.351149+0000","last_became_peered":"2023-11-18T20:59:25.351149+0000","last_unstale":"2023-11-18T21:28:43.081381+0000","last_undegraded":"2023-11-18T21:28:43.081381+0000","last_fullsized":"2023-11-18T21:28:43.081381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:37:55.630369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3704571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":4031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"31'77","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.952612+0000","last_change":"2023-11-18T20:59:35.844046+0000","last_active":"2023-11-18T21:27:27.952612+0000","last_peered":"2023-11-18T21:27:27.952612+0000","last_clean":"2023-11-18T21:27:27.952612+0000","last_became_active":"2023-11-18T20:59:35.843208+0000","last_became_peered":"2023-11-18T20:59:35.843208+0000","last_unstale":"2023-11-18T21:27:27.952612+0000","last_undegraded":"2023-11-18T21:27:27.952612+0000","last_fullsized":"2023-11-18T21:27:27.952612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:21:06.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":6277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'59","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.670708+0000","last_change":"2023-11-18T20:59:27.866997+0000","last_active":"2023-11-18T21:28:43.670708+0000","last_peered":"2023-11-18T21:28:43.670708+0000","last_clean":"2023-11-18T21:28:43.670708+0000","last_became_active":"2023-11-18T20:59:27.866233+0000","last_became_peered":"2023-11-18T20:59:27.866233+0000","last_unstale":"2023-11-18T21:28:43.670708+0000","last_undegraded":"2023-11-18T21:28:43.670708+0000","last_fullsized":"2023-11-18T21:28:43.670708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:19.998748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"31'93","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.127406+0000","last_change":"2023-11-18T20:59:25.362589+0000","last_active":"2023-11-18T21:28:26.127406+0000","last_peered":"2023-11-18T21:28:26.127406+0000","last_clean":"2023-11-18T21:28:26.127406+0000","last_became_active":"2023-11-18T20:59:25.362287+0000","last_became_peered":"2023-11-18T20:59:25.362287+0000","last_unstale":"2023-11-18T21:28:26.127406+0000","last_undegraded":"2023-11-18T21:28:26.127406+0000","last_fullsized":"2023-11-18T21:28:26.127406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:24.791294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"31'78","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.501676+0000","last_change":"2023-11-18T20:59:35.846859+0000","last_active":"2023-11-18T21:27:18.501676+0000","last_peered":"2023-11-18T21:27:18.501676+0000","last_clean":"2023-11-18T21:27:18.501676+0000","last_became_active":"2023-11-18T20:59:35.845378+0000","last_became_peered":"2023-11-18T20:59:35.845378+0000","last_unstale":"2023-11-18T21:27:18.501676+0000","last_undegraded":"2023-11-18T21:27:18.501676+0000","last_fullsized":"2023-11-18T21:27:18.501676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"31'57","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.633140+0000","last_change":"2023-11-18T20:59:27.863967+0000","last_active":"2023-11-18T21:28:43.633140+0000","last_peered":"2023-11-18T21:28:43.633140+0000","last_clean":"2023-11-18T21:28:43.633140+0000","last_became_active":"2023-11-18T20:59:27.863435+0000","last_became_peered":"2023-11-18T20:59:27.863435+0000","last_unstale":"2023-11-18T21:28:43.633140+0000","last_undegraded":"2023-11-18T21:28:43.633140+0000","last_fullsized":"2023-11-18T21:28:43.633140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:04.837624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"31'121","reported_seq":263,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.070745+0000","last_change":"2023-11-18T20:59:25.361677+0000","last_active":"2023-11-18T21:28:26.070745+0000","last_peered":"2023-11-18T21:28:26.070745+0000","last_clean":"2023-11-18T21:28:26.070745+0000","last_became_active":"2023-11-18T20:59:25.361313+0000","last_became_peered":"2023-11-18T20:59:25.361313+0000","last_unstale":"2023-11-18T21:28:26.070745+0000","last_undegraded":"2023-11-18T21:28:26.070745+0000","last_fullsized":"2023-11-18T21:28:26.070745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25371,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":112,"num_write":121,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"31'82","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.965955+0000","last_change":"2023-11-18T20:59:35.832893+0000","last_active":"2023-11-18T21:27:27.965955+0000","last_peered":"2023-11-18T21:27:27.965955+0000","last_clean":"2023-11-18T21:27:27.965955+0000","last_became_active":"2023-11-18T20:59:35.832562+0000","last_became_peered":"2023-11-18T20:59:35.832562+0000","last_unstale":"2023-11-18T21:27:27.965955+0000","last_undegraded":"2023-11-18T21:27:27.965955+0000","last_fullsized":"2023-11-18T21:27:27.965955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:53:05.127511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":7445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'55","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678154+0000","last_change":"2023-11-18T20:59:27.874128+0000","last_active":"2023-11-18T21:28:43.678154+0000","last_peered":"2023-11-18T21:28:43.678154+0000","last_clean":"2023-11-18T21:28:43.678154+0000","last_became_active":"2023-11-18T20:59:27.865971+0000","last_became_peered":"2023-11-18T20:59:27.865971+0000","last_unstale":"2023-11-18T21:28:43.678154+0000","last_undegraded":"2023-11-18T21:28:43.678154+0000","last_fullsized":"2023-11-18T21:28:43.678154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"31'1150","reported_seq":1184,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.293706+0000","last_change":"2023-11-18T20:59:25.350262+0000","last_active":"2023-11-18T21:28:32.293706+0000","last_peered":"2023-11-18T21:28:32.293706+0000","last_clean":"2023-11-18T21:28:32.293706+0000","last_became_active":"2023-11-18T20:59:25.349577+0000","last_became_peered":"2023-11-18T20:59:25.349577+0000","last_unstale":"2023-11-18T21:28:32.293706+0000","last_undegraded":"2023-11-18T21:28:32.293706+0000","last_fullsized":"2023-11-18T21:28:32.293706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":4577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"31'99","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:26.994212+0000","last_change":"2023-11-18T20:59:35.849720+0000","last_active":"2023-11-18T21:27:26.994212+0000","last_peered":"2023-11-18T21:27:26.994212+0000","last_clean":"2023-11-18T21:27:26.994212+0000","last_became_active":"2023-11-18T20:59:35.848000+0000","last_became_peered":"2023-11-18T20:59:35.848000+0000","last_unstale":"2023-11-18T21:27:26.994212+0000","last_undegraded":"2023-11-18T21:27:26.994212+0000","last_fullsized":"2023-11-18T21:27:26.994212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:41:54.553006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":10947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"31'51","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.641202+0000","last_change":"2023-11-18T20:59:27.891817+0000","last_active":"2023-11-18T21:28:43.641202+0000","last_peered":"2023-11-18T21:28:43.641202+0000","last_clean":"2023-11-18T21:28:43.641202+0000","last_became_active":"2023-11-18T20:59:27.891260+0000","last_became_peered":"2023-11-18T20:59:27.891260+0000","last_unstale":"2023-11-18T21:28:43.641202+0000","last_undegraded":"2023-11-18T21:28:43.641202+0000","last_fullsized":"2023-11-18T21:28:43.641202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:25.331055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"31'67","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:33.868078+0000","last_change":"2023-11-18T20:59:25.363983+0000","last_active":"2023-11-18T21:28:33.868078+0000","last_peered":"2023-11-18T21:28:33.868078+0000","last_clean":"2023-11-18T21:28:33.868078+0000","last_became_active":"2023-11-18T20:59:25.363289+0000","last_became_peered":"2023-11-18T20:59:25.363289+0000","last_unstale":"2023-11-18T21:28:33.868078+0000","last_undegraded":"2023-11-18T21:28:33.868078+0000","last_fullsized":"2023-11-18T21:28:33.868078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"31'68","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.149401+0000","last_change":"2023-11-18T20:59:35.771712+0000","last_active":"2023-11-18T21:27:28.149401+0000","last_peered":"2023-11-18T21:27:28.149401+0000","last_clean":"2023-11-18T21:27:28.149401+0000","last_became_active":"2023-11-18T20:59:35.771263+0000","last_became_peered":"2023-11-18T20:59:35.771263+0000","last_unstale":"2023-11-18T21:27:28.149401+0000","last_undegraded":"2023-11-18T21:27:28.149401+0000","last_fullsized":"2023-11-18T21:27:28.149401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":272,"num_write":61,"num_write_kb":11998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"31'64","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.648283+0000","last_change":"2023-11-18T20:59:27.834172+0000","last_active":"2023-11-18T21:28:43.648283+0000","last_peered":"2023-11-18T21:28:43.648283+0000","last_clean":"2023-11-18T21:28:43.648283+0000","last_became_active":"2023-11-18T20:59:27.832589+0000","last_became_peered":"2023-11-18T20:59:27.832589+0000","last_unstale":"2023-11-18T21:28:43.648283+0000","last_undegraded":"2023-11-18T21:28:43.648283+0000","last_fullsized":"2023-11-18T21:28:43.648283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"31'116","reported_seq":259,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:11.762077+0000","last_change":"2023-11-18T20:59:25.494236+0000","last_active":"2023-11-18T21:28:11.762077+0000","last_peered":"2023-11-18T21:28:11.762077+0000","last_clean":"2023-11-18T21:28:11.762077+0000","last_became_active":"2023-11-18T20:59:25.493373+0000","last_became_peered":"2023-11-18T20:59:25.493373+0000","last_unstale":"2023-11-18T21:28:11.762077+0000","last_undegraded":"2023-11-18T21:28:11.762077+0000","last_fullsized":"2023-11-18T21:28:11.762077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:13.859109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20332,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":112,"num_write":115,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'93","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:21.763452+0000","last_change":"2023-11-18T20:59:35.773319+0000","last_active":"2023-11-18T21:27:21.763452+0000","last_peered":"2023-11-18T21:27:21.763452+0000","last_clean":"2023-11-18T21:27:21.763452+0000","last_became_active":"2023-11-18T20:59:35.772563+0000","last_became_peered":"2023-11-18T20:59:35.772563+0000","last_unstale":"2023-11-18T21:27:21.763452+0000","last_undegraded":"2023-11-18T21:27:21.763452+0000","last_fullsized":"2023-11-18T21:27:21.763452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:12.287749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":9621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'57","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.695084+0000","last_change":"2023-11-18T20:59:27.892789+0000","last_active":"2023-11-18T21:28:43.695084+0000","last_peered":"2023-11-18T21:28:43.695084+0000","last_clean":"2023-11-18T21:28:43.695084+0000","last_became_active":"2023-11-18T20:59:27.891883+0000","last_became_peered":"2023-11-18T20:59:27.891883+0000","last_unstale":"2023-11-18T21:28:43.695084+0000","last_undegraded":"2023-11-18T21:28:43.695084+0000","last_fullsized":"2023-11-18T21:28:43.695084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:12.020475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"31'158","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.392162+0000","last_change":"2023-11-18T20:59:25.497309+0000","last_active":"2023-11-18T21:28:32.392162+0000","last_peered":"2023-11-18T21:28:32.392162+0000","last_clean":"2023-11-18T21:28:32.392162+0000","last_became_active":"2023-11-18T20:59:25.496680+0000","last_became_peered":"2023-11-18T20:59:25.496680+0000","last_unstale":"2023-11-18T21:28:32.392162+0000","last_undegraded":"2023-11-18T21:28:32.392162+0000","last_fullsized":"2023-11-18T21:28:32.392162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"31'67","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.919444+0000","last_change":"2023-11-18T20:59:35.842258+0000","last_active":"2023-11-18T21:27:27.919444+0000","last_peered":"2023-11-18T21:27:27.919444+0000","last_clean":"2023-11-18T21:27:27.919444+0000","last_became_active":"2023-11-18T20:59:35.838830+0000","last_became_peered":"2023-11-18T20:59:35.838830+0000","last_unstale":"2023-11-18T21:27:27.919444+0000","last_undegraded":"2023-11-18T21:27:27.919444+0000","last_fullsized":"2023-11-18T21:27:27.919444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:12:39.697374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":8132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"31'63","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:21.787641+0000","last_change":"2023-11-18T20:59:35.839178+0000","last_active":"2023-11-18T21:27:21.787641+0000","last_peered":"2023-11-18T21:27:21.787641+0000","last_clean":"2023-11-18T21:27:21.787641+0000","last_became_active":"2023-11-18T20:59:35.838375+0000","last_became_peered":"2023-11-18T20:59:35.838375+0000","last_unstale":"2023-11-18T21:27:21.787641+0000","last_undegraded":"2023-11-18T21:27:21.787641+0000","last_fullsized":"2023-11-18T21:27:21.787641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:56:09.565932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"31'61","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.578789+0000","last_change":"2023-11-18T20:59:27.689539+0000","last_active":"2023-11-18T21:28:43.578789+0000","last_peered":"2023-11-18T21:28:43.578789+0000","last_clean":"2023-11-18T21:28:43.578789+0000","last_became_active":"2023-11-18T20:59:27.688522+0000","last_became_peered":"2023-11-18T20:59:27.688522+0000","last_unstale":"2023-11-18T21:28:43.578789+0000","last_undegraded":"2023-11-18T21:28:43.578789+0000","last_fullsized":"2023-11-18T21:28:43.578789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:06:48.337696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"31'7","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:51.862615+0000","last_change":"2023-11-18T20:59:25.494125+0000","last_active":"2023-11-18T21:27:51.862615+0000","last_peered":"2023-11-18T21:27:51.862615+0000","last_clean":"2023-11-18T21:27:51.862615+0000","last_became_active":"2023-11-18T20:59:25.493357+0000","last_became_peered":"2023-11-18T20:59:25.493357+0000","last_unstale":"2023-11-18T21:27:51.862615+0000","last_undegraded":"2023-11-18T21:27:51.862615+0000","last_fullsized":"2023-11-18T21:27:51.862615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'97","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.014725+0000","last_change":"2023-11-18T20:59:35.776653+0000","last_active":"2023-11-18T21:27:27.014725+0000","last_peered":"2023-11-18T21:27:27.014725+0000","last_clean":"2023-11-18T21:27:27.014725+0000","last_became_active":"2023-11-18T20:59:35.776138+0000","last_became_peered":"2023-11-18T20:59:35.776138+0000","last_unstale":"2023-11-18T21:27:27.014725+0000","last_undegraded":"2023-11-18T21:27:27.014725+0000","last_fullsized":"2023-11-18T21:27:27.014725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:08:25.933599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'54","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.642467+0000","last_change":"2023-11-18T20:59:27.860987+0000","last_active":"2023-11-18T21:28:43.642467+0000","last_peered":"2023-11-18T21:28:43.642467+0000","last_clean":"2023-11-18T21:28:43.642467+0000","last_became_active":"2023-11-18T20:59:27.860537+0000","last_became_peered":"2023-11-18T20:59:27.860537+0000","last_unstale":"2023-11-18T21:28:43.642467+0000","last_undegraded":"2023-11-18T21:28:43.642467+0000","last_fullsized":"2023-11-18T21:28:43.642467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"31'228","reported_seq":485,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.255998+0000","last_change":"2023-11-18T20:59:25.354967+0000","last_active":"2023-11-18T21:28:32.255998+0000","last_peered":"2023-11-18T21:28:32.255998+0000","last_clean":"2023-11-18T21:28:32.255998+0000","last_became_active":"2023-11-18T20:59:25.354690+0000","last_became_peered":"2023-11-18T20:59:25.354690+0000","last_unstale":"2023-11-18T21:28:32.255998+0000","last_undegraded":"2023-11-18T21:28:32.255998+0000","last_fullsized":"2023-11-18T21:28:32.255998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:50.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34720,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":223,"num_read_kb":227,"num_write":228,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"31'175","reported_seq":370,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.108932+0000","last_change":"2023-11-18T20:59:25.346493+0000","last_active":"2023-11-18T21:28:26.108932+0000","last_peered":"2023-11-18T21:28:26.108932+0000","last_clean":"2023-11-18T21:28:26.108932+0000","last_became_active":"2023-11-18T20:59:25.346192+0000","last_became_peered":"2023-11-18T20:59:25.346192+0000","last_unstale":"2023-11-18T21:28:26.108932+0000","last_undegraded":"2023-11-18T21:28:26.108932+0000","last_fullsized":"2023-11-18T21:28:26.108932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:30.162962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":165,"num_write":171,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'63","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.671087+0000","last_change":"2023-11-18T20:59:27.868460+0000","last_active":"2023-11-18T21:28:43.671087+0000","last_peered":"2023-11-18T21:28:43.671087+0000","last_clean":"2023-11-18T21:28:43.671087+0000","last_became_active":"2023-11-18T20:59:27.867886+0000","last_became_peered":"2023-11-18T20:59:27.867886+0000","last_unstale":"2023-11-18T21:28:43.671087+0000","last_undegraded":"2023-11-18T21:28:43.671087+0000","last_fullsized":"2023-11-18T21:28:43.671087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:39.647294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'95","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.021970+0000","last_change":"2023-11-18T20:59:35.851163+0000","last_active":"2023-11-18T21:27:27.021970+0000","last_peered":"2023-11-18T21:27:27.021970+0000","last_clean":"2023-11-18T21:27:27.021970+0000","last_became_active":"2023-11-18T20:59:35.850427+0000","last_became_peered":"2023-11-18T20:59:35.850427+0000","last_unstale":"2023-11-18T21:27:27.021970+0000","last_undegraded":"2023-11-18T21:27:27.021970+0000","last_fullsized":"2023-11-18T21:27:27.021970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:20.729626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2343","reported_seq":2376,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.081692+0000","last_change":"2023-11-18T20:59:25.462276+0000","last_active":"2023-11-18T21:28:43.081692+0000","last_peered":"2023-11-18T21:28:43.081692+0000","last_clean":"2023-11-18T21:28:43.081692+0000","last_became_active":"2023-11-18T20:59:25.460449+0000","last_became_peered":"2023-11-18T20:59:25.460449+0000","last_unstale":"2023-11-18T21:28:43.081692+0000","last_undegraded":"2023-11-18T21:28:43.081692+0000","last_fullsized":"2023-11-18T21:28:43.081692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2343,"log_dups_size":0,"ondisk_log_size":2343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:25:57.950600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8759326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2333,"num_write_kb":9750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"31'69","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.626007+0000","last_change":"2023-11-18T20:59:27.841332+0000","last_active":"2023-11-18T21:28:43.626007+0000","last_peered":"2023-11-18T21:28:43.626007+0000","last_clean":"2023-11-18T21:28:43.626007+0000","last_became_active":"2023-11-18T20:59:27.840528+0000","last_became_peered":"2023-11-18T20:59:27.840528+0000","last_unstale":"2023-11-18T21:28:43.626007+0000","last_undegraded":"2023-11-18T21:28:43.626007+0000","last_fullsized":"2023-11-18T21:28:43.626007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"31'65","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:26.984823+0000","last_change":"2023-11-18T20:59:35.776844+0000","last_active":"2023-11-18T21:27:26.984823+0000","last_peered":"2023-11-18T21:27:26.984823+0000","last_clean":"2023-11-18T21:27:26.984823+0000","last_became_active":"2023-11-18T20:59:35.775977+0000","last_became_peered":"2023-11-18T20:59:35.775977+0000","last_unstale":"2023-11-18T21:27:26.984823+0000","last_undegraded":"2023-11-18T21:27:26.984823+0000","last_fullsized":"2023-11-18T21:27:26.984823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:06:00.187752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"31'59","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.669791+0000","last_change":"2023-11-18T20:59:27.888673+0000","last_active":"2023-11-18T21:28:43.669791+0000","last_peered":"2023-11-18T21:28:43.669791+0000","last_clean":"2023-11-18T21:28:43.669791+0000","last_became_active":"2023-11-18T20:59:27.887716+0000","last_became_peered":"2023-11-18T20:59:27.887716+0000","last_unstale":"2023-11-18T21:28:43.669791+0000","last_undegraded":"2023-11-18T21:28:43.669791+0000","last_fullsized":"2023-11-18T21:28:43.669791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"31'67","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.471935+0000","last_change":"2023-11-18T20:59:27.684810+0000","last_active":"2023-11-18T21:28:43.471935+0000","last_peered":"2023-11-18T21:28:43.471935+0000","last_clean":"2023-11-18T21:28:43.471935+0000","last_became_active":"2023-11-18T20:59:27.680712+0000","last_became_peered":"2023-11-18T20:59:27.680712+0000","last_unstale":"2023-11-18T21:28:43.471935+0000","last_undegraded":"2023-11-18T21:28:43.471935+0000","last_fullsized":"2023-11-18T21:28:43.471935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"31'57","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.646654+0000","last_change":"2023-11-18T20:59:27.835960+0000","last_active":"2023-11-18T21:28:43.646654+0000","last_peered":"2023-11-18T21:28:43.646654+0000","last_clean":"2023-11-18T21:28:43.646654+0000","last_became_active":"2023-11-18T20:59:27.835120+0000","last_became_peered":"2023-11-18T20:59:27.835120+0000","last_unstale":"2023-11-18T21:28:43.646654+0000","last_undegraded":"2023-11-18T21:28:43.646654+0000","last_fullsized":"2023-11-18T21:28:43.646654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:35:51.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"31'59","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.632517+0000","last_change":"2023-11-18T20:59:27.833652+0000","last_active":"2023-11-18T21:28:43.632517+0000","last_peered":"2023-11-18T21:28:43.632517+0000","last_clean":"2023-11-18T21:28:43.632517+0000","last_became_active":"2023-11-18T20:59:27.833049+0000","last_became_peered":"2023-11-18T20:59:27.833049+0000","last_unstale":"2023-11-18T21:28:43.632517+0000","last_undegraded":"2023-11-18T21:28:43.632517+0000","last_fullsized":"2023-11-18T21:28:43.632517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:23.262919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"31'40","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.654877+0000","last_change":"2023-11-18T20:59:27.878824+0000","last_active":"2023-11-18T21:28:43.654877+0000","last_peered":"2023-11-18T21:28:43.654877+0000","last_clean":"2023-11-18T21:28:43.654877+0000","last_became_active":"2023-11-18T20:59:27.878353+0000","last_became_peered":"2023-11-18T20:59:27.878353+0000","last_unstale":"2023-11-18T21:28:43.654877+0000","last_undegraded":"2023-11-18T21:28:43.654877+0000","last_fullsized":"2023-11-18T21:28:43.654877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:04.074467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'50","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.581622+0000","last_change":"2023-11-18T20:59:27.866570+0000","last_active":"2023-11-18T21:28:43.581622+0000","last_peered":"2023-11-18T21:28:43.581622+0000","last_clean":"2023-11-18T21:28:43.581622+0000","last_became_active":"2023-11-18T20:59:27.866165+0000","last_became_peered":"2023-11-18T20:59:27.866165+0000","last_unstale":"2023-11-18T21:28:43.581622+0000","last_undegraded":"2023-11-18T21:28:43.581622+0000","last_fullsized":"2023-11-18T21:28:43.581622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:05:51.974471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"31'55","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.693558+0000","last_change":"2023-11-18T20:59:27.895340+0000","last_active":"2023-11-18T21:28:43.693558+0000","last_peered":"2023-11-18T21:28:43.693558+0000","last_clean":"2023-11-18T21:28:43.693558+0000","last_became_active":"2023-11-18T20:59:27.893918+0000","last_became_peered":"2023-11-18T20:59:27.893918+0000","last_unstale":"2023-11-18T21:28:43.693558+0000","last_undegraded":"2023-11-18T21:28:43.693558+0000","last_fullsized":"2023-11-18T21:28:43.693558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:11.899550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"31'49","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630693+0000","last_change":"2023-11-18T20:59:27.839127+0000","last_active":"2023-11-18T21:28:43.630693+0000","last_peered":"2023-11-18T21:28:43.630693+0000","last_clean":"2023-11-18T21:28:43.630693+0000","last_became_active":"2023-11-18T20:59:27.838509+0000","last_became_peered":"2023-11-18T20:59:27.838509+0000","last_unstale":"2023-11-18T21:28:43.630693+0000","last_undegraded":"2023-11-18T21:28:43.630693+0000","last_fullsized":"2023-11-18T21:28:43.630693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"31'60","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.628797+0000","last_change":"2023-11-18T20:59:27.836167+0000","last_active":"2023-11-18T21:28:43.628797+0000","last_peered":"2023-11-18T21:28:43.628797+0000","last_clean":"2023-11-18T21:28:43.628797+0000","last_became_active":"2023-11-18T20:59:27.835226+0000","last_became_peered":"2023-11-18T20:59:27.835226+0000","last_unstale":"2023-11-18T21:28:43.628797+0000","last_undegraded":"2023-11-18T21:28:43.628797+0000","last_fullsized":"2023-11-18T21:28:43.628797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:23:46.608216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'73","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.661836+0000","last_change":"2023-11-18T20:59:27.889937+0000","last_active":"2023-11-18T21:28:43.661836+0000","last_peered":"2023-11-18T21:28:43.661836+0000","last_clean":"2023-11-18T21:28:43.661836+0000","last_became_active":"2023-11-18T20:59:27.889325+0000","last_became_peered":"2023-11-18T20:59:27.889325+0000","last_unstale":"2023-11-18T21:28:43.661836+0000","last_undegraded":"2023-11-18T21:28:43.661836+0000","last_fullsized":"2023-11-18T21:28:43.661836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:39.674424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"31'63","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.670691+0000","last_change":"2023-11-18T20:59:27.867439+0000","last_active":"2023-11-18T21:28:43.670691+0000","last_peered":"2023-11-18T21:28:43.670691+0000","last_clean":"2023-11-18T21:28:43.670691+0000","last_became_active":"2023-11-18T20:59:27.866609+0000","last_became_peered":"2023-11-18T20:59:27.866609+0000","last_unstale":"2023-11-18T21:28:43.670691+0000","last_undegraded":"2023-11-18T21:28:43.670691+0000","last_fullsized":"2023-11-18T21:28:43.670691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:46:49.094141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'64","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.615236+0000","last_change":"2023-11-18T20:59:27.883416+0000","last_active":"2023-11-18T21:28:43.615236+0000","last_peered":"2023-11-18T21:28:43.615236+0000","last_clean":"2023-11-18T21:28:43.615236+0000","last_became_active":"2023-11-18T20:59:27.882976+0000","last_became_peered":"2023-11-18T20:59:27.882976+0000","last_unstale":"2023-11-18T21:28:43.615236+0000","last_undegraded":"2023-11-18T21:28:43.615236+0000","last_fullsized":"2023-11-18T21:28:43.615236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:12.611142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"31'51","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.679081+0000","last_change":"2023-11-18T20:59:27.873520+0000","last_active":"2023-11-18T21:28:43.679081+0000","last_peered":"2023-11-18T21:28:43.679081+0000","last_clean":"2023-11-18T21:28:43.679081+0000","last_became_active":"2023-11-18T20:59:27.872627+0000","last_became_peered":"2023-11-18T20:59:27.872627+0000","last_unstale":"2023-11-18T21:28:43.679081+0000","last_undegraded":"2023-11-18T21:28:43.679081+0000","last_fullsized":"2023-11-18T21:28:43.679081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"31'60","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.654001+0000","last_change":"2023-11-18T20:59:27.687118+0000","last_active":"2023-11-18T21:28:43.654001+0000","last_peered":"2023-11-18T21:28:43.654001+0000","last_clean":"2023-11-18T21:28:43.654001+0000","last_became_active":"2023-11-18T20:59:27.686311+0000","last_became_peered":"2023-11-18T20:59:27.686311+0000","last_unstale":"2023-11-18T21:28:43.654001+0000","last_undegraded":"2023-11-18T21:28:43.654001+0000","last_fullsized":"2023-11-18T21:28:43.654001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:25:27.490214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'65","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.471465+0000","last_change":"2023-11-18T20:59:27.892404+0000","last_active":"2023-11-18T21:28:43.471465+0000","last_peered":"2023-11-18T21:28:43.471465+0000","last_clean":"2023-11-18T21:28:43.471465+0000","last_became_active":"2023-11-18T20:59:27.891767+0000","last_became_peered":"2023-11-18T20:59:27.891767+0000","last_unstale":"2023-11-18T21:28:43.471465+0000","last_undegraded":"2023-11-18T21:28:43.471465+0000","last_fullsized":"2023-11-18T21:28:43.471465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"31'51","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.669452+0000","last_change":"2023-11-18T20:59:27.866920+0000","last_active":"2023-11-18T21:28:43.669452+0000","last_peered":"2023-11-18T21:28:43.669452+0000","last_clean":"2023-11-18T21:28:43.669452+0000","last_became_active":"2023-11-18T20:59:27.866153+0000","last_became_peered":"2023-11-18T20:59:27.866153+0000","last_unstale":"2023-11-18T21:28:43.669452+0000","last_undegraded":"2023-11-18T21:28:43.669452+0000","last_fullsized":"2023-11-18T21:28:43.669452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:50:43.894365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'60","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.664304+0000","last_change":"2023-11-18T20:59:27.890399+0000","last_active":"2023-11-18T21:28:43.664304+0000","last_peered":"2023-11-18T21:28:43.664304+0000","last_clean":"2023-11-18T21:28:43.664304+0000","last_became_active":"2023-11-18T20:59:27.889704+0000","last_became_peered":"2023-11-18T20:59:27.889704+0000","last_unstale":"2023-11-18T21:28:43.664304+0000","last_undegraded":"2023-11-18T21:28:43.664304+0000","last_fullsized":"2023-11-18T21:28:43.664304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:34:37.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"31'63","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.670763+0000","last_change":"2023-11-18T20:59:27.871794+0000","last_active":"2023-11-18T21:28:43.670763+0000","last_peered":"2023-11-18T21:28:43.670763+0000","last_clean":"2023-11-18T21:28:43.670763+0000","last_became_active":"2023-11-18T20:59:27.871337+0000","last_became_peered":"2023-11-18T20:59:27.871337+0000","last_unstale":"2023-11-18T21:28:43.670763+0000","last_undegraded":"2023-11-18T21:28:43.670763+0000","last_fullsized":"2023-11-18T21:28:43.670763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:16.370847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"31'53","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.584958+0000","last_change":"2023-11-18T20:59:27.867288+0000","last_active":"2023-11-18T21:28:43.584958+0000","last_peered":"2023-11-18T21:28:43.584958+0000","last_clean":"2023-11-18T21:28:43.584958+0000","last_became_active":"2023-11-18T20:59:27.866560+0000","last_became_peered":"2023-11-18T20:59:27.866560+0000","last_unstale":"2023-11-18T21:28:43.584958+0000","last_undegraded":"2023-11-18T21:28:43.584958+0000","last_fullsized":"2023-11-18T21:28:43.584958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"31'52","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.669336+0000","last_change":"2023-11-18T20:59:27.878944+0000","last_active":"2023-11-18T21:28:43.669336+0000","last_peered":"2023-11-18T21:28:43.669336+0000","last_clean":"2023-11-18T21:28:43.669336+0000","last_became_active":"2023-11-18T20:59:27.878485+0000","last_became_peered":"2023-11-18T20:59:27.878485+0000","last_unstale":"2023-11-18T21:28:43.669336+0000","last_undegraded":"2023-11-18T21:28:43.669336+0000","last_fullsized":"2023-11-18T21:28:43.669336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:04.749189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"31'53","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678771+0000","last_change":"2023-11-18T20:59:27.874019+0000","last_active":"2023-11-18T21:28:43.678771+0000","last_peered":"2023-11-18T21:28:43.678771+0000","last_clean":"2023-11-18T21:28:43.678771+0000","last_became_active":"2023-11-18T20:59:27.873255+0000","last_became_peered":"2023-11-18T20:59:27.873255+0000","last_unstale":"2023-11-18T21:28:43.678771+0000","last_undegraded":"2023-11-18T21:28:43.678771+0000","last_fullsized":"2023-11-18T21:28:43.678771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"31'53","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.677510+0000","last_change":"2023-11-18T20:59:27.868086+0000","last_active":"2023-11-18T21:28:43.677510+0000","last_peered":"2023-11-18T21:28:43.677510+0000","last_clean":"2023-11-18T21:28:43.677510+0000","last_became_active":"2023-11-18T20:59:27.866901+0000","last_became_peered":"2023-11-18T20:59:27.866901+0000","last_unstale":"2023-11-18T21:28:43.677510+0000","last_undegraded":"2023-11-18T21:28:43.677510+0000","last_fullsized":"2023-11-18T21:28:43.677510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"31'59","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.675973+0000","last_change":"2023-11-18T20:59:27.888617+0000","last_active":"2023-11-18T21:28:43.675973+0000","last_peered":"2023-11-18T21:28:43.675973+0000","last_clean":"2023-11-18T21:28:43.675973+0000","last_became_active":"2023-11-18T20:59:27.888068+0000","last_became_peered":"2023-11-18T20:59:27.888068+0000","last_unstale":"2023-11-18T21:28:43.675973+0000","last_undegraded":"2023-11-18T21:28:43.675973+0000","last_fullsized":"2023-11-18T21:28:43.675973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:53.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"31'46","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.632841+0000","last_change":"2023-11-18T20:59:27.684428+0000","last_active":"2023-11-18T21:28:43.632841+0000","last_peered":"2023-11-18T21:28:43.632841+0000","last_clean":"2023-11-18T21:28:43.632841+0000","last_became_active":"2023-11-18T20:59:27.682936+0000","last_became_peered":"2023-11-18T20:59:27.682936+0000","last_unstale":"2023-11-18T21:28:43.632841+0000","last_undegraded":"2023-11-18T21:28:43.632841+0000","last_fullsized":"2023-11-18T21:28:43.632841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:52.955875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"31'66","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.672196+0000","last_change":"2023-11-18T20:59:27.865937+0000","last_active":"2023-11-18T21:28:43.672196+0000","last_peered":"2023-11-18T21:28:43.672196+0000","last_clean":"2023-11-18T21:28:43.672196+0000","last_became_active":"2023-11-18T20:59:27.865401+0000","last_became_peered":"2023-11-18T20:59:27.865401+0000","last_unstale":"2023-11-18T21:28:43.672196+0000","last_undegraded":"2023-11-18T21:28:43.672196+0000","last_fullsized":"2023-11-18T21:28:43.672196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:00.251369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"31'51","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.668462+0000","last_change":"2023-11-18T20:59:27.865748+0000","last_active":"2023-11-18T21:28:43.668462+0000","last_peered":"2023-11-18T21:28:43.668462+0000","last_clean":"2023-11-18T21:28:43.668462+0000","last_became_active":"2023-11-18T20:59:27.864956+0000","last_became_peered":"2023-11-18T20:59:27.864956+0000","last_unstale":"2023-11-18T21:28:43.668462+0000","last_undegraded":"2023-11-18T21:28:43.668462+0000","last_fullsized":"2023-11-18T21:28:43.668462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"31'38","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.667115+0000","last_change":"2023-11-18T20:59:27.889838+0000","last_active":"2023-11-18T21:28:43.667115+0000","last_peered":"2023-11-18T21:28:43.667115+0000","last_clean":"2023-11-18T21:28:43.667115+0000","last_became_active":"2023-11-18T20:59:27.889307+0000","last_became_peered":"2023-11-18T20:59:27.889307+0000","last_unstale":"2023-11-18T21:28:43.667115+0000","last_undegraded":"2023-11-18T21:28:43.667115+0000","last_fullsized":"2023-11-18T21:28:43.667115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'47","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.671477+0000","last_change":"2023-11-18T20:59:27.866394+0000","last_active":"2023-11-18T21:28:43.671477+0000","last_peered":"2023-11-18T21:28:43.671477+0000","last_clean":"2023-11-18T21:28:43.671477+0000","last_became_active":"2023-11-18T20:59:27.865625+0000","last_became_peered":"2023-11-18T20:59:27.865625+0000","last_unstale":"2023-11-18T21:28:43.671477+0000","last_undegraded":"2023-11-18T21:28:43.671477+0000","last_fullsized":"2023-11-18T21:28:43.671477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"31'54","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.662646+0000","last_change":"2023-11-18T20:59:27.892765+0000","last_active":"2023-11-18T21:28:43.662646+0000","last_peered":"2023-11-18T21:28:43.662646+0000","last_clean":"2023-11-18T21:28:43.662646+0000","last_became_active":"2023-11-18T20:59:27.891753+0000","last_became_peered":"2023-11-18T20:59:27.891753+0000","last_unstale":"2023-11-18T21:28:43.662646+0000","last_undegraded":"2023-11-18T21:28:43.662646+0000","last_fullsized":"2023-11-18T21:28:43.662646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:52.955875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"31'63","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630861+0000","last_change":"2023-11-18T20:59:27.837531+0000","last_active":"2023-11-18T21:28:43.630861+0000","last_peered":"2023-11-18T21:28:43.630861+0000","last_clean":"2023-11-18T21:28:43.630861+0000","last_became_active":"2023-11-18T20:59:27.836899+0000","last_became_peered":"2023-11-18T20:59:27.836899+0000","last_unstale":"2023-11-18T21:28:43.630861+0000","last_undegraded":"2023-11-18T21:28:43.630861+0000","last_fullsized":"2023-11-18T21:28:43.630861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:04.716391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"31'58","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.639720+0000","last_change":"2023-11-18T20:59:27.864494+0000","last_active":"2023-11-18T21:28:43.639720+0000","last_peered":"2023-11-18T21:28:43.639720+0000","last_clean":"2023-11-18T21:28:43.639720+0000","last_became_active":"2023-11-18T20:59:27.863732+0000","last_became_peered":"2023-11-18T20:59:27.863732+0000","last_unstale":"2023-11-18T21:28:43.639720+0000","last_undegraded":"2023-11-18T21:28:43.639720+0000","last_fullsized":"2023-11-18T21:28:43.639720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"31'63","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678165+0000","last_change":"2023-11-18T20:59:27.873605+0000","last_active":"2023-11-18T21:28:43.678165+0000","last_peered":"2023-11-18T21:28:43.678165+0000","last_clean":"2023-11-18T21:28:43.678165+0000","last_became_active":"2023-11-18T20:59:27.871167+0000","last_became_peered":"2023-11-18T20:59:27.871167+0000","last_unstale":"2023-11-18T21:28:43.678165+0000","last_undegraded":"2023-11-18T21:28:43.678165+0000","last_fullsized":"2023-11-18T21:28:43.678165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:54:51.212807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":448,"num_write":2451,"num_write_kb":251040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2621,"ondisk_log_size":2621,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3577,"ondisk_log_size":3577,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23672018,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":675,"num_read_kb":695,"num_write":9681,"num_write_kb":28189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47595520,"data_stored":47344036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8458,"ondisk_log_size":8458,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509807,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":181032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.90100000000000002,"15min":0.89700000000000002},"min":{"1min":0.51000000000000001,"5min":0.44,"15min":0.34799999999999998},"max":{"1min":1.3280000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.246},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.90800000000000003,"15min":0.93200000000000005},"min":{"1min":0.46100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.393,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92200000000000004,"15min":0.92900000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.3320000000000001,"5min":1.6579999999999999,"15min":1.7210000000000001},"last":1.179},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92100000000000004,"15min":0.93500000000000005},"min":{"1min":0.41599999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4319999999999999,"5min":1.51,"15min":2.524},"last":0.88400000000000001}]},{"osd":2,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.052,"15min":1.052},"min":{"1min":0.53400000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.585,"5min":1.585,"15min":1.694},"last":1.036},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.97699999999999998,"15min":1.01},"min":{"1min":0.47999999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.589},"last":1.006}]},{"osd":3,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.014,"15min":1.0109999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4219999999999999,"5min":1.7509999999999999,"15min":1.831},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.073,"5min":1.0389999999999999,"15min":1.0529999999999999},"min":{"1min":0.57599999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.627,"5min":1.627,"15min":2.4430000000000001},"last":1.216}]},{"osd":4,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.92800000000000005,"15min":0.95199999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4299999999999999,"5min":1.45,"15min":1.601},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0760000000000001,"15min":1.0700000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.40100000000000002},"max":{"1min":1.617,"5min":2.266,"15min":2.266},"last":1.1000000000000001}]},{"osd":5,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.024,"15min":1.0309999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.40300000000000002},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.7509999999999999},"last":1.145},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1040000000000001,"15min":1.1060000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.434},"max":{"1min":1.643,"5min":1.716,"15min":2.0619999999999998},"last":0.93700000000000006}]},{"osd":6,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.127,"15min":1.149},"min":{"1min":0.59199999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":2.1659999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.1850000000000001,"15min":1.1910000000000001},"min":{"1min":0.54600000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.698,"5min":2.181,"15min":2.2080000000000002},"last":1.534}]}]},{"osd":6,"up_from":15,"seq":64424509807,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72804,"kb_used_data":15260,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299036,"statfs":{"total":96636764160,"available":96562212864,"internally_reserved":0,"allocated":15626240,"data_stored":15415703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.91300000000000003},"min":{"1min":0.629,"5min":0.312,"15min":0.312},"max":{"1min":1.4990000000000001,"5min":1.52,"15min":1.72},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.95499999999999996,"15min":0.95599999999999996},"min":{"1min":0.626,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5029999999999999,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.1120000000000001}]},{"osd":1,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.65700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.397,"5min":1.3999999999999999,"15min":1.887},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.111,"5min":0.98699999999999999,"15min":0.99099999999999999},"min":{"1min":0.71699999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.3899999999999999,"5min":3.73,"15min":3.73},"last":1.302}]},{"osd":2,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.95599999999999996,"15min":0.95899999999999996},"min":{"1min":0.69499999999999995,"5min":0.51600000000000001,"15min":0.498},"max":{"1min":1.3580000000000001,"5min":1.48,"15min":1.6459999999999999},"last":1.087},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.0069999999999999,"15min":1.044},"min":{"1min":0.66800000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.4970000000000001,"5min":1.964,"15min":1.964},"last":1.1579999999999999}]},{"osd":3,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.056,"15min":1.0469999999999999},"min":{"1min":0.77700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3400000000000001,"5min":1.7330000000000001,"15min":1.8759999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.105,"5min":1.0780000000000001,"15min":1.0629999999999999},"min":{"1min":0.80600000000000005,"5min":0.55400000000000005,"15min":0.42399999999999999},"max":{"1min":1.2949999999999999,"5min":3.9889999999999999,"15min":3.9889999999999999},"last":0.999}]},{"osd":4,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0269999999999999,"15min":1.0329999999999999},"min":{"1min":0.504,"5min":0.35099999999999998,"15min":0.318},"max":{"1min":1.413,"5min":1.7529999999999999,"15min":2.1030000000000002},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.1040000000000001,"15min":1.1000000000000001},"min":{"1min":0.68600000000000005,"5min":0.50700000000000001,"15min":0.38900000000000001},"max":{"1min":1.577,"5min":1.873,"15min":1.873},"last":1.2270000000000001}]},{"osd":5,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.70199999999999996,"5min":0.621,"15min":0.38600000000000001},"max":{"1min":1.6850000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.159,"15min":1.1699999999999999},"min":{"1min":0.61599999999999999,"5min":0.55000000000000004,"15min":0.35999999999999999},"max":{"1min":1.7789999999999999,"5min":2.194,"15min":2.3700000000000001},"last":1.3380000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1679999999999999,"15min":1.1910000000000001},"min":{"1min":0.73899999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.909,"5min":1.909,"15min":2.1379999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.198,"15min":1.2050000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.45300000000000001},"max":{"1min":1.855,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.1930000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509807,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62884,"kb_used_data":9500,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308956,"statfs":{"total":96636764160,"available":96572370944,"internally_reserved":0,"allocated":9728000,"data_stored":9504573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.88200000000000001,"15min":0.90700000000000003},"min":{"1min":0.55400000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2909999999999999,"5min":1.3899999999999999,"15min":1.494},"last":1.498},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.91300000000000003,"15min":0.94499999999999995},"min":{"1min":0.70599999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.496,"5min":1.5940000000000001,"15min":2.0600000000000001},"last":0.77100000000000002}]},{"osd":1,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.94599999999999995,"15min":0.91800000000000004},"min":{"1min":0.54500000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.4470000000000001,"5min":1.6419999999999999,"15min":1.79},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.91500000000000004,"15min":0.97199999999999998},"min":{"1min":0.76400000000000001,"5min":0.441,"15min":0.39700000000000002},"max":{"1min":1.391,"5min":1.474,"15min":1.794},"last":1.3859999999999999}]},{"osd":2,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.69099999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4059999999999999,"5min":1.504,"15min":2.1379999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.026,"15min":1.0149999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.41199999999999998},"max":{"1min":1.3500000000000001,"5min":1.53,"15min":1.6659999999999999},"last":0.96599999999999997}]},{"osd":3,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.0209999999999999,"15min":1.026},"min":{"1min":0.70599999999999996,"5min":0.60199999999999998,"15min":0.53700000000000003},"max":{"1min":1.2709999999999999,"5min":1.472,"15min":1.5960000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.0629999999999999,"15min":1.0940000000000001},"min":{"1min":0.78200000000000003,"5min":0.51600000000000001,"15min":0.38100000000000001},"max":{"1min":1.5449999999999999,"5min":1.766,"15min":2.2080000000000002},"last":1.0640000000000001}]},{"osd":4,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97099999999999997,"15min":0.98199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.42699999999999999},"max":{"1min":1.2729999999999999,"5min":1.849,"15min":1.9099999999999999},"last":1.131},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.077,"15min":1.089},"min":{"1min":0.64900000000000002,"5min":0.501,"15min":0.439},"max":{"1min":1.3080000000000001,"5min":1.585,"15min":2.4359999999999999},"last":1.1579999999999999}]},{"osd":6,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.054,"15min":1.081},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.32500000000000001},"max":{"1min":1.6240000000000001,"5min":1.6299999999999999,"15min":2.2909999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.105,"15min":1.115},"min":{"1min":0.60899999999999999,"5min":0.58999999999999997,"15min":0.36299999999999999},"max":{"1min":1.405,"5min":1.883,"15min":2.0019999999999998},"last":1.1890000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.147,"15min":1.171},"min":{"1min":0.74199999999999999,"5min":0.52000000000000002,"15min":0.50700000000000001},"max":{"1min":1.4850000000000001,"5min":1.6839999999999999,"15min":2.0209999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.1819999999999999,"15min":1.2230000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.41499999999999998},"max":{"1min":1.5860000000000001,"5min":1.732,"15min":2.2789999999999999},"last":1.448}]}]},{"osd":3,"up_from":15,"seq":64424509806,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60828,"kb_used_data":7444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311012,"statfs":{"total":96636764160,"available":96574476288,"internally_reserved":0,"allocated":7622656,"data_stored":7382745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,20,19],"upper_bound":512},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.52800000000000002,"5min":0.33700000000000002,"15min":0.309},"max":{"1min":1.052,"5min":1.458,"15min":1.458},"last":1.125},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.57299999999999995,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":1.353,"5min":1.3540000000000001,"15min":1.605},"last":1.018}]},{"osd":1,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84299999999999997,"15min":0.84499999999999997},"min":{"1min":0.52400000000000002,"5min":0.372,"15min":0.34899999999999998},"max":{"1min":1.2190000000000001,"5min":1.4510000000000001,"15min":1.7549999999999999},"last":1.593},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76100000000000001,"15min":0.77100000000000002},"min":{"1min":0.48999999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.93700000000000006,"5min":1.629,"15min":1.629},"last":0.58199999999999996}]},{"osd":2,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.99399999999999999,"15min":1.022},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.847},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.98599999999999999,"15min":1.014},"min":{"1min":0.627,"5min":0.36699999999999999,"15min":0.32900000000000001},"max":{"1min":1.5900000000000001,"5min":1.609,"15min":1.794},"last":1.6519999999999999}]},{"osd":4,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0509999999999999,"15min":1.0840000000000001},"min":{"1min":0.71699999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.522,"5min":1.613,"15min":2.0630000000000002},"last":1.744},{"interface":"front","average":{"1min":1.069,"5min":1.034,"15min":1.0569999999999999},"min":{"1min":0.81799999999999995,"5min":0.55500000000000005,"15min":0.439},"max":{"1min":1.2809999999999999,"5min":1.5900000000000001,"15min":1.968},"last":1.7150000000000001}]},{"osd":5,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.099,"15min":1.117},"min":{"1min":0.875,"5min":0.52700000000000002,"15min":0.45200000000000001},"max":{"1min":1.3839999999999999,"5min":1.7090000000000001,"15min":2.1709999999999998},"last":1.788},{"interface":"front","average":{"1min":1.097,"5min":1.1020000000000001,"15min":1.1100000000000001},"min":{"1min":0.79700000000000004,"5min":0.58299999999999996,"15min":0.54900000000000004},"max":{"1min":1.494,"5min":1.736,"15min":1.798},"last":0.54700000000000004}]},{"osd":6,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.115,"15min":1.155},"min":{"1min":0.83399999999999996,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":1.46,"5min":1.5680000000000001,"15min":1.927},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.147,"15min":1.1539999999999999},"min":{"1min":0.70799999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.383,"5min":1.8600000000000001,"15min":1.929},"last":0.50900000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1970000000000001,"15min":1.214},"min":{"1min":0.96499999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.5189999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.2450000000000001,"15min":1.2609999999999999},"min":{"1min":0.85199999999999998,"5min":0.61599999999999999,"15min":0.60299999999999998},"max":{"1min":1.5780000000000001,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.7669999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509806,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36000,"kb_used_data":4824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335840,"statfs":{"total":96636764160,"available":96599900160,"internally_reserved":0,"allocated":4939776,"data_stored":4726754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.72199999999999998,"15min":0.73999999999999999},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.24299999999999999},"max":{"1min":0.98899999999999999,"5min":1.405,"15min":2.04},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.28999999999999998,"15min":0.27300000000000002},"max":{"1min":1.2410000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.78900000000000003}]},{"osd":1,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.85399999999999998,"15min":0.86699999999999999},"min":{"1min":0.48799999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.3029999999999999,"5min":1.5129999999999999,"15min":1.978},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.84899999999999998,"15min":0.88600000000000001},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":1.3320000000000001,"5min":1.552,"15min":1.919},"last":0.60699999999999998}]},{"osd":3,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.83999999999999997,"15min":0.83499999999999996},"min":{"1min":0.54000000000000004,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.377,"5min":1.7090000000000001,"15min":1.8740000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0229999999999999,"15min":1.018},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.309},"max":{"1min":1.3540000000000001,"5min":1.7809999999999999,"15min":2.0960000000000001},"last":0.89400000000000002}]},{"osd":4,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0960000000000001,"15min":1.115},"min":{"1min":0.77900000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.4630000000000001,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.1399999999999999,"15min":1.1659999999999999},"min":{"1min":0.69399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6080000000000001,"5min":2.161,"15min":2.161},"last":1.1060000000000001}]},{"osd":5,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1539999999999999,"15min":1.1899999999999999},"min":{"1min":0.76200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.492,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.141},"min":{"1min":0.79800000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4370000000000001,"5min":1.7390000000000001,"15min":1.8009999999999999},"last":0.997}]},{"osd":6,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.163,"15min":1.173},"min":{"1min":0.78700000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.482,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.155},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.264,"15min":1.2589999999999999},"min":{"1min":0.72699999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.794,"5min":1.994,"15min":2.1800000000000002},"last":1.3420000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.248,"15min":1.286},"min":{"1min":0.84199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.645,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2310000000000001,"15min":1.254},"min":{"1min":0.95199999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.536,"5min":1.96,"15min":1.992},"last":1.244}]}]},{"osd":1,"up_from":15,"seq":64424509805,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":966656,"data_stored":748254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.45500000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":1.341,"5min":1.359,"15min":1.4330000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.47199999999999998,"5min":0.318,"15min":0.318},"max":{"1min":1.329,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.91000000000000003}]},{"osd":2,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.99399999999999999,"5min":1.6859999999999999,"15min":1.706},"last":0.626},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90600000000000003,"15min":0.91500000000000004},"min":{"1min":0.52000000000000002,"5min":0.41599999999999998,"15min":0.35099999999999998},"max":{"1min":1.4550000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.875}]},{"osd":3,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.96299999999999997,"15min":0.98199999999999998},"min":{"1min":0.51400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.5660000000000001,"5min":1.7170000000000001,"15min":1.881},"last":1.03},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.94599999999999995,"15min":0.95899999999999996},"min":{"1min":0.68300000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4419999999999999,"5min":1.6519999999999999,"15min":1.73},"last":0.79700000000000004}]},{"osd":4,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.77000000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.867},"last":1.081},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.171,"15min":1.1839999999999999},"min":{"1min":0.76900000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5249999999999999,"5min":1.716,"15min":1.9039999999999999},"last":1.163}]},{"osd":5,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1539999999999999,"15min":1.165},"min":{"1min":0.88700000000000001,"5min":0.54000000000000004,"15min":0.53200000000000003},"max":{"1min":1.4410000000000001,"5min":1.8660000000000001,"15min":2.0230000000000001},"last":1.137},{"interface":"front","average":{"1min":1.163,"5min":1.1200000000000001,"15min":1.1379999999999999},"min":{"1min":0.85299999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.639,"5min":1.6819999999999999,"15min":1.8400000000000001},"last":1.2050000000000001}]},{"osd":6,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.274,"15min":1.2709999999999999},"min":{"1min":0.84899999999999998,"5min":0.64200000000000002,"15min":0.59999999999999998},"max":{"1min":1.5920000000000001,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.2070000000000001,"15min":1.24},"min":{"1min":0.75,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5840000000000001,"5min":1.8819999999999999,"15min":2.0600000000000001},"last":0.96999999999999997}]},{"osd":7,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2589999999999999,"15min":1.292},"min":{"1min":0.85199999999999998,"5min":0.79800000000000004,"15min":0.73499999999999999},"max":{"1min":1.5309999999999999,"5min":1.9530000000000001,"15min":2.1389999999999998},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.22,"15min":1.2490000000000001},"min":{"1min":0.83299999999999996,"5min":0.66000000000000003,"15min":0.65400000000000003},"max":{"1min":1.7769999999999999,"5min":1.806,"15min":1.988},"last":1.2969999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509805,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60764,"kb_used_data":7380,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311076,"statfs":{"total":96636764160,"available":96574541824,"internally_reserved":0,"allocated":7557120,"data_stored":7321877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71099999999999997,"15min":0.745},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0680000000000001,"5min":1.4750000000000001,"15min":1.7370000000000001},"last":0.628},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.29799999999999999},"max":{"1min":1.1220000000000001,"5min":1.536,"15min":1.8560000000000001},"last":1.0589999999999999}]},{"osd":2,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.85999999999999999,"15min":0.878},"min":{"1min":0.432,"5min":0.43099999999999999,"15min":0.29199999999999998},"max":{"1min":1.2569999999999999,"5min":1.3720000000000001,"15min":1.7190000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.89900000000000002,"15min":0.91000000000000003},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.317},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.8959999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90200000000000002,"15min":0.89200000000000002},"min":{"1min":0.33700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3979999999999999,"5min":1.756,"15min":1.869},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.034,"15min":1.0189999999999999},"min":{"1min":0.51700000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3600000000000001,"5min":1.6180000000000001,"15min":1.9259999999999999},"last":0.97599999999999998}]},{"osd":4,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.022,"15min":1.0189999999999999},"min":{"1min":0.57599999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.458,"5min":1.5529999999999999,"15min":1.9610000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.129,"15min":1.1220000000000001},"min":{"1min":0.74099999999999999,"5min":0.57999999999999996,"15min":0.47899999999999998},"max":{"1min":1.5860000000000001,"5min":2.101,"15min":2.101},"last":1.095}]},{"osd":5,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1319999999999999,"15min":1.1659999999999999},"min":{"1min":0.81000000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.667,"5min":1.667,"15min":2.1669999999999998},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.0840000000000001,"15min":1.0980000000000001},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4490000000000001,"5min":1.728,"15min":2.1280000000000001},"last":1.123}]},{"osd":6,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.177,"15min":1.2110000000000001},"min":{"1min":0.71199999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.637,"5min":1.9910000000000001,"15min":2.101},"last":1.153},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.212,"15min":1.2370000000000001},"min":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.718,"5min":1.831,"15min":2.2480000000000002},"last":1.2549999999999999}]},{"osd":7,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.272,"15min":1.292},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.764,"5min":1.792,"15min":2.2410000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.2130000000000001,"15min":1.1970000000000001},"min":{"1min":0.83499999999999996,"5min":0.64400000000000002,"15min":0.60099999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.2130000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542509,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35648,"kb_used_data":4472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336192,"statfs":{"total":96636764160,"available":96600260608,"internally_reserved":0,"allocated":4579328,"data_stored":4332954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.88400000000000001,"15min":0.90300000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2609999999999999,"5min":1.544,"15min":1.544},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.877,"15min":0.90700000000000003},"min":{"1min":0.48499999999999999,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":1.319,"5min":1.4179999999999999,"15min":1.6319999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.90900000000000003,"15min":0.92800000000000005},"min":{"1min":0.61899999999999999,"5min":0.498,"15min":0.45000000000000001},"max":{"1min":1.369,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3140000000000001,"5min":1.454,"15min":1.7689999999999999},"last":0.505}]},{"osd":2,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":1.282,"5min":1.613,"15min":1.708},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.99299999999999999,"15min":1.02},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.456,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.97799999999999998,"15min":1.002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.44500000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":2.2370000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.125,"15min":1.1100000000000001},"min":{"1min":0.81699999999999995,"5min":0.628,"15min":0.59499999999999997},"max":{"1min":1.4570000000000001,"5min":1.752,"15min":1.8220000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.98299999999999998,"15min":1.012},"min":{"1min":0.60899999999999999,"5min":0.41199999999999998,"15min":0.38500000000000001},"max":{"1min":1.593,"5min":1.6779999999999999,"15min":2.016},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.99399999999999999,"15min":1.024},"min":{"1min":0.55600000000000005,"5min":0.39800000000000002,"15min":0.34300000000000003},"max":{"1min":1.5529999999999999,"5min":1.659,"15min":1.821},"last":0.625}]},{"osd":6,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0589999999999999,"15min":1.071},"min":{"1min":0.67100000000000004,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":1.3640000000000001,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.181,"15min":1.1990000000000001},"min":{"1min":0.59999999999999998,"5min":0.497,"15min":0.44500000000000001},"max":{"1min":1.694,"5min":1.788,"15min":2.1230000000000002},"last":0.54000000000000004}]},{"osd":7,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.1359999999999999,"15min":1.145},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.379},"max":{"1min":1.653,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.246,"15min":1.2529999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.544,"5min":1.996,"15min":2.1160000000000001},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7225344,"data_stored":7185737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":21746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4608000,"data_stored":4590614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7290880,"data_stored":7246605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4247552,"data_stored":4196814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8802304,"data_stored":8778065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15294464,"data_stored":15279563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":44892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T21:28:50.043 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T21:28:50.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.206+0000 7f7e0a827640 1 Processor -- start 2023-11-18T21:28:50.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.206+0000 7f7e0a827640 1 -- start start 2023-11-18T21:28:50.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.206+0000 7f7e0a827640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e04151720 0x7f7e0406ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:50.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.206+0000 7f7e0a827640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7e040c40e0 0x7f7e040c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:50.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.206+0000 7f7e0a827640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0406f4a0 con 0x7f7e04151340 2023-11-18T21:28:50.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.206+0000 7f7e0a827640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e04072570 con 0x7f7e040c40e0 2023-11-18T21:28:50.207 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.206+0000 7f7e0a827640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e04070be0 con 0x7f7e04151720 2023-11-18T21:28:50.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.206+0000 7f7e08dc4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7e040c40e0 0x7f7e040c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:50.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.206+0000 7f7dfbfff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e04151720 0x7f7e0406ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:50.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.206+0000 7f7e03fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7e04151340 0x7f7e04157c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:54742/0 (socket says 172.21.15.49:54742) 2023-11-18T21:28:50.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.206+0000 7f7e03fff640 1 -- 172.21.15.49:0/2542892433 learned_addr learned my addr 172.21.15.49:0/2542892433 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:50.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.218+0000 7f7dfbfff640 1 -- 172.21.15.49:0/2542892433 >> v2:172.21.15.106:3300/0 conn(0x7f7e040c40e0 msgr2=0x7f7e040c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:50.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.218+0000 7f7dfbfff640 1 --2- 172.21.15.49:0/2542892433 >> v2:172.21.15.106:3300/0 conn(0x7f7e040c40e0 0x7f7e040c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:50.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.218+0000 7f7dfbfff640 1 -- 172.21.15.49:0/2542892433 >> v1:172.21.15.106:6789/0 conn(0x7f7e04151340 legacy=0x7f7e04157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:50.218 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.218+0000 7f7dfbfff640 1 -- 172.21.15.49:0/2542892433 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e04070e80 con 0x7f7e04151720 2023-11-18T21:28:50.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.222+0000 7f7dfbfff640 1 --2- 172.21.15.49:0/2542892433 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e04151720 0x7f7e0406ee10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0097c0 tx=0x7f7dec01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cb1adaad73b6593 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.230+0000 7f7e037fe640 1 -- 172.21.15.49:0/2542892433 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0ab650 con 0x7f7e04151720 2023-11-18T21:28:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.230+0000 7f7e037fe640 1 -- 172.21.15.49:0/2542892433 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec0ab7b0 con 0x7f7e04151720 2023-11-18T21:28:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.230+0000 7f7e037fe640 1 -- 172.21.15.49:0/2542892433 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0abb40 con 0x7f7e04151720 2023-11-18T21:28:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.230+0000 7f7e0a827640 1 -- 172.21.15.49:0/2542892433 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e04151720 msgr2=0x7f7e0406ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.230+0000 7f7e0a827640 1 --2- 172.21.15.49:0/2542892433 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e04151720 0x7f7e0406ee10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0097c0 tx=0x7f7dec01c450 comp rx=0 tx=0).stop 2023-11-18T21:28:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e0a827640 1 -- 172.21.15.49:0/2542892433 shutdown_connections 2023-11-18T21:28:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e0a827640 1 --2- 172.21.15.49:0/2542892433 >> v2:172.21.15.106:3300/0 conn(0x7f7e040c40e0 0x7f7e040c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e0a827640 1 --2- 172.21.15.49:0/2542892433 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e04151720 0x7f7e0406ee10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:50.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e0a827640 1 -- 172.21.15.49:0/2542892433 >> 172.21.15.49:0/2542892433 conn(0x7f7e0406c6a0 msgr2=0x7f7e0406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:50.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e0a827640 1 -- 172.21.15.49:0/2542892433 shutdown_connections 2023-11-18T21:28:50.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e0a827640 1 -- 172.21.15.49:0/2542892433 wait complete. 2023-11-18T21:28:50.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e0a827640 1 Processor -- start 2023-11-18T21:28:50.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e0a827640 1 -- start start 2023-11-18T21:28:50.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e0a827640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e040c40e0 0x7f7e04150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:50.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e0a827640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e04151340 0x7f7e04140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:50.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e0a827640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e04151720 0x7f7e0414a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e0a827640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e04155270 con 0x7f7e04151340 2023-11-18T21:28:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e0a827640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e04154f90 con 0x7f7e04151720 2023-11-18T21:28:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e0a827640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e04150780 con 0x7f7e040c40e0 2023-11-18T21:28:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7dfbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e04151340 0x7f7e04140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7dfbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e04151340 0x7f7e04140420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40586/0 (socket says 172.21.15.49:40586) 2023-11-18T21:28:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7dfbfff640 1 -- 172.21.15.49:0/3458833832 learned_addr learned my addr 172.21.15.49:0/3458833832 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.234+0000 7f7e08dc4640 1 --2- 172.21.15.49:0/3458833832 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e04151720 0x7f7e0414a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:50.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.238+0000 7f7e03fff640 1 --2- 172.21.15.49:0/3458833832 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e040c40e0 0x7f7e04150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:50.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.242+0000 7f7dfbfff640 1 -- 172.21.15.49:0/3458833832 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e040c40e0 msgr2=0x7f7e04150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:50.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.242+0000 7f7dfbfff640 1 --2- 172.21.15.49:0/3458833832 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e040c40e0 0x7f7e04150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:50.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.242+0000 7f7dfbfff640 1 -- 172.21.15.49:0/3458833832 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e04151720 msgr2=0x7f7e0414a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:50.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.242+0000 7f7dfbfff640 1 --2- 172.21.15.49:0/3458833832 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e04151720 0x7f7e0414a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:50.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.242+0000 7f7dfbfff640 1 -- 172.21.15.49:0/3458833832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec009420 con 0x7f7e04151340 2023-11-18T21:28:50.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.242+0000 7f7dfbfff640 1 --2- 172.21.15.49:0/3458833832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e04151340 0x7f7e04140420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0ad040 tx=0x7f7dec01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.246+0000 7f7e017fa640 1 -- 172.21.15.49:0/3458833832 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0bf610 con 0x7f7e04151340 2023-11-18T21:28:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.246+0000 7f7e017fa640 1 -- 172.21.15.49:0/3458833832 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec0bf790 con 0x7f7e04151340 2023-11-18T21:28:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.246+0000 7f7e017fa640 1 -- 172.21.15.49:0/3458833832 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0bfb40 con 0x7f7e04151340 2023-11-18T21:28:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.246+0000 7f7e0a827640 1 -- 172.21.15.49:0/3458833832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e04150a60 con 0x7f7e04151340 2023-11-18T21:28:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.246+0000 7f7e0a827640 1 -- 172.21.15.49:0/3458833832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0414e650 con 0x7f7e04151340 2023-11-18T21:28:50.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.250+0000 7f7e0a827640 1 -- 172.21.15.49:0/3458833832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e04150c50 con 0x7f7e04151340 2023-11-18T21:28:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.274+0000 7f7e017fa640 1 -- 172.21.15.49:0/3458833832 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7dec0b5400 con 0x7f7e04151340 2023-11-18T21:28:50.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.274+0000 7f7e017fa640 1 --2- 172.21.15.49:0/3458833832 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7de40664c0 0x7f7de4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:50.275 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.274+0000 7f7e03fff640 1 --2- 172.21.15.49:0/3458833832 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7de40664c0 0x7f7de4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.274+0000 7f7e03fff640 1 --2- 172.21.15.49:0/3458833832 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7de40664c0 0x7f7de4068980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7df4000f70 tx=0x7f7df4007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:50.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.278+0000 7f7e017fa640 1 -- 172.21.15.49:0/3458833832 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f7dec0f02b0 con 0x7f7e04151340 2023-11-18T21:28:50.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.570+0000 7f7e017fa640 1 -- 172.21.15.49:0/3458833832 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7dec0ec5f0 con 0x7f7e04151340 2023-11-18T21:28:50.745 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.746+0000 7f7e0a827640 1 -- 172.21.15.49:0/3458833832 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e040c8e20 con 0x7f7de40664c0 2023-11-18T21:28:50.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.770+0000 7f7e017fa640 1 -- 172.21.15.49:0/3458833832 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368703 (secure 0 0 0) 0x7f7e040c8e20 con 0x7f7de40664c0 2023-11-18T21:28:50.775 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:28:50.778 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-18T21:28:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.778+0000 7f7e0a827640 1 -- 172.21.15.49:0/3458833832 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7de40664c0 msgr2=0x7f7de4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.778+0000 7f7e0a827640 1 --2- 172.21.15.49:0/3458833832 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7de40664c0 0x7f7de4068980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7df4000f70 tx=0x7f7df4007e90 comp rx=0 tx=0).stop 2023-11-18T21:28:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.778+0000 7f7e0a827640 1 -- 172.21.15.49:0/3458833832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e04151340 msgr2=0x7f7e04140420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.778+0000 7f7e0a827640 1 --2- 172.21.15.49:0/3458833832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e04151340 0x7f7e04140420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0ad040 tx=0x7f7dec01ac90 comp rx=0 tx=0).stop 2023-11-18T21:28:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.778+0000 7f7e0a827640 1 -- 172.21.15.49:0/3458833832 shutdown_connections 2023-11-18T21:28:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.778+0000 7f7e0a827640 1 --2- 172.21.15.49:0/3458833832 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7de40664c0 0x7f7de4068980 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.778+0000 7f7e0a827640 1 --2- 172.21.15.49:0/3458833832 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e04151720 0x7f7e0414a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.778+0000 7f7e0a827640 1 --2- 172.21.15.49:0/3458833832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e04151340 0x7f7e04140420 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.778+0000 7f7e0a827640 1 --2- 172.21.15.49:0/3458833832 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e040c40e0 0x7f7e04150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:50.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.778+0000 7f7e0a827640 1 -- 172.21.15.49:0/3458833832 >> 172.21.15.49:0/3458833832 conn(0x7f7e0406c6a0 msgr2=0x7f7e04157250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:50.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.778+0000 7f7e0a827640 1 -- 172.21.15.49:0/3458833832 shutdown_connections 2023-11-18T21:28:50.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.778+0000 7f7e0a827640 1 -- 172.21.15.49:0/3458833832 wait complete. 2023-11-18T21:28:50.798 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":933,"stamp":"2023-11-18T21:28:50.539559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24262386,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":804,"num_read_kb":1243,"num_write":12291,"num_write_kb":281645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14773,"ondisk_log_size":14773,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":388472,"kb_used_data":50232,"kb_used_omap":12,"kb_used_meta":338163,"kb_avail":754586248,"statfs":{"total":773094113280,"available":772696317952,"internally_reserved":0,"allocated":51437568,"data_stored":49613892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":346279473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,20,19],"upper_bound":512},"perf_stat":{"commit_latency_ms":185,"apply_latency_ms":185,"commit_latency_ns":185000000,"apply_latency_ns":185000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1945,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005293"},"pg_stats":[{"pgid":"2.1f","version":"31'73","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:35.344676+0000","last_change":"2023-11-18T20:59:25.350113+0000","last_active":"2023-11-18T21:28:35.344676+0000","last_peered":"2023-11-18T21:28:35.344676+0000","last_clean":"2023-11-18T21:28:35.344676+0000","last_became_active":"2023-11-18T20:59:25.349869+0000","last_became_peered":"2023-11-18T20:59:25.349869+0000","last_unstale":"2023-11-18T21:28:35.344676+0000","last_undegraded":"2023-11-18T21:28:35.344676+0000","last_fullsized":"2023-11-18T21:28:35.344676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:56:07.719325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'45","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.673746+0000","last_change":"2023-11-18T20:59:27.895973+0000","last_active":"2023-11-18T21:28:43.673746+0000","last_peered":"2023-11-18T21:28:43.673746+0000","last_clean":"2023-11-18T21:28:43.673746+0000","last_became_active":"2023-11-18T20:59:27.895678+0000","last_became_peered":"2023-11-18T20:59:27.895678+0000","last_unstale":"2023-11-18T21:28:43.673746+0000","last_undegraded":"2023-11-18T21:28:43.673746+0000","last_fullsized":"2023-11-18T21:28:43.673746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"31'87","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.055420+0000","last_change":"2023-11-18T20:59:35.848621+0000","last_active":"2023-11-18T21:27:28.055420+0000","last_peered":"2023-11-18T21:27:28.055420+0000","last_clean":"2023-11-18T21:27:28.055420+0000","last_became_active":"2023-11-18T20:59:35.848140+0000","last_became_peered":"2023-11-18T20:59:35.848140+0000","last_unstale":"2023-11-18T21:27:28.055420+0000","last_undegraded":"2023-11-18T21:27:28.055420+0000","last_fullsized":"2023-11-18T21:27:28.055420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:12.962470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:59.358340+0000","last_change":"2023-11-18T20:59:25.463657+0000","last_active":"2023-11-18T21:27:59.358340+0000","last_peered":"2023-11-18T21:27:59.358340+0000","last_clean":"2023-11-18T21:27:59.358340+0000","last_became_active":"2023-11-18T20:59:25.463001+0000","last_became_peered":"2023-11-18T20:59:25.463001+0000","last_unstale":"2023-11-18T21:27:59.358340+0000","last_undegraded":"2023-11-18T21:27:59.358340+0000","last_fullsized":"2023-11-18T21:27:59.358340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"31'59","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630833+0000","last_change":"2023-11-18T20:59:27.837801+0000","last_active":"2023-11-18T21:28:43.630833+0000","last_peered":"2023-11-18T21:28:43.630833+0000","last_clean":"2023-11-18T21:28:43.630833+0000","last_became_active":"2023-11-18T20:59:27.836937+0000","last_became_peered":"2023-11-18T20:59:27.836937+0000","last_unstale":"2023-11-18T21:28:43.630833+0000","last_undegraded":"2023-11-18T21:28:43.630833+0000","last_fullsized":"2023-11-18T21:28:43.630833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"31'91","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.094446+0000","last_change":"2023-11-18T20:59:35.843015+0000","last_active":"2023-11-18T21:27:28.094446+0000","last_peered":"2023-11-18T21:27:28.094446+0000","last_clean":"2023-11-18T21:27:28.094446+0000","last_became_active":"2023-11-18T20:59:35.842552+0000","last_became_peered":"2023-11-18T20:59:35.842552+0000","last_unstale":"2023-11-18T21:27:28.094446+0000","last_undegraded":"2023-11-18T21:27:28.094446+0000","last_fullsized":"2023-11-18T21:27:28.094446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:17.222664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"31'175","reported_seq":208,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:29.248169+0000","last_change":"2023-11-18T20:59:25.497907+0000","last_active":"2023-11-18T21:28:29.248169+0000","last_peered":"2023-11-18T21:28:29.248169+0000","last_clean":"2023-11-18T21:28:29.248169+0000","last_became_active":"2023-11-18T20:59:25.497070+0000","last_became_peered":"2023-11-18T20:59:25.497070+0000","last_unstale":"2023-11-18T21:28:29.248169+0000","last_undegraded":"2023-11-18T21:28:29.248169+0000","last_fullsized":"2023-11-18T21:28:29.248169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"31'56","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.671790+0000","last_change":"2023-11-18T20:59:27.868161+0000","last_active":"2023-11-18T21:28:43.671790+0000","last_peered":"2023-11-18T21:28:43.671790+0000","last_clean":"2023-11-18T21:28:43.671790+0000","last_became_active":"2023-11-18T20:59:27.867021+0000","last_became_peered":"2023-11-18T20:59:27.867021+0000","last_unstale":"2023-11-18T21:28:43.671790+0000","last_undegraded":"2023-11-18T21:28:43.671790+0000","last_fullsized":"2023-11-18T21:28:43.671790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'88","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:22.937522+0000","last_change":"2023-11-18T20:59:35.830210+0000","last_active":"2023-11-18T21:27:22.937522+0000","last_peered":"2023-11-18T21:27:22.937522+0000","last_clean":"2023-11-18T21:27:22.937522+0000","last_became_active":"2023-11-18T20:59:35.829636+0000","last_became_peered":"2023-11-18T20:59:35.829636+0000","last_unstale":"2023-11-18T21:27:22.937522+0000","last_undegraded":"2023-11-18T21:27:22.937522+0000","last_fullsized":"2023-11-18T21:27:22.937522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":32,"num_write":84,"num_write_kb":9481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"31'10","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.072620+0000","last_change":"2023-11-18T20:59:25.493859+0000","last_active":"2023-11-18T21:28:26.072620+0000","last_peered":"2023-11-18T21:28:26.072620+0000","last_clean":"2023-11-18T21:28:26.072620+0000","last_became_active":"2023-11-18T20:59:25.493087+0000","last_became_peered":"2023-11-18T20:59:25.493087+0000","last_unstale":"2023-11-18T21:28:26.072620+0000","last_undegraded":"2023-11-18T21:28:26.072620+0000","last_fullsized":"2023-11-18T21:28:26.072620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"31'65","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.677740+0000","last_change":"2023-11-18T20:59:27.871929+0000","last_active":"2023-11-18T21:28:43.677740+0000","last_peered":"2023-11-18T21:28:43.677740+0000","last_clean":"2023-11-18T21:28:43.677740+0000","last_became_active":"2023-11-18T20:59:27.871076+0000","last_became_peered":"2023-11-18T20:59:27.871076+0000","last_unstale":"2023-11-18T21:28:43.677740+0000","last_undegraded":"2023-11-18T21:28:43.677740+0000","last_fullsized":"2023-11-18T21:28:43.677740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:24:09.546791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"31'63","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.541263+0000","last_change":"2023-11-18T20:59:35.833547+0000","last_active":"2023-11-18T21:27:18.541263+0000","last_peered":"2023-11-18T21:27:18.541263+0000","last_clean":"2023-11-18T21:27:18.541263+0000","last_became_active":"2023-11-18T20:59:35.833016+0000","last_became_peered":"2023-11-18T20:59:35.833016+0000","last_unstale":"2023-11-18T21:27:18.541263+0000","last_undegraded":"2023-11-18T21:27:18.541263+0000","last_fullsized":"2023-11-18T21:27:18.541263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:58.416590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":5002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"31'56","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.634810+0000","last_change":"2023-11-18T20:59:27.682005+0000","last_active":"2023-11-18T21:28:43.634810+0000","last_peered":"2023-11-18T21:28:43.634810+0000","last_clean":"2023-11-18T21:28:43.634810+0000","last_became_active":"2023-11-18T20:59:27.681154+0000","last_became_peered":"2023-11-18T20:59:27.681154+0000","last_unstale":"2023-11-18T21:28:43.634810+0000","last_undegraded":"2023-11-18T21:28:43.634810+0000","last_fullsized":"2023-11-18T21:28:43.634810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:10.426499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"31'142","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.042960+0000","last_change":"2023-11-18T20:59:25.339269+0000","last_active":"2023-11-18T21:28:43.042960+0000","last_peered":"2023-11-18T21:28:43.042960+0000","last_clean":"2023-11-18T21:28:43.042960+0000","last_became_active":"2023-11-18T20:59:25.338067+0000","last_became_peered":"2023-11-18T20:59:25.338067+0000","last_unstale":"2023-11-18T21:28:43.042960+0000","last_undegraded":"2023-11-18T21:28:43.042960+0000","last_fullsized":"2023-11-18T21:28:43.042960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395570,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'89","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:23.791465+0000","last_change":"2023-11-18T21:00:28.755990+0000","last_active":"2023-11-18T21:27:23.791465+0000","last_peered":"2023-11-18T21:27:23.791465+0000","last_clean":"2023-11-18T21:27:23.791465+0000","last_became_active":"2023-11-18T21:00:28.755606+0000","last_became_peered":"2023-11-18T21:00:28.755606+0000","last_unstale":"2023-11-18T21:27:23.791465+0000","last_undegraded":"2023-11-18T21:27:23.791465+0000","last_fullsized":"2023-11-18T21:27:23.791465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:06.870579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":4704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'54","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.476664+0000","last_change":"2023-11-18T20:59:27.861550+0000","last_active":"2023-11-18T21:28:43.476664+0000","last_peered":"2023-11-18T21:28:43.476664+0000","last_clean":"2023-11-18T21:28:43.476664+0000","last_became_active":"2023-11-18T20:59:27.861045+0000","last_became_peered":"2023-11-18T20:59:27.861045+0000","last_unstale":"2023-11-18T21:28:43.476664+0000","last_undegraded":"2023-11-18T21:28:43.476664+0000","last_fullsized":"2023-11-18T21:28:43.476664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"31'407","reported_seq":442,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:37.390812+0000","last_change":"2023-11-18T20:59:25.458601+0000","last_active":"2023-11-18T21:28:37.390812+0000","last_peered":"2023-11-18T21:28:37.390812+0000","last_clean":"2023-11-18T21:28:37.390812+0000","last_became_active":"2023-11-18T20:59:25.457871+0000","last_became_peered":"2023-11-18T20:59:25.457871+0000","last_unstale":"2023-11-18T21:28:37.390812+0000","last_undegraded":"2023-11-18T21:28:37.390812+0000","last_fullsized":"2023-11-18T21:28:37.390812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:09.387812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":996,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"31'93","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:24.972970+0000","last_change":"2023-11-18T20:59:35.842967+0000","last_active":"2023-11-18T21:27:24.972970+0000","last_peered":"2023-11-18T21:27:24.972970+0000","last_clean":"2023-11-18T21:27:24.972970+0000","last_became_active":"2023-11-18T20:59:35.842583+0000","last_became_peered":"2023-11-18T20:59:35.842583+0000","last_unstale":"2023-11-18T21:27:24.972970+0000","last_undegraded":"2023-11-18T21:27:24.972970+0000","last_fullsized":"2023-11-18T21:27:24.972970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:40.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'46","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.574354+0000","last_change":"2023-11-18T20:59:27.688043+0000","last_active":"2023-11-18T21:28:43.574354+0000","last_peered":"2023-11-18T21:28:43.574354+0000","last_clean":"2023-11-18T21:28:43.574354+0000","last_became_active":"2023-11-18T20:59:27.687250+0000","last_became_peered":"2023-11-18T20:59:27.687250+0000","last_unstale":"2023-11-18T21:28:43.574354+0000","last_undegraded":"2023-11-18T21:28:43.574354+0000","last_fullsized":"2023-11-18T21:28:43.574354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:16:48.432607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"31'202","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:29.201820+0000","last_change":"2023-11-18T20:59:25.351927+0000","last_active":"2023-11-18T21:28:29.201820+0000","last_peered":"2023-11-18T21:28:29.201820+0000","last_clean":"2023-11-18T21:28:29.201820+0000","last_became_active":"2023-11-18T20:59:25.351318+0000","last_became_peered":"2023-11-18T20:59:25.351318+0000","last_unstale":"2023-11-18T21:28:29.201820+0000","last_undegraded":"2023-11-18T21:28:29.201820+0000","last_fullsized":"2023-11-18T21:28:29.201820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:20:38.006315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'80","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.908455+0000","last_change":"2023-11-18T20:59:35.835375+0000","last_active":"2023-11-18T21:27:18.908455+0000","last_peered":"2023-11-18T21:27:18.908455+0000","last_clean":"2023-11-18T21:27:18.908455+0000","last_became_active":"2023-11-18T20:59:35.834894+0000","last_became_peered":"2023-11-18T20:59:35.834894+0000","last_unstale":"2023-11-18T21:27:18.908455+0000","last_undegraded":"2023-11-18T21:27:18.908455+0000","last_fullsized":"2023-11-18T21:27:18.908455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:33.448377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":144,"num_write":72,"num_write_kb":6857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"31'48","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.628688+0000","last_change":"2023-11-18T20:59:27.687356+0000","last_active":"2023-11-18T21:28:43.628688+0000","last_peered":"2023-11-18T21:28:43.628688+0000","last_clean":"2023-11-18T21:28:43.628688+0000","last_became_active":"2023-11-18T20:59:27.686692+0000","last_became_peered":"2023-11-18T20:59:27.686692+0000","last_unstale":"2023-11-18T21:28:43.628688+0000","last_undegraded":"2023-11-18T21:28:43.628688+0000","last_fullsized":"2023-11-18T21:28:43.628688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:20:58.633153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:18.661759+0000","last_change":"2023-11-18T20:59:25.347589+0000","last_active":"2023-11-18T21:28:18.661759+0000","last_peered":"2023-11-18T21:28:18.661759+0000","last_clean":"2023-11-18T21:28:18.661759+0000","last_became_active":"2023-11-18T20:59:25.347022+0000","last_became_peered":"2023-11-18T20:59:25.347022+0000","last_unstale":"2023-11-18T21:28:18.661759+0000","last_undegraded":"2023-11-18T21:28:18.661759+0000","last_fullsized":"2023-11-18T21:28:18.661759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'120","reported_seq":147,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.477259+0000","last_change":"2023-11-18T20:59:35.771398+0000","last_active":"2023-11-18T21:27:18.477259+0000","last_peered":"2023-11-18T21:27:18.477259+0000","last_clean":"2023-11-18T21:27:18.477259+0000","last_became_active":"2023-11-18T20:59:35.770923+0000","last_became_peered":"2023-11-18T20:59:35.770923+0000","last_unstale":"2023-11-18T21:27:18.477259+0000","last_undegraded":"2023-11-18T21:27:18.477259+0000","last_fullsized":"2023-11-18T21:27:18.477259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'44","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.574046+0000","last_change":"2023-11-18T20:59:27.689972+0000","last_active":"2023-11-18T21:28:43.574046+0000","last_peered":"2023-11-18T21:28:43.574046+0000","last_clean":"2023-11-18T21:28:43.574046+0000","last_became_active":"2023-11-18T20:59:27.689156+0000","last_became_peered":"2023-11-18T20:59:27.689156+0000","last_unstale":"2023-11-18T21:28:43.574046+0000","last_undegraded":"2023-11-18T21:28:43.574046+0000","last_fullsized":"2023-11-18T21:28:43.574046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:58.264895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"31'12","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:18.009596+0000","last_change":"2023-11-18T20:59:25.348005+0000","last_active":"2023-11-18T21:28:18.009596+0000","last_peered":"2023-11-18T21:28:18.009596+0000","last_clean":"2023-11-18T21:28:18.009596+0000","last_became_active":"2023-11-18T20:59:25.346318+0000","last_became_peered":"2023-11-18T20:59:25.346318+0000","last_unstale":"2023-11-18T21:28:18.009596+0000","last_undegraded":"2023-11-18T21:28:18.009596+0000","last_fullsized":"2023-11-18T21:28:18.009596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:37.045716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"31'81","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.069352+0000","last_change":"2023-11-18T20:59:35.833754+0000","last_active":"2023-11-18T21:27:27.069352+0000","last_peered":"2023-11-18T21:27:27.069352+0000","last_clean":"2023-11-18T21:27:27.069352+0000","last_became_active":"2023-11-18T20:59:35.833407+0000","last_became_peered":"2023-11-18T20:59:35.833407+0000","last_unstale":"2023-11-18T21:27:27.069352+0000","last_undegraded":"2023-11-18T21:27:27.069352+0000","last_fullsized":"2023-11-18T21:27:27.069352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:38:06.355389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":9489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'53","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.574066+0000","last_change":"2023-11-18T20:59:27.863887+0000","last_active":"2023-11-18T21:28:43.574066+0000","last_peered":"2023-11-18T21:28:43.574066+0000","last_clean":"2023-11-18T21:28:43.574066+0000","last_became_active":"2023-11-18T20:59:27.863358+0000","last_became_peered":"2023-11-18T20:59:27.863358+0000","last_unstale":"2023-11-18T21:28:43.574066+0000","last_undegraded":"2023-11-18T21:28:43.574066+0000","last_fullsized":"2023-11-18T21:28:43.574066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:50.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"31'150","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:36.791102+0000","last_change":"2023-11-18T20:59:25.351394+0000","last_active":"2023-11-18T21:28:36.791102+0000","last_peered":"2023-11-18T21:28:36.791102+0000","last_clean":"2023-11-18T21:28:36.791102+0000","last_became_active":"2023-11-18T20:59:25.350705+0000","last_became_peered":"2023-11-18T20:59:25.350705+0000","last_unstale":"2023-11-18T21:28:36.791102+0000","last_undegraded":"2023-11-18T21:28:36.791102+0000","last_fullsized":"2023-11-18T21:28:36.791102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:01:57.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"31'89","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.136525+0000","last_change":"2023-11-18T20:59:35.840991+0000","last_active":"2023-11-18T21:27:28.136525+0000","last_peered":"2023-11-18T21:27:28.136525+0000","last_clean":"2023-11-18T21:27:28.136525+0000","last_became_active":"2023-11-18T20:59:35.840533+0000","last_became_peered":"2023-11-18T20:59:35.840533+0000","last_unstale":"2023-11-18T21:27:28.136525+0000","last_undegraded":"2023-11-18T21:27:28.136525+0000","last_fullsized":"2023-11-18T21:27:28.136525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:06:47.876845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":9026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"31'60","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.582868+0000","last_change":"2023-11-18T20:59:27.869100+0000","last_active":"2023-11-18T21:28:43.582868+0000","last_peered":"2023-11-18T21:28:43.582868+0000","last_clean":"2023-11-18T21:28:43.582868+0000","last_became_active":"2023-11-18T20:59:27.868355+0000","last_became_peered":"2023-11-18T20:59:27.868355+0000","last_unstale":"2023-11-18T21:28:43.582868+0000","last_undegraded":"2023-11-18T21:28:43.582868+0000","last_fullsized":"2023-11-18T21:28:43.582868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:25.235096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"31'94","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:19.874168+0000","last_change":"2023-11-18T20:59:25.350304+0000","last_active":"2023-11-18T21:28:19.874168+0000","last_peered":"2023-11-18T21:28:19.874168+0000","last_clean":"2023-11-18T21:28:19.874168+0000","last_became_active":"2023-11-18T20:59:25.349346+0000","last_became_peered":"2023-11-18T20:59:25.349346+0000","last_unstale":"2023-11-18T21:28:19.874168+0000","last_undegraded":"2023-11-18T21:28:19.874168+0000","last_fullsized":"2023-11-18T21:28:19.874168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:41.179268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"31'98","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.020859+0000","last_change":"2023-11-18T20:59:35.847005+0000","last_active":"2023-11-18T21:27:27.020859+0000","last_peered":"2023-11-18T21:27:27.020859+0000","last_clean":"2023-11-18T21:27:27.020859+0000","last_became_active":"2023-11-18T20:59:35.846458+0000","last_became_peered":"2023-11-18T20:59:35.846458+0000","last_unstale":"2023-11-18T21:27:27.020859+0000","last_undegraded":"2023-11-18T21:27:27.020859+0000","last_fullsized":"2023-11-18T21:27:27.020859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":10588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"31'50","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.667381+0000","last_change":"2023-11-18T20:59:27.889369+0000","last_active":"2023-11-18T21:28:43.667381+0000","last_peered":"2023-11-18T21:28:43.667381+0000","last_clean":"2023-11-18T21:28:43.667381+0000","last_became_active":"2023-11-18T20:59:27.887876+0000","last_became_peered":"2023-11-18T20:59:27.887876+0000","last_unstale":"2023-11-18T21:28:43.667381+0000","last_undegraded":"2023-11-18T21:28:43.667381+0000","last_fullsized":"2023-11-18T21:28:43.667381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:38.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"31'6","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:18.000761+0000","last_change":"2023-11-18T20:59:25.459620+0000","last_active":"2023-11-18T21:28:18.000761+0000","last_peered":"2023-11-18T21:28:18.000761+0000","last_clean":"2023-11-18T21:28:18.000761+0000","last_became_active":"2023-11-18T20:59:25.459235+0000","last_became_peered":"2023-11-18T20:59:25.459235+0000","last_unstale":"2023-11-18T21:28:18.000761+0000","last_undegraded":"2023-11-18T21:28:18.000761+0000","last_fullsized":"2023-11-18T21:28:18.000761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:02.325885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:20.899113+0000","last_change":"2023-11-18T20:59:35.835800+0000","last_active":"2023-11-18T21:27:20.899113+0000","last_peered":"2023-11-18T21:27:20.899113+0000","last_clean":"2023-11-18T21:27:20.899113+0000","last_became_active":"2023-11-18T20:59:35.834275+0000","last_became_peered":"2023-11-18T20:59:35.834275+0000","last_unstale":"2023-11-18T21:27:20.899113+0000","last_undegraded":"2023-11-18T21:27:20.899113+0000","last_fullsized":"2023-11-18T21:27:20.899113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'61","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.476976+0000","last_change":"2023-11-18T21:00:28.721070+0000","last_active":"2023-11-18T21:28:43.476976+0000","last_peered":"2023-11-18T21:28:43.476976+0000","last_clean":"2023-11-18T21:28:43.476976+0000","last_became_active":"2023-11-18T21:00:28.720412+0000","last_became_peered":"2023-11-18T21:00:28.720412+0000","last_unstale":"2023-11-18T21:28:43.476976+0000","last_undegraded":"2023-11-18T21:28:43.476976+0000","last_fullsized":"2023-11-18T21:28:43.476976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"31'655","reported_seq":691,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.048563+0000","last_change":"2023-11-18T20:59:25.355096+0000","last_active":"2023-11-18T21:28:43.048563+0000","last_peered":"2023-11-18T21:28:43.048563+0000","last_clean":"2023-11-18T21:28:43.048563+0000","last_became_active":"2023-11-18T20:59:25.354716+0000","last_became_peered":"2023-11-18T20:59:25.354716+0000","last_unstale":"2023-11-18T21:28:43.048563+0000","last_undegraded":"2023-11-18T21:28:43.048563+0000","last_fullsized":"2023-11-18T21:28:43.048563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:51.039181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":3369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'79","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.120724+0000","last_change":"2023-11-18T20:59:35.839218+0000","last_active":"2023-11-18T21:27:28.120724+0000","last_peered":"2023-11-18T21:27:28.120724+0000","last_clean":"2023-11-18T21:27:28.120724+0000","last_became_active":"2023-11-18T20:59:35.838732+0000","last_became_peered":"2023-11-18T20:59:35.838732+0000","last_unstale":"2023-11-18T21:27:28.120724+0000","last_undegraded":"2023-11-18T21:27:28.120724+0000","last_fullsized":"2023-11-18T21:27:28.120724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:50.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"31'54","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.634030+0000","last_change":"2023-11-18T20:59:27.839403+0000","last_active":"2023-11-18T21:28:43.634030+0000","last_peered":"2023-11-18T21:28:43.634030+0000","last_clean":"2023-11-18T21:28:43.634030+0000","last_became_active":"2023-11-18T20:59:27.838664+0000","last_became_peered":"2023-11-18T20:59:27.838664+0000","last_unstale":"2023-11-18T21:28:43.634030+0000","last_undegraded":"2023-11-18T21:28:43.634030+0000","last_fullsized":"2023-11-18T21:28:43.634030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"31'164","reported_seq":273,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:38.912485+0000","last_change":"2023-11-18T20:59:25.458840+0000","last_active":"2023-11-18T21:28:38.912485+0000","last_peered":"2023-11-18T21:28:38.912485+0000","last_clean":"2023-11-18T21:28:38.912485+0000","last_became_active":"2023-11-18T20:59:25.458075+0000","last_became_peered":"2023-11-18T20:59:25.458075+0000","last_unstale":"2023-11-18T21:28:38.912485+0000","last_undegraded":"2023-11-18T21:28:38.912485+0000","last_fullsized":"2023-11-18T21:28:38.912485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:48.644992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18647,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":79,"num_write":158,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"31'81","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:24.941939+0000","last_change":"2023-11-18T20:59:35.833736+0000","last_active":"2023-11-18T21:27:24.941939+0000","last_peered":"2023-11-18T21:27:24.941939+0000","last_clean":"2023-11-18T21:27:24.941939+0000","last_became_active":"2023-11-18T20:59:35.832891+0000","last_became_peered":"2023-11-18T20:59:35.832891+0000","last_unstale":"2023-11-18T21:27:24.941939+0000","last_undegraded":"2023-11-18T21:27:24.941939+0000","last_fullsized":"2023-11-18T21:27:24.941939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:12.929672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"31'58","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.597860+0000","last_change":"2023-11-18T20:59:27.889690+0000","last_active":"2023-11-18T21:28:43.597860+0000","last_peered":"2023-11-18T21:28:43.597860+0000","last_clean":"2023-11-18T21:28:43.597860+0000","last_became_active":"2023-11-18T20:59:27.889115+0000","last_became_peered":"2023-11-18T20:59:27.889115+0000","last_unstale":"2023-11-18T21:28:43.597860+0000","last_undegraded":"2023-11-18T21:28:43.597860+0000","last_fullsized":"2023-11-18T21:28:43.597860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:57:08.995074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:10.915862+0000","last_change":"2023-11-18T20:59:25.460190+0000","last_active":"2023-11-18T21:28:10.915862+0000","last_peered":"2023-11-18T21:28:10.915862+0000","last_clean":"2023-11-18T21:28:10.915862+0000","last_became_active":"2023-11-18T20:59:25.459405+0000","last_became_peered":"2023-11-18T20:59:25.459405+0000","last_unstale":"2023-11-18T21:28:10.915862+0000","last_undegraded":"2023-11-18T21:28:10.915862+0000","last_fullsized":"2023-11-18T21:28:10.915862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"31'64","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:25.970399+0000","last_change":"2023-11-18T20:59:35.842229+0000","last_active":"2023-11-18T21:27:25.970399+0000","last_peered":"2023-11-18T21:27:25.970399+0000","last_clean":"2023-11-18T21:27:25.970399+0000","last_became_active":"2023-11-18T20:59:35.835644+0000","last_became_peered":"2023-11-18T20:59:35.835644+0000","last_unstale":"2023-11-18T21:27:25.970399+0000","last_undegraded":"2023-11-18T21:27:25.970399+0000","last_fullsized":"2023-11-18T21:27:25.970399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:28.212029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"31'47","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.613220+0000","last_change":"2023-11-18T20:59:27.890885+0000","last_active":"2023-11-18T21:28:43.613220+0000","last_peered":"2023-11-18T21:28:43.613220+0000","last_clean":"2023-11-18T21:28:43.613220+0000","last_became_active":"2023-11-18T20:59:27.890499+0000","last_became_peered":"2023-11-18T20:59:27.890499+0000","last_unstale":"2023-11-18T21:28:43.613220+0000","last_undegraded":"2023-11-18T21:28:43.613220+0000","last_fullsized":"2023-11-18T21:28:43.613220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:33:26.362872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:04.464620+0000","last_change":"2023-11-18T20:59:25.339255+0000","last_active":"2023-11-18T21:28:04.464620+0000","last_peered":"2023-11-18T21:28:04.464620+0000","last_clean":"2023-11-18T21:28:04.464620+0000","last_became_active":"2023-11-18T20:59:25.338020+0000","last_became_peered":"2023-11-18T20:59:25.338020+0000","last_unstale":"2023-11-18T21:28:04.464620+0000","last_undegraded":"2023-11-18T21:28:04.464620+0000","last_fullsized":"2023-11-18T21:28:04.464620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:07.183625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:24:52.449457+0000","last_change":"2023-11-18T20:58:44.731742+0000","last_active":"2023-11-18T21:24:52.449457+0000","last_peered":"2023-11-18T21:24:52.449457+0000","last_clean":"2023-11-18T21:24:52.449457+0000","last_became_active":"2023-11-18T20:58:44.731076+0000","last_became_peered":"2023-11-18T20:58:44.731076+0000","last_unstale":"2023-11-18T21:24:52.449457+0000","last_undegraded":"2023-11-18T21:24:52.449457+0000","last_fullsized":"2023-11-18T21:24:52.449457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:58:42.561435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:58:42.561435+0000","last_clean_scrub_stamp":"2023-11-18T20:58:42.561435+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:48:40.458317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'66","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.824052+0000","last_change":"2023-11-18T20:59:35.771637+0000","last_active":"2023-11-18T21:27:18.824052+0000","last_peered":"2023-11-18T21:27:18.824052+0000","last_clean":"2023-11-18T21:27:18.824052+0000","last_became_active":"2023-11-18T20:59:35.771146+0000","last_became_peered":"2023-11-18T20:59:35.771146+0000","last_unstale":"2023-11-18T21:27:18.824052+0000","last_undegraded":"2023-11-18T21:27:18.824052+0000","last_fullsized":"2023-11-18T21:27:18.824052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:15.290602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":6116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"31'58","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.654090+0000","last_change":"2023-11-18T20:59:27.684091+0000","last_active":"2023-11-18T21:28:43.654090+0000","last_peered":"2023-11-18T21:28:43.654090+0000","last_clean":"2023-11-18T21:28:43.654090+0000","last_became_active":"2023-11-18T20:59:27.683316+0000","last_became_peered":"2023-11-18T20:59:27.683316+0000","last_unstale":"2023-11-18T21:28:43.654090+0000","last_undegraded":"2023-11-18T21:28:43.654090+0000","last_fullsized":"2023-11-18T21:28:43.654090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:52:02.757528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"31'666","reported_seq":701,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.066698+0000","last_change":"2023-11-18T20:59:25.357198+0000","last_active":"2023-11-18T21:28:43.066698+0000","last_peered":"2023-11-18T21:28:43.066698+0000","last_clean":"2023-11-18T21:28:43.066698+0000","last_became_active":"2023-11-18T20:59:25.356883+0000","last_became_peered":"2023-11-18T20:59:25.356883+0000","last_unstale":"2023-11-18T21:28:43.066698+0000","last_undegraded":"2023-11-18T21:28:43.066698+0000","last_fullsized":"2023-11-18T21:28:43.066698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:09.508737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3370313,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"31'82","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:25.976634+0000","last_change":"2023-11-18T20:59:35.834266+0000","last_active":"2023-11-18T21:27:25.976634+0000","last_peered":"2023-11-18T21:27:25.976634+0000","last_clean":"2023-11-18T21:27:25.976634+0000","last_became_active":"2023-11-18T20:59:35.833790+0000","last_became_peered":"2023-11-18T20:59:35.833790+0000","last_unstale":"2023-11-18T21:27:25.976634+0000","last_undegraded":"2023-11-18T21:27:25.976634+0000","last_fullsized":"2023-11-18T21:27:25.976634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:08.464650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":7460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'56","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678848+0000","last_change":"2023-11-18T20:59:27.873828+0000","last_active":"2023-11-18T21:28:43.678848+0000","last_peered":"2023-11-18T21:28:43.678848+0000","last_clean":"2023-11-18T21:28:43.678848+0000","last_became_active":"2023-11-18T20:59:27.872733+0000","last_became_peered":"2023-11-18T20:59:27.872733+0000","last_unstale":"2023-11-18T21:28:43.678848+0000","last_undegraded":"2023-11-18T21:28:43.678848+0000","last_fullsized":"2023-11-18T21:28:43.678848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"31'7","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.098478+0000","last_change":"2023-11-18T20:59:25.497529+0000","last_active":"2023-11-18T21:28:26.098478+0000","last_peered":"2023-11-18T21:28:26.098478+0000","last_clean":"2023-11-18T21:28:26.098478+0000","last_became_active":"2023-11-18T20:59:25.496694+0000","last_became_peered":"2023-11-18T20:59:25.496694+0000","last_unstale":"2023-11-18T21:28:26.098478+0000","last_undegraded":"2023-11-18T21:28:26.098478+0000","last_fullsized":"2023-11-18T21:28:26.098478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'95","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:24.986581+0000","last_change":"2023-11-18T20:59:35.829393+0000","last_active":"2023-11-18T21:27:24.986581+0000","last_peered":"2023-11-18T21:27:24.986581+0000","last_clean":"2023-11-18T21:27:24.986581+0000","last_became_active":"2023-11-18T20:59:35.828446+0000","last_became_peered":"2023-11-18T20:59:35.828446+0000","last_unstale":"2023-11-18T21:27:24.986581+0000","last_undegraded":"2023-11-18T21:27:24.986581+0000","last_fullsized":"2023-11-18T21:27:24.986581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:33.544336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":11010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"31'55","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678331+0000","last_change":"2023-11-18T20:59:27.875122+0000","last_active":"2023-11-18T21:28:43.678331+0000","last_peered":"2023-11-18T21:28:43.678331+0000","last_clean":"2023-11-18T21:28:43.678331+0000","last_became_active":"2023-11-18T20:59:27.870220+0000","last_became_peered":"2023-11-18T20:59:27.870220+0000","last_unstale":"2023-11-18T21:28:43.678331+0000","last_undegraded":"2023-11-18T21:28:43.678331+0000","last_fullsized":"2023-11-18T21:28:43.678331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:39.557454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"31'12","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:27.050057+0000","last_change":"2023-11-18T20:59:25.457826+0000","last_active":"2023-11-18T21:28:27.050057+0000","last_peered":"2023-11-18T21:28:27.050057+0000","last_clean":"2023-11-18T21:28:27.050057+0000","last_became_active":"2023-11-18T20:59:25.457392+0000","last_became_peered":"2023-11-18T20:59:25.457392+0000","last_unstale":"2023-11-18T21:28:27.050057+0000","last_undegraded":"2023-11-18T21:28:27.050057+0000","last_fullsized":"2023-11-18T21:28:27.050057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:07:56.724852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"31'70","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.074726+0000","last_change":"2023-11-18T20:59:35.831579+0000","last_active":"2023-11-18T21:27:28.074726+0000","last_peered":"2023-11-18T21:27:28.074726+0000","last_clean":"2023-11-18T21:27:28.074726+0000","last_became_active":"2023-11-18T20:59:35.831147+0000","last_became_peered":"2023-11-18T20:59:35.831147+0000","last_unstale":"2023-11-18T21:27:28.074726+0000","last_undegraded":"2023-11-18T21:27:28.074726+0000","last_fullsized":"2023-11-18T21:27:28.074726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:08.730686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"31'58","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.688733+0000","last_change":"2023-11-18T20:59:27.895618+0000","last_active":"2023-11-18T21:28:43.688733+0000","last_peered":"2023-11-18T21:28:43.688733+0000","last_clean":"2023-11-18T21:28:43.688733+0000","last_became_active":"2023-11-18T20:59:27.894931+0000","last_became_peered":"2023-11-18T20:59:27.894931+0000","last_unstale":"2023-11-18T21:28:43.688733+0000","last_undegraded":"2023-11-18T21:28:43.688733+0000","last_fullsized":"2023-11-18T21:28:43.688733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:33.165546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"31'206","reported_seq":241,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.287261+0000","last_change":"2023-11-18T20:59:25.458603+0000","last_active":"2023-11-18T21:28:32.287261+0000","last_peered":"2023-11-18T21:28:32.287261+0000","last_clean":"2023-11-18T21:28:32.287261+0000","last_became_active":"2023-11-18T20:59:25.457932+0000","last_became_peered":"2023-11-18T20:59:25.457932+0000","last_unstale":"2023-11-18T21:28:32.287261+0000","last_undegraded":"2023-11-18T21:28:32.287261+0000","last_fullsized":"2023-11-18T21:28:32.287261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":499,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"31'58","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.099951+0000","last_change":"2023-11-18T20:59:35.832209+0000","last_active":"2023-11-18T21:27:28.099951+0000","last_peered":"2023-11-18T21:27:28.099951+0000","last_clean":"2023-11-18T21:27:28.099951+0000","last_became_active":"2023-11-18T20:59:35.831804+0000","last_became_peered":"2023-11-18T20:59:35.831804+0000","last_unstale":"2023-11-18T21:27:28.099951+0000","last_undegraded":"2023-11-18T21:27:28.099951+0000","last_fullsized":"2023-11-18T21:27:28.099951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:13.050905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":9539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'55","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.664165+0000","last_change":"2023-11-18T20:59:27.884733+0000","last_active":"2023-11-18T21:28:43.664165+0000","last_peered":"2023-11-18T21:28:43.664165+0000","last_clean":"2023-11-18T21:28:43.664165+0000","last_became_active":"2023-11-18T20:59:27.884143+0000","last_became_peered":"2023-11-18T20:59:27.884143+0000","last_unstale":"2023-11-18T21:28:43.664165+0000","last_undegraded":"2023-11-18T21:28:43.664165+0000","last_fullsized":"2023-11-18T21:28:43.664165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:32.466816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"31'147","reported_seq":181,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:11.998500+0000","last_change":"2023-11-18T20:59:25.362761+0000","last_active":"2023-11-18T21:28:11.998500+0000","last_peered":"2023-11-18T21:28:11.998500+0000","last_clean":"2023-11-18T21:28:11.998500+0000","last_became_active":"2023-11-18T20:59:25.362350+0000","last_became_peered":"2023-11-18T20:59:25.362350+0000","last_unstale":"2023-11-18T21:28:11.998500+0000","last_undegraded":"2023-11-18T21:28:11.998500+0000","last_fullsized":"2023-11-18T21:28:11.998500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:32:54.741681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"31'80","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.936662+0000","last_change":"2023-11-18T20:59:35.836797+0000","last_active":"2023-11-18T21:27:27.936662+0000","last_peered":"2023-11-18T21:27:27.936662+0000","last_clean":"2023-11-18T21:27:27.936662+0000","last_became_active":"2023-11-18T20:59:35.834153+0000","last_became_peered":"2023-11-18T20:59:35.834153+0000","last_unstale":"2023-11-18T21:27:27.936662+0000","last_undegraded":"2023-11-18T21:27:27.936662+0000","last_fullsized":"2023-11-18T21:27:27.936662+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:18.639780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'47","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.626927+0000","last_change":"2023-11-18T20:59:27.841401+0000","last_active":"2023-11-18T21:28:43.626927+0000","last_peered":"2023-11-18T21:28:43.626927+0000","last_clean":"2023-11-18T21:28:43.626927+0000","last_became_active":"2023-11-18T20:59:27.840852+0000","last_became_peered":"2023-11-18T20:59:27.840852+0000","last_unstale":"2023-11-18T21:28:43.626927+0000","last_undegraded":"2023-11-18T21:28:43.626927+0000","last_fullsized":"2023-11-18T21:28:43.626927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"31'840","reported_seq":874,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.081381+0000","last_change":"2023-11-18T20:59:25.351707+0000","last_active":"2023-11-18T21:28:43.081381+0000","last_peered":"2023-11-18T21:28:43.081381+0000","last_clean":"2023-11-18T21:28:43.081381+0000","last_became_active":"2023-11-18T20:59:25.351149+0000","last_became_peered":"2023-11-18T20:59:25.351149+0000","last_unstale":"2023-11-18T21:28:43.081381+0000","last_undegraded":"2023-11-18T21:28:43.081381+0000","last_fullsized":"2023-11-18T21:28:43.081381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:37:55.630369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3704571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":4031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"31'77","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.952612+0000","last_change":"2023-11-18T20:59:35.844046+0000","last_active":"2023-11-18T21:27:27.952612+0000","last_peered":"2023-11-18T21:27:27.952612+0000","last_clean":"2023-11-18T21:27:27.952612+0000","last_became_active":"2023-11-18T20:59:35.843208+0000","last_became_peered":"2023-11-18T20:59:35.843208+0000","last_unstale":"2023-11-18T21:27:27.952612+0000","last_undegraded":"2023-11-18T21:27:27.952612+0000","last_fullsized":"2023-11-18T21:27:27.952612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:21:06.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":6277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'59","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.670708+0000","last_change":"2023-11-18T20:59:27.866997+0000","last_active":"2023-11-18T21:28:43.670708+0000","last_peered":"2023-11-18T21:28:43.670708+0000","last_clean":"2023-11-18T21:28:43.670708+0000","last_became_active":"2023-11-18T20:59:27.866233+0000","last_became_peered":"2023-11-18T20:59:27.866233+0000","last_unstale":"2023-11-18T21:28:43.670708+0000","last_undegraded":"2023-11-18T21:28:43.670708+0000","last_fullsized":"2023-11-18T21:28:43.670708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:19.998748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"31'93","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.127406+0000","last_change":"2023-11-18T20:59:25.362589+0000","last_active":"2023-11-18T21:28:26.127406+0000","last_peered":"2023-11-18T21:28:26.127406+0000","last_clean":"2023-11-18T21:28:26.127406+0000","last_became_active":"2023-11-18T20:59:25.362287+0000","last_became_peered":"2023-11-18T20:59:25.362287+0000","last_unstale":"2023-11-18T21:28:26.127406+0000","last_undegraded":"2023-11-18T21:28:26.127406+0000","last_fullsized":"2023-11-18T21:28:26.127406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:24.791294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"31'78","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.501676+0000","last_change":"2023-11-18T20:59:35.846859+0000","last_active":"2023-11-18T21:27:18.501676+0000","last_peered":"2023-11-18T21:27:18.501676+0000","last_clean":"2023-11-18T21:27:18.501676+0000","last_became_active":"2023-11-18T20:59:35.845378+0000","last_became_peered":"2023-11-18T20:59:35.845378+0000","last_unstale":"2023-11-18T21:27:18.501676+0000","last_undegraded":"2023-11-18T21:27:18.501676+0000","last_fullsized":"2023-11-18T21:27:18.501676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"31'57","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.633140+0000","last_change":"2023-11-18T20:59:27.863967+0000","last_active":"2023-11-18T21:28:43.633140+0000","last_peered":"2023-11-18T21:28:43.633140+0000","last_clean":"2023-11-18T21:28:43.633140+0000","last_became_active":"2023-11-18T20:59:27.863435+0000","last_became_peered":"2023-11-18T20:59:27.863435+0000","last_unstale":"2023-11-18T21:28:43.633140+0000","last_undegraded":"2023-11-18T21:28:43.633140+0000","last_fullsized":"2023-11-18T21:28:43.633140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:04.837624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"31'121","reported_seq":263,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.070745+0000","last_change":"2023-11-18T20:59:25.361677+0000","last_active":"2023-11-18T21:28:26.070745+0000","last_peered":"2023-11-18T21:28:26.070745+0000","last_clean":"2023-11-18T21:28:26.070745+0000","last_became_active":"2023-11-18T20:59:25.361313+0000","last_became_peered":"2023-11-18T20:59:25.361313+0000","last_unstale":"2023-11-18T21:28:26.070745+0000","last_undegraded":"2023-11-18T21:28:26.070745+0000","last_fullsized":"2023-11-18T21:28:26.070745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25371,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":112,"num_write":121,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"31'82","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.965955+0000","last_change":"2023-11-18T20:59:35.832893+0000","last_active":"2023-11-18T21:27:27.965955+0000","last_peered":"2023-11-18T21:27:27.965955+0000","last_clean":"2023-11-18T21:27:27.965955+0000","last_became_active":"2023-11-18T20:59:35.832562+0000","last_became_peered":"2023-11-18T20:59:35.832562+0000","last_unstale":"2023-11-18T21:27:27.965955+0000","last_undegraded":"2023-11-18T21:27:27.965955+0000","last_fullsized":"2023-11-18T21:27:27.965955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:53:05.127511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":7445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'55","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678154+0000","last_change":"2023-11-18T20:59:27.874128+0000","last_active":"2023-11-18T21:28:43.678154+0000","last_peered":"2023-11-18T21:28:43.678154+0000","last_clean":"2023-11-18T21:28:43.678154+0000","last_became_active":"2023-11-18T20:59:27.865971+0000","last_became_peered":"2023-11-18T20:59:27.865971+0000","last_unstale":"2023-11-18T21:28:43.678154+0000","last_undegraded":"2023-11-18T21:28:43.678154+0000","last_fullsized":"2023-11-18T21:28:43.678154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"31'1150","reported_seq":1184,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.293706+0000","last_change":"2023-11-18T20:59:25.350262+0000","last_active":"2023-11-18T21:28:32.293706+0000","last_peered":"2023-11-18T21:28:32.293706+0000","last_clean":"2023-11-18T21:28:32.293706+0000","last_became_active":"2023-11-18T20:59:25.349577+0000","last_became_peered":"2023-11-18T20:59:25.349577+0000","last_unstale":"2023-11-18T21:28:32.293706+0000","last_undegraded":"2023-11-18T21:28:32.293706+0000","last_fullsized":"2023-11-18T21:28:32.293706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":4577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"31'99","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:26.994212+0000","last_change":"2023-11-18T20:59:35.849720+0000","last_active":"2023-11-18T21:27:26.994212+0000","last_peered":"2023-11-18T21:27:26.994212+0000","last_clean":"2023-11-18T21:27:26.994212+0000","last_became_active":"2023-11-18T20:59:35.848000+0000","last_became_peered":"2023-11-18T20:59:35.848000+0000","last_unstale":"2023-11-18T21:27:26.994212+0000","last_undegraded":"2023-11-18T21:27:26.994212+0000","last_fullsized":"2023-11-18T21:27:26.994212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:41:54.553006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":10947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"31'51","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.641202+0000","last_change":"2023-11-18T20:59:27.891817+0000","last_active":"2023-11-18T21:28:43.641202+0000","last_peered":"2023-11-18T21:28:43.641202+0000","last_clean":"2023-11-18T21:28:43.641202+0000","last_became_active":"2023-11-18T20:59:27.891260+0000","last_became_peered":"2023-11-18T20:59:27.891260+0000","last_unstale":"2023-11-18T21:28:43.641202+0000","last_undegraded":"2023-11-18T21:28:43.641202+0000","last_fullsized":"2023-11-18T21:28:43.641202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:25.331055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"31'67","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:33.868078+0000","last_change":"2023-11-18T20:59:25.363983+0000","last_active":"2023-11-18T21:28:33.868078+0000","last_peered":"2023-11-18T21:28:33.868078+0000","last_clean":"2023-11-18T21:28:33.868078+0000","last_became_active":"2023-11-18T20:59:25.363289+0000","last_became_peered":"2023-11-18T20:59:25.363289+0000","last_unstale":"2023-11-18T21:28:33.868078+0000","last_undegraded":"2023-11-18T21:28:33.868078+0000","last_fullsized":"2023-11-18T21:28:33.868078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"31'68","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.149401+0000","last_change":"2023-11-18T20:59:35.771712+0000","last_active":"2023-11-18T21:27:28.149401+0000","last_peered":"2023-11-18T21:27:28.149401+0000","last_clean":"2023-11-18T21:27:28.149401+0000","last_became_active":"2023-11-18T20:59:35.771263+0000","last_became_peered":"2023-11-18T20:59:35.771263+0000","last_unstale":"2023-11-18T21:27:28.149401+0000","last_undegraded":"2023-11-18T21:27:28.149401+0000","last_fullsized":"2023-11-18T21:27:28.149401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":272,"num_write":61,"num_write_kb":11998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"31'64","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.648283+0000","last_change":"2023-11-18T20:59:27.834172+0000","last_active":"2023-11-18T21:28:43.648283+0000","last_peered":"2023-11-18T21:28:43.648283+0000","last_clean":"2023-11-18T21:28:43.648283+0000","last_became_active":"2023-11-18T20:59:27.832589+0000","last_became_peered":"2023-11-18T20:59:27.832589+0000","last_unstale":"2023-11-18T21:28:43.648283+0000","last_undegraded":"2023-11-18T21:28:43.648283+0000","last_fullsized":"2023-11-18T21:28:43.648283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"31'116","reported_seq":259,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:11.762077+0000","last_change":"2023-11-18T20:59:25.494236+0000","last_active":"2023-11-18T21:28:11.762077+0000","last_peered":"2023-11-18T21:28:11.762077+0000","last_clean":"2023-11-18T21:28:11.762077+0000","last_became_active":"2023-11-18T20:59:25.493373+0000","last_became_peered":"2023-11-18T20:59:25.493373+0000","last_unstale":"2023-11-18T21:28:11.762077+0000","last_undegraded":"2023-11-18T21:28:11.762077+0000","last_fullsized":"2023-11-18T21:28:11.762077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:13.859109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20332,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":112,"num_write":115,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'93","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:21.763452+0000","last_change":"2023-11-18T20:59:35.773319+0000","last_active":"2023-11-18T21:27:21.763452+0000","last_peered":"2023-11-18T21:27:21.763452+0000","last_clean":"2023-11-18T21:27:21.763452+0000","last_became_active":"2023-11-18T20:59:35.772563+0000","last_became_peered":"2023-11-18T20:59:35.772563+0000","last_unstale":"2023-11-18T21:27:21.763452+0000","last_undegraded":"2023-11-18T21:27:21.763452+0000","last_fullsized":"2023-11-18T21:27:21.763452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:12.287749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":9621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'57","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.695084+0000","last_change":"2023-11-18T20:59:27.892789+0000","last_active":"2023-11-18T21:28:43.695084+0000","last_peered":"2023-11-18T21:28:43.695084+0000","last_clean":"2023-11-18T21:28:43.695084+0000","last_became_active":"2023-11-18T20:59:27.891883+0000","last_became_peered":"2023-11-18T20:59:27.891883+0000","last_unstale":"2023-11-18T21:28:43.695084+0000","last_undegraded":"2023-11-18T21:28:43.695084+0000","last_fullsized":"2023-11-18T21:28:43.695084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:12.020475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"31'158","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.392162+0000","last_change":"2023-11-18T20:59:25.497309+0000","last_active":"2023-11-18T21:28:32.392162+0000","last_peered":"2023-11-18T21:28:32.392162+0000","last_clean":"2023-11-18T21:28:32.392162+0000","last_became_active":"2023-11-18T20:59:25.496680+0000","last_became_peered":"2023-11-18T20:59:25.496680+0000","last_unstale":"2023-11-18T21:28:32.392162+0000","last_undegraded":"2023-11-18T21:28:32.392162+0000","last_fullsized":"2023-11-18T21:28:32.392162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"31'67","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.919444+0000","last_change":"2023-11-18T20:59:35.842258+0000","last_active":"2023-11-18T21:27:27.919444+0000","last_peered":"2023-11-18T21:27:27.919444+0000","last_clean":"2023-11-18T21:27:27.919444+0000","last_became_active":"2023-11-18T20:59:35.838830+0000","last_became_peered":"2023-11-18T20:59:35.838830+0000","last_unstale":"2023-11-18T21:27:27.919444+0000","last_undegraded":"2023-11-18T21:27:27.919444+0000","last_fullsized":"2023-11-18T21:27:27.919444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:12:39.697374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":8132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"31'63","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:21.787641+0000","last_change":"2023-11-18T20:59:35.839178+0000","last_active":"2023-11-18T21:27:21.787641+0000","last_peered":"2023-11-18T21:27:21.787641+0000","last_clean":"2023-11-18T21:27:21.787641+0000","last_became_active":"2023-11-18T20:59:35.838375+0000","last_became_peered":"2023-11-18T20:59:35.838375+0000","last_unstale":"2023-11-18T21:27:21.787641+0000","last_undegraded":"2023-11-18T21:27:21.787641+0000","last_fullsized":"2023-11-18T21:27:21.787641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:56:09.565932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"31'61","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.578789+0000","last_change":"2023-11-18T20:59:27.689539+0000","last_active":"2023-11-18T21:28:43.578789+0000","last_peered":"2023-11-18T21:28:43.578789+0000","last_clean":"2023-11-18T21:28:43.578789+0000","last_became_active":"2023-11-18T20:59:27.688522+0000","last_became_peered":"2023-11-18T20:59:27.688522+0000","last_unstale":"2023-11-18T21:28:43.578789+0000","last_undegraded":"2023-11-18T21:28:43.578789+0000","last_fullsized":"2023-11-18T21:28:43.578789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:06:48.337696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"31'7","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:51.862615+0000","last_change":"2023-11-18T20:59:25.494125+0000","last_active":"2023-11-18T21:27:51.862615+0000","last_peered":"2023-11-18T21:27:51.862615+0000","last_clean":"2023-11-18T21:27:51.862615+0000","last_became_active":"2023-11-18T20:59:25.493357+0000","last_became_peered":"2023-11-18T20:59:25.493357+0000","last_unstale":"2023-11-18T21:27:51.862615+0000","last_undegraded":"2023-11-18T21:27:51.862615+0000","last_fullsized":"2023-11-18T21:27:51.862615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'97","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.014725+0000","last_change":"2023-11-18T20:59:35.776653+0000","last_active":"2023-11-18T21:27:27.014725+0000","last_peered":"2023-11-18T21:27:27.014725+0000","last_clean":"2023-11-18T21:27:27.014725+0000","last_became_active":"2023-11-18T20:59:35.776138+0000","last_became_peered":"2023-11-18T20:59:35.776138+0000","last_unstale":"2023-11-18T21:27:27.014725+0000","last_undegraded":"2023-11-18T21:27:27.014725+0000","last_fullsized":"2023-11-18T21:27:27.014725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:08:25.933599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'54","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.642467+0000","last_change":"2023-11-18T20:59:27.860987+0000","last_active":"2023-11-18T21:28:43.642467+0000","last_peered":"2023-11-18T21:28:43.642467+0000","last_clean":"2023-11-18T21:28:43.642467+0000","last_became_active":"2023-11-18T20:59:27.860537+0000","last_became_peered":"2023-11-18T20:59:27.860537+0000","last_unstale":"2023-11-18T21:28:43.642467+0000","last_undegraded":"2023-11-18T21:28:43.642467+0000","last_fullsized":"2023-11-18T21:28:43.642467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"31'228","reported_seq":485,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.255998+0000","last_change":"2023-11-18T20:59:25.354967+0000","last_active":"2023-11-18T21:28:32.255998+0000","last_peered":"2023-11-18T21:28:32.255998+0000","last_clean":"2023-11-18T21:28:32.255998+0000","last_became_active":"2023-11-18T20:59:25.354690+0000","last_became_peered":"2023-11-18T20:59:25.354690+0000","last_unstale":"2023-11-18T21:28:32.255998+0000","last_undegraded":"2023-11-18T21:28:32.255998+0000","last_fullsized":"2023-11-18T21:28:32.255998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:50.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34720,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":223,"num_read_kb":227,"num_write":228,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"31'175","reported_seq":370,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.108932+0000","last_change":"2023-11-18T20:59:25.346493+0000","last_active":"2023-11-18T21:28:26.108932+0000","last_peered":"2023-11-18T21:28:26.108932+0000","last_clean":"2023-11-18T21:28:26.108932+0000","last_became_active":"2023-11-18T20:59:25.346192+0000","last_became_peered":"2023-11-18T20:59:25.346192+0000","last_unstale":"2023-11-18T21:28:26.108932+0000","last_undegraded":"2023-11-18T21:28:26.108932+0000","last_fullsized":"2023-11-18T21:28:26.108932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:30.162962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":165,"num_write":171,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'63","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.671087+0000","last_change":"2023-11-18T20:59:27.868460+0000","last_active":"2023-11-18T21:28:43.671087+0000","last_peered":"2023-11-18T21:28:43.671087+0000","last_clean":"2023-11-18T21:28:43.671087+0000","last_became_active":"2023-11-18T20:59:27.867886+0000","last_became_peered":"2023-11-18T20:59:27.867886+0000","last_unstale":"2023-11-18T21:28:43.671087+0000","last_undegraded":"2023-11-18T21:28:43.671087+0000","last_fullsized":"2023-11-18T21:28:43.671087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:39.647294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'95","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.021970+0000","last_change":"2023-11-18T20:59:35.851163+0000","last_active":"2023-11-18T21:27:27.021970+0000","last_peered":"2023-11-18T21:27:27.021970+0000","last_clean":"2023-11-18T21:27:27.021970+0000","last_became_active":"2023-11-18T20:59:35.850427+0000","last_became_peered":"2023-11-18T20:59:35.850427+0000","last_unstale":"2023-11-18T21:27:27.021970+0000","last_undegraded":"2023-11-18T21:27:27.021970+0000","last_fullsized":"2023-11-18T21:27:27.021970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:20.729626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2343","reported_seq":2376,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.081692+0000","last_change":"2023-11-18T20:59:25.462276+0000","last_active":"2023-11-18T21:28:43.081692+0000","last_peered":"2023-11-18T21:28:43.081692+0000","last_clean":"2023-11-18T21:28:43.081692+0000","last_became_active":"2023-11-18T20:59:25.460449+0000","last_became_peered":"2023-11-18T20:59:25.460449+0000","last_unstale":"2023-11-18T21:28:43.081692+0000","last_undegraded":"2023-11-18T21:28:43.081692+0000","last_fullsized":"2023-11-18T21:28:43.081692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2343,"log_dups_size":0,"ondisk_log_size":2343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:25:57.950600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8759326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2333,"num_write_kb":9750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"31'69","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.626007+0000","last_change":"2023-11-18T20:59:27.841332+0000","last_active":"2023-11-18T21:28:43.626007+0000","last_peered":"2023-11-18T21:28:43.626007+0000","last_clean":"2023-11-18T21:28:43.626007+0000","last_became_active":"2023-11-18T20:59:27.840528+0000","last_became_peered":"2023-11-18T20:59:27.840528+0000","last_unstale":"2023-11-18T21:28:43.626007+0000","last_undegraded":"2023-11-18T21:28:43.626007+0000","last_fullsized":"2023-11-18T21:28:43.626007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"31'65","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:26.984823+0000","last_change":"2023-11-18T20:59:35.776844+0000","last_active":"2023-11-18T21:27:26.984823+0000","last_peered":"2023-11-18T21:27:26.984823+0000","last_clean":"2023-11-18T21:27:26.984823+0000","last_became_active":"2023-11-18T20:59:35.775977+0000","last_became_peered":"2023-11-18T20:59:35.775977+0000","last_unstale":"2023-11-18T21:27:26.984823+0000","last_undegraded":"2023-11-18T21:27:26.984823+0000","last_fullsized":"2023-11-18T21:27:26.984823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:06:00.187752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"31'59","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.669791+0000","last_change":"2023-11-18T20:59:27.888673+0000","last_active":"2023-11-18T21:28:43.669791+0000","last_peered":"2023-11-18T21:28:43.669791+0000","last_clean":"2023-11-18T21:28:43.669791+0000","last_became_active":"2023-11-18T20:59:27.887716+0000","last_became_peered":"2023-11-18T20:59:27.887716+0000","last_unstale":"2023-11-18T21:28:43.669791+0000","last_undegraded":"2023-11-18T21:28:43.669791+0000","last_fullsized":"2023-11-18T21:28:43.669791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"31'67","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.471935+0000","last_change":"2023-11-18T20:59:27.684810+0000","last_active":"2023-11-18T21:28:43.471935+0000","last_peered":"2023-11-18T21:28:43.471935+0000","last_clean":"2023-11-18T21:28:43.471935+0000","last_became_active":"2023-11-18T20:59:27.680712+0000","last_became_peered":"2023-11-18T20:59:27.680712+0000","last_unstale":"2023-11-18T21:28:43.471935+0000","last_undegraded":"2023-11-18T21:28:43.471935+0000","last_fullsized":"2023-11-18T21:28:43.471935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"31'57","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.646654+0000","last_change":"2023-11-18T20:59:27.835960+0000","last_active":"2023-11-18T21:28:43.646654+0000","last_peered":"2023-11-18T21:28:43.646654+0000","last_clean":"2023-11-18T21:28:43.646654+0000","last_became_active":"2023-11-18T20:59:27.835120+0000","last_became_peered":"2023-11-18T20:59:27.835120+0000","last_unstale":"2023-11-18T21:28:43.646654+0000","last_undegraded":"2023-11-18T21:28:43.646654+0000","last_fullsized":"2023-11-18T21:28:43.646654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:35:51.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"31'59","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.632517+0000","last_change":"2023-11-18T20:59:27.833652+0000","last_active":"2023-11-18T21:28:43.632517+0000","last_peered":"2023-11-18T21:28:43.632517+0000","last_clean":"2023-11-18T21:28:43.632517+0000","last_became_active":"2023-11-18T20:59:27.833049+0000","last_became_peered":"2023-11-18T20:59:27.833049+0000","last_unstale":"2023-11-18T21:28:43.632517+0000","last_undegraded":"2023-11-18T21:28:43.632517+0000","last_fullsized":"2023-11-18T21:28:43.632517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:23.262919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"31'40","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.654877+0000","last_change":"2023-11-18T20:59:27.878824+0000","last_active":"2023-11-18T21:28:43.654877+0000","last_peered":"2023-11-18T21:28:43.654877+0000","last_clean":"2023-11-18T21:28:43.654877+0000","last_became_active":"2023-11-18T20:59:27.878353+0000","last_became_peered":"2023-11-18T20:59:27.878353+0000","last_unstale":"2023-11-18T21:28:43.654877+0000","last_undegraded":"2023-11-18T21:28:43.654877+0000","last_fullsized":"2023-11-18T21:28:43.654877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:04.074467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'50","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.581622+0000","last_change":"2023-11-18T20:59:27.866570+0000","last_active":"2023-11-18T21:28:43.581622+0000","last_peered":"2023-11-18T21:28:43.581622+0000","last_clean":"2023-11-18T21:28:43.581622+0000","last_became_active":"2023-11-18T20:59:27.866165+0000","last_became_peered":"2023-11-18T20:59:27.866165+0000","last_unstale":"2023-11-18T21:28:43.581622+0000","last_undegraded":"2023-11-18T21:28:43.581622+0000","last_fullsized":"2023-11-18T21:28:43.581622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:05:51.974471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"31'55","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.693558+0000","last_change":"2023-11-18T20:59:27.895340+0000","last_active":"2023-11-18T21:28:43.693558+0000","last_peered":"2023-11-18T21:28:43.693558+0000","last_clean":"2023-11-18T21:28:43.693558+0000","last_became_active":"2023-11-18T20:59:27.893918+0000","last_became_peered":"2023-11-18T20:59:27.893918+0000","last_unstale":"2023-11-18T21:28:43.693558+0000","last_undegraded":"2023-11-18T21:28:43.693558+0000","last_fullsized":"2023-11-18T21:28:43.693558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:11.899550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"31'49","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630693+0000","last_change":"2023-11-18T20:59:27.839127+0000","last_active":"2023-11-18T21:28:43.630693+0000","last_peered":"2023-11-18T21:28:43.630693+0000","last_clean":"2023-11-18T21:28:43.630693+0000","last_became_active":"2023-11-18T20:59:27.838509+0000","last_became_peered":"2023-11-18T20:59:27.838509+0000","last_unstale":"2023-11-18T21:28:43.630693+0000","last_undegraded":"2023-11-18T21:28:43.630693+0000","last_fullsized":"2023-11-18T21:28:43.630693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"31'60","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.628797+0000","last_change":"2023-11-18T20:59:27.836167+0000","last_active":"2023-11-18T21:28:43.628797+0000","last_peered":"2023-11-18T21:28:43.628797+0000","last_clean":"2023-11-18T21:28:43.628797+0000","last_became_active":"2023-11-18T20:59:27.835226+0000","last_became_peered":"2023-11-18T20:59:27.835226+0000","last_unstale":"2023-11-18T21:28:43.628797+0000","last_undegraded":"2023-11-18T21:28:43.628797+0000","last_fullsized":"2023-11-18T21:28:43.628797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:23:46.608216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'73","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.661836+0000","last_change":"2023-11-18T20:59:27.889937+0000","last_active":"2023-11-18T21:28:43.661836+0000","last_peered":"2023-11-18T21:28:43.661836+0000","last_clean":"2023-11-18T21:28:43.661836+0000","last_became_active":"2023-11-18T20:59:27.889325+0000","last_became_peered":"2023-11-18T20:59:27.889325+0000","last_unstale":"2023-11-18T21:28:43.661836+0000","last_undegraded":"2023-11-18T21:28:43.661836+0000","last_fullsized":"2023-11-18T21:28:43.661836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:39.674424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"31'63","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.670691+0000","last_change":"2023-11-18T20:59:27.867439+0000","last_active":"2023-11-18T21:28:43.670691+0000","last_peered":"2023-11-18T21:28:43.670691+0000","last_clean":"2023-11-18T21:28:43.670691+0000","last_became_active":"2023-11-18T20:59:27.866609+0000","last_became_peered":"2023-11-18T20:59:27.866609+0000","last_unstale":"2023-11-18T21:28:43.670691+0000","last_undegraded":"2023-11-18T21:28:43.670691+0000","last_fullsized":"2023-11-18T21:28:43.670691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:46:49.094141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'64","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.615236+0000","last_change":"2023-11-18T20:59:27.883416+0000","last_active":"2023-11-18T21:28:43.615236+0000","last_peered":"2023-11-18T21:28:43.615236+0000","last_clean":"2023-11-18T21:28:43.615236+0000","last_became_active":"2023-11-18T20:59:27.882976+0000","last_became_peered":"2023-11-18T20:59:27.882976+0000","last_unstale":"2023-11-18T21:28:43.615236+0000","last_undegraded":"2023-11-18T21:28:43.615236+0000","last_fullsized":"2023-11-18T21:28:43.615236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:12.611142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"31'51","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.679081+0000","last_change":"2023-11-18T20:59:27.873520+0000","last_active":"2023-11-18T21:28:43.679081+0000","last_peered":"2023-11-18T21:28:43.679081+0000","last_clean":"2023-11-18T21:28:43.679081+0000","last_became_active":"2023-11-18T20:59:27.872627+0000","last_became_peered":"2023-11-18T20:59:27.872627+0000","last_unstale":"2023-11-18T21:28:43.679081+0000","last_undegraded":"2023-11-18T21:28:43.679081+0000","last_fullsized":"2023-11-18T21:28:43.679081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"31'60","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.654001+0000","last_change":"2023-11-18T20:59:27.687118+0000","last_active":"2023-11-18T21:28:43.654001+0000","last_peered":"2023-11-18T21:28:43.654001+0000","last_clean":"2023-11-18T21:28:43.654001+0000","last_became_active":"2023-11-18T20:59:27.686311+0000","last_became_peered":"2023-11-18T20:59:27.686311+0000","last_unstale":"2023-11-18T21:28:43.654001+0000","last_undegraded":"2023-11-18T21:28:43.654001+0000","last_fullsized":"2023-11-18T21:28:43.654001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:25:27.490214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'65","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.471465+0000","last_change":"2023-11-18T20:59:27.892404+0000","last_active":"2023-11-18T21:28:43.471465+0000","last_peered":"2023-11-18T21:28:43.471465+0000","last_clean":"2023-11-18T21:28:43.471465+0000","last_became_active":"2023-11-18T20:59:27.891767+0000","last_became_peered":"2023-11-18T20:59:27.891767+0000","last_unstale":"2023-11-18T21:28:43.471465+0000","last_undegraded":"2023-11-18T21:28:43.471465+0000","last_fullsized":"2023-11-18T21:28:43.471465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"31'51","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.669452+0000","last_change":"2023-11-18T20:59:27.866920+0000","last_active":"2023-11-18T21:28:43.669452+0000","last_peered":"2023-11-18T21:28:43.669452+0000","last_clean":"2023-11-18T21:28:43.669452+0000","last_became_active":"2023-11-18T20:59:27.866153+0000","last_became_peered":"2023-11-18T20:59:27.866153+0000","last_unstale":"2023-11-18T21:28:43.669452+0000","last_undegraded":"2023-11-18T21:28:43.669452+0000","last_fullsized":"2023-11-18T21:28:43.669452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:50:43.894365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'60","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.664304+0000","last_change":"2023-11-18T20:59:27.890399+0000","last_active":"2023-11-18T21:28:43.664304+0000","last_peered":"2023-11-18T21:28:43.664304+0000","last_clean":"2023-11-18T21:28:43.664304+0000","last_became_active":"2023-11-18T20:59:27.889704+0000","last_became_peered":"2023-11-18T20:59:27.889704+0000","last_unstale":"2023-11-18T21:28:43.664304+0000","last_undegraded":"2023-11-18T21:28:43.664304+0000","last_fullsized":"2023-11-18T21:28:43.664304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:34:37.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"31'63","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.670763+0000","last_change":"2023-11-18T20:59:27.871794+0000","last_active":"2023-11-18T21:28:43.670763+0000","last_peered":"2023-11-18T21:28:43.670763+0000","last_clean":"2023-11-18T21:28:43.670763+0000","last_became_active":"2023-11-18T20:59:27.871337+0000","last_became_peered":"2023-11-18T20:59:27.871337+0000","last_unstale":"2023-11-18T21:28:43.670763+0000","last_undegraded":"2023-11-18T21:28:43.670763+0000","last_fullsized":"2023-11-18T21:28:43.670763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:16.370847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"31'53","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.584958+0000","last_change":"2023-11-18T20:59:27.867288+0000","last_active":"2023-11-18T21:28:43.584958+0000","last_peered":"2023-11-18T21:28:43.584958+0000","last_clean":"2023-11-18T21:28:43.584958+0000","last_became_active":"2023-11-18T20:59:27.866560+0000","last_became_peered":"2023-11-18T20:59:27.866560+0000","last_unstale":"2023-11-18T21:28:43.584958+0000","last_undegraded":"2023-11-18T21:28:43.584958+0000","last_fullsized":"2023-11-18T21:28:43.584958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"31'52","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.669336+0000","last_change":"2023-11-18T20:59:27.878944+0000","last_active":"2023-11-18T21:28:43.669336+0000","last_peered":"2023-11-18T21:28:43.669336+0000","last_clean":"2023-11-18T21:28:43.669336+0000","last_became_active":"2023-11-18T20:59:27.878485+0000","last_became_peered":"2023-11-18T20:59:27.878485+0000","last_unstale":"2023-11-18T21:28:43.669336+0000","last_undegraded":"2023-11-18T21:28:43.669336+0000","last_fullsized":"2023-11-18T21:28:43.669336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:04.749189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"31'53","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678771+0000","last_change":"2023-11-18T20:59:27.874019+0000","last_active":"2023-11-18T21:28:43.678771+0000","last_peered":"2023-11-18T21:28:43.678771+0000","last_clean":"2023-11-18T21:28:43.678771+0000","last_became_active":"2023-11-18T20:59:27.873255+0000","last_became_peered":"2023-11-18T20:59:27.873255+0000","last_unstale":"2023-11-18T21:28:43.678771+0000","last_undegraded":"2023-11-18T21:28:43.678771+0000","last_fullsized":"2023-11-18T21:28:43.678771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"31'53","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.677510+0000","last_change":"2023-11-18T20:59:27.868086+0000","last_active":"2023-11-18T21:28:43.677510+0000","last_peered":"2023-11-18T21:28:43.677510+0000","last_clean":"2023-11-18T21:28:43.677510+0000","last_became_active":"2023-11-18T20:59:27.866901+0000","last_became_peered":"2023-11-18T20:59:27.866901+0000","last_unstale":"2023-11-18T21:28:43.677510+0000","last_undegraded":"2023-11-18T21:28:43.677510+0000","last_fullsized":"2023-11-18T21:28:43.677510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"31'59","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.675973+0000","last_change":"2023-11-18T20:59:27.888617+0000","last_active":"2023-11-18T21:28:43.675973+0000","last_peered":"2023-11-18T21:28:43.675973+0000","last_clean":"2023-11-18T21:28:43.675973+0000","last_became_active":"2023-11-18T20:59:27.888068+0000","last_became_peered":"2023-11-18T20:59:27.888068+0000","last_unstale":"2023-11-18T21:28:43.675973+0000","last_undegraded":"2023-11-18T21:28:43.675973+0000","last_fullsized":"2023-11-18T21:28:43.675973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:53.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"31'46","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.632841+0000","last_change":"2023-11-18T20:59:27.684428+0000","last_active":"2023-11-18T21:28:43.632841+0000","last_peered":"2023-11-18T21:28:43.632841+0000","last_clean":"2023-11-18T21:28:43.632841+0000","last_became_active":"2023-11-18T20:59:27.682936+0000","last_became_peered":"2023-11-18T20:59:27.682936+0000","last_unstale":"2023-11-18T21:28:43.632841+0000","last_undegraded":"2023-11-18T21:28:43.632841+0000","last_fullsized":"2023-11-18T21:28:43.632841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:52.955875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"31'66","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.672196+0000","last_change":"2023-11-18T20:59:27.865937+0000","last_active":"2023-11-18T21:28:43.672196+0000","last_peered":"2023-11-18T21:28:43.672196+0000","last_clean":"2023-11-18T21:28:43.672196+0000","last_became_active":"2023-11-18T20:59:27.865401+0000","last_became_peered":"2023-11-18T20:59:27.865401+0000","last_unstale":"2023-11-18T21:28:43.672196+0000","last_undegraded":"2023-11-18T21:28:43.672196+0000","last_fullsized":"2023-11-18T21:28:43.672196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:00.251369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"31'51","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.668462+0000","last_change":"2023-11-18T20:59:27.865748+0000","last_active":"2023-11-18T21:28:43.668462+0000","last_peered":"2023-11-18T21:28:43.668462+0000","last_clean":"2023-11-18T21:28:43.668462+0000","last_became_active":"2023-11-18T20:59:27.864956+0000","last_became_peered":"2023-11-18T20:59:27.864956+0000","last_unstale":"2023-11-18T21:28:43.668462+0000","last_undegraded":"2023-11-18T21:28:43.668462+0000","last_fullsized":"2023-11-18T21:28:43.668462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"31'38","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.667115+0000","last_change":"2023-11-18T20:59:27.889838+0000","last_active":"2023-11-18T21:28:43.667115+0000","last_peered":"2023-11-18T21:28:43.667115+0000","last_clean":"2023-11-18T21:28:43.667115+0000","last_became_active":"2023-11-18T20:59:27.889307+0000","last_became_peered":"2023-11-18T20:59:27.889307+0000","last_unstale":"2023-11-18T21:28:43.667115+0000","last_undegraded":"2023-11-18T21:28:43.667115+0000","last_fullsized":"2023-11-18T21:28:43.667115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'47","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.671477+0000","last_change":"2023-11-18T20:59:27.866394+0000","last_active":"2023-11-18T21:28:43.671477+0000","last_peered":"2023-11-18T21:28:43.671477+0000","last_clean":"2023-11-18T21:28:43.671477+0000","last_became_active":"2023-11-18T20:59:27.865625+0000","last_became_peered":"2023-11-18T20:59:27.865625+0000","last_unstale":"2023-11-18T21:28:43.671477+0000","last_undegraded":"2023-11-18T21:28:43.671477+0000","last_fullsized":"2023-11-18T21:28:43.671477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"31'54","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.662646+0000","last_change":"2023-11-18T20:59:27.892765+0000","last_active":"2023-11-18T21:28:43.662646+0000","last_peered":"2023-11-18T21:28:43.662646+0000","last_clean":"2023-11-18T21:28:43.662646+0000","last_became_active":"2023-11-18T20:59:27.891753+0000","last_became_peered":"2023-11-18T20:59:27.891753+0000","last_unstale":"2023-11-18T21:28:43.662646+0000","last_undegraded":"2023-11-18T21:28:43.662646+0000","last_fullsized":"2023-11-18T21:28:43.662646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:52.955875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"31'63","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630861+0000","last_change":"2023-11-18T20:59:27.837531+0000","last_active":"2023-11-18T21:28:43.630861+0000","last_peered":"2023-11-18T21:28:43.630861+0000","last_clean":"2023-11-18T21:28:43.630861+0000","last_became_active":"2023-11-18T20:59:27.836899+0000","last_became_peered":"2023-11-18T20:59:27.836899+0000","last_unstale":"2023-11-18T21:28:43.630861+0000","last_undegraded":"2023-11-18T21:28:43.630861+0000","last_fullsized":"2023-11-18T21:28:43.630861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:04.716391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"31'58","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.639720+0000","last_change":"2023-11-18T20:59:27.864494+0000","last_active":"2023-11-18T21:28:43.639720+0000","last_peered":"2023-11-18T21:28:43.639720+0000","last_clean":"2023-11-18T21:28:43.639720+0000","last_became_active":"2023-11-18T20:59:27.863732+0000","last_became_peered":"2023-11-18T20:59:27.863732+0000","last_unstale":"2023-11-18T21:28:43.639720+0000","last_undegraded":"2023-11-18T21:28:43.639720+0000","last_fullsized":"2023-11-18T21:28:43.639720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"31'63","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678165+0000","last_change":"2023-11-18T20:59:27.873605+0000","last_active":"2023-11-18T21:28:43.678165+0000","last_peered":"2023-11-18T21:28:43.678165+0000","last_clean":"2023-11-18T21:28:43.678165+0000","last_became_active":"2023-11-18T20:59:27.871167+0000","last_became_peered":"2023-11-18T20:59:27.871167+0000","last_unstale":"2023-11-18T21:28:43.678165+0000","last_undegraded":"2023-11-18T21:28:43.678165+0000","last_fullsized":"2023-11-18T21:28:43.678165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:54:51.212807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":448,"num_write":2451,"num_write_kb":251040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2621,"ondisk_log_size":2621,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3577,"ondisk_log_size":3577,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23672018,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":675,"num_read_kb":695,"num_write":9681,"num_write_kb":28189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47595520,"data_stored":47344036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8458,"ondisk_log_size":8458,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509807,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":181032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.90100000000000002,"15min":0.89700000000000002},"min":{"1min":0.51000000000000001,"5min":0.44,"15min":0.34799999999999998},"max":{"1min":1.3280000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.246},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.90800000000000003,"15min":0.93200000000000005},"min":{"1min":0.46100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.393,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92200000000000004,"15min":0.92900000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.3320000000000001,"5min":1.6579999999999999,"15min":1.7210000000000001},"last":1.179},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92100000000000004,"15min":0.93500000000000005},"min":{"1min":0.41599999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4319999999999999,"5min":1.51,"15min":2.524},"last":0.88400000000000001}]},{"osd":2,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.052,"15min":1.052},"min":{"1min":0.53400000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.585,"5min":1.585,"15min":1.694},"last":1.036},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.97699999999999998,"15min":1.01},"min":{"1min":0.47999999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.589},"last":1.006}]},{"osd":3,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.014,"15min":1.0109999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4219999999999999,"5min":1.7509999999999999,"15min":1.831},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.073,"5min":1.0389999999999999,"15min":1.0529999999999999},"min":{"1min":0.57599999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.627,"5min":1.627,"15min":2.4430000000000001},"last":1.216}]},{"osd":4,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.92800000000000005,"15min":0.95199999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4299999999999999,"5min":1.45,"15min":1.601},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0760000000000001,"15min":1.0700000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.40100000000000002},"max":{"1min":1.617,"5min":2.266,"15min":2.266},"last":1.1000000000000001}]},{"osd":5,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.024,"15min":1.0309999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.40300000000000002},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.7509999999999999},"last":1.145},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1040000000000001,"15min":1.1060000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.434},"max":{"1min":1.643,"5min":1.716,"15min":2.0619999999999998},"last":0.93700000000000006}]},{"osd":6,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.127,"15min":1.149},"min":{"1min":0.59199999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":2.1659999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.1850000000000001,"15min":1.1910000000000001},"min":{"1min":0.54600000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.698,"5min":2.181,"15min":2.2080000000000002},"last":1.534}]}]},{"osd":6,"up_from":15,"seq":64424509807,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72804,"kb_used_data":15260,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299036,"statfs":{"total":96636764160,"available":96562212864,"internally_reserved":0,"allocated":15626240,"data_stored":15415703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.91300000000000003},"min":{"1min":0.629,"5min":0.312,"15min":0.312},"max":{"1min":1.4990000000000001,"5min":1.52,"15min":1.72},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.95499999999999996,"15min":0.95599999999999996},"min":{"1min":0.626,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5029999999999999,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.1120000000000001}]},{"osd":1,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.65700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.397,"5min":1.3999999999999999,"15min":1.887},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.111,"5min":0.98699999999999999,"15min":0.99099999999999999},"min":{"1min":0.71699999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.3899999999999999,"5min":3.73,"15min":3.73},"last":1.302}]},{"osd":2,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.95599999999999996,"15min":0.95899999999999996},"min":{"1min":0.69499999999999995,"5min":0.51600000000000001,"15min":0.498},"max":{"1min":1.3580000000000001,"5min":1.48,"15min":1.6459999999999999},"last":1.087},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.0069999999999999,"15min":1.044},"min":{"1min":0.66800000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.4970000000000001,"5min":1.964,"15min":1.964},"last":1.1579999999999999}]},{"osd":3,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.056,"15min":1.0469999999999999},"min":{"1min":0.77700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3400000000000001,"5min":1.7330000000000001,"15min":1.8759999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.105,"5min":1.0780000000000001,"15min":1.0629999999999999},"min":{"1min":0.80600000000000005,"5min":0.55400000000000005,"15min":0.42399999999999999},"max":{"1min":1.2949999999999999,"5min":3.9889999999999999,"15min":3.9889999999999999},"last":0.999}]},{"osd":4,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0269999999999999,"15min":1.0329999999999999},"min":{"1min":0.504,"5min":0.35099999999999998,"15min":0.318},"max":{"1min":1.413,"5min":1.7529999999999999,"15min":2.1030000000000002},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.1040000000000001,"15min":1.1000000000000001},"min":{"1min":0.68600000000000005,"5min":0.50700000000000001,"15min":0.38900000000000001},"max":{"1min":1.577,"5min":1.873,"15min":1.873},"last":1.2270000000000001}]},{"osd":5,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.70199999999999996,"5min":0.621,"15min":0.38600000000000001},"max":{"1min":1.6850000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.159,"15min":1.1699999999999999},"min":{"1min":0.61599999999999999,"5min":0.55000000000000004,"15min":0.35999999999999999},"max":{"1min":1.7789999999999999,"5min":2.194,"15min":2.3700000000000001},"last":1.3380000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1679999999999999,"15min":1.1910000000000001},"min":{"1min":0.73899999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.909,"5min":1.909,"15min":2.1379999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.198,"15min":1.2050000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.45300000000000001},"max":{"1min":1.855,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.1930000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509807,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62884,"kb_used_data":9500,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308956,"statfs":{"total":96636764160,"available":96572370944,"internally_reserved":0,"allocated":9728000,"data_stored":9504573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.88200000000000001,"15min":0.90700000000000003},"min":{"1min":0.55400000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2909999999999999,"5min":1.3899999999999999,"15min":1.494},"last":1.498},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.91300000000000003,"15min":0.94499999999999995},"min":{"1min":0.70599999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.496,"5min":1.5940000000000001,"15min":2.0600000000000001},"last":0.77100000000000002}]},{"osd":1,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.94599999999999995,"15min":0.91800000000000004},"min":{"1min":0.54500000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.4470000000000001,"5min":1.6419999999999999,"15min":1.79},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.91500000000000004,"15min":0.97199999999999998},"min":{"1min":0.76400000000000001,"5min":0.441,"15min":0.39700000000000002},"max":{"1min":1.391,"5min":1.474,"15min":1.794},"last":1.3859999999999999}]},{"osd":2,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.69099999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4059999999999999,"5min":1.504,"15min":2.1379999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.026,"15min":1.0149999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.41199999999999998},"max":{"1min":1.3500000000000001,"5min":1.53,"15min":1.6659999999999999},"last":0.96599999999999997}]},{"osd":3,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.0209999999999999,"15min":1.026},"min":{"1min":0.70599999999999996,"5min":0.60199999999999998,"15min":0.53700000000000003},"max":{"1min":1.2709999999999999,"5min":1.472,"15min":1.5960000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.0629999999999999,"15min":1.0940000000000001},"min":{"1min":0.78200000000000003,"5min":0.51600000000000001,"15min":0.38100000000000001},"max":{"1min":1.5449999999999999,"5min":1.766,"15min":2.2080000000000002},"last":1.0640000000000001}]},{"osd":4,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97099999999999997,"15min":0.98199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.42699999999999999},"max":{"1min":1.2729999999999999,"5min":1.849,"15min":1.9099999999999999},"last":1.131},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.077,"15min":1.089},"min":{"1min":0.64900000000000002,"5min":0.501,"15min":0.439},"max":{"1min":1.3080000000000001,"5min":1.585,"15min":2.4359999999999999},"last":1.1579999999999999}]},{"osd":6,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.054,"15min":1.081},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.32500000000000001},"max":{"1min":1.6240000000000001,"5min":1.6299999999999999,"15min":2.2909999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.105,"15min":1.115},"min":{"1min":0.60899999999999999,"5min":0.58999999999999997,"15min":0.36299999999999999},"max":{"1min":1.405,"5min":1.883,"15min":2.0019999999999998},"last":1.1890000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.147,"15min":1.171},"min":{"1min":0.74199999999999999,"5min":0.52000000000000002,"15min":0.50700000000000001},"max":{"1min":1.4850000000000001,"5min":1.6839999999999999,"15min":2.0209999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.1819999999999999,"15min":1.2230000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.41499999999999998},"max":{"1min":1.5860000000000001,"5min":1.732,"15min":2.2789999999999999},"last":1.448}]}]},{"osd":3,"up_from":15,"seq":64424509806,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60828,"kb_used_data":7444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311012,"statfs":{"total":96636764160,"available":96574476288,"internally_reserved":0,"allocated":7622656,"data_stored":7382745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,20,19],"upper_bound":512},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.52800000000000002,"5min":0.33700000000000002,"15min":0.309},"max":{"1min":1.052,"5min":1.458,"15min":1.458},"last":1.125},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.57299999999999995,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":1.353,"5min":1.3540000000000001,"15min":1.605},"last":1.018}]},{"osd":1,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84299999999999997,"15min":0.84499999999999997},"min":{"1min":0.52400000000000002,"5min":0.372,"15min":0.34899999999999998},"max":{"1min":1.2190000000000001,"5min":1.4510000000000001,"15min":1.7549999999999999},"last":1.593},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76100000000000001,"15min":0.77100000000000002},"min":{"1min":0.48999999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.93700000000000006,"5min":1.629,"15min":1.629},"last":0.58199999999999996}]},{"osd":2,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.99399999999999999,"15min":1.022},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.847},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.98599999999999999,"15min":1.014},"min":{"1min":0.627,"5min":0.36699999999999999,"15min":0.32900000000000001},"max":{"1min":1.5900000000000001,"5min":1.609,"15min":1.794},"last":1.6519999999999999}]},{"osd":4,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0509999999999999,"15min":1.0840000000000001},"min":{"1min":0.71699999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.522,"5min":1.613,"15min":2.0630000000000002},"last":1.744},{"interface":"front","average":{"1min":1.069,"5min":1.034,"15min":1.0569999999999999},"min":{"1min":0.81799999999999995,"5min":0.55500000000000005,"15min":0.439},"max":{"1min":1.2809999999999999,"5min":1.5900000000000001,"15min":1.968},"last":1.7150000000000001}]},{"osd":5,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.099,"15min":1.117},"min":{"1min":0.875,"5min":0.52700000000000002,"15min":0.45200000000000001},"max":{"1min":1.3839999999999999,"5min":1.7090000000000001,"15min":2.1709999999999998},"last":1.788},{"interface":"front","average":{"1min":1.097,"5min":1.1020000000000001,"15min":1.1100000000000001},"min":{"1min":0.79700000000000004,"5min":0.58299999999999996,"15min":0.54900000000000004},"max":{"1min":1.494,"5min":1.736,"15min":1.798},"last":0.54700000000000004}]},{"osd":6,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.115,"15min":1.155},"min":{"1min":0.83399999999999996,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":1.46,"5min":1.5680000000000001,"15min":1.927},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.147,"15min":1.1539999999999999},"min":{"1min":0.70799999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.383,"5min":1.8600000000000001,"15min":1.929},"last":0.50900000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1970000000000001,"15min":1.214},"min":{"1min":0.96499999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.5189999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.2450000000000001,"15min":1.2609999999999999},"min":{"1min":0.85199999999999998,"5min":0.61599999999999999,"15min":0.60299999999999998},"max":{"1min":1.5780000000000001,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.7669999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509806,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36000,"kb_used_data":4824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335840,"statfs":{"total":96636764160,"available":96599900160,"internally_reserved":0,"allocated":4939776,"data_stored":4726754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.72199999999999998,"15min":0.73999999999999999},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.24299999999999999},"max":{"1min":0.98899999999999999,"5min":1.405,"15min":2.04},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.28999999999999998,"15min":0.27300000000000002},"max":{"1min":1.2410000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.78900000000000003}]},{"osd":1,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.85399999999999998,"15min":0.86699999999999999},"min":{"1min":0.48799999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.3029999999999999,"5min":1.5129999999999999,"15min":1.978},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.84899999999999998,"15min":0.88600000000000001},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":1.3320000000000001,"5min":1.552,"15min":1.919},"last":0.60699999999999998}]},{"osd":3,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.83999999999999997,"15min":0.83499999999999996},"min":{"1min":0.54000000000000004,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.377,"5min":1.7090000000000001,"15min":1.8740000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0229999999999999,"15min":1.018},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.309},"max":{"1min":1.3540000000000001,"5min":1.7809999999999999,"15min":2.0960000000000001},"last":0.89400000000000002}]},{"osd":4,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0960000000000001,"15min":1.115},"min":{"1min":0.77900000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.4630000000000001,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.1399999999999999,"15min":1.1659999999999999},"min":{"1min":0.69399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6080000000000001,"5min":2.161,"15min":2.161},"last":1.1060000000000001}]},{"osd":5,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1539999999999999,"15min":1.1899999999999999},"min":{"1min":0.76200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.492,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.141},"min":{"1min":0.79800000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4370000000000001,"5min":1.7390000000000001,"15min":1.8009999999999999},"last":0.997}]},{"osd":6,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.163,"15min":1.173},"min":{"1min":0.78700000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.482,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.155},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.264,"15min":1.2589999999999999},"min":{"1min":0.72699999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.794,"5min":1.994,"15min":2.1800000000000002},"last":1.3420000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.248,"15min":1.286},"min":{"1min":0.84199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.645,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2310000000000001,"15min":1.254},"min":{"1min":0.95199999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.536,"5min":1.96,"15min":1.992},"last":1.244}]}]},{"osd":1,"up_from":15,"seq":64424509805,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":966656,"data_stored":748254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.45500000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":1.341,"5min":1.359,"15min":1.4330000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.47199999999999998,"5min":0.318,"15min":0.318},"max":{"1min":1.329,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.91000000000000003}]},{"osd":2,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.99399999999999999,"5min":1.6859999999999999,"15min":1.706},"last":0.626},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90600000000000003,"15min":0.91500000000000004},"min":{"1min":0.52000000000000002,"5min":0.41599999999999998,"15min":0.35099999999999998},"max":{"1min":1.4550000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.875}]},{"osd":3,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.96299999999999997,"15min":0.98199999999999998},"min":{"1min":0.51400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.5660000000000001,"5min":1.7170000000000001,"15min":1.881},"last":1.03},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.94599999999999995,"15min":0.95899999999999996},"min":{"1min":0.68300000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4419999999999999,"5min":1.6519999999999999,"15min":1.73},"last":0.79700000000000004}]},{"osd":4,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.77000000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.867},"last":1.081},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.171,"15min":1.1839999999999999},"min":{"1min":0.76900000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5249999999999999,"5min":1.716,"15min":1.9039999999999999},"last":1.163}]},{"osd":5,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1539999999999999,"15min":1.165},"min":{"1min":0.88700000000000001,"5min":0.54000000000000004,"15min":0.53200000000000003},"max":{"1min":1.4410000000000001,"5min":1.8660000000000001,"15min":2.0230000000000001},"last":1.137},{"interface":"front","average":{"1min":1.163,"5min":1.1200000000000001,"15min":1.1379999999999999},"min":{"1min":0.85299999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.639,"5min":1.6819999999999999,"15min":1.8400000000000001},"last":1.2050000000000001}]},{"osd":6,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.274,"15min":1.2709999999999999},"min":{"1min":0.84899999999999998,"5min":0.64200000000000002,"15min":0.59999999999999998},"max":{"1min":1.5920000000000001,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.2070000000000001,"15min":1.24},"min":{"1min":0.75,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5840000000000001,"5min":1.8819999999999999,"15min":2.0600000000000001},"last":0.96999999999999997}]},{"osd":7,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2589999999999999,"15min":1.292},"min":{"1min":0.85199999999999998,"5min":0.79800000000000004,"15min":0.73499999999999999},"max":{"1min":1.5309999999999999,"5min":1.9530000000000001,"15min":2.1389999999999998},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.22,"15min":1.2490000000000001},"min":{"1min":0.83299999999999996,"5min":0.66000000000000003,"15min":0.65400000000000003},"max":{"1min":1.7769999999999999,"5min":1.806,"15min":1.988},"last":1.2969999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509805,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60764,"kb_used_data":7380,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311076,"statfs":{"total":96636764160,"available":96574541824,"internally_reserved":0,"allocated":7557120,"data_stored":7321877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71099999999999997,"15min":0.745},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0680000000000001,"5min":1.4750000000000001,"15min":1.7370000000000001},"last":0.628},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.29799999999999999},"max":{"1min":1.1220000000000001,"5min":1.536,"15min":1.8560000000000001},"last":1.0589999999999999}]},{"osd":2,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.85999999999999999,"15min":0.878},"min":{"1min":0.432,"5min":0.43099999999999999,"15min":0.29199999999999998},"max":{"1min":1.2569999999999999,"5min":1.3720000000000001,"15min":1.7190000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.89900000000000002,"15min":0.91000000000000003},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.317},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.8959999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90200000000000002,"15min":0.89200000000000002},"min":{"1min":0.33700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3979999999999999,"5min":1.756,"15min":1.869},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.034,"15min":1.0189999999999999},"min":{"1min":0.51700000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3600000000000001,"5min":1.6180000000000001,"15min":1.9259999999999999},"last":0.97599999999999998}]},{"osd":4,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.022,"15min":1.0189999999999999},"min":{"1min":0.57599999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.458,"5min":1.5529999999999999,"15min":1.9610000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.129,"15min":1.1220000000000001},"min":{"1min":0.74099999999999999,"5min":0.57999999999999996,"15min":0.47899999999999998},"max":{"1min":1.5860000000000001,"5min":2.101,"15min":2.101},"last":1.095}]},{"osd":5,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1319999999999999,"15min":1.1659999999999999},"min":{"1min":0.81000000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.667,"5min":1.667,"15min":2.1669999999999998},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.0840000000000001,"15min":1.0980000000000001},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4490000000000001,"5min":1.728,"15min":2.1280000000000001},"last":1.123}]},{"osd":6,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.177,"15min":1.2110000000000001},"min":{"1min":0.71199999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.637,"5min":1.9910000000000001,"15min":2.101},"last":1.153},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.212,"15min":1.2370000000000001},"min":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.718,"5min":1.831,"15min":2.2480000000000002},"last":1.2549999999999999}]},{"osd":7,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.272,"15min":1.292},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.764,"5min":1.792,"15min":2.2410000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.2130000000000001,"15min":1.1970000000000001},"min":{"1min":0.83499999999999996,"5min":0.64400000000000002,"15min":0.60099999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.2130000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542510,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35648,"kb_used_data":4472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336192,"statfs":{"total":96636764160,"available":96600260608,"internally_reserved":0,"allocated":4579328,"data_stored":4332954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.88400000000000001,"15min":0.90300000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2609999999999999,"5min":1.544,"15min":1.544},"last":1.196},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.877,"15min":0.90700000000000003},"min":{"1min":0.48499999999999999,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":1.319,"5min":1.4179999999999999,"15min":1.6319999999999999},"last":0.68899999999999995}]},{"osd":1,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.90900000000000003,"15min":0.92800000000000005},"min":{"1min":0.61899999999999999,"5min":0.498,"15min":0.45000000000000001},"max":{"1min":1.369,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3140000000000001,"5min":1.454,"15min":1.7689999999999999},"last":0.90000000000000002}]},{"osd":2,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":1.282,"5min":1.613,"15min":1.708},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.99299999999999999,"15min":1.02},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.456,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":1.29}]},{"osd":3,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.97799999999999998,"15min":1.002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.44500000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":2.2370000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.125,"15min":1.1100000000000001},"min":{"1min":0.81699999999999995,"5min":0.628,"15min":0.59499999999999997},"max":{"1min":1.4570000000000001,"5min":1.752,"15min":1.8220000000000001},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.98299999999999998,"15min":1.012},"min":{"1min":0.60899999999999999,"5min":0.41199999999999998,"15min":0.38500000000000001},"max":{"1min":1.593,"5min":1.6779999999999999,"15min":2.016},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.99399999999999999,"15min":1.024},"min":{"1min":0.55600000000000005,"5min":0.39800000000000002,"15min":0.34300000000000003},"max":{"1min":1.5529999999999999,"5min":1.659,"15min":1.821},"last":1.0309999999999999}]},{"osd":6,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0589999999999999,"15min":1.071},"min":{"1min":0.67100000000000004,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":1.3640000000000001,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.135,"5min":1.181,"15min":1.1990000000000001},"min":{"1min":0.59999999999999998,"5min":0.497,"15min":0.44500000000000001},"max":{"1min":1.694,"5min":1.788,"15min":2.1230000000000002},"last":1.377}]},{"osd":7,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.1359999999999999,"15min":1.145},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.379},"max":{"1min":1.653,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.246,"15min":1.2529999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.544,"5min":1.996,"15min":2.1160000000000001},"last":1.3460000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7225344,"data_stored":7185737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":21746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4608000,"data_stored":4590614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7290880,"data_stored":7246605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4247552,"data_stored":4196814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8802304,"data_stored":8778065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15294464,"data_stored":15279563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":44892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T21:28:50.803 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-18T21:28:50.804 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T21:28:50.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.970+0000 7fca7331a640 1 Processor -- start 2023-11-18T21:28:50.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.970+0000 7fca7331a640 1 -- start start 2023-11-18T21:28:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.974+0000 7fca7331a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fca6c153ad0 0x7fca6c159680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.974+0000 7fca7331a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6c0c2d60 con 0x7fca6c0cbd70 2023-11-18T21:28:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.974+0000 7fca7331a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6c15cb90 con 0x7fca6c0727a0 2023-11-18T21:28:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.974+0000 7fca7331a640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6c15ce70 con 0x7fca6c153ad0 2023-11-18T21:28:50.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.974+0000 7fca708b5640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fca6c153ad0 0x7fca6c159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.974+0000 7fca708b5640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fca6c153ad0 0x7fca6c159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:52194/0 (socket says 172.21.15.49:52194) 2023-11-18T21:28:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.974+0000 7fca708b5640 1 -- 172.21.15.49:0/667082028 learned_addr learned my addr 172.21.15.49:0/667082028 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.982+0000 7fca708b5640 1 -- 172.21.15.49:0/667082028 >> v1:172.21.15.106:6789/0 conn(0x7fca6c0727a0 legacy=0x7fca6c0c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.982+0000 7fca708b5640 1 -- 172.21.15.49:0/667082028 >> v1:172.21.15.49:6789/0 conn(0x7fca6c0cbd70 legacy=0x7fca6c1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:50.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.982+0000 7fca708b5640 1 -- 172.21.15.49:0/667082028 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c15d150 con 0x7fca6c153ad0 2023-11-18T21:28:50.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:50.990+0000 7fca708b5640 1 --2- 172.21.15.49:0/667082028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca6c153ad0 0x7fca6c159680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca60009e80 tx=0x7fca6001f160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de8d156606bf17e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:51.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.002+0000 7fca6bfff640 1 -- 172.21.15.49:0/667082028 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca600af400 con 0x7fca6c153ad0 2023-11-18T21:28:51.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.002+0000 7fca6bfff640 1 -- 172.21.15.49:0/667082028 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca600ab050 con 0x7fca6c153ad0 2023-11-18T21:28:51.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.002+0000 7fca6bfff640 1 -- 172.21.15.49:0/667082028 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca600af780 con 0x7fca6c153ad0 2023-11-18T21:28:51.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.002+0000 7fca7331a640 1 -- 172.21.15.49:0/667082028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca6c153ad0 msgr2=0x7fca6c159680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:51.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.002+0000 7fca7331a640 1 --2- 172.21.15.49:0/667082028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca6c153ad0 0x7fca6c159680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca60009e80 tx=0x7fca6001f160 comp rx=0 tx=0).stop 2023-11-18T21:28:51.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.002+0000 7fca7331a640 1 -- 172.21.15.49:0/667082028 shutdown_connections 2023-11-18T21:28:51.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.002+0000 7fca7331a640 1 --2- 172.21.15.49:0/667082028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca6c153ad0 0x7fca6c159680 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:51.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.002+0000 7fca7331a640 1 -- 172.21.15.49:0/667082028 >> 172.21.15.49:0/667082028 conn(0x7fca6c070230 msgr2=0x7fca6c06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:51.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.002+0000 7fca7331a640 1 -- 172.21.15.49:0/667082028 shutdown_connections 2023-11-18T21:28:51.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.002+0000 7fca7331a640 1 -- 172.21.15.49:0/667082028 wait complete. 2023-11-18T21:28:51.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.006+0000 7fca7331a640 1 Processor -- start 2023-11-18T21:28:51.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.006+0000 7fca7331a640 1 -- start start 2023-11-18T21:28:51.006 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.006+0000 7fca7331a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca6c0727a0 0x7fca6c14bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:51.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.006+0000 7fca7331a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca6c0cbd70 0x7fca6c15c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:51.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.006+0000 7fca7331a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca6c153ad0 0x7fca6c14fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:51.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.006+0000 7fca7331a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c14b6f0 con 0x7fca6c153ad0 2023-11-18T21:28:51.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.006+0000 7fca7331a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c150b50 con 0x7fca6c0cbd70 2023-11-18T21:28:51.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.006+0000 7fca7331a640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c1498d0 con 0x7fca6c0727a0 2023-11-18T21:28:51.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.006+0000 7fca710b6640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca6c0727a0 0x7fca6c14bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:51.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.006+0000 7fca708b5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca6c0cbd70 0x7fca6c15c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:51.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.006+0000 7fca710b6640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca6c0727a0 0x7fca6c14bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:50716/0 (socket says 172.21.15.49:50716) 2023-11-18T21:28:51.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.006+0000 7fca710b6640 1 -- 172.21.15.49:0/3669133423 learned_addr learned my addr 172.21.15.49:0/3669133423 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:51.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.018+0000 7fca708b5640 1 -- 172.21.15.49:0/3669133423 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca6c0727a0 msgr2=0x7fca6c14bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:51.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.018+0000 7fca708b5640 1 --2- 172.21.15.49:0/3669133423 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca6c0727a0 0x7fca6c14bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:51.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.018+0000 7fca708b5640 1 -- 172.21.15.49:0/3669133423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca6c153ad0 msgr2=0x7fca6c14fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:51.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.018+0000 7fca708b5640 1 --2- 172.21.15.49:0/3669133423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca6c153ad0 0x7fca6c14fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:51.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.018+0000 7fca708b5640 1 -- 172.21.15.49:0/3669133423 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca60009b30 con 0x7fca6c0cbd70 2023-11-18T21:28:51.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.022+0000 7fca708b5640 1 --2- 172.21.15.49:0/3669133423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca6c0cbd70 0x7fca6c15c0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fca600ae000 tx=0x7fca6001bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:51.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.038+0000 7fca69ffb640 1 -- 172.21.15.49:0/3669133423 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca600c1070 con 0x7fca6c0cbd70 2023-11-18T21:28:51.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.038+0000 7fca69ffb640 1 -- 172.21.15.49:0/3669133423 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca600af690 con 0x7fca6c0cbd70 2023-11-18T21:28:51.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.038+0000 7fca69ffb640 1 -- 172.21.15.49:0/3669133423 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca600afa20 con 0x7fca6c0cbd70 2023-11-18T21:28:51.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.038+0000 7fca7331a640 1 -- 172.21.15.49:0/3669133423 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6c14a5c0 con 0x7fca6c0cbd70 2023-11-18T21:28:51.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.038+0000 7fca7331a640 1 -- 172.21.15.49:0/3669133423 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6c14f5b0 con 0x7fca6c0cbd70 2023-11-18T21:28:51.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.038+0000 7fca7331a640 1 -- 172.21.15.49:0/3669133423 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6c14b860 con 0x7fca6c0cbd70 2023-11-18T21:28:51.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.450+0000 7fca69ffb640 1 -- 172.21.15.49:0/3669133423 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fca600b6050 con 0x7fca6c0cbd70 2023-11-18T21:28:51.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.454+0000 7fca69ffb640 1 --2- 172.21.15.49:0/3669133423 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fca58066470 0x7fca58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:51.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.454+0000 7fca710b6640 1 --2- 172.21.15.49:0/3669133423 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fca58066470 0x7fca58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:51.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.454+0000 7fca710b6640 1 --2- 172.21.15.49:0/3669133423 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fca58066470 0x7fca58068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca5c001960 tx=0x7fca5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:51.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.462+0000 7fca69ffb640 1 -- 172.21.15.49:0/3669133423 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fca600f3ad0 con 0x7fca6c0cbd70 2023-11-18T21:28:51.492 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.490+0000 7fca69ffb640 1 -- 172.21.15.49:0/3669133423 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca600f31a0 con 0x7fca6c0cbd70 2023-11-18T21:28:51.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.730+0000 7fca7331a640 1 -- 172.21.15.49:0/3669133423 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca6c152a00 con 0x7fca58066470 2023-11-18T21:28:51.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.758+0000 7fca69ffb640 1 -- 172.21.15.49:0/3669133423 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368703 (secure 0 0 0) 0x7fca6c152a00 con 0x7fca58066470 2023-11-18T21:28:51.761 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:28:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-18T21:28:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.766+0000 7fca7331a640 1 -- 172.21.15.49:0/3669133423 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fca58066470 msgr2=0x7fca58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.766+0000 7fca7331a640 1 --2- 172.21.15.49:0/3669133423 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fca58066470 0x7fca58068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca5c001960 tx=0x7fca5c009040 comp rx=0 tx=0).stop 2023-11-18T21:28:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.766+0000 7fca7331a640 1 -- 172.21.15.49:0/3669133423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca6c0cbd70 msgr2=0x7fca6c15c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.766+0000 7fca7331a640 1 --2- 172.21.15.49:0/3669133423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca6c0cbd70 0x7fca6c15c0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fca600ae000 tx=0x7fca6001bf00 comp rx=0 tx=0).stop 2023-11-18T21:28:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.766+0000 7fca7331a640 1 -- 172.21.15.49:0/3669133423 shutdown_connections 2023-11-18T21:28:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.766+0000 7fca7331a640 1 --2- 172.21.15.49:0/3669133423 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fca58066470 0x7fca58068930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.766+0000 7fca7331a640 1 --2- 172.21.15.49:0/3669133423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca6c153ad0 0x7fca6c14fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.766+0000 7fca7331a640 1 --2- 172.21.15.49:0/3669133423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca6c0cbd70 0x7fca6c15c0d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.766+0000 7fca7331a640 1 --2- 172.21.15.49:0/3669133423 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca6c0727a0 0x7fca6c14bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.766+0000 7fca7331a640 1 -- 172.21.15.49:0/3669133423 >> 172.21.15.49:0/3669133423 conn(0x7fca6c070230 msgr2=0x7fca6c06b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.766+0000 7fca7331a640 1 -- 172.21.15.49:0/3669133423 shutdown_connections 2023-11-18T21:28:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.766+0000 7fca7331a640 1 -- 172.21.15.49:0/3669133423 wait complete. 2023-11-18T21:28:51.790 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":933,"stamp":"2023-11-18T21:28:50.539559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24262386,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":804,"num_read_kb":1243,"num_write":12291,"num_write_kb":281645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14773,"ondisk_log_size":14773,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":388472,"kb_used_data":50232,"kb_used_omap":12,"kb_used_meta":338163,"kb_avail":754586248,"statfs":{"total":773094113280,"available":772696317952,"internally_reserved":0,"allocated":51437568,"data_stored":49613892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":346279473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,20,19],"upper_bound":512},"perf_stat":{"commit_latency_ms":185,"apply_latency_ms":185,"commit_latency_ns":185000000,"apply_latency_ns":185000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1945,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005293"},"pg_stats":[{"pgid":"2.1f","version":"31'73","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:35.344676+0000","last_change":"2023-11-18T20:59:25.350113+0000","last_active":"2023-11-18T21:28:35.344676+0000","last_peered":"2023-11-18T21:28:35.344676+0000","last_clean":"2023-11-18T21:28:35.344676+0000","last_became_active":"2023-11-18T20:59:25.349869+0000","last_became_peered":"2023-11-18T20:59:25.349869+0000","last_unstale":"2023-11-18T21:28:35.344676+0000","last_undegraded":"2023-11-18T21:28:35.344676+0000","last_fullsized":"2023-11-18T21:28:35.344676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:56:07.719325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'45","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.673746+0000","last_change":"2023-11-18T20:59:27.895973+0000","last_active":"2023-11-18T21:28:43.673746+0000","last_peered":"2023-11-18T21:28:43.673746+0000","last_clean":"2023-11-18T21:28:43.673746+0000","last_became_active":"2023-11-18T20:59:27.895678+0000","last_became_peered":"2023-11-18T20:59:27.895678+0000","last_unstale":"2023-11-18T21:28:43.673746+0000","last_undegraded":"2023-11-18T21:28:43.673746+0000","last_fullsized":"2023-11-18T21:28:43.673746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"31'87","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.055420+0000","last_change":"2023-11-18T20:59:35.848621+0000","last_active":"2023-11-18T21:27:28.055420+0000","last_peered":"2023-11-18T21:27:28.055420+0000","last_clean":"2023-11-18T21:27:28.055420+0000","last_became_active":"2023-11-18T20:59:35.848140+0000","last_became_peered":"2023-11-18T20:59:35.848140+0000","last_unstale":"2023-11-18T21:27:28.055420+0000","last_undegraded":"2023-11-18T21:27:28.055420+0000","last_fullsized":"2023-11-18T21:27:28.055420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:12.962470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:59.358340+0000","last_change":"2023-11-18T20:59:25.463657+0000","last_active":"2023-11-18T21:27:59.358340+0000","last_peered":"2023-11-18T21:27:59.358340+0000","last_clean":"2023-11-18T21:27:59.358340+0000","last_became_active":"2023-11-18T20:59:25.463001+0000","last_became_peered":"2023-11-18T20:59:25.463001+0000","last_unstale":"2023-11-18T21:27:59.358340+0000","last_undegraded":"2023-11-18T21:27:59.358340+0000","last_fullsized":"2023-11-18T21:27:59.358340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"31'59","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630833+0000","last_change":"2023-11-18T20:59:27.837801+0000","last_active":"2023-11-18T21:28:43.630833+0000","last_peered":"2023-11-18T21:28:43.630833+0000","last_clean":"2023-11-18T21:28:43.630833+0000","last_became_active":"2023-11-18T20:59:27.836937+0000","last_became_peered":"2023-11-18T20:59:27.836937+0000","last_unstale":"2023-11-18T21:28:43.630833+0000","last_undegraded":"2023-11-18T21:28:43.630833+0000","last_fullsized":"2023-11-18T21:28:43.630833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"31'91","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.094446+0000","last_change":"2023-11-18T20:59:35.843015+0000","last_active":"2023-11-18T21:27:28.094446+0000","last_peered":"2023-11-18T21:27:28.094446+0000","last_clean":"2023-11-18T21:27:28.094446+0000","last_became_active":"2023-11-18T20:59:35.842552+0000","last_became_peered":"2023-11-18T20:59:35.842552+0000","last_unstale":"2023-11-18T21:27:28.094446+0000","last_undegraded":"2023-11-18T21:27:28.094446+0000","last_fullsized":"2023-11-18T21:27:28.094446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:17.222664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"31'175","reported_seq":208,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:29.248169+0000","last_change":"2023-11-18T20:59:25.497907+0000","last_active":"2023-11-18T21:28:29.248169+0000","last_peered":"2023-11-18T21:28:29.248169+0000","last_clean":"2023-11-18T21:28:29.248169+0000","last_became_active":"2023-11-18T20:59:25.497070+0000","last_became_peered":"2023-11-18T20:59:25.497070+0000","last_unstale":"2023-11-18T21:28:29.248169+0000","last_undegraded":"2023-11-18T21:28:29.248169+0000","last_fullsized":"2023-11-18T21:28:29.248169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"31'56","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.671790+0000","last_change":"2023-11-18T20:59:27.868161+0000","last_active":"2023-11-18T21:28:43.671790+0000","last_peered":"2023-11-18T21:28:43.671790+0000","last_clean":"2023-11-18T21:28:43.671790+0000","last_became_active":"2023-11-18T20:59:27.867021+0000","last_became_peered":"2023-11-18T20:59:27.867021+0000","last_unstale":"2023-11-18T21:28:43.671790+0000","last_undegraded":"2023-11-18T21:28:43.671790+0000","last_fullsized":"2023-11-18T21:28:43.671790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'88","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:22.937522+0000","last_change":"2023-11-18T20:59:35.830210+0000","last_active":"2023-11-18T21:27:22.937522+0000","last_peered":"2023-11-18T21:27:22.937522+0000","last_clean":"2023-11-18T21:27:22.937522+0000","last_became_active":"2023-11-18T20:59:35.829636+0000","last_became_peered":"2023-11-18T20:59:35.829636+0000","last_unstale":"2023-11-18T21:27:22.937522+0000","last_undegraded":"2023-11-18T21:27:22.937522+0000","last_fullsized":"2023-11-18T21:27:22.937522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":32,"num_write":84,"num_write_kb":9481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"31'10","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.072620+0000","last_change":"2023-11-18T20:59:25.493859+0000","last_active":"2023-11-18T21:28:26.072620+0000","last_peered":"2023-11-18T21:28:26.072620+0000","last_clean":"2023-11-18T21:28:26.072620+0000","last_became_active":"2023-11-18T20:59:25.493087+0000","last_became_peered":"2023-11-18T20:59:25.493087+0000","last_unstale":"2023-11-18T21:28:26.072620+0000","last_undegraded":"2023-11-18T21:28:26.072620+0000","last_fullsized":"2023-11-18T21:28:26.072620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"31'65","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.677740+0000","last_change":"2023-11-18T20:59:27.871929+0000","last_active":"2023-11-18T21:28:43.677740+0000","last_peered":"2023-11-18T21:28:43.677740+0000","last_clean":"2023-11-18T21:28:43.677740+0000","last_became_active":"2023-11-18T20:59:27.871076+0000","last_became_peered":"2023-11-18T20:59:27.871076+0000","last_unstale":"2023-11-18T21:28:43.677740+0000","last_undegraded":"2023-11-18T21:28:43.677740+0000","last_fullsized":"2023-11-18T21:28:43.677740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:24:09.546791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"31'63","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.541263+0000","last_change":"2023-11-18T20:59:35.833547+0000","last_active":"2023-11-18T21:27:18.541263+0000","last_peered":"2023-11-18T21:27:18.541263+0000","last_clean":"2023-11-18T21:27:18.541263+0000","last_became_active":"2023-11-18T20:59:35.833016+0000","last_became_peered":"2023-11-18T20:59:35.833016+0000","last_unstale":"2023-11-18T21:27:18.541263+0000","last_undegraded":"2023-11-18T21:27:18.541263+0000","last_fullsized":"2023-11-18T21:27:18.541263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:58.416590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":5002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"31'56","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.634810+0000","last_change":"2023-11-18T20:59:27.682005+0000","last_active":"2023-11-18T21:28:43.634810+0000","last_peered":"2023-11-18T21:28:43.634810+0000","last_clean":"2023-11-18T21:28:43.634810+0000","last_became_active":"2023-11-18T20:59:27.681154+0000","last_became_peered":"2023-11-18T20:59:27.681154+0000","last_unstale":"2023-11-18T21:28:43.634810+0000","last_undegraded":"2023-11-18T21:28:43.634810+0000","last_fullsized":"2023-11-18T21:28:43.634810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:10.426499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"31'142","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.042960+0000","last_change":"2023-11-18T20:59:25.339269+0000","last_active":"2023-11-18T21:28:43.042960+0000","last_peered":"2023-11-18T21:28:43.042960+0000","last_clean":"2023-11-18T21:28:43.042960+0000","last_became_active":"2023-11-18T20:59:25.338067+0000","last_became_peered":"2023-11-18T20:59:25.338067+0000","last_unstale":"2023-11-18T21:28:43.042960+0000","last_undegraded":"2023-11-18T21:28:43.042960+0000","last_fullsized":"2023-11-18T21:28:43.042960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395570,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'89","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:23.791465+0000","last_change":"2023-11-18T21:00:28.755990+0000","last_active":"2023-11-18T21:27:23.791465+0000","last_peered":"2023-11-18T21:27:23.791465+0000","last_clean":"2023-11-18T21:27:23.791465+0000","last_became_active":"2023-11-18T21:00:28.755606+0000","last_became_peered":"2023-11-18T21:00:28.755606+0000","last_unstale":"2023-11-18T21:27:23.791465+0000","last_undegraded":"2023-11-18T21:27:23.791465+0000","last_fullsized":"2023-11-18T21:27:23.791465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:06.870579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":4704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'54","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.476664+0000","last_change":"2023-11-18T20:59:27.861550+0000","last_active":"2023-11-18T21:28:43.476664+0000","last_peered":"2023-11-18T21:28:43.476664+0000","last_clean":"2023-11-18T21:28:43.476664+0000","last_became_active":"2023-11-18T20:59:27.861045+0000","last_became_peered":"2023-11-18T20:59:27.861045+0000","last_unstale":"2023-11-18T21:28:43.476664+0000","last_undegraded":"2023-11-18T21:28:43.476664+0000","last_fullsized":"2023-11-18T21:28:43.476664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"31'407","reported_seq":442,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:37.390812+0000","last_change":"2023-11-18T20:59:25.458601+0000","last_active":"2023-11-18T21:28:37.390812+0000","last_peered":"2023-11-18T21:28:37.390812+0000","last_clean":"2023-11-18T21:28:37.390812+0000","last_became_active":"2023-11-18T20:59:25.457871+0000","last_became_peered":"2023-11-18T20:59:25.457871+0000","last_unstale":"2023-11-18T21:28:37.390812+0000","last_undegraded":"2023-11-18T21:28:37.390812+0000","last_fullsized":"2023-11-18T21:28:37.390812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:09.387812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":996,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"31'93","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:24.972970+0000","last_change":"2023-11-18T20:59:35.842967+0000","last_active":"2023-11-18T21:27:24.972970+0000","last_peered":"2023-11-18T21:27:24.972970+0000","last_clean":"2023-11-18T21:27:24.972970+0000","last_became_active":"2023-11-18T20:59:35.842583+0000","last_became_peered":"2023-11-18T20:59:35.842583+0000","last_unstale":"2023-11-18T21:27:24.972970+0000","last_undegraded":"2023-11-18T21:27:24.972970+0000","last_fullsized":"2023-11-18T21:27:24.972970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:40.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'46","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.574354+0000","last_change":"2023-11-18T20:59:27.688043+0000","last_active":"2023-11-18T21:28:43.574354+0000","last_peered":"2023-11-18T21:28:43.574354+0000","last_clean":"2023-11-18T21:28:43.574354+0000","last_became_active":"2023-11-18T20:59:27.687250+0000","last_became_peered":"2023-11-18T20:59:27.687250+0000","last_unstale":"2023-11-18T21:28:43.574354+0000","last_undegraded":"2023-11-18T21:28:43.574354+0000","last_fullsized":"2023-11-18T21:28:43.574354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:16:48.432607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"31'202","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:29.201820+0000","last_change":"2023-11-18T20:59:25.351927+0000","last_active":"2023-11-18T21:28:29.201820+0000","last_peered":"2023-11-18T21:28:29.201820+0000","last_clean":"2023-11-18T21:28:29.201820+0000","last_became_active":"2023-11-18T20:59:25.351318+0000","last_became_peered":"2023-11-18T20:59:25.351318+0000","last_unstale":"2023-11-18T21:28:29.201820+0000","last_undegraded":"2023-11-18T21:28:29.201820+0000","last_fullsized":"2023-11-18T21:28:29.201820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:20:38.006315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'80","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.908455+0000","last_change":"2023-11-18T20:59:35.835375+0000","last_active":"2023-11-18T21:27:18.908455+0000","last_peered":"2023-11-18T21:27:18.908455+0000","last_clean":"2023-11-18T21:27:18.908455+0000","last_became_active":"2023-11-18T20:59:35.834894+0000","last_became_peered":"2023-11-18T20:59:35.834894+0000","last_unstale":"2023-11-18T21:27:18.908455+0000","last_undegraded":"2023-11-18T21:27:18.908455+0000","last_fullsized":"2023-11-18T21:27:18.908455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:33.448377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":144,"num_write":72,"num_write_kb":6857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"31'48","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.628688+0000","last_change":"2023-11-18T20:59:27.687356+0000","last_active":"2023-11-18T21:28:43.628688+0000","last_peered":"2023-11-18T21:28:43.628688+0000","last_clean":"2023-11-18T21:28:43.628688+0000","last_became_active":"2023-11-18T20:59:27.686692+0000","last_became_peered":"2023-11-18T20:59:27.686692+0000","last_unstale":"2023-11-18T21:28:43.628688+0000","last_undegraded":"2023-11-18T21:28:43.628688+0000","last_fullsized":"2023-11-18T21:28:43.628688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:20:58.633153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:18.661759+0000","last_change":"2023-11-18T20:59:25.347589+0000","last_active":"2023-11-18T21:28:18.661759+0000","last_peered":"2023-11-18T21:28:18.661759+0000","last_clean":"2023-11-18T21:28:18.661759+0000","last_became_active":"2023-11-18T20:59:25.347022+0000","last_became_peered":"2023-11-18T20:59:25.347022+0000","last_unstale":"2023-11-18T21:28:18.661759+0000","last_undegraded":"2023-11-18T21:28:18.661759+0000","last_fullsized":"2023-11-18T21:28:18.661759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'120","reported_seq":147,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.477259+0000","last_change":"2023-11-18T20:59:35.771398+0000","last_active":"2023-11-18T21:27:18.477259+0000","last_peered":"2023-11-18T21:27:18.477259+0000","last_clean":"2023-11-18T21:27:18.477259+0000","last_became_active":"2023-11-18T20:59:35.770923+0000","last_became_peered":"2023-11-18T20:59:35.770923+0000","last_unstale":"2023-11-18T21:27:18.477259+0000","last_undegraded":"2023-11-18T21:27:18.477259+0000","last_fullsized":"2023-11-18T21:27:18.477259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'44","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.574046+0000","last_change":"2023-11-18T20:59:27.689972+0000","last_active":"2023-11-18T21:28:43.574046+0000","last_peered":"2023-11-18T21:28:43.574046+0000","last_clean":"2023-11-18T21:28:43.574046+0000","last_became_active":"2023-11-18T20:59:27.689156+0000","last_became_peered":"2023-11-18T20:59:27.689156+0000","last_unstale":"2023-11-18T21:28:43.574046+0000","last_undegraded":"2023-11-18T21:28:43.574046+0000","last_fullsized":"2023-11-18T21:28:43.574046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:58.264895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"31'12","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:18.009596+0000","last_change":"2023-11-18T20:59:25.348005+0000","last_active":"2023-11-18T21:28:18.009596+0000","last_peered":"2023-11-18T21:28:18.009596+0000","last_clean":"2023-11-18T21:28:18.009596+0000","last_became_active":"2023-11-18T20:59:25.346318+0000","last_became_peered":"2023-11-18T20:59:25.346318+0000","last_unstale":"2023-11-18T21:28:18.009596+0000","last_undegraded":"2023-11-18T21:28:18.009596+0000","last_fullsized":"2023-11-18T21:28:18.009596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:37.045716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"31'81","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.069352+0000","last_change":"2023-11-18T20:59:35.833754+0000","last_active":"2023-11-18T21:27:27.069352+0000","last_peered":"2023-11-18T21:27:27.069352+0000","last_clean":"2023-11-18T21:27:27.069352+0000","last_became_active":"2023-11-18T20:59:35.833407+0000","last_became_peered":"2023-11-18T20:59:35.833407+0000","last_unstale":"2023-11-18T21:27:27.069352+0000","last_undegraded":"2023-11-18T21:27:27.069352+0000","last_fullsized":"2023-11-18T21:27:27.069352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:38:06.355389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":9489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'53","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.574066+0000","last_change":"2023-11-18T20:59:27.863887+0000","last_active":"2023-11-18T21:28:43.574066+0000","last_peered":"2023-11-18T21:28:43.574066+0000","last_clean":"2023-11-18T21:28:43.574066+0000","last_became_active":"2023-11-18T20:59:27.863358+0000","last_became_peered":"2023-11-18T20:59:27.863358+0000","last_unstale":"2023-11-18T21:28:43.574066+0000","last_undegraded":"2023-11-18T21:28:43.574066+0000","last_fullsized":"2023-11-18T21:28:43.574066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:50.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"31'150","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:36.791102+0000","last_change":"2023-11-18T20:59:25.351394+0000","last_active":"2023-11-18T21:28:36.791102+0000","last_peered":"2023-11-18T21:28:36.791102+0000","last_clean":"2023-11-18T21:28:36.791102+0000","last_became_active":"2023-11-18T20:59:25.350705+0000","last_became_peered":"2023-11-18T20:59:25.350705+0000","last_unstale":"2023-11-18T21:28:36.791102+0000","last_undegraded":"2023-11-18T21:28:36.791102+0000","last_fullsized":"2023-11-18T21:28:36.791102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:01:57.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"31'89","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.136525+0000","last_change":"2023-11-18T20:59:35.840991+0000","last_active":"2023-11-18T21:27:28.136525+0000","last_peered":"2023-11-18T21:27:28.136525+0000","last_clean":"2023-11-18T21:27:28.136525+0000","last_became_active":"2023-11-18T20:59:35.840533+0000","last_became_peered":"2023-11-18T20:59:35.840533+0000","last_unstale":"2023-11-18T21:27:28.136525+0000","last_undegraded":"2023-11-18T21:27:28.136525+0000","last_fullsized":"2023-11-18T21:27:28.136525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:06:47.876845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":9026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"31'60","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.582868+0000","last_change":"2023-11-18T20:59:27.869100+0000","last_active":"2023-11-18T21:28:43.582868+0000","last_peered":"2023-11-18T21:28:43.582868+0000","last_clean":"2023-11-18T21:28:43.582868+0000","last_became_active":"2023-11-18T20:59:27.868355+0000","last_became_peered":"2023-11-18T20:59:27.868355+0000","last_unstale":"2023-11-18T21:28:43.582868+0000","last_undegraded":"2023-11-18T21:28:43.582868+0000","last_fullsized":"2023-11-18T21:28:43.582868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:25.235096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"31'94","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:19.874168+0000","last_change":"2023-11-18T20:59:25.350304+0000","last_active":"2023-11-18T21:28:19.874168+0000","last_peered":"2023-11-18T21:28:19.874168+0000","last_clean":"2023-11-18T21:28:19.874168+0000","last_became_active":"2023-11-18T20:59:25.349346+0000","last_became_peered":"2023-11-18T20:59:25.349346+0000","last_unstale":"2023-11-18T21:28:19.874168+0000","last_undegraded":"2023-11-18T21:28:19.874168+0000","last_fullsized":"2023-11-18T21:28:19.874168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:41.179268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"31'98","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.020859+0000","last_change":"2023-11-18T20:59:35.847005+0000","last_active":"2023-11-18T21:27:27.020859+0000","last_peered":"2023-11-18T21:27:27.020859+0000","last_clean":"2023-11-18T21:27:27.020859+0000","last_became_active":"2023-11-18T20:59:35.846458+0000","last_became_peered":"2023-11-18T20:59:35.846458+0000","last_unstale":"2023-11-18T21:27:27.020859+0000","last_undegraded":"2023-11-18T21:27:27.020859+0000","last_fullsized":"2023-11-18T21:27:27.020859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":10588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"31'50","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.667381+0000","last_change":"2023-11-18T20:59:27.889369+0000","last_active":"2023-11-18T21:28:43.667381+0000","last_peered":"2023-11-18T21:28:43.667381+0000","last_clean":"2023-11-18T21:28:43.667381+0000","last_became_active":"2023-11-18T20:59:27.887876+0000","last_became_peered":"2023-11-18T20:59:27.887876+0000","last_unstale":"2023-11-18T21:28:43.667381+0000","last_undegraded":"2023-11-18T21:28:43.667381+0000","last_fullsized":"2023-11-18T21:28:43.667381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:38.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"31'6","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:18.000761+0000","last_change":"2023-11-18T20:59:25.459620+0000","last_active":"2023-11-18T21:28:18.000761+0000","last_peered":"2023-11-18T21:28:18.000761+0000","last_clean":"2023-11-18T21:28:18.000761+0000","last_became_active":"2023-11-18T20:59:25.459235+0000","last_became_peered":"2023-11-18T20:59:25.459235+0000","last_unstale":"2023-11-18T21:28:18.000761+0000","last_undegraded":"2023-11-18T21:28:18.000761+0000","last_fullsized":"2023-11-18T21:28:18.000761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:02.325885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:20.899113+0000","last_change":"2023-11-18T20:59:35.835800+0000","last_active":"2023-11-18T21:27:20.899113+0000","last_peered":"2023-11-18T21:27:20.899113+0000","last_clean":"2023-11-18T21:27:20.899113+0000","last_became_active":"2023-11-18T20:59:35.834275+0000","last_became_peered":"2023-11-18T20:59:35.834275+0000","last_unstale":"2023-11-18T21:27:20.899113+0000","last_undegraded":"2023-11-18T21:27:20.899113+0000","last_fullsized":"2023-11-18T21:27:20.899113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'61","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.476976+0000","last_change":"2023-11-18T21:00:28.721070+0000","last_active":"2023-11-18T21:28:43.476976+0000","last_peered":"2023-11-18T21:28:43.476976+0000","last_clean":"2023-11-18T21:28:43.476976+0000","last_became_active":"2023-11-18T21:00:28.720412+0000","last_became_peered":"2023-11-18T21:00:28.720412+0000","last_unstale":"2023-11-18T21:28:43.476976+0000","last_undegraded":"2023-11-18T21:28:43.476976+0000","last_fullsized":"2023-11-18T21:28:43.476976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"31'655","reported_seq":691,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.048563+0000","last_change":"2023-11-18T20:59:25.355096+0000","last_active":"2023-11-18T21:28:43.048563+0000","last_peered":"2023-11-18T21:28:43.048563+0000","last_clean":"2023-11-18T21:28:43.048563+0000","last_became_active":"2023-11-18T20:59:25.354716+0000","last_became_peered":"2023-11-18T20:59:25.354716+0000","last_unstale":"2023-11-18T21:28:43.048563+0000","last_undegraded":"2023-11-18T21:28:43.048563+0000","last_fullsized":"2023-11-18T21:28:43.048563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:51.039181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":3369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'79","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.120724+0000","last_change":"2023-11-18T20:59:35.839218+0000","last_active":"2023-11-18T21:27:28.120724+0000","last_peered":"2023-11-18T21:27:28.120724+0000","last_clean":"2023-11-18T21:27:28.120724+0000","last_became_active":"2023-11-18T20:59:35.838732+0000","last_became_peered":"2023-11-18T20:59:35.838732+0000","last_unstale":"2023-11-18T21:27:28.120724+0000","last_undegraded":"2023-11-18T21:27:28.120724+0000","last_fullsized":"2023-11-18T21:27:28.120724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:50.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"31'54","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.634030+0000","last_change":"2023-11-18T20:59:27.839403+0000","last_active":"2023-11-18T21:28:43.634030+0000","last_peered":"2023-11-18T21:28:43.634030+0000","last_clean":"2023-11-18T21:28:43.634030+0000","last_became_active":"2023-11-18T20:59:27.838664+0000","last_became_peered":"2023-11-18T20:59:27.838664+0000","last_unstale":"2023-11-18T21:28:43.634030+0000","last_undegraded":"2023-11-18T21:28:43.634030+0000","last_fullsized":"2023-11-18T21:28:43.634030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"31'164","reported_seq":273,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:38.912485+0000","last_change":"2023-11-18T20:59:25.458840+0000","last_active":"2023-11-18T21:28:38.912485+0000","last_peered":"2023-11-18T21:28:38.912485+0000","last_clean":"2023-11-18T21:28:38.912485+0000","last_became_active":"2023-11-18T20:59:25.458075+0000","last_became_peered":"2023-11-18T20:59:25.458075+0000","last_unstale":"2023-11-18T21:28:38.912485+0000","last_undegraded":"2023-11-18T21:28:38.912485+0000","last_fullsized":"2023-11-18T21:28:38.912485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:48.644992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18647,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":79,"num_write":158,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"31'81","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:24.941939+0000","last_change":"2023-11-18T20:59:35.833736+0000","last_active":"2023-11-18T21:27:24.941939+0000","last_peered":"2023-11-18T21:27:24.941939+0000","last_clean":"2023-11-18T21:27:24.941939+0000","last_became_active":"2023-11-18T20:59:35.832891+0000","last_became_peered":"2023-11-18T20:59:35.832891+0000","last_unstale":"2023-11-18T21:27:24.941939+0000","last_undegraded":"2023-11-18T21:27:24.941939+0000","last_fullsized":"2023-11-18T21:27:24.941939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:12.929672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"31'58","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.597860+0000","last_change":"2023-11-18T20:59:27.889690+0000","last_active":"2023-11-18T21:28:43.597860+0000","last_peered":"2023-11-18T21:28:43.597860+0000","last_clean":"2023-11-18T21:28:43.597860+0000","last_became_active":"2023-11-18T20:59:27.889115+0000","last_became_peered":"2023-11-18T20:59:27.889115+0000","last_unstale":"2023-11-18T21:28:43.597860+0000","last_undegraded":"2023-11-18T21:28:43.597860+0000","last_fullsized":"2023-11-18T21:28:43.597860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:57:08.995074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:10.915862+0000","last_change":"2023-11-18T20:59:25.460190+0000","last_active":"2023-11-18T21:28:10.915862+0000","last_peered":"2023-11-18T21:28:10.915862+0000","last_clean":"2023-11-18T21:28:10.915862+0000","last_became_active":"2023-11-18T20:59:25.459405+0000","last_became_peered":"2023-11-18T20:59:25.459405+0000","last_unstale":"2023-11-18T21:28:10.915862+0000","last_undegraded":"2023-11-18T21:28:10.915862+0000","last_fullsized":"2023-11-18T21:28:10.915862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"31'64","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:25.970399+0000","last_change":"2023-11-18T20:59:35.842229+0000","last_active":"2023-11-18T21:27:25.970399+0000","last_peered":"2023-11-18T21:27:25.970399+0000","last_clean":"2023-11-18T21:27:25.970399+0000","last_became_active":"2023-11-18T20:59:35.835644+0000","last_became_peered":"2023-11-18T20:59:35.835644+0000","last_unstale":"2023-11-18T21:27:25.970399+0000","last_undegraded":"2023-11-18T21:27:25.970399+0000","last_fullsized":"2023-11-18T21:27:25.970399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:28.212029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"31'47","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.613220+0000","last_change":"2023-11-18T20:59:27.890885+0000","last_active":"2023-11-18T21:28:43.613220+0000","last_peered":"2023-11-18T21:28:43.613220+0000","last_clean":"2023-11-18T21:28:43.613220+0000","last_became_active":"2023-11-18T20:59:27.890499+0000","last_became_peered":"2023-11-18T20:59:27.890499+0000","last_unstale":"2023-11-18T21:28:43.613220+0000","last_undegraded":"2023-11-18T21:28:43.613220+0000","last_fullsized":"2023-11-18T21:28:43.613220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:33:26.362872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:04.464620+0000","last_change":"2023-11-18T20:59:25.339255+0000","last_active":"2023-11-18T21:28:04.464620+0000","last_peered":"2023-11-18T21:28:04.464620+0000","last_clean":"2023-11-18T21:28:04.464620+0000","last_became_active":"2023-11-18T20:59:25.338020+0000","last_became_peered":"2023-11-18T20:59:25.338020+0000","last_unstale":"2023-11-18T21:28:04.464620+0000","last_undegraded":"2023-11-18T21:28:04.464620+0000","last_fullsized":"2023-11-18T21:28:04.464620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:07.183625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:24:52.449457+0000","last_change":"2023-11-18T20:58:44.731742+0000","last_active":"2023-11-18T21:24:52.449457+0000","last_peered":"2023-11-18T21:24:52.449457+0000","last_clean":"2023-11-18T21:24:52.449457+0000","last_became_active":"2023-11-18T20:58:44.731076+0000","last_became_peered":"2023-11-18T20:58:44.731076+0000","last_unstale":"2023-11-18T21:24:52.449457+0000","last_undegraded":"2023-11-18T21:24:52.449457+0000","last_fullsized":"2023-11-18T21:24:52.449457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:58:42.561435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:58:42.561435+0000","last_clean_scrub_stamp":"2023-11-18T20:58:42.561435+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:48:40.458317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'66","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.824052+0000","last_change":"2023-11-18T20:59:35.771637+0000","last_active":"2023-11-18T21:27:18.824052+0000","last_peered":"2023-11-18T21:27:18.824052+0000","last_clean":"2023-11-18T21:27:18.824052+0000","last_became_active":"2023-11-18T20:59:35.771146+0000","last_became_peered":"2023-11-18T20:59:35.771146+0000","last_unstale":"2023-11-18T21:27:18.824052+0000","last_undegraded":"2023-11-18T21:27:18.824052+0000","last_fullsized":"2023-11-18T21:27:18.824052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:15.290602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":6116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"31'58","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.654090+0000","last_change":"2023-11-18T20:59:27.684091+0000","last_active":"2023-11-18T21:28:43.654090+0000","last_peered":"2023-11-18T21:28:43.654090+0000","last_clean":"2023-11-18T21:28:43.654090+0000","last_became_active":"2023-11-18T20:59:27.683316+0000","last_became_peered":"2023-11-18T20:59:27.683316+0000","last_unstale":"2023-11-18T21:28:43.654090+0000","last_undegraded":"2023-11-18T21:28:43.654090+0000","last_fullsized":"2023-11-18T21:28:43.654090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:52:02.757528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"31'666","reported_seq":701,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.066698+0000","last_change":"2023-11-18T20:59:25.357198+0000","last_active":"2023-11-18T21:28:43.066698+0000","last_peered":"2023-11-18T21:28:43.066698+0000","last_clean":"2023-11-18T21:28:43.066698+0000","last_became_active":"2023-11-18T20:59:25.356883+0000","last_became_peered":"2023-11-18T20:59:25.356883+0000","last_unstale":"2023-11-18T21:28:43.066698+0000","last_undegraded":"2023-11-18T21:28:43.066698+0000","last_fullsized":"2023-11-18T21:28:43.066698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:09.508737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3370313,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"31'82","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:25.976634+0000","last_change":"2023-11-18T20:59:35.834266+0000","last_active":"2023-11-18T21:27:25.976634+0000","last_peered":"2023-11-18T21:27:25.976634+0000","last_clean":"2023-11-18T21:27:25.976634+0000","last_became_active":"2023-11-18T20:59:35.833790+0000","last_became_peered":"2023-11-18T20:59:35.833790+0000","last_unstale":"2023-11-18T21:27:25.976634+0000","last_undegraded":"2023-11-18T21:27:25.976634+0000","last_fullsized":"2023-11-18T21:27:25.976634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:08.464650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":7460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'56","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678848+0000","last_change":"2023-11-18T20:59:27.873828+0000","last_active":"2023-11-18T21:28:43.678848+0000","last_peered":"2023-11-18T21:28:43.678848+0000","last_clean":"2023-11-18T21:28:43.678848+0000","last_became_active":"2023-11-18T20:59:27.872733+0000","last_became_peered":"2023-11-18T20:59:27.872733+0000","last_unstale":"2023-11-18T21:28:43.678848+0000","last_undegraded":"2023-11-18T21:28:43.678848+0000","last_fullsized":"2023-11-18T21:28:43.678848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"31'7","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.098478+0000","last_change":"2023-11-18T20:59:25.497529+0000","last_active":"2023-11-18T21:28:26.098478+0000","last_peered":"2023-11-18T21:28:26.098478+0000","last_clean":"2023-11-18T21:28:26.098478+0000","last_became_active":"2023-11-18T20:59:25.496694+0000","last_became_peered":"2023-11-18T20:59:25.496694+0000","last_unstale":"2023-11-18T21:28:26.098478+0000","last_undegraded":"2023-11-18T21:28:26.098478+0000","last_fullsized":"2023-11-18T21:28:26.098478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'95","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:24.986581+0000","last_change":"2023-11-18T20:59:35.829393+0000","last_active":"2023-11-18T21:27:24.986581+0000","last_peered":"2023-11-18T21:27:24.986581+0000","last_clean":"2023-11-18T21:27:24.986581+0000","last_became_active":"2023-11-18T20:59:35.828446+0000","last_became_peered":"2023-11-18T20:59:35.828446+0000","last_unstale":"2023-11-18T21:27:24.986581+0000","last_undegraded":"2023-11-18T21:27:24.986581+0000","last_fullsized":"2023-11-18T21:27:24.986581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:33.544336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":11010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"31'55","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678331+0000","last_change":"2023-11-18T20:59:27.875122+0000","last_active":"2023-11-18T21:28:43.678331+0000","last_peered":"2023-11-18T21:28:43.678331+0000","last_clean":"2023-11-18T21:28:43.678331+0000","last_became_active":"2023-11-18T20:59:27.870220+0000","last_became_peered":"2023-11-18T20:59:27.870220+0000","last_unstale":"2023-11-18T21:28:43.678331+0000","last_undegraded":"2023-11-18T21:28:43.678331+0000","last_fullsized":"2023-11-18T21:28:43.678331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:39.557454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"31'12","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:27.050057+0000","last_change":"2023-11-18T20:59:25.457826+0000","last_active":"2023-11-18T21:28:27.050057+0000","last_peered":"2023-11-18T21:28:27.050057+0000","last_clean":"2023-11-18T21:28:27.050057+0000","last_became_active":"2023-11-18T20:59:25.457392+0000","last_became_peered":"2023-11-18T20:59:25.457392+0000","last_unstale":"2023-11-18T21:28:27.050057+0000","last_undegraded":"2023-11-18T21:28:27.050057+0000","last_fullsized":"2023-11-18T21:28:27.050057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:07:56.724852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"31'70","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.074726+0000","last_change":"2023-11-18T20:59:35.831579+0000","last_active":"2023-11-18T21:27:28.074726+0000","last_peered":"2023-11-18T21:27:28.074726+0000","last_clean":"2023-11-18T21:27:28.074726+0000","last_became_active":"2023-11-18T20:59:35.831147+0000","last_became_peered":"2023-11-18T20:59:35.831147+0000","last_unstale":"2023-11-18T21:27:28.074726+0000","last_undegraded":"2023-11-18T21:27:28.074726+0000","last_fullsized":"2023-11-18T21:27:28.074726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:08.730686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"31'58","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.688733+0000","last_change":"2023-11-18T20:59:27.895618+0000","last_active":"2023-11-18T21:28:43.688733+0000","last_peered":"2023-11-18T21:28:43.688733+0000","last_clean":"2023-11-18T21:28:43.688733+0000","last_became_active":"2023-11-18T20:59:27.894931+0000","last_became_peered":"2023-11-18T20:59:27.894931+0000","last_unstale":"2023-11-18T21:28:43.688733+0000","last_undegraded":"2023-11-18T21:28:43.688733+0000","last_fullsized":"2023-11-18T21:28:43.688733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:33.165546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"31'206","reported_seq":241,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.287261+0000","last_change":"2023-11-18T20:59:25.458603+0000","last_active":"2023-11-18T21:28:32.287261+0000","last_peered":"2023-11-18T21:28:32.287261+0000","last_clean":"2023-11-18T21:28:32.287261+0000","last_became_active":"2023-11-18T20:59:25.457932+0000","last_became_peered":"2023-11-18T20:59:25.457932+0000","last_unstale":"2023-11-18T21:28:32.287261+0000","last_undegraded":"2023-11-18T21:28:32.287261+0000","last_fullsized":"2023-11-18T21:28:32.287261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":499,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"31'58","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.099951+0000","last_change":"2023-11-18T20:59:35.832209+0000","last_active":"2023-11-18T21:27:28.099951+0000","last_peered":"2023-11-18T21:27:28.099951+0000","last_clean":"2023-11-18T21:27:28.099951+0000","last_became_active":"2023-11-18T20:59:35.831804+0000","last_became_peered":"2023-11-18T20:59:35.831804+0000","last_unstale":"2023-11-18T21:27:28.099951+0000","last_undegraded":"2023-11-18T21:27:28.099951+0000","last_fullsized":"2023-11-18T21:27:28.099951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:13.050905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":9539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'55","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.664165+0000","last_change":"2023-11-18T20:59:27.884733+0000","last_active":"2023-11-18T21:28:43.664165+0000","last_peered":"2023-11-18T21:28:43.664165+0000","last_clean":"2023-11-18T21:28:43.664165+0000","last_became_active":"2023-11-18T20:59:27.884143+0000","last_became_peered":"2023-11-18T20:59:27.884143+0000","last_unstale":"2023-11-18T21:28:43.664165+0000","last_undegraded":"2023-11-18T21:28:43.664165+0000","last_fullsized":"2023-11-18T21:28:43.664165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:32.466816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"31'147","reported_seq":181,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:11.998500+0000","last_change":"2023-11-18T20:59:25.362761+0000","last_active":"2023-11-18T21:28:11.998500+0000","last_peered":"2023-11-18T21:28:11.998500+0000","last_clean":"2023-11-18T21:28:11.998500+0000","last_became_active":"2023-11-18T20:59:25.362350+0000","last_became_peered":"2023-11-18T20:59:25.362350+0000","last_unstale":"2023-11-18T21:28:11.998500+0000","last_undegraded":"2023-11-18T21:28:11.998500+0000","last_fullsized":"2023-11-18T21:28:11.998500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:32:54.741681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"31'80","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.936662+0000","last_change":"2023-11-18T20:59:35.836797+0000","last_active":"2023-11-18T21:27:27.936662+0000","last_peered":"2023-11-18T21:27:27.936662+0000","last_clean":"2023-11-18T21:27:27.936662+0000","last_became_active":"2023-11-18T20:59:35.834153+0000","last_became_peered":"2023-11-18T20:59:35.834153+0000","last_unstale":"2023-11-18T21:27:27.936662+0000","last_undegraded":"2023-11-18T21:27:27.936662+0000","last_fullsized":"2023-11-18T21:27:27.936662+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:18.639780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'47","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.626927+0000","last_change":"2023-11-18T20:59:27.841401+0000","last_active":"2023-11-18T21:28:43.626927+0000","last_peered":"2023-11-18T21:28:43.626927+0000","last_clean":"2023-11-18T21:28:43.626927+0000","last_became_active":"2023-11-18T20:59:27.840852+0000","last_became_peered":"2023-11-18T20:59:27.840852+0000","last_unstale":"2023-11-18T21:28:43.626927+0000","last_undegraded":"2023-11-18T21:28:43.626927+0000","last_fullsized":"2023-11-18T21:28:43.626927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"31'840","reported_seq":874,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.081381+0000","last_change":"2023-11-18T20:59:25.351707+0000","last_active":"2023-11-18T21:28:43.081381+0000","last_peered":"2023-11-18T21:28:43.081381+0000","last_clean":"2023-11-18T21:28:43.081381+0000","last_became_active":"2023-11-18T20:59:25.351149+0000","last_became_peered":"2023-11-18T20:59:25.351149+0000","last_unstale":"2023-11-18T21:28:43.081381+0000","last_undegraded":"2023-11-18T21:28:43.081381+0000","last_fullsized":"2023-11-18T21:28:43.081381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:37:55.630369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3704571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":4031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"31'77","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.952612+0000","last_change":"2023-11-18T20:59:35.844046+0000","last_active":"2023-11-18T21:27:27.952612+0000","last_peered":"2023-11-18T21:27:27.952612+0000","last_clean":"2023-11-18T21:27:27.952612+0000","last_became_active":"2023-11-18T20:59:35.843208+0000","last_became_peered":"2023-11-18T20:59:35.843208+0000","last_unstale":"2023-11-18T21:27:27.952612+0000","last_undegraded":"2023-11-18T21:27:27.952612+0000","last_fullsized":"2023-11-18T21:27:27.952612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:21:06.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":6277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'59","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.670708+0000","last_change":"2023-11-18T20:59:27.866997+0000","last_active":"2023-11-18T21:28:43.670708+0000","last_peered":"2023-11-18T21:28:43.670708+0000","last_clean":"2023-11-18T21:28:43.670708+0000","last_became_active":"2023-11-18T20:59:27.866233+0000","last_became_peered":"2023-11-18T20:59:27.866233+0000","last_unstale":"2023-11-18T21:28:43.670708+0000","last_undegraded":"2023-11-18T21:28:43.670708+0000","last_fullsized":"2023-11-18T21:28:43.670708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:19.998748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"31'93","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.127406+0000","last_change":"2023-11-18T20:59:25.362589+0000","last_active":"2023-11-18T21:28:26.127406+0000","last_peered":"2023-11-18T21:28:26.127406+0000","last_clean":"2023-11-18T21:28:26.127406+0000","last_became_active":"2023-11-18T20:59:25.362287+0000","last_became_peered":"2023-11-18T20:59:25.362287+0000","last_unstale":"2023-11-18T21:28:26.127406+0000","last_undegraded":"2023-11-18T21:28:26.127406+0000","last_fullsized":"2023-11-18T21:28:26.127406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:24.791294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"31'78","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.501676+0000","last_change":"2023-11-18T20:59:35.846859+0000","last_active":"2023-11-18T21:27:18.501676+0000","last_peered":"2023-11-18T21:27:18.501676+0000","last_clean":"2023-11-18T21:27:18.501676+0000","last_became_active":"2023-11-18T20:59:35.845378+0000","last_became_peered":"2023-11-18T20:59:35.845378+0000","last_unstale":"2023-11-18T21:27:18.501676+0000","last_undegraded":"2023-11-18T21:27:18.501676+0000","last_fullsized":"2023-11-18T21:27:18.501676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"31'57","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.633140+0000","last_change":"2023-11-18T20:59:27.863967+0000","last_active":"2023-11-18T21:28:43.633140+0000","last_peered":"2023-11-18T21:28:43.633140+0000","last_clean":"2023-11-18T21:28:43.633140+0000","last_became_active":"2023-11-18T20:59:27.863435+0000","last_became_peered":"2023-11-18T20:59:27.863435+0000","last_unstale":"2023-11-18T21:28:43.633140+0000","last_undegraded":"2023-11-18T21:28:43.633140+0000","last_fullsized":"2023-11-18T21:28:43.633140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:04.837624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"31'121","reported_seq":263,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.070745+0000","last_change":"2023-11-18T20:59:25.361677+0000","last_active":"2023-11-18T21:28:26.070745+0000","last_peered":"2023-11-18T21:28:26.070745+0000","last_clean":"2023-11-18T21:28:26.070745+0000","last_became_active":"2023-11-18T20:59:25.361313+0000","last_became_peered":"2023-11-18T20:59:25.361313+0000","last_unstale":"2023-11-18T21:28:26.070745+0000","last_undegraded":"2023-11-18T21:28:26.070745+0000","last_fullsized":"2023-11-18T21:28:26.070745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25371,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":112,"num_write":121,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"31'82","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.965955+0000","last_change":"2023-11-18T20:59:35.832893+0000","last_active":"2023-11-18T21:27:27.965955+0000","last_peered":"2023-11-18T21:27:27.965955+0000","last_clean":"2023-11-18T21:27:27.965955+0000","last_became_active":"2023-11-18T20:59:35.832562+0000","last_became_peered":"2023-11-18T20:59:35.832562+0000","last_unstale":"2023-11-18T21:27:27.965955+0000","last_undegraded":"2023-11-18T21:27:27.965955+0000","last_fullsized":"2023-11-18T21:27:27.965955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:53:05.127511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":7445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'55","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678154+0000","last_change":"2023-11-18T20:59:27.874128+0000","last_active":"2023-11-18T21:28:43.678154+0000","last_peered":"2023-11-18T21:28:43.678154+0000","last_clean":"2023-11-18T21:28:43.678154+0000","last_became_active":"2023-11-18T20:59:27.865971+0000","last_became_peered":"2023-11-18T20:59:27.865971+0000","last_unstale":"2023-11-18T21:28:43.678154+0000","last_undegraded":"2023-11-18T21:28:43.678154+0000","last_fullsized":"2023-11-18T21:28:43.678154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"31'1150","reported_seq":1184,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.293706+0000","last_change":"2023-11-18T20:59:25.350262+0000","last_active":"2023-11-18T21:28:32.293706+0000","last_peered":"2023-11-18T21:28:32.293706+0000","last_clean":"2023-11-18T21:28:32.293706+0000","last_became_active":"2023-11-18T20:59:25.349577+0000","last_became_peered":"2023-11-18T20:59:25.349577+0000","last_unstale":"2023-11-18T21:28:32.293706+0000","last_undegraded":"2023-11-18T21:28:32.293706+0000","last_fullsized":"2023-11-18T21:28:32.293706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":4577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"31'99","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:26.994212+0000","last_change":"2023-11-18T20:59:35.849720+0000","last_active":"2023-11-18T21:27:26.994212+0000","last_peered":"2023-11-18T21:27:26.994212+0000","last_clean":"2023-11-18T21:27:26.994212+0000","last_became_active":"2023-11-18T20:59:35.848000+0000","last_became_peered":"2023-11-18T20:59:35.848000+0000","last_unstale":"2023-11-18T21:27:26.994212+0000","last_undegraded":"2023-11-18T21:27:26.994212+0000","last_fullsized":"2023-11-18T21:27:26.994212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:41:54.553006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":10947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"31'51","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.641202+0000","last_change":"2023-11-18T20:59:27.891817+0000","last_active":"2023-11-18T21:28:43.641202+0000","last_peered":"2023-11-18T21:28:43.641202+0000","last_clean":"2023-11-18T21:28:43.641202+0000","last_became_active":"2023-11-18T20:59:27.891260+0000","last_became_peered":"2023-11-18T20:59:27.891260+0000","last_unstale":"2023-11-18T21:28:43.641202+0000","last_undegraded":"2023-11-18T21:28:43.641202+0000","last_fullsized":"2023-11-18T21:28:43.641202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:25.331055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"31'67","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:33.868078+0000","last_change":"2023-11-18T20:59:25.363983+0000","last_active":"2023-11-18T21:28:33.868078+0000","last_peered":"2023-11-18T21:28:33.868078+0000","last_clean":"2023-11-18T21:28:33.868078+0000","last_became_active":"2023-11-18T20:59:25.363289+0000","last_became_peered":"2023-11-18T20:59:25.363289+0000","last_unstale":"2023-11-18T21:28:33.868078+0000","last_undegraded":"2023-11-18T21:28:33.868078+0000","last_fullsized":"2023-11-18T21:28:33.868078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"31'68","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.149401+0000","last_change":"2023-11-18T20:59:35.771712+0000","last_active":"2023-11-18T21:27:28.149401+0000","last_peered":"2023-11-18T21:27:28.149401+0000","last_clean":"2023-11-18T21:27:28.149401+0000","last_became_active":"2023-11-18T20:59:35.771263+0000","last_became_peered":"2023-11-18T20:59:35.771263+0000","last_unstale":"2023-11-18T21:27:28.149401+0000","last_undegraded":"2023-11-18T21:27:28.149401+0000","last_fullsized":"2023-11-18T21:27:28.149401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":272,"num_write":61,"num_write_kb":11998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"31'64","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.648283+0000","last_change":"2023-11-18T20:59:27.834172+0000","last_active":"2023-11-18T21:28:43.648283+0000","last_peered":"2023-11-18T21:28:43.648283+0000","last_clean":"2023-11-18T21:28:43.648283+0000","last_became_active":"2023-11-18T20:59:27.832589+0000","last_became_peered":"2023-11-18T20:59:27.832589+0000","last_unstale":"2023-11-18T21:28:43.648283+0000","last_undegraded":"2023-11-18T21:28:43.648283+0000","last_fullsized":"2023-11-18T21:28:43.648283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"31'116","reported_seq":259,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:11.762077+0000","last_change":"2023-11-18T20:59:25.494236+0000","last_active":"2023-11-18T21:28:11.762077+0000","last_peered":"2023-11-18T21:28:11.762077+0000","last_clean":"2023-11-18T21:28:11.762077+0000","last_became_active":"2023-11-18T20:59:25.493373+0000","last_became_peered":"2023-11-18T20:59:25.493373+0000","last_unstale":"2023-11-18T21:28:11.762077+0000","last_undegraded":"2023-11-18T21:28:11.762077+0000","last_fullsized":"2023-11-18T21:28:11.762077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:13.859109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20332,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":112,"num_write":115,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'93","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:21.763452+0000","last_change":"2023-11-18T20:59:35.773319+0000","last_active":"2023-11-18T21:27:21.763452+0000","last_peered":"2023-11-18T21:27:21.763452+0000","last_clean":"2023-11-18T21:27:21.763452+0000","last_became_active":"2023-11-18T20:59:35.772563+0000","last_became_peered":"2023-11-18T20:59:35.772563+0000","last_unstale":"2023-11-18T21:27:21.763452+0000","last_undegraded":"2023-11-18T21:27:21.763452+0000","last_fullsized":"2023-11-18T21:27:21.763452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:12.287749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":9621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'57","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.695084+0000","last_change":"2023-11-18T20:59:27.892789+0000","last_active":"2023-11-18T21:28:43.695084+0000","last_peered":"2023-11-18T21:28:43.695084+0000","last_clean":"2023-11-18T21:28:43.695084+0000","last_became_active":"2023-11-18T20:59:27.891883+0000","last_became_peered":"2023-11-18T20:59:27.891883+0000","last_unstale":"2023-11-18T21:28:43.695084+0000","last_undegraded":"2023-11-18T21:28:43.695084+0000","last_fullsized":"2023-11-18T21:28:43.695084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:12.020475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"31'158","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.392162+0000","last_change":"2023-11-18T20:59:25.497309+0000","last_active":"2023-11-18T21:28:32.392162+0000","last_peered":"2023-11-18T21:28:32.392162+0000","last_clean":"2023-11-18T21:28:32.392162+0000","last_became_active":"2023-11-18T20:59:25.496680+0000","last_became_peered":"2023-11-18T20:59:25.496680+0000","last_unstale":"2023-11-18T21:28:32.392162+0000","last_undegraded":"2023-11-18T21:28:32.392162+0000","last_fullsized":"2023-11-18T21:28:32.392162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"31'67","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.919444+0000","last_change":"2023-11-18T20:59:35.842258+0000","last_active":"2023-11-18T21:27:27.919444+0000","last_peered":"2023-11-18T21:27:27.919444+0000","last_clean":"2023-11-18T21:27:27.919444+0000","last_became_active":"2023-11-18T20:59:35.838830+0000","last_became_peered":"2023-11-18T20:59:35.838830+0000","last_unstale":"2023-11-18T21:27:27.919444+0000","last_undegraded":"2023-11-18T21:27:27.919444+0000","last_fullsized":"2023-11-18T21:27:27.919444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:12:39.697374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":8132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"31'63","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:21.787641+0000","last_change":"2023-11-18T20:59:35.839178+0000","last_active":"2023-11-18T21:27:21.787641+0000","last_peered":"2023-11-18T21:27:21.787641+0000","last_clean":"2023-11-18T21:27:21.787641+0000","last_became_active":"2023-11-18T20:59:35.838375+0000","last_became_peered":"2023-11-18T20:59:35.838375+0000","last_unstale":"2023-11-18T21:27:21.787641+0000","last_undegraded":"2023-11-18T21:27:21.787641+0000","last_fullsized":"2023-11-18T21:27:21.787641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:56:09.565932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"31'61","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.578789+0000","last_change":"2023-11-18T20:59:27.689539+0000","last_active":"2023-11-18T21:28:43.578789+0000","last_peered":"2023-11-18T21:28:43.578789+0000","last_clean":"2023-11-18T21:28:43.578789+0000","last_became_active":"2023-11-18T20:59:27.688522+0000","last_became_peered":"2023-11-18T20:59:27.688522+0000","last_unstale":"2023-11-18T21:28:43.578789+0000","last_undegraded":"2023-11-18T21:28:43.578789+0000","last_fullsized":"2023-11-18T21:28:43.578789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:06:48.337696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"31'7","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:51.862615+0000","last_change":"2023-11-18T20:59:25.494125+0000","last_active":"2023-11-18T21:27:51.862615+0000","last_peered":"2023-11-18T21:27:51.862615+0000","last_clean":"2023-11-18T21:27:51.862615+0000","last_became_active":"2023-11-18T20:59:25.493357+0000","last_became_peered":"2023-11-18T20:59:25.493357+0000","last_unstale":"2023-11-18T21:27:51.862615+0000","last_undegraded":"2023-11-18T21:27:51.862615+0000","last_fullsized":"2023-11-18T21:27:51.862615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'97","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.014725+0000","last_change":"2023-11-18T20:59:35.776653+0000","last_active":"2023-11-18T21:27:27.014725+0000","last_peered":"2023-11-18T21:27:27.014725+0000","last_clean":"2023-11-18T21:27:27.014725+0000","last_became_active":"2023-11-18T20:59:35.776138+0000","last_became_peered":"2023-11-18T20:59:35.776138+0000","last_unstale":"2023-11-18T21:27:27.014725+0000","last_undegraded":"2023-11-18T21:27:27.014725+0000","last_fullsized":"2023-11-18T21:27:27.014725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:08:25.933599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'54","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.642467+0000","last_change":"2023-11-18T20:59:27.860987+0000","last_active":"2023-11-18T21:28:43.642467+0000","last_peered":"2023-11-18T21:28:43.642467+0000","last_clean":"2023-11-18T21:28:43.642467+0000","last_became_active":"2023-11-18T20:59:27.860537+0000","last_became_peered":"2023-11-18T20:59:27.860537+0000","last_unstale":"2023-11-18T21:28:43.642467+0000","last_undegraded":"2023-11-18T21:28:43.642467+0000","last_fullsized":"2023-11-18T21:28:43.642467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"31'228","reported_seq":485,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.255998+0000","last_change":"2023-11-18T20:59:25.354967+0000","last_active":"2023-11-18T21:28:32.255998+0000","last_peered":"2023-11-18T21:28:32.255998+0000","last_clean":"2023-11-18T21:28:32.255998+0000","last_became_active":"2023-11-18T20:59:25.354690+0000","last_became_peered":"2023-11-18T20:59:25.354690+0000","last_unstale":"2023-11-18T21:28:32.255998+0000","last_undegraded":"2023-11-18T21:28:32.255998+0000","last_fullsized":"2023-11-18T21:28:32.255998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:50.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34720,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":223,"num_read_kb":227,"num_write":228,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"31'175","reported_seq":370,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.108932+0000","last_change":"2023-11-18T20:59:25.346493+0000","last_active":"2023-11-18T21:28:26.108932+0000","last_peered":"2023-11-18T21:28:26.108932+0000","last_clean":"2023-11-18T21:28:26.108932+0000","last_became_active":"2023-11-18T20:59:25.346192+0000","last_became_peered":"2023-11-18T20:59:25.346192+0000","last_unstale":"2023-11-18T21:28:26.108932+0000","last_undegraded":"2023-11-18T21:28:26.108932+0000","last_fullsized":"2023-11-18T21:28:26.108932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:30.162962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":165,"num_write":171,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'63","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.671087+0000","last_change":"2023-11-18T20:59:27.868460+0000","last_active":"2023-11-18T21:28:43.671087+0000","last_peered":"2023-11-18T21:28:43.671087+0000","last_clean":"2023-11-18T21:28:43.671087+0000","last_became_active":"2023-11-18T20:59:27.867886+0000","last_became_peered":"2023-11-18T20:59:27.867886+0000","last_unstale":"2023-11-18T21:28:43.671087+0000","last_undegraded":"2023-11-18T21:28:43.671087+0000","last_fullsized":"2023-11-18T21:28:43.671087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:47:39.647294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'95","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.021970+0000","last_change":"2023-11-18T20:59:35.851163+0000","last_active":"2023-11-18T21:27:27.021970+0000","last_peered":"2023-11-18T21:27:27.021970+0000","last_clean":"2023-11-18T21:27:27.021970+0000","last_became_active":"2023-11-18T20:59:35.850427+0000","last_became_peered":"2023-11-18T20:59:35.850427+0000","last_unstale":"2023-11-18T21:27:27.021970+0000","last_undegraded":"2023-11-18T21:27:27.021970+0000","last_fullsized":"2023-11-18T21:27:27.021970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:20.729626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2343","reported_seq":2376,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.081692+0000","last_change":"2023-11-18T20:59:25.462276+0000","last_active":"2023-11-18T21:28:43.081692+0000","last_peered":"2023-11-18T21:28:43.081692+0000","last_clean":"2023-11-18T21:28:43.081692+0000","last_became_active":"2023-11-18T20:59:25.460449+0000","last_became_peered":"2023-11-18T20:59:25.460449+0000","last_unstale":"2023-11-18T21:28:43.081692+0000","last_undegraded":"2023-11-18T21:28:43.081692+0000","last_fullsized":"2023-11-18T21:28:43.081692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2343,"log_dups_size":0,"ondisk_log_size":2343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:25:57.950600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8759326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2333,"num_write_kb":9750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"31'69","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.626007+0000","last_change":"2023-11-18T20:59:27.841332+0000","last_active":"2023-11-18T21:28:43.626007+0000","last_peered":"2023-11-18T21:28:43.626007+0000","last_clean":"2023-11-18T21:28:43.626007+0000","last_became_active":"2023-11-18T20:59:27.840528+0000","last_became_peered":"2023-11-18T20:59:27.840528+0000","last_unstale":"2023-11-18T21:28:43.626007+0000","last_undegraded":"2023-11-18T21:28:43.626007+0000","last_fullsized":"2023-11-18T21:28:43.626007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"31'65","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:26.984823+0000","last_change":"2023-11-18T20:59:35.776844+0000","last_active":"2023-11-18T21:27:26.984823+0000","last_peered":"2023-11-18T21:27:26.984823+0000","last_clean":"2023-11-18T21:27:26.984823+0000","last_became_active":"2023-11-18T20:59:35.775977+0000","last_became_peered":"2023-11-18T20:59:35.775977+0000","last_unstale":"2023-11-18T21:27:26.984823+0000","last_undegraded":"2023-11-18T21:27:26.984823+0000","last_fullsized":"2023-11-18T21:27:26.984823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:06:00.187752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"31'59","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.669791+0000","last_change":"2023-11-18T20:59:27.888673+0000","last_active":"2023-11-18T21:28:43.669791+0000","last_peered":"2023-11-18T21:28:43.669791+0000","last_clean":"2023-11-18T21:28:43.669791+0000","last_became_active":"2023-11-18T20:59:27.887716+0000","last_became_peered":"2023-11-18T20:59:27.887716+0000","last_unstale":"2023-11-18T21:28:43.669791+0000","last_undegraded":"2023-11-18T21:28:43.669791+0000","last_fullsized":"2023-11-18T21:28:43.669791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"31'67","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.471935+0000","last_change":"2023-11-18T20:59:27.684810+0000","last_active":"2023-11-18T21:28:43.471935+0000","last_peered":"2023-11-18T21:28:43.471935+0000","last_clean":"2023-11-18T21:28:43.471935+0000","last_became_active":"2023-11-18T20:59:27.680712+0000","last_became_peered":"2023-11-18T20:59:27.680712+0000","last_unstale":"2023-11-18T21:28:43.471935+0000","last_undegraded":"2023-11-18T21:28:43.471935+0000","last_fullsized":"2023-11-18T21:28:43.471935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"31'57","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.646654+0000","last_change":"2023-11-18T20:59:27.835960+0000","last_active":"2023-11-18T21:28:43.646654+0000","last_peered":"2023-11-18T21:28:43.646654+0000","last_clean":"2023-11-18T21:28:43.646654+0000","last_became_active":"2023-11-18T20:59:27.835120+0000","last_became_peered":"2023-11-18T20:59:27.835120+0000","last_unstale":"2023-11-18T21:28:43.646654+0000","last_undegraded":"2023-11-18T21:28:43.646654+0000","last_fullsized":"2023-11-18T21:28:43.646654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:35:51.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"31'59","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.632517+0000","last_change":"2023-11-18T20:59:27.833652+0000","last_active":"2023-11-18T21:28:43.632517+0000","last_peered":"2023-11-18T21:28:43.632517+0000","last_clean":"2023-11-18T21:28:43.632517+0000","last_became_active":"2023-11-18T20:59:27.833049+0000","last_became_peered":"2023-11-18T20:59:27.833049+0000","last_unstale":"2023-11-18T21:28:43.632517+0000","last_undegraded":"2023-11-18T21:28:43.632517+0000","last_fullsized":"2023-11-18T21:28:43.632517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:23.262919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"31'40","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.654877+0000","last_change":"2023-11-18T20:59:27.878824+0000","last_active":"2023-11-18T21:28:43.654877+0000","last_peered":"2023-11-18T21:28:43.654877+0000","last_clean":"2023-11-18T21:28:43.654877+0000","last_became_active":"2023-11-18T20:59:27.878353+0000","last_became_peered":"2023-11-18T20:59:27.878353+0000","last_unstale":"2023-11-18T21:28:43.654877+0000","last_undegraded":"2023-11-18T21:28:43.654877+0000","last_fullsized":"2023-11-18T21:28:43.654877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:04.074467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'50","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.581622+0000","last_change":"2023-11-18T20:59:27.866570+0000","last_active":"2023-11-18T21:28:43.581622+0000","last_peered":"2023-11-18T21:28:43.581622+0000","last_clean":"2023-11-18T21:28:43.581622+0000","last_became_active":"2023-11-18T20:59:27.866165+0000","last_became_peered":"2023-11-18T20:59:27.866165+0000","last_unstale":"2023-11-18T21:28:43.581622+0000","last_undegraded":"2023-11-18T21:28:43.581622+0000","last_fullsized":"2023-11-18T21:28:43.581622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:05:51.974471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"31'55","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.693558+0000","last_change":"2023-11-18T20:59:27.895340+0000","last_active":"2023-11-18T21:28:43.693558+0000","last_peered":"2023-11-18T21:28:43.693558+0000","last_clean":"2023-11-18T21:28:43.693558+0000","last_became_active":"2023-11-18T20:59:27.893918+0000","last_became_peered":"2023-11-18T20:59:27.893918+0000","last_unstale":"2023-11-18T21:28:43.693558+0000","last_undegraded":"2023-11-18T21:28:43.693558+0000","last_fullsized":"2023-11-18T21:28:43.693558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:11.899550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"31'49","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630693+0000","last_change":"2023-11-18T20:59:27.839127+0000","last_active":"2023-11-18T21:28:43.630693+0000","last_peered":"2023-11-18T21:28:43.630693+0000","last_clean":"2023-11-18T21:28:43.630693+0000","last_became_active":"2023-11-18T20:59:27.838509+0000","last_became_peered":"2023-11-18T20:59:27.838509+0000","last_unstale":"2023-11-18T21:28:43.630693+0000","last_undegraded":"2023-11-18T21:28:43.630693+0000","last_fullsized":"2023-11-18T21:28:43.630693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"31'60","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.628797+0000","last_change":"2023-11-18T20:59:27.836167+0000","last_active":"2023-11-18T21:28:43.628797+0000","last_peered":"2023-11-18T21:28:43.628797+0000","last_clean":"2023-11-18T21:28:43.628797+0000","last_became_active":"2023-11-18T20:59:27.835226+0000","last_became_peered":"2023-11-18T20:59:27.835226+0000","last_unstale":"2023-11-18T21:28:43.628797+0000","last_undegraded":"2023-11-18T21:28:43.628797+0000","last_fullsized":"2023-11-18T21:28:43.628797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:23:46.608216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'73","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.661836+0000","last_change":"2023-11-18T20:59:27.889937+0000","last_active":"2023-11-18T21:28:43.661836+0000","last_peered":"2023-11-18T21:28:43.661836+0000","last_clean":"2023-11-18T21:28:43.661836+0000","last_became_active":"2023-11-18T20:59:27.889325+0000","last_became_peered":"2023-11-18T20:59:27.889325+0000","last_unstale":"2023-11-18T21:28:43.661836+0000","last_undegraded":"2023-11-18T21:28:43.661836+0000","last_fullsized":"2023-11-18T21:28:43.661836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:39.674424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"31'63","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.670691+0000","last_change":"2023-11-18T20:59:27.867439+0000","last_active":"2023-11-18T21:28:43.670691+0000","last_peered":"2023-11-18T21:28:43.670691+0000","last_clean":"2023-11-18T21:28:43.670691+0000","last_became_active":"2023-11-18T20:59:27.866609+0000","last_became_peered":"2023-11-18T20:59:27.866609+0000","last_unstale":"2023-11-18T21:28:43.670691+0000","last_undegraded":"2023-11-18T21:28:43.670691+0000","last_fullsized":"2023-11-18T21:28:43.670691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:46:49.094141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'64","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.615236+0000","last_change":"2023-11-18T20:59:27.883416+0000","last_active":"2023-11-18T21:28:43.615236+0000","last_peered":"2023-11-18T21:28:43.615236+0000","last_clean":"2023-11-18T21:28:43.615236+0000","last_became_active":"2023-11-18T20:59:27.882976+0000","last_became_peered":"2023-11-18T20:59:27.882976+0000","last_unstale":"2023-11-18T21:28:43.615236+0000","last_undegraded":"2023-11-18T21:28:43.615236+0000","last_fullsized":"2023-11-18T21:28:43.615236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:29:12.611142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"31'51","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.679081+0000","last_change":"2023-11-18T20:59:27.873520+0000","last_active":"2023-11-18T21:28:43.679081+0000","last_peered":"2023-11-18T21:28:43.679081+0000","last_clean":"2023-11-18T21:28:43.679081+0000","last_became_active":"2023-11-18T20:59:27.872627+0000","last_became_peered":"2023-11-18T20:59:27.872627+0000","last_unstale":"2023-11-18T21:28:43.679081+0000","last_undegraded":"2023-11-18T21:28:43.679081+0000","last_fullsized":"2023-11-18T21:28:43.679081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"31'60","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.654001+0000","last_change":"2023-11-18T20:59:27.687118+0000","last_active":"2023-11-18T21:28:43.654001+0000","last_peered":"2023-11-18T21:28:43.654001+0000","last_clean":"2023-11-18T21:28:43.654001+0000","last_became_active":"2023-11-18T20:59:27.686311+0000","last_became_peered":"2023-11-18T20:59:27.686311+0000","last_unstale":"2023-11-18T21:28:43.654001+0000","last_undegraded":"2023-11-18T21:28:43.654001+0000","last_fullsized":"2023-11-18T21:28:43.654001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:25:27.490214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'65","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.471465+0000","last_change":"2023-11-18T20:59:27.892404+0000","last_active":"2023-11-18T21:28:43.471465+0000","last_peered":"2023-11-18T21:28:43.471465+0000","last_clean":"2023-11-18T21:28:43.471465+0000","last_became_active":"2023-11-18T20:59:27.891767+0000","last_became_peered":"2023-11-18T20:59:27.891767+0000","last_unstale":"2023-11-18T21:28:43.471465+0000","last_undegraded":"2023-11-18T21:28:43.471465+0000","last_fullsized":"2023-11-18T21:28:43.471465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"31'51","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.669452+0000","last_change":"2023-11-18T20:59:27.866920+0000","last_active":"2023-11-18T21:28:43.669452+0000","last_peered":"2023-11-18T21:28:43.669452+0000","last_clean":"2023-11-18T21:28:43.669452+0000","last_became_active":"2023-11-18T20:59:27.866153+0000","last_became_peered":"2023-11-18T20:59:27.866153+0000","last_unstale":"2023-11-18T21:28:43.669452+0000","last_undegraded":"2023-11-18T21:28:43.669452+0000","last_fullsized":"2023-11-18T21:28:43.669452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:50:43.894365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'60","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.664304+0000","last_change":"2023-11-18T20:59:27.890399+0000","last_active":"2023-11-18T21:28:43.664304+0000","last_peered":"2023-11-18T21:28:43.664304+0000","last_clean":"2023-11-18T21:28:43.664304+0000","last_became_active":"2023-11-18T20:59:27.889704+0000","last_became_peered":"2023-11-18T20:59:27.889704+0000","last_unstale":"2023-11-18T21:28:43.664304+0000","last_undegraded":"2023-11-18T21:28:43.664304+0000","last_fullsized":"2023-11-18T21:28:43.664304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:34:37.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"31'63","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.670763+0000","last_change":"2023-11-18T20:59:27.871794+0000","last_active":"2023-11-18T21:28:43.670763+0000","last_peered":"2023-11-18T21:28:43.670763+0000","last_clean":"2023-11-18T21:28:43.670763+0000","last_became_active":"2023-11-18T20:59:27.871337+0000","last_became_peered":"2023-11-18T20:59:27.871337+0000","last_unstale":"2023-11-18T21:28:43.670763+0000","last_undegraded":"2023-11-18T21:28:43.670763+0000","last_fullsized":"2023-11-18T21:28:43.670763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:16.370847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"31'53","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.584958+0000","last_change":"2023-11-18T20:59:27.867288+0000","last_active":"2023-11-18T21:28:43.584958+0000","last_peered":"2023-11-18T21:28:43.584958+0000","last_clean":"2023-11-18T21:28:43.584958+0000","last_became_active":"2023-11-18T20:59:27.866560+0000","last_became_peered":"2023-11-18T20:59:27.866560+0000","last_unstale":"2023-11-18T21:28:43.584958+0000","last_undegraded":"2023-11-18T21:28:43.584958+0000","last_fullsized":"2023-11-18T21:28:43.584958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"31'52","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.669336+0000","last_change":"2023-11-18T20:59:27.878944+0000","last_active":"2023-11-18T21:28:43.669336+0000","last_peered":"2023-11-18T21:28:43.669336+0000","last_clean":"2023-11-18T21:28:43.669336+0000","last_became_active":"2023-11-18T20:59:27.878485+0000","last_became_peered":"2023-11-18T20:59:27.878485+0000","last_unstale":"2023-11-18T21:28:43.669336+0000","last_undegraded":"2023-11-18T21:28:43.669336+0000","last_fullsized":"2023-11-18T21:28:43.669336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:04.749189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"31'53","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678771+0000","last_change":"2023-11-18T20:59:27.874019+0000","last_active":"2023-11-18T21:28:43.678771+0000","last_peered":"2023-11-18T21:28:43.678771+0000","last_clean":"2023-11-18T21:28:43.678771+0000","last_became_active":"2023-11-18T20:59:27.873255+0000","last_became_peered":"2023-11-18T20:59:27.873255+0000","last_unstale":"2023-11-18T21:28:43.678771+0000","last_undegraded":"2023-11-18T21:28:43.678771+0000","last_fullsized":"2023-11-18T21:28:43.678771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"31'53","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.677510+0000","last_change":"2023-11-18T20:59:27.868086+0000","last_active":"2023-11-18T21:28:43.677510+0000","last_peered":"2023-11-18T21:28:43.677510+0000","last_clean":"2023-11-18T21:28:43.677510+0000","last_became_active":"2023-11-18T20:59:27.866901+0000","last_became_peered":"2023-11-18T20:59:27.866901+0000","last_unstale":"2023-11-18T21:28:43.677510+0000","last_undegraded":"2023-11-18T21:28:43.677510+0000","last_fullsized":"2023-11-18T21:28:43.677510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"31'59","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.675973+0000","last_change":"2023-11-18T20:59:27.888617+0000","last_active":"2023-11-18T21:28:43.675973+0000","last_peered":"2023-11-18T21:28:43.675973+0000","last_clean":"2023-11-18T21:28:43.675973+0000","last_became_active":"2023-11-18T20:59:27.888068+0000","last_became_peered":"2023-11-18T20:59:27.888068+0000","last_unstale":"2023-11-18T21:28:43.675973+0000","last_undegraded":"2023-11-18T21:28:43.675973+0000","last_fullsized":"2023-11-18T21:28:43.675973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:53.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"31'46","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.632841+0000","last_change":"2023-11-18T20:59:27.684428+0000","last_active":"2023-11-18T21:28:43.632841+0000","last_peered":"2023-11-18T21:28:43.632841+0000","last_clean":"2023-11-18T21:28:43.632841+0000","last_became_active":"2023-11-18T20:59:27.682936+0000","last_became_peered":"2023-11-18T20:59:27.682936+0000","last_unstale":"2023-11-18T21:28:43.632841+0000","last_undegraded":"2023-11-18T21:28:43.632841+0000","last_fullsized":"2023-11-18T21:28:43.632841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:52.955875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"31'66","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.672196+0000","last_change":"2023-11-18T20:59:27.865937+0000","last_active":"2023-11-18T21:28:43.672196+0000","last_peered":"2023-11-18T21:28:43.672196+0000","last_clean":"2023-11-18T21:28:43.672196+0000","last_became_active":"2023-11-18T20:59:27.865401+0000","last_became_peered":"2023-11-18T20:59:27.865401+0000","last_unstale":"2023-11-18T21:28:43.672196+0000","last_undegraded":"2023-11-18T21:28:43.672196+0000","last_fullsized":"2023-11-18T21:28:43.672196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:00.251369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"31'51","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.668462+0000","last_change":"2023-11-18T20:59:27.865748+0000","last_active":"2023-11-18T21:28:43.668462+0000","last_peered":"2023-11-18T21:28:43.668462+0000","last_clean":"2023-11-18T21:28:43.668462+0000","last_became_active":"2023-11-18T20:59:27.864956+0000","last_became_peered":"2023-11-18T20:59:27.864956+0000","last_unstale":"2023-11-18T21:28:43.668462+0000","last_undegraded":"2023-11-18T21:28:43.668462+0000","last_fullsized":"2023-11-18T21:28:43.668462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"31'38","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.667115+0000","last_change":"2023-11-18T20:59:27.889838+0000","last_active":"2023-11-18T21:28:43.667115+0000","last_peered":"2023-11-18T21:28:43.667115+0000","last_clean":"2023-11-18T21:28:43.667115+0000","last_became_active":"2023-11-18T20:59:27.889307+0000","last_became_peered":"2023-11-18T20:59:27.889307+0000","last_unstale":"2023-11-18T21:28:43.667115+0000","last_undegraded":"2023-11-18T21:28:43.667115+0000","last_fullsized":"2023-11-18T21:28:43.667115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'47","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.671477+0000","last_change":"2023-11-18T20:59:27.866394+0000","last_active":"2023-11-18T21:28:43.671477+0000","last_peered":"2023-11-18T21:28:43.671477+0000","last_clean":"2023-11-18T21:28:43.671477+0000","last_became_active":"2023-11-18T20:59:27.865625+0000","last_became_peered":"2023-11-18T20:59:27.865625+0000","last_unstale":"2023-11-18T21:28:43.671477+0000","last_undegraded":"2023-11-18T21:28:43.671477+0000","last_fullsized":"2023-11-18T21:28:43.671477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"31'54","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.662646+0000","last_change":"2023-11-18T20:59:27.892765+0000","last_active":"2023-11-18T21:28:43.662646+0000","last_peered":"2023-11-18T21:28:43.662646+0000","last_clean":"2023-11-18T21:28:43.662646+0000","last_became_active":"2023-11-18T20:59:27.891753+0000","last_became_peered":"2023-11-18T20:59:27.891753+0000","last_unstale":"2023-11-18T21:28:43.662646+0000","last_undegraded":"2023-11-18T21:28:43.662646+0000","last_fullsized":"2023-11-18T21:28:43.662646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:52.955875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"31'63","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630861+0000","last_change":"2023-11-18T20:59:27.837531+0000","last_active":"2023-11-18T21:28:43.630861+0000","last_peered":"2023-11-18T21:28:43.630861+0000","last_clean":"2023-11-18T21:28:43.630861+0000","last_became_active":"2023-11-18T20:59:27.836899+0000","last_became_peered":"2023-11-18T20:59:27.836899+0000","last_unstale":"2023-11-18T21:28:43.630861+0000","last_undegraded":"2023-11-18T21:28:43.630861+0000","last_fullsized":"2023-11-18T21:28:43.630861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:04.716391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"31'58","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.639720+0000","last_change":"2023-11-18T20:59:27.864494+0000","last_active":"2023-11-18T21:28:43.639720+0000","last_peered":"2023-11-18T21:28:43.639720+0000","last_clean":"2023-11-18T21:28:43.639720+0000","last_became_active":"2023-11-18T20:59:27.863732+0000","last_became_peered":"2023-11-18T20:59:27.863732+0000","last_unstale":"2023-11-18T21:28:43.639720+0000","last_undegraded":"2023-11-18T21:28:43.639720+0000","last_fullsized":"2023-11-18T21:28:43.639720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"31'63","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678165+0000","last_change":"2023-11-18T20:59:27.873605+0000","last_active":"2023-11-18T21:28:43.678165+0000","last_peered":"2023-11-18T21:28:43.678165+0000","last_clean":"2023-11-18T21:28:43.678165+0000","last_became_active":"2023-11-18T20:59:27.871167+0000","last_became_peered":"2023-11-18T20:59:27.871167+0000","last_unstale":"2023-11-18T21:28:43.678165+0000","last_undegraded":"2023-11-18T21:28:43.678165+0000","last_fullsized":"2023-11-18T21:28:43.678165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:54:51.212807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":448,"num_write":2451,"num_write_kb":251040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2621,"ondisk_log_size":2621,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3577,"ondisk_log_size":3577,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23672018,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":675,"num_read_kb":695,"num_write":9681,"num_write_kb":28189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47595520,"data_stored":47344036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8458,"ondisk_log_size":8458,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509807,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":181032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.90100000000000002,"15min":0.89700000000000002},"min":{"1min":0.51000000000000001,"5min":0.44,"15min":0.34799999999999998},"max":{"1min":1.3280000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.246},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.90800000000000003,"15min":0.93200000000000005},"min":{"1min":0.46100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.393,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92200000000000004,"15min":0.92900000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.3320000000000001,"5min":1.6579999999999999,"15min":1.7210000000000001},"last":1.179},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92100000000000004,"15min":0.93500000000000005},"min":{"1min":0.41599999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4319999999999999,"5min":1.51,"15min":2.524},"last":0.88400000000000001}]},{"osd":2,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.052,"15min":1.052},"min":{"1min":0.53400000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.585,"5min":1.585,"15min":1.694},"last":1.036},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.97699999999999998,"15min":1.01},"min":{"1min":0.47999999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.589},"last":1.006}]},{"osd":3,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.014,"15min":1.0109999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4219999999999999,"5min":1.7509999999999999,"15min":1.831},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.073,"5min":1.0389999999999999,"15min":1.0529999999999999},"min":{"1min":0.57599999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.627,"5min":1.627,"15min":2.4430000000000001},"last":1.216}]},{"osd":4,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.92800000000000005,"15min":0.95199999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4299999999999999,"5min":1.45,"15min":1.601},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0760000000000001,"15min":1.0700000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.40100000000000002},"max":{"1min":1.617,"5min":2.266,"15min":2.266},"last":1.1000000000000001}]},{"osd":5,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.024,"15min":1.0309999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.40300000000000002},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.7509999999999999},"last":1.145},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1040000000000001,"15min":1.1060000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.434},"max":{"1min":1.643,"5min":1.716,"15min":2.0619999999999998},"last":0.93700000000000006}]},{"osd":6,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.127,"15min":1.149},"min":{"1min":0.59199999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":2.1659999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.1850000000000001,"15min":1.1910000000000001},"min":{"1min":0.54600000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.698,"5min":2.181,"15min":2.2080000000000002},"last":1.534}]}]},{"osd":6,"up_from":15,"seq":64424509807,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72804,"kb_used_data":15260,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299036,"statfs":{"total":96636764160,"available":96562212864,"internally_reserved":0,"allocated":15626240,"data_stored":15415703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.91300000000000003},"min":{"1min":0.629,"5min":0.312,"15min":0.312},"max":{"1min":1.4990000000000001,"5min":1.52,"15min":1.72},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.95499999999999996,"15min":0.95599999999999996},"min":{"1min":0.626,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5029999999999999,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.1120000000000001}]},{"osd":1,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.65700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.397,"5min":1.3999999999999999,"15min":1.887},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.111,"5min":0.98699999999999999,"15min":0.99099999999999999},"min":{"1min":0.71699999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.3899999999999999,"5min":3.73,"15min":3.73},"last":1.302}]},{"osd":2,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.95599999999999996,"15min":0.95899999999999996},"min":{"1min":0.69499999999999995,"5min":0.51600000000000001,"15min":0.498},"max":{"1min":1.3580000000000001,"5min":1.48,"15min":1.6459999999999999},"last":1.087},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.0069999999999999,"15min":1.044},"min":{"1min":0.66800000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.4970000000000001,"5min":1.964,"15min":1.964},"last":1.1579999999999999}]},{"osd":3,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.056,"15min":1.0469999999999999},"min":{"1min":0.77700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3400000000000001,"5min":1.7330000000000001,"15min":1.8759999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.105,"5min":1.0780000000000001,"15min":1.0629999999999999},"min":{"1min":0.80600000000000005,"5min":0.55400000000000005,"15min":0.42399999999999999},"max":{"1min":1.2949999999999999,"5min":3.9889999999999999,"15min":3.9889999999999999},"last":0.999}]},{"osd":4,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0269999999999999,"15min":1.0329999999999999},"min":{"1min":0.504,"5min":0.35099999999999998,"15min":0.318},"max":{"1min":1.413,"5min":1.7529999999999999,"15min":2.1030000000000002},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.1040000000000001,"15min":1.1000000000000001},"min":{"1min":0.68600000000000005,"5min":0.50700000000000001,"15min":0.38900000000000001},"max":{"1min":1.577,"5min":1.873,"15min":1.873},"last":1.2270000000000001}]},{"osd":5,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.70199999999999996,"5min":0.621,"15min":0.38600000000000001},"max":{"1min":1.6850000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.159,"15min":1.1699999999999999},"min":{"1min":0.61599999999999999,"5min":0.55000000000000004,"15min":0.35999999999999999},"max":{"1min":1.7789999999999999,"5min":2.194,"15min":2.3700000000000001},"last":1.3380000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1679999999999999,"15min":1.1910000000000001},"min":{"1min":0.73899999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.909,"5min":1.909,"15min":2.1379999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.198,"15min":1.2050000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.45300000000000001},"max":{"1min":1.855,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.1930000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509807,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62884,"kb_used_data":9500,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308956,"statfs":{"total":96636764160,"available":96572370944,"internally_reserved":0,"allocated":9728000,"data_stored":9504573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.88200000000000001,"15min":0.90700000000000003},"min":{"1min":0.55400000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2909999999999999,"5min":1.3899999999999999,"15min":1.494},"last":1.498},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.91300000000000003,"15min":0.94499999999999995},"min":{"1min":0.70599999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.496,"5min":1.5940000000000001,"15min":2.0600000000000001},"last":0.77100000000000002}]},{"osd":1,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.94599999999999995,"15min":0.91800000000000004},"min":{"1min":0.54500000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.4470000000000001,"5min":1.6419999999999999,"15min":1.79},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.91500000000000004,"15min":0.97199999999999998},"min":{"1min":0.76400000000000001,"5min":0.441,"15min":0.39700000000000002},"max":{"1min":1.391,"5min":1.474,"15min":1.794},"last":1.3859999999999999}]},{"osd":2,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.69099999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4059999999999999,"5min":1.504,"15min":2.1379999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.026,"15min":1.0149999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.41199999999999998},"max":{"1min":1.3500000000000001,"5min":1.53,"15min":1.6659999999999999},"last":0.96599999999999997}]},{"osd":3,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.0209999999999999,"15min":1.026},"min":{"1min":0.70599999999999996,"5min":0.60199999999999998,"15min":0.53700000000000003},"max":{"1min":1.2709999999999999,"5min":1.472,"15min":1.5960000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.0629999999999999,"15min":1.0940000000000001},"min":{"1min":0.78200000000000003,"5min":0.51600000000000001,"15min":0.38100000000000001},"max":{"1min":1.5449999999999999,"5min":1.766,"15min":2.2080000000000002},"last":1.0640000000000001}]},{"osd":4,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97099999999999997,"15min":0.98199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.42699999999999999},"max":{"1min":1.2729999999999999,"5min":1.849,"15min":1.9099999999999999},"last":1.131},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.077,"15min":1.089},"min":{"1min":0.64900000000000002,"5min":0.501,"15min":0.439},"max":{"1min":1.3080000000000001,"5min":1.585,"15min":2.4359999999999999},"last":1.1579999999999999}]},{"osd":6,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.054,"15min":1.081},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.32500000000000001},"max":{"1min":1.6240000000000001,"5min":1.6299999999999999,"15min":2.2909999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.105,"15min":1.115},"min":{"1min":0.60899999999999999,"5min":0.58999999999999997,"15min":0.36299999999999999},"max":{"1min":1.405,"5min":1.883,"15min":2.0019999999999998},"last":1.1890000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.147,"15min":1.171},"min":{"1min":0.74199999999999999,"5min":0.52000000000000002,"15min":0.50700000000000001},"max":{"1min":1.4850000000000001,"5min":1.6839999999999999,"15min":2.0209999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.1819999999999999,"15min":1.2230000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.41499999999999998},"max":{"1min":1.5860000000000001,"5min":1.732,"15min":2.2789999999999999},"last":1.448}]}]},{"osd":3,"up_from":15,"seq":64424509806,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60828,"kb_used_data":7444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311012,"statfs":{"total":96636764160,"available":96574476288,"internally_reserved":0,"allocated":7622656,"data_stored":7382745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,20,19],"upper_bound":512},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.52800000000000002,"5min":0.33700000000000002,"15min":0.309},"max":{"1min":1.052,"5min":1.458,"15min":1.458},"last":1.125},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.57299999999999995,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":1.353,"5min":1.3540000000000001,"15min":1.605},"last":1.018}]},{"osd":1,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84299999999999997,"15min":0.84499999999999997},"min":{"1min":0.52400000000000002,"5min":0.372,"15min":0.34899999999999998},"max":{"1min":1.2190000000000001,"5min":1.4510000000000001,"15min":1.7549999999999999},"last":1.593},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76100000000000001,"15min":0.77100000000000002},"min":{"1min":0.48999999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.93700000000000006,"5min":1.629,"15min":1.629},"last":0.58199999999999996}]},{"osd":2,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.99399999999999999,"15min":1.022},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.847},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.98599999999999999,"15min":1.014},"min":{"1min":0.627,"5min":0.36699999999999999,"15min":0.32900000000000001},"max":{"1min":1.5900000000000001,"5min":1.609,"15min":1.794},"last":1.6519999999999999}]},{"osd":4,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0509999999999999,"15min":1.0840000000000001},"min":{"1min":0.71699999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.522,"5min":1.613,"15min":2.0630000000000002},"last":1.744},{"interface":"front","average":{"1min":1.069,"5min":1.034,"15min":1.0569999999999999},"min":{"1min":0.81799999999999995,"5min":0.55500000000000005,"15min":0.439},"max":{"1min":1.2809999999999999,"5min":1.5900000000000001,"15min":1.968},"last":1.7150000000000001}]},{"osd":5,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.099,"15min":1.117},"min":{"1min":0.875,"5min":0.52700000000000002,"15min":0.45200000000000001},"max":{"1min":1.3839999999999999,"5min":1.7090000000000001,"15min":2.1709999999999998},"last":1.788},{"interface":"front","average":{"1min":1.097,"5min":1.1020000000000001,"15min":1.1100000000000001},"min":{"1min":0.79700000000000004,"5min":0.58299999999999996,"15min":0.54900000000000004},"max":{"1min":1.494,"5min":1.736,"15min":1.798},"last":0.54700000000000004}]},{"osd":6,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.115,"15min":1.155},"min":{"1min":0.83399999999999996,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":1.46,"5min":1.5680000000000001,"15min":1.927},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.147,"15min":1.1539999999999999},"min":{"1min":0.70799999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.383,"5min":1.8600000000000001,"15min":1.929},"last":0.50900000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1970000000000001,"15min":1.214},"min":{"1min":0.96499999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.5189999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.2450000000000001,"15min":1.2609999999999999},"min":{"1min":0.85199999999999998,"5min":0.61599999999999999,"15min":0.60299999999999998},"max":{"1min":1.5780000000000001,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.7669999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509806,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36000,"kb_used_data":4824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335840,"statfs":{"total":96636764160,"available":96599900160,"internally_reserved":0,"allocated":4939776,"data_stored":4726754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.72199999999999998,"15min":0.73999999999999999},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.24299999999999999},"max":{"1min":0.98899999999999999,"5min":1.405,"15min":2.04},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.28999999999999998,"15min":0.27300000000000002},"max":{"1min":1.2410000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.78900000000000003}]},{"osd":1,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.85399999999999998,"15min":0.86699999999999999},"min":{"1min":0.48799999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.3029999999999999,"5min":1.5129999999999999,"15min":1.978},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.84899999999999998,"15min":0.88600000000000001},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":1.3320000000000001,"5min":1.552,"15min":1.919},"last":0.60699999999999998}]},{"osd":3,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.83999999999999997,"15min":0.83499999999999996},"min":{"1min":0.54000000000000004,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.377,"5min":1.7090000000000001,"15min":1.8740000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0229999999999999,"15min":1.018},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.309},"max":{"1min":1.3540000000000001,"5min":1.7809999999999999,"15min":2.0960000000000001},"last":0.89400000000000002}]},{"osd":4,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0960000000000001,"15min":1.115},"min":{"1min":0.77900000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.4630000000000001,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.1399999999999999,"15min":1.1659999999999999},"min":{"1min":0.69399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6080000000000001,"5min":2.161,"15min":2.161},"last":1.1060000000000001}]},{"osd":5,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1539999999999999,"15min":1.1899999999999999},"min":{"1min":0.76200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.492,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.141},"min":{"1min":0.79800000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4370000000000001,"5min":1.7390000000000001,"15min":1.8009999999999999},"last":0.997}]},{"osd":6,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.163,"15min":1.173},"min":{"1min":0.78700000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.482,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.155},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.264,"15min":1.2589999999999999},"min":{"1min":0.72699999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.794,"5min":1.994,"15min":2.1800000000000002},"last":1.3420000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.248,"15min":1.286},"min":{"1min":0.84199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.645,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2310000000000001,"15min":1.254},"min":{"1min":0.95199999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.536,"5min":1.96,"15min":1.992},"last":1.244}]}]},{"osd":1,"up_from":15,"seq":64424509805,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":966656,"data_stored":748254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.45500000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":1.341,"5min":1.359,"15min":1.4330000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.47199999999999998,"5min":0.318,"15min":0.318},"max":{"1min":1.329,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.91000000000000003}]},{"osd":2,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.99399999999999999,"5min":1.6859999999999999,"15min":1.706},"last":0.626},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90600000000000003,"15min":0.91500000000000004},"min":{"1min":0.52000000000000002,"5min":0.41599999999999998,"15min":0.35099999999999998},"max":{"1min":1.4550000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.875}]},{"osd":3,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.96299999999999997,"15min":0.98199999999999998},"min":{"1min":0.51400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.5660000000000001,"5min":1.7170000000000001,"15min":1.881},"last":1.03},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.94599999999999995,"15min":0.95899999999999996},"min":{"1min":0.68300000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4419999999999999,"5min":1.6519999999999999,"15min":1.73},"last":0.79700000000000004}]},{"osd":4,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.77000000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.867},"last":1.081},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.171,"15min":1.1839999999999999},"min":{"1min":0.76900000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5249999999999999,"5min":1.716,"15min":1.9039999999999999},"last":1.163}]},{"osd":5,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1539999999999999,"15min":1.165},"min":{"1min":0.88700000000000001,"5min":0.54000000000000004,"15min":0.53200000000000003},"max":{"1min":1.4410000000000001,"5min":1.8660000000000001,"15min":2.0230000000000001},"last":1.137},{"interface":"front","average":{"1min":1.163,"5min":1.1200000000000001,"15min":1.1379999999999999},"min":{"1min":0.85299999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.639,"5min":1.6819999999999999,"15min":1.8400000000000001},"last":1.2050000000000001}]},{"osd":6,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.274,"15min":1.2709999999999999},"min":{"1min":0.84899999999999998,"5min":0.64200000000000002,"15min":0.59999999999999998},"max":{"1min":1.5920000000000001,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.2070000000000001,"15min":1.24},"min":{"1min":0.75,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5840000000000001,"5min":1.8819999999999999,"15min":2.0600000000000001},"last":0.96999999999999997}]},{"osd":7,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2589999999999999,"15min":1.292},"min":{"1min":0.85199999999999998,"5min":0.79800000000000004,"15min":0.73499999999999999},"max":{"1min":1.5309999999999999,"5min":1.9530000000000001,"15min":2.1389999999999998},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.22,"15min":1.2490000000000001},"min":{"1min":0.83299999999999996,"5min":0.66000000000000003,"15min":0.65400000000000003},"max":{"1min":1.7769999999999999,"5min":1.806,"15min":1.988},"last":1.2969999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509805,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60764,"kb_used_data":7380,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311076,"statfs":{"total":96636764160,"available":96574541824,"internally_reserved":0,"allocated":7557120,"data_stored":7321877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71099999999999997,"15min":0.745},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0680000000000001,"5min":1.4750000000000001,"15min":1.7370000000000001},"last":0.628},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.29799999999999999},"max":{"1min":1.1220000000000001,"5min":1.536,"15min":1.8560000000000001},"last":1.0589999999999999}]},{"osd":2,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.85999999999999999,"15min":0.878},"min":{"1min":0.432,"5min":0.43099999999999999,"15min":0.29199999999999998},"max":{"1min":1.2569999999999999,"5min":1.3720000000000001,"15min":1.7190000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.89900000000000002,"15min":0.91000000000000003},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.317},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.8959999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90200000000000002,"15min":0.89200000000000002},"min":{"1min":0.33700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3979999999999999,"5min":1.756,"15min":1.869},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.034,"15min":1.0189999999999999},"min":{"1min":0.51700000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3600000000000001,"5min":1.6180000000000001,"15min":1.9259999999999999},"last":0.97599999999999998}]},{"osd":4,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.022,"15min":1.0189999999999999},"min":{"1min":0.57599999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.458,"5min":1.5529999999999999,"15min":1.9610000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.129,"15min":1.1220000000000001},"min":{"1min":0.74099999999999999,"5min":0.57999999999999996,"15min":0.47899999999999998},"max":{"1min":1.5860000000000001,"5min":2.101,"15min":2.101},"last":1.095}]},{"osd":5,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1319999999999999,"15min":1.1659999999999999},"min":{"1min":0.81000000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.667,"5min":1.667,"15min":2.1669999999999998},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.0840000000000001,"15min":1.0980000000000001},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4490000000000001,"5min":1.728,"15min":2.1280000000000001},"last":1.123}]},{"osd":6,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.177,"15min":1.2110000000000001},"min":{"1min":0.71199999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.637,"5min":1.9910000000000001,"15min":2.101},"last":1.153},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.212,"15min":1.2370000000000001},"min":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.718,"5min":1.831,"15min":2.2480000000000002},"last":1.2549999999999999}]},{"osd":7,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.272,"15min":1.292},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.764,"5min":1.792,"15min":2.2410000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.2130000000000001,"15min":1.1970000000000001},"min":{"1min":0.83499999999999996,"5min":0.64400000000000002,"15min":0.60099999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.2130000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542510,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35648,"kb_used_data":4472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336192,"statfs":{"total":96636764160,"available":96600260608,"internally_reserved":0,"allocated":4579328,"data_stored":4332954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.88400000000000001,"15min":0.90300000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2609999999999999,"5min":1.544,"15min":1.544},"last":1.196},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.877,"15min":0.90700000000000003},"min":{"1min":0.48499999999999999,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":1.319,"5min":1.4179999999999999,"15min":1.6319999999999999},"last":0.68899999999999995}]},{"osd":1,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.90900000000000003,"15min":0.92800000000000005},"min":{"1min":0.61899999999999999,"5min":0.498,"15min":0.45000000000000001},"max":{"1min":1.369,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3140000000000001,"5min":1.454,"15min":1.7689999999999999},"last":0.90000000000000002}]},{"osd":2,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":1.282,"5min":1.613,"15min":1.708},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.99299999999999999,"15min":1.02},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.456,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":1.29}]},{"osd":3,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.97799999999999998,"15min":1.002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.44500000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":2.2370000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.125,"15min":1.1100000000000001},"min":{"1min":0.81699999999999995,"5min":0.628,"15min":0.59499999999999997},"max":{"1min":1.4570000000000001,"5min":1.752,"15min":1.8220000000000001},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.98299999999999998,"15min":1.012},"min":{"1min":0.60899999999999999,"5min":0.41199999999999998,"15min":0.38500000000000001},"max":{"1min":1.593,"5min":1.6779999999999999,"15min":2.016},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.99399999999999999,"15min":1.024},"min":{"1min":0.55600000000000005,"5min":0.39800000000000002,"15min":0.34300000000000003},"max":{"1min":1.5529999999999999,"5min":1.659,"15min":1.821},"last":1.0309999999999999}]},{"osd":6,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0589999999999999,"15min":1.071},"min":{"1min":0.67100000000000004,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":1.3640000000000001,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.135,"5min":1.181,"15min":1.1990000000000001},"min":{"1min":0.59999999999999998,"5min":0.497,"15min":0.44500000000000001},"max":{"1min":1.694,"5min":1.788,"15min":2.1230000000000002},"last":1.377}]},{"osd":7,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.1359999999999999,"15min":1.145},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.379},"max":{"1min":1.653,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.246,"15min":1.2529999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.544,"5min":1.996,"15min":2.1160000000000001},"last":1.3460000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7225344,"data_stored":7185737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":21746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4608000,"data_stored":4590614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7290880,"data_stored":7246605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4247552,"data_stored":4196814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8802304,"data_stored":8778065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15294464,"data_stored":15279563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":44892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T21:28:51.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T21:28:51.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.962+0000 7faca1908640 1 Processor -- start 2023-11-18T21:28:51.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.966+0000 7faca1908640 1 -- start start 2023-11-18T21:28:51.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.966+0000 7faca1908640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac9c1505d0 0x7fac9c15a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:51.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.966+0000 7faca1908640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac9c0c6c50 0x7fac9c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:51.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.966+0000 7faca1908640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9c0c27d0 con 0x7fac9c1501f0 2023-11-18T21:28:51.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.966+0000 7faca1908640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9c0c3270 con 0x7fac9c0c6c50 2023-11-18T21:28:51.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.966+0000 7faca1908640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c0c25e0 con 0x7fac9c1505d0 2023-11-18T21:28:51.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.966+0000 7fac9b7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac9c0c6c50 0x7fac9c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:51.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.966+0000 7fac9b7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fac9c0c6c50 0x7fac9c1560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40602/0 (socket says 172.21.15.49:40602) 2023-11-18T21:28:51.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.966+0000 7fac9b7fe640 1 -- 172.21.15.49:0/1040720876 learned_addr learned my addr 172.21.15.49:0/1040720876 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:51.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.970+0000 7fac9b7fe640 1 -- 172.21.15.49:0/1040720876 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac9c1505d0 msgr2=0x7fac9c15a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:51.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.970+0000 7fac9b7fe640 1 --2- 172.21.15.49:0/1040720876 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac9c1505d0 0x7fac9c15a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:51.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.970+0000 7fac9b7fe640 1 -- 172.21.15.49:0/1040720876 >> v1:172.21.15.106:6789/0 conn(0x7fac9c1501f0 legacy=0x7fac9c0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:51.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.970+0000 7fac9b7fe640 1 -- 172.21.15.49:0/1040720876 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c0c2ab0 con 0x7fac9c0c6c50 2023-11-18T21:28:51.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.974+0000 7fac9b7fe640 1 --2- 172.21.15.49:0/1040720876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac9c0c6c50 0x7fac9c1560c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fac94009870 tx=0x7fac9401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3330f5f4da042fa1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:51.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.978+0000 7fac99ffb640 1 -- 172.21.15.49:0/1040720876 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac940aa670 con 0x7fac9c0c6c50 2023-11-18T21:28:51.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.978+0000 7fac99ffb640 1 -- 172.21.15.49:0/1040720876 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac940aa7d0 con 0x7fac9c0c6c50 2023-11-18T21:28:51.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.978+0000 7fac99ffb640 1 -- 172.21.15.49:0/1040720876 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac940aab60 con 0x7fac9c0c6c50 2023-11-18T21:28:51.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.978+0000 7faca1908640 1 -- 172.21.15.49:0/1040720876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac9c0c6c50 msgr2=0x7fac9c1560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:51.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.978+0000 7faca1908640 1 --2- 172.21.15.49:0/1040720876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac9c0c6c50 0x7fac9c1560c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fac94009870 tx=0x7fac9401c510 comp rx=0 tx=0).stop 2023-11-18T21:28:51.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.978+0000 7faca1908640 1 -- 172.21.15.49:0/1040720876 shutdown_connections 2023-11-18T21:28:51.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.978+0000 7faca1908640 1 --2- 172.21.15.49:0/1040720876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac9c0c6c50 0x7fac9c1560c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:51.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.978+0000 7faca1908640 1 --2- 172.21.15.49:0/1040720876 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac9c1505d0 0x7fac9c15a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:51.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.978+0000 7faca1908640 1 -- 172.21.15.49:0/1040720876 >> 172.21.15.49:0/1040720876 conn(0x7fac9c06c6a0 msgr2=0x7fac9c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:51.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.978+0000 7faca1908640 1 -- 172.21.15.49:0/1040720876 shutdown_connections 2023-11-18T21:28:51.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.978+0000 7faca1908640 1 -- 172.21.15.49:0/1040720876 wait complete. 2023-11-18T21:28:51.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.982+0000 7faca1908640 1 Processor -- start 2023-11-18T21:28:51.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.982+0000 7faca1908640 1 -- start start 2023-11-18T21:28:51.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.982+0000 7faca1908640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac9c0c6c50 0x7fac9c071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:51.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.982+0000 7faca1908640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac9c1501f0 0x7fac9c154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:51.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.982+0000 7faca1908640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac9c1505d0 0x7fac9c154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:51.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.982+0000 7faca1908640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c1ef080 con 0x7fac9c1501f0 2023-11-18T21:28:51.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.982+0000 7faca1908640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c1ee190 con 0x7fac9c1505d0 2023-11-18T21:28:51.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.982+0000 7faca1908640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c1ee470 con 0x7fac9c0c6c50 2023-11-18T21:28:51.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.982+0000 7fac9a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac9c1501f0 0x7fac9c154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:51.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.982+0000 7fac9a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac9c1501f0 0x7fac9c154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40618/0 (socket says 172.21.15.49:40618) 2023-11-18T21:28:51.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.982+0000 7fac9a7fc640 1 -- 172.21.15.49:0/577724654 learned_addr learned my addr 172.21.15.49:0/577724654 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:51.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.982+0000 7fac9b7fe640 1 --2- 172.21.15.49:0/577724654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac9c1505d0 0x7fac9c154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:51.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.982+0000 7fac9affd640 1 --2- 172.21.15.49:0/577724654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac9c0c6c50 0x7fac9c071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:51.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.986+0000 7fac9a7fc640 1 -- 172.21.15.49:0/577724654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac9c0c6c50 msgr2=0x7fac9c071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:51.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.986+0000 7fac9a7fc640 1 --2- 172.21.15.49:0/577724654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac9c0c6c50 0x7fac9c071d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:51.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.986+0000 7fac9a7fc640 1 -- 172.21.15.49:0/577724654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac9c1505d0 msgr2=0x7fac9c154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:51.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.986+0000 7fac9a7fc640 1 --2- 172.21.15.49:0/577724654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac9c1505d0 0x7fac9c154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:51.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.986+0000 7fac9a7fc640 1 -- 172.21.15.49:0/577724654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac940094d0 con 0x7fac9c1501f0 2023-11-18T21:28:51.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.990+0000 7fac9a7fc640 1 --2- 172.21.15.49:0/577724654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac9c1501f0 0x7fac9c154210 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fac8400b410 tx=0x7fac8400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:51.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.994+0000 7fac93fff640 1 -- 172.21.15.49:0/577724654 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84011830 con 0x7fac9c1501f0 2023-11-18T21:28:51.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.994+0000 7fac93fff640 1 -- 172.21.15.49:0/577724654 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac84011990 con 0x7fac9c1501f0 2023-11-18T21:28:51.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.994+0000 7fac93fff640 1 -- 172.21.15.49:0/577724654 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84011d40 con 0x7fac9c1501f0 2023-11-18T21:28:51.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.994+0000 7faca1908640 1 -- 172.21.15.49:0/577724654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9c1ee750 con 0x7fac9c1501f0 2023-11-18T21:28:51.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.994+0000 7faca1908640 1 -- 172.21.15.49:0/577724654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9c1eed10 con 0x7fac9c1501f0 2023-11-18T21:28:51.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:51.994+0000 7faca1908640 1 -- 172.21.15.49:0/577724654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9c0c18a0 con 0x7fac9c1501f0 2023-11-18T21:28:52.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.018+0000 7fac93fff640 1 -- 172.21.15.49:0/577724654 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fac8401a400 con 0x7fac9c1501f0 2023-11-18T21:28:52.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.018+0000 7fac93fff640 1 --2- 172.21.15.49:0/577724654 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fac7c0664c0 0x7fac7c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:52.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.018+0000 7fac9affd640 1 --2- 172.21.15.49:0/577724654 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fac7c0664c0 0x7fac7c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:52.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.018+0000 7fac9affd640 1 --2- 172.21.15.49:0/577724654 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fac7c0664c0 0x7fac7c068980 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0012f0 tx=0x7fac8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:52.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.306+0000 7fac93fff640 1 -- 172.21.15.49:0/577724654 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fac84025e20 con 0x7fac9c1501f0 2023-11-18T21:28:52.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.306+0000 7fac93fff640 1 -- 172.21.15.49:0/577724654 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fac840519e0 con 0x7fac9c1501f0 2023-11-18T21:28:52.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.482+0000 7faca1908640 1 -- 172.21.15.49:0/577724654 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac9c156ff0 con 0x7fac9c1501f0 2023-11-18T21:28:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.574+0000 7fac93fff640 1 -- 172.21.15.49:0/577724654 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18408 (secure 0 0 0) 0x7fac84015020 con 0x7fac9c1501f0 2023-11-18T21:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":31,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T21:00:28.529922+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T21:28:52.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.578+0000 7faca1908640 1 -- 172.21.15.49:0/577724654 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fac7c0664c0 msgr2=0x7fac7c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.578+0000 7faca1908640 1 --2- 172.21.15.49:0/577724654 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fac7c0664c0 0x7fac7c068980 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0012f0 tx=0x7fac8c009040 comp rx=0 tx=0).stop 2023-11-18T21:28:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.578+0000 7faca1908640 1 -- 172.21.15.49:0/577724654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac9c1501f0 msgr2=0x7fac9c154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.578+0000 7faca1908640 1 --2- 172.21.15.49:0/577724654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac9c1501f0 0x7fac9c154210 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fac8400b410 tx=0x7fac8400b8d0 comp rx=0 tx=0).stop 2023-11-18T21:28:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.582+0000 7faca1908640 1 -- 172.21.15.49:0/577724654 shutdown_connections 2023-11-18T21:28:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.582+0000 7faca1908640 1 --2- 172.21.15.49:0/577724654 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fac7c0664c0 0x7fac7c068980 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.582+0000 7faca1908640 1 --2- 172.21.15.49:0/577724654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac9c1505d0 0x7fac9c154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.582+0000 7faca1908640 1 --2- 172.21.15.49:0/577724654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac9c1501f0 0x7fac9c154210 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.582+0000 7faca1908640 1 --2- 172.21.15.49:0/577724654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac9c0c6c50 0x7fac9c071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.582+0000 7faca1908640 1 -- 172.21.15.49:0/577724654 >> 172.21.15.49:0/577724654 conn(0x7fac9c06c6a0 msgr2=0x7fac9c0c50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.582+0000 7faca1908640 1 -- 172.21.15.49:0/577724654 shutdown_connections 2023-11-18T21:28:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:52.582+0000 7faca1908640 1 -- 172.21.15.49:0/577724654 wait complete. 2023-11-18T21:28:53.608 INFO:tasks.ceph:Scrubbing osd.0 2023-11-18T21:28:53.608 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-18T21:28:53.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.746+0000 7f1ec4183640 1 Processor -- start 2023-11-18T21:28:53.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.746+0000 7f1ec4183640 1 -- start start 2023-11-18T21:28:53.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.746+0000 7f1ec4183640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ebc14fc10 0x7f1ebc1559e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:53.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.746+0000 7f1ec4183640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1ebc0c6960 0x7f1ebc06b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:53.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.746+0000 7f1ec4183640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ebc06afb0 con 0x7f1ebc0c6540 2023-11-18T21:28:53.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.746+0000 7f1ec4183640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ebc06b980 con 0x7f1ebc0c6960 2023-11-18T21:28:53.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.746+0000 7f1ec4183640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc0c6ed0 con 0x7f1ebc14fc10 2023-11-18T21:28:53.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.794+0000 7f1ec2720640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1ebc0c6960 0x7f1ebc06b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:53.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.798+0000 7f1ec2720640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1ebc0c6960 0x7f1ebc06b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40632/0 (socket says 172.21.15.49:40632) 2023-11-18T21:28:53.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.798+0000 7f1ec2720640 1 -- 172.21.15.49:0/3946032808 learned_addr learned my addr 172.21.15.49:0/3946032808 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:53.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.802+0000 7f1ec2720640 1 -- 172.21.15.49:0/3946032808 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ebc14fc10 msgr2=0x7f1ebc1559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:53.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.802+0000 7f1ec2720640 1 --2- 172.21.15.49:0/3946032808 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ebc14fc10 0x7f1ebc1559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:53.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.802+0000 7f1ec2720640 1 -- 172.21.15.49:0/3946032808 >> v1:172.21.15.106:6789/0 conn(0x7f1ebc0c6540 legacy=0x7f1ebc0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:53.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.802+0000 7f1ec2720640 1 -- 172.21.15.49:0/3946032808 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ebc0c7170 con 0x7f1ebc0c6960 2023-11-18T21:28:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.810+0000 7f1ec2720640 1 --2- 172.21.15.49:0/3946032808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ebc0c6960 0x7f1ebc06b440 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4009e50 tx=0x7f1eb401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bca37c522fe9e29 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.818+0000 7f1ec0f1d640 1 -- 172.21.15.49:0/3946032808 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb40af400 con 0x7f1ebc0c6960 2023-11-18T21:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.818+0000 7f1ec0f1d640 1 -- 172.21.15.49:0/3946032808 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb40ab050 con 0x7f1ebc0c6960 2023-11-18T21:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.818+0000 7f1ec0f1d640 1 -- 172.21.15.49:0/3946032808 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb40af780 con 0x7f1ebc0c6960 2023-11-18T21:28:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.818+0000 7f1ec4183640 1 -- 172.21.15.49:0/3946032808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ebc0c6960 msgr2=0x7f1ebc06b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:53.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.818+0000 7f1ec4183640 1 --2- 172.21.15.49:0/3946032808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ebc0c6960 0x7f1ebc06b440 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4009e50 tx=0x7f1eb401f1c0 comp rx=0 tx=0).stop 2023-11-18T21:28:53.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.818+0000 7f1ec4183640 1 -- 172.21.15.49:0/3946032808 shutdown_connections 2023-11-18T21:28:53.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.818+0000 7f1ec4183640 1 --2- 172.21.15.49:0/3946032808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ebc0c6960 0x7f1ebc06b440 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:53.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.818+0000 7f1ec4183640 1 --2- 172.21.15.49:0/3946032808 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ebc14fc10 0x7f1ebc1559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:53.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.818+0000 7f1ec4183640 1 -- 172.21.15.49:0/3946032808 >> 172.21.15.49:0/3946032808 conn(0x7f1ebc06d220 msgr2=0x7f1ebc06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:53.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.818+0000 7f1ec4183640 1 -- 172.21.15.49:0/3946032808 shutdown_connections 2023-11-18T21:28:53.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.818+0000 7f1ec4183640 1 -- 172.21.15.49:0/3946032808 wait complete. 2023-11-18T21:28:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.822+0000 7f1ec4183640 1 Processor -- start 2023-11-18T21:28:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.822+0000 7f1ec4183640 1 -- start start 2023-11-18T21:28:53.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.822+0000 7f1ec4183640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ebc0c6960 0x7f1ebc1f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:53.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.822+0000 7f1ec4183640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ebc14fc10 0x7f1ebc14e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:53.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.822+0000 7f1ec4183640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ebc14aa10 0x7f1ebc1edfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:53.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.822+0000 7f1ec4183640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc154500 con 0x7f1ebc14fc10 2023-11-18T21:28:53.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.822+0000 7f1ec4183640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc1e72c0 con 0x7f1ebc0c6960 2023-11-18T21:28:53.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.822+0000 7f1ec4183640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc14b310 con 0x7f1ebc14aa10 2023-11-18T21:28:53.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.822+0000 7f1ec171e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ebc14fc10 0x7f1ebc14e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:53.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.822+0000 7f1ec171e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ebc14fc10 0x7f1ebc14e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40636/0 (socket says 172.21.15.49:40636) 2023-11-18T21:28:53.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.822+0000 7f1ec171e640 1 -- 172.21.15.49:0/2654652963 learned_addr learned my addr 172.21.15.49:0/2654652963 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:53.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.830+0000 7f1ec1f1f640 1 --2- 172.21.15.49:0/2654652963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ebc0c6960 0x7f1ebc1f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:53.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.830+0000 7f1ec171e640 1 -- 172.21.15.49:0/2654652963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ebc14aa10 msgr2=0x7f1ebc1edfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:53.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.830+0000 7f1ec171e640 1 --2- 172.21.15.49:0/2654652963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ebc14aa10 0x7f1ebc1edfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:53.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.830+0000 7f1ec171e640 1 -- 172.21.15.49:0/2654652963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ebc0c6960 msgr2=0x7f1ebc1f0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:53.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.830+0000 7f1ec171e640 1 --2- 172.21.15.49:0/2654652963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ebc0c6960 0x7f1ebc1f0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:53.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.830+0000 7f1ec171e640 1 -- 172.21.15.49:0/2654652963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb4009b30 con 0x7f1ebc14fc10 2023-11-18T21:28:53.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.834+0000 7f1ec171e640 1 --2- 172.21.15.49:0/2654652963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ebc14fc10 0x7f1ebc14e5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800c490 tx=0x7f1eb8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.842+0000 7f1eb27fc640 1 -- 172.21.15.49:0/2654652963 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8003600 con 0x7f1ebc14fc10 2023-11-18T21:28:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.842+0000 7f1eb27fc640 1 -- 172.21.15.49:0/2654652963 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb8003780 con 0x7f1ebc14fc10 2023-11-18T21:28:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.842+0000 7f1eb27fc640 1 -- 172.21.15.49:0/2654652963 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8003b70 con 0x7f1ebc14fc10 2023-11-18T21:28:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.842+0000 7f1ec4183640 1 -- 172.21.15.49:0/2654652963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ebc1f0f90 con 0x7f1ebc14fc10 2023-11-18T21:28:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.842+0000 7f1ec4183640 1 -- 172.21.15.49:0/2654652963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ebc1e6500 con 0x7f1ebc14fc10 2023-11-18T21:28:53.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.842+0000 7f1ec4183640 1 -- 172.21.15.49:0/2654652963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ebc0c2e90 con 0x7f1ebc14fc10 2023-11-18T21:28:53.873 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.874+0000 7f1eb27fc640 1 -- 172.21.15.49:0/2654652963 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1eb8003cd0 con 0x7f1ebc14fc10 2023-11-18T21:28:53.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.874+0000 7f1eb27fc640 1 --2- 172.21.15.49:0/2654652963 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1ea00664c0 0x7f1ea0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:53.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.874+0000 7f1ec1f1f640 1 --2- 172.21.15.49:0/2654652963 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1ea00664c0 0x7f1ea0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:53.876 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.874+0000 7f1ec1f1f640 1 --2- 172.21.15.49:0/2654652963 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1ea00664c0 0x7f1ea0068980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1eac006fd0 tx=0x7f1eac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:53.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.878+0000 7f1eb27fc640 1 -- 172.21.15.49:0/2654652963 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f1eb8055400 con 0x7f1ebc14fc10 2023-11-18T21:28:53.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.878+0000 7f1eb27fc640 1 --2- 172.21.15.49:0/2654652963 >> [v2:172.21.15.49:6800/53487446,v1:172.21.15.49:6801/53487446] conn(0x7f1ea006fac0 0x7f1ea0071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:53.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.878+0000 7f1eb27fc640 1 -- 172.21.15.49:0/2654652963 --> [v2:172.21.15.49:6800/53487446,v1:172.21.15.49:6801/53487446] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ea0072610 con 0x7f1ea006fac0 2023-11-18T21:28:53.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.878+0000 7f1eb27fc640 1 -- 172.21.15.49:0/2654652963 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1eb8001170 con 0x7f1ebc14fc10 2023-11-18T21:28:53.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.878+0000 7f1ec2720640 1 --2- 172.21.15.49:0/2654652963 >> [v2:172.21.15.49:6800/53487446,v1:172.21.15.49:6801/53487446] conn(0x7f1ea006fac0 0x7f1ea0071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.878+0000 7f1ec2720640 1 --2- 172.21.15.49:0/2654652963 >> [v2:172.21.15.49:6800/53487446,v1:172.21.15.49:6801/53487446] conn(0x7f1ea006fac0 0x7f1ea0071f40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:53.881 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.882+0000 7f1eb27fc640 1 -- 172.21.15.49:0/2654652963 <== osd.0 v2:172.21.15.49:6800/53487446 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1ea0072610 con 0x7f1ea006fac0 2023-11-18T21:28:53.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.894+0000 7f1ec4183640 1 -- 172.21.15.49:0/2654652963 --> [v2:172.21.15.49:6800/53487446,v1:172.21.15.49:6801/53487446] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1ebc0c2bb0 con 0x7f1ea006fac0 2023-11-18T21:28:53.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.894+0000 7f1eb27fc640 1 -- 172.21.15.49:0/2654652963 <== osd.0 v2:172.21.15.49:6800/53487446 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1eb40af400 con 0x7f1ea006fac0 2023-11-18T21:28:53.897 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T21:28:53.897 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T21:28:53.897 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T21:28:53.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.894+0000 7f1ec4183640 1 -- 172.21.15.49:0/2654652963 >> [v2:172.21.15.49:6800/53487446,v1:172.21.15.49:6801/53487446] conn(0x7f1ea006fac0 msgr2=0x7f1ea0071f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:53.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.894+0000 7f1ec4183640 1 --2- 172.21.15.49:0/2654652963 >> [v2:172.21.15.49:6800/53487446,v1:172.21.15.49:6801/53487446] conn(0x7f1ea006fac0 0x7f1ea0071f40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:53.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.894+0000 7f1ec4183640 1 -- 172.21.15.49:0/2654652963 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1ea00664c0 msgr2=0x7f1ea0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:53.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.894+0000 7f1ec4183640 1 --2- 172.21.15.49:0/2654652963 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f1ea00664c0 0x7f1ea0068980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1eac006fd0 tx=0x7f1eac008040 comp rx=0 tx=0).stop 2023-11-18T21:28:53.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.894+0000 7f1ec4183640 1 -- 172.21.15.49:0/2654652963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ebc14fc10 msgr2=0x7f1ebc14e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:53.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.894+0000 7f1ec4183640 1 --2- 172.21.15.49:0/2654652963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ebc14fc10 0x7f1ebc14e5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800c490 tx=0x7f1eb8001e80 comp rx=0 tx=0).stop 2023-11-18T21:28:53.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.894+0000 7f1ec2720640 1 -- 172.21.15.49:0/2654652963 reap_dead start 2023-11-18T21:28:53.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.898+0000 7f1ec4183640 1 -- 172.21.15.49:0/2654652963 shutdown_connections 2023-11-18T21:28:53.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.898+0000 7f1ec4183640 1 -- 172.21.15.49:0/2654652963 >> 172.21.15.49:0/2654652963 conn(0x7f1ebc06d220 msgr2=0x7f1ebc0c9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:53.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.898+0000 7f1ec4183640 1 -- 172.21.15.49:0/2654652963 shutdown_connections 2023-11-18T21:28:53.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:53.898+0000 7f1ec4183640 1 -- 172.21.15.49:0/2654652963 wait complete. 2023-11-18T21:28:53.916 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-18T21:28:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.042+0000 7fcf36276640 1 Processor -- start 2023-11-18T21:28:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.042+0000 7fcf36276640 1 -- start start 2023-11-18T21:28:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.042+0000 7fcf36276640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf3015c1c0 0x7fcf30159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.042+0000 7fcf36276640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3015a4a0 con 0x7fcf3015b620 2023-11-18T21:28:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.042+0000 7fcf36276640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3006d560 con 0x7fcf3015c5a0 2023-11-18T21:28:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.042+0000 7fcf36276640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3006cc00 con 0x7fcf3015c1c0 2023-11-18T21:28:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.042+0000 7fcf2ffff640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcf3015c1c0 0x7fcf30159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.042+0000 7fcf34813640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcf3015b620 0x7fcf300cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55486/0 (socket says 172.21.15.49:55486) 2023-11-18T21:28:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.042+0000 7fcf34813640 1 -- 172.21.15.49:0/1075793714 learned_addr learned my addr 172.21.15.49:0/1075793714 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.046+0000 7fcf2ffff640 1 -- 172.21.15.49:0/1075793714 >> v1:172.21.15.106:6789/0 conn(0x7fcf3015c5a0 legacy=0x7fcf3015af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.046+0000 7fcf2ffff640 1 -- 172.21.15.49:0/1075793714 >> v1:172.21.15.49:6789/0 conn(0x7fcf3015b620 legacy=0x7fcf300cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.046+0000 7fcf2ffff640 1 -- 172.21.15.49:0/1075793714 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3006c680 con 0x7fcf3015c1c0 2023-11-18T21:28:54.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.054+0000 7fcf2ffff640 1 --2- 172.21.15.49:0/1075793714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf3015c1c0 0x7fcf30159f60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcf280097c0 tx=0x7fcf2801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2df4ef0f9f4e955 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:54.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.058+0000 7fcf2effd640 1 -- 172.21.15.49:0/1075793714 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf280ab650 con 0x7fcf3015c1c0 2023-11-18T21:28:54.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.058+0000 7fcf2effd640 1 -- 172.21.15.49:0/1075793714 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf280ab7b0 con 0x7fcf3015c1c0 2023-11-18T21:28:54.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.058+0000 7fcf2effd640 1 -- 172.21.15.49:0/1075793714 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf280abb40 con 0x7fcf3015c1c0 2023-11-18T21:28:54.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.058+0000 7fcf36276640 1 -- 172.21.15.49:0/1075793714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf3015c1c0 msgr2=0x7fcf30159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.058+0000 7fcf36276640 1 --2- 172.21.15.49:0/1075793714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf3015c1c0 0x7fcf30159f60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcf280097c0 tx=0x7fcf2801c450 comp rx=0 tx=0).stop 2023-11-18T21:28:54.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.058+0000 7fcf36276640 1 -- 172.21.15.49:0/1075793714 shutdown_connections 2023-11-18T21:28:54.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.058+0000 7fcf36276640 1 --2- 172.21.15.49:0/1075793714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf3015c1c0 0x7fcf30159f60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.058+0000 7fcf36276640 1 -- 172.21.15.49:0/1075793714 >> 172.21.15.49:0/1075793714 conn(0x7fcf30060fd0 msgr2=0x7fcf300613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:54.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.058+0000 7fcf36276640 1 -- 172.21.15.49:0/1075793714 shutdown_connections 2023-11-18T21:28:54.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.062+0000 7fcf36276640 1 -- 172.21.15.49:0/1075793714 wait complete. 2023-11-18T21:28:54.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.062+0000 7fcf36276640 1 Processor -- start 2023-11-18T21:28:54.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.062+0000 7fcf36276640 1 -- start start 2023-11-18T21:28:54.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.062+0000 7fcf36276640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3015b620 0x7fcf3014fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.062+0000 7fcf36276640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3015c1c0 0x7fcf300c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.062+0000 7fcf36276640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf3015c5a0 0x7fcf300bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.062+0000 7fcf36276640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300c83d0 con 0x7fcf3015c5a0 2023-11-18T21:28:54.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.062+0000 7fcf36276640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30150490 con 0x7fcf3015c1c0 2023-11-18T21:28:54.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.062+0000 7fcf36276640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30150770 con 0x7fcf3015b620 2023-11-18T21:28:54.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.062+0000 7fcf34813640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf3015c5a0 0x7fcf300bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.062+0000 7fcf34813640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf3015c5a0 0x7fcf300bf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40652/0 (socket says 172.21.15.49:40652) 2023-11-18T21:28:54.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.062+0000 7fcf34813640 1 -- 172.21.15.49:0/3943969375 learned_addr learned my addr 172.21.15.49:0/3943969375 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:54.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.062+0000 7fcf2f7fe640 1 --2- 172.21.15.49:0/3943969375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3015c1c0 0x7fcf300c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.062+0000 7fcf2ffff640 1 --2- 172.21.15.49:0/3943969375 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3015b620 0x7fcf3014fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.066+0000 7fcf34813640 1 -- 172.21.15.49:0/3943969375 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3015b620 msgr2=0x7fcf3014fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.066+0000 7fcf34813640 1 --2- 172.21.15.49:0/3943969375 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3015b620 0x7fcf3014fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.066+0000 7fcf34813640 1 -- 172.21.15.49:0/3943969375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3015c1c0 msgr2=0x7fcf300c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.066+0000 7fcf34813640 1 --2- 172.21.15.49:0/3943969375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3015c1c0 0x7fcf300c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.069 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.066+0000 7fcf34813640 1 -- 172.21.15.49:0/3943969375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf28009420 con 0x7fcf3015c5a0 2023-11-18T21:28:54.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.070+0000 7fcf34813640 1 --2- 172.21.15.49:0/3943969375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf3015c5a0 0x7fcf300bf9c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000c3c0 tx=0x7fcf2000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:54.073 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.074+0000 7fcf2cff9640 1 -- 172.21.15.49:0/3943969375 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20005cf0 con 0x7fcf3015c5a0 2023-11-18T21:28:54.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.074+0000 7fcf36276640 1 -- 172.21.15.49:0/3943969375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf301521b0 con 0x7fcf3015c5a0 2023-11-18T21:28:54.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.074+0000 7fcf36276640 1 -- 172.21.15.49:0/3943969375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf30152770 con 0x7fcf3015c5a0 2023-11-18T21:28:54.074 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.074+0000 7fcf36276640 1 -- 172.21.15.49:0/3943969375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf301529b0 con 0x7fcf3015c5a0 2023-11-18T21:28:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.382+0000 7fcf2cff9640 1 -- 172.21.15.49:0/3943969375 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20005e50 con 0x7fcf3015c5a0 2023-11-18T21:28:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.382+0000 7fcf2cff9640 1 -- 172.21.15.49:0/3943969375 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf200072d0 con 0x7fcf3015c5a0 2023-11-18T21:28:54.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.382+0000 7fcf2cff9640 1 -- 172.21.15.49:0/3943969375 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf200074f0 con 0x7fcf3015c5a0 2023-11-18T21:28:54.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.386+0000 7fcf2cff9640 1 --2- 172.21.15.49:0/3943969375 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf1c066470 0x7fcf1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.386 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.386+0000 7fcf2ffff640 1 --2- 172.21.15.49:0/3943969375 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf1c066470 0x7fcf1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.386+0000 7fcf2ffff640 1 --2- 172.21.15.49:0/3943969375 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf1c066470 0x7fcf1c068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcf280af000 tx=0x7fcf280a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:54.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.414+0000 7fcf2cff9640 1 -- 172.21.15.49:0/3943969375 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fcf20054990 con 0x7fcf3015c5a0 2023-11-18T21:28:54.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.414+0000 7fcf2cff9640 1 -- 172.21.15.49:0/3943969375 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf20050cd0 con 0x7fcf3015c5a0 2023-11-18T21:28:54.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.582+0000 7fcf36276640 1 -- 172.21.15.49:0/3943969375 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf3015a9f0 con 0x7fcf1c066470 2023-11-18T21:28:54.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.582+0000 7fcf2cff9640 1 -- 172.21.15.49:0/3943969375 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcf280abad0 con 0x7fcf1c066470 2023-11-18T21:28:54.584 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 0 to deep-scrub 2023-11-18T21:28:54.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.586+0000 7fcf36276640 1 -- 172.21.15.49:0/3943969375 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf1c066470 msgr2=0x7fcf1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.586+0000 7fcf36276640 1 --2- 172.21.15.49:0/3943969375 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf1c066470 0x7fcf1c068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcf280af000 tx=0x7fcf280a7000 comp rx=0 tx=0).stop 2023-11-18T21:28:54.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.586+0000 7fcf36276640 1 -- 172.21.15.49:0/3943969375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf3015c5a0 msgr2=0x7fcf300bf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.586+0000 7fcf36276640 1 --2- 172.21.15.49:0/3943969375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf3015c5a0 0x7fcf300bf9c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000c3c0 tx=0x7fcf2000c880 comp rx=0 tx=0).stop 2023-11-18T21:28:54.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.586+0000 7fcf36276640 1 -- 172.21.15.49:0/3943969375 shutdown_connections 2023-11-18T21:28:54.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.586+0000 7fcf36276640 1 --2- 172.21.15.49:0/3943969375 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcf1c066470 0x7fcf1c068930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.586+0000 7fcf36276640 1 --2- 172.21.15.49:0/3943969375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf3015c5a0 0x7fcf300bf9c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.586+0000 7fcf36276640 1 --2- 172.21.15.49:0/3943969375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3015c1c0 0x7fcf300c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.586+0000 7fcf36276640 1 --2- 172.21.15.49:0/3943969375 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3015b620 0x7fcf3014fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.586+0000 7fcf36276640 1 -- 172.21.15.49:0/3943969375 >> 172.21.15.49:0/3943969375 conn(0x7fcf30060fd0 msgr2=0x7fcf301582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:54.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.586+0000 7fcf36276640 1 -- 172.21.15.49:0/3943969375 shutdown_connections 2023-11-18T21:28:54.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.586+0000 7fcf36276640 1 -- 172.21.15.49:0/3943969375 wait complete. 2023-11-18T21:28:54.604 INFO:tasks.ceph:Scrubbing osd.1 2023-11-18T21:28:54.605 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-18T21:28:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.726+0000 7f3b1df35640 1 Processor -- start 2023-11-18T21:28:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.726+0000 7f3b1df35640 1 -- start start 2023-11-18T21:28:54.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.726+0000 7f3b1df35640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3b180cc3c0 0x7f3b180ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.730+0000 7f3b1df35640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b1815a280 0x7f3b18163e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.730+0000 7f3b1df35640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b180cd9a0 con 0x7f3b180ce0c0 2023-11-18T21:28:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.730+0000 7f3b1df35640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b180ca550 con 0x7f3b180cc3c0 2023-11-18T21:28:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.730+0000 7f3b1df35640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180ce9e0 con 0x7f3b1815a280 2023-11-18T21:28:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.730+0000 7f3b16ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3b180cc3c0 0x7f3b180ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.730+0000 7f3b17fff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b1815a280 0x7f3b18163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.730+0000 7f3b16ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3b180cc3c0 0x7f3b180ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:52240/0 (socket says 172.21.15.49:52240) 2023-11-18T21:28:54.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.730+0000 7f3b16ffd640 1 -- 172.21.15.49:0/3349537827 learned_addr learned my addr 172.21.15.49:0/3349537827 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:54.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.738+0000 7f3b17fff640 1 -- 172.21.15.49:0/3349537827 >> v2:172.21.15.106:3300/0 conn(0x7f3b180cc3c0 msgr2=0x7f3b180ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:54.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.738+0000 7f3b17fff640 1 --2- 172.21.15.49:0/3349537827 >> v2:172.21.15.106:3300/0 conn(0x7f3b180cc3c0 0x7f3b180ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.738+0000 7f3b17fff640 1 -- 172.21.15.49:0/3349537827 >> v1:172.21.15.49:6789/0 conn(0x7f3b180ce0c0 legacy=0x7f3b18159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.738+0000 7f3b17fff640 1 -- 172.21.15.49:0/3349537827 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b181596c0 con 0x7f3b1815a280 2023-11-18T21:28:54.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.742+0000 7f3b17fff640 1 --2- 172.21.15.49:0/3349537827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b1815a280 0x7f3b18163e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009d90 tx=0x7f3b1001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d9a9a024b8184e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:54.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.750+0000 7f3b167fc640 1 -- 172.21.15.49:0/3349537827 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b100a5a10 con 0x7f3b1815a280 2023-11-18T21:28:54.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.750+0000 7f3b167fc640 1 -- 172.21.15.49:0/3349537827 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b100a5b70 con 0x7f3b1815a280 2023-11-18T21:28:54.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.750+0000 7f3b167fc640 1 -- 172.21.15.49:0/3349537827 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b100ad440 con 0x7f3b1815a280 2023-11-18T21:28:54.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.750+0000 7f3b1df35640 1 -- 172.21.15.49:0/3349537827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b1815a280 msgr2=0x7f3b18163e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.750+0000 7f3b1df35640 1 --2- 172.21.15.49:0/3349537827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b1815a280 0x7f3b18163e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009d90 tx=0x7f3b1001c950 comp rx=0 tx=0).stop 2023-11-18T21:28:54.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.750+0000 7f3b1df35640 1 -- 172.21.15.49:0/3349537827 shutdown_connections 2023-11-18T21:28:54.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.750+0000 7f3b1df35640 1 --2- 172.21.15.49:0/3349537827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b1815a280 0x7f3b18163e50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.750+0000 7f3b1df35640 1 --2- 172.21.15.49:0/3349537827 >> v2:172.21.15.106:3300/0 conn(0x7f3b180cc3c0 0x7f3b180ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.750+0000 7f3b1df35640 1 -- 172.21.15.49:0/3349537827 >> 172.21.15.49:0/3349537827 conn(0x7f3b180b07c0 msgr2=0x7f3b180b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:54.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.750+0000 7f3b1df35640 1 -- 172.21.15.49:0/3349537827 shutdown_connections 2023-11-18T21:28:54.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.750+0000 7f3b1df35640 1 -- 172.21.15.49:0/3349537827 wait complete. 2023-11-18T21:28:54.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.754+0000 7f3b1df35640 1 Processor -- start 2023-11-18T21:28:54.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.754+0000 7f3b1df35640 1 -- start start 2023-11-18T21:28:54.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.754+0000 7f3b1df35640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b180cc3c0 0x7f3b181f0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.754+0000 7f3b1df35640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b180ce0c0 0x7f3b18155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.754+0000 7f3b1df35640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b1815a280 0x7f3b181487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.754+0000 7f3b1df35640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b181483f0 con 0x7f3b180cc3c0 2023-11-18T21:28:54.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.754+0000 7f3b1df35640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18150c00 con 0x7f3b180ce0c0 2023-11-18T21:28:54.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.754+0000 7f3b1df35640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18154d10 con 0x7f3b1815a280 2023-11-18T21:28:54.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.754+0000 7f3b177fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b180cc3c0 0x7f3b181f0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.754+0000 7f3b16ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b180ce0c0 0x7f3b18155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.754+0000 7f3b16ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b180ce0c0 0x7f3b18155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:52242/0 (socket says 172.21.15.49:52242) 2023-11-18T21:28:54.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.754+0000 7f3b16ffd640 1 -- 172.21.15.49:0/3571540027 learned_addr learned my addr 172.21.15.49:0/3571540027 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:54.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.758+0000 7f3b17fff640 1 --2- 172.21.15.49:0/3571540027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b1815a280 0x7f3b181487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.758+0000 7f3b177fe640 1 -- 172.21.15.49:0/3571540027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b1815a280 msgr2=0x7f3b181487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.758+0000 7f3b177fe640 1 --2- 172.21.15.49:0/3571540027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b1815a280 0x7f3b181487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.758+0000 7f3b177fe640 1 -- 172.21.15.49:0/3571540027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b180ce0c0 msgr2=0x7f3b18155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.758+0000 7f3b177fe640 1 --2- 172.21.15.49:0/3571540027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b180ce0c0 0x7f3b18155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.758+0000 7f3b177fe640 1 -- 172.21.15.49:0/3571540027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b10009a70 con 0x7f3b180cc3c0 2023-11-18T21:28:54.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.762+0000 7f3b177fe640 1 --2- 172.21.15.49:0/3571540027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b180cc3c0 0x7f3b181f0c90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800c3f0 tx=0x7f3b0800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:54.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.766+0000 7f3afffff640 1 -- 172.21.15.49:0/3571540027 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b080052d0 con 0x7f3b180cc3c0 2023-11-18T21:28:54.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.766+0000 7f3afffff640 1 -- 172.21.15.49:0/3571540027 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b08005430 con 0x7f3b180cc3c0 2023-11-18T21:28:54.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.766+0000 7f3afffff640 1 -- 172.21.15.49:0/3571540027 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08007260 con 0x7f3b180cc3c0 2023-11-18T21:28:54.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.766+0000 7f3b1df35640 1 -- 172.21.15.49:0/3571540027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b181555b0 con 0x7f3b180cc3c0 2023-11-18T21:28:54.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.766+0000 7f3b1df35640 1 -- 172.21.15.49:0/3571540027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b181f37d0 con 0x7f3b180cc3c0 2023-11-18T21:28:54.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.766+0000 7f3b1df35640 1 -- 172.21.15.49:0/3571540027 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b180aefb0 con 0x7f3b180cc3c0 2023-11-18T21:28:54.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.786+0000 7f3afffff640 1 -- 172.21.15.49:0/3571540027 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b080073c0 con 0x7f3b180cc3c0 2023-11-18T21:28:54.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.786+0000 7f3afffff640 1 --2- 172.21.15.49:0/3571540027 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b040664f0 0x7f3b040689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.790+0000 7f3b16ffd640 1 --2- 172.21.15.49:0/3571540027 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b040664f0 0x7f3b040689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.790+0000 7f3b16ffd640 1 --2- 172.21.15.49:0/3571540027 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b040664f0 0x7f3b040689b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3b18157520 tx=0x7f3b0c009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:54.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.794+0000 7f3afffff640 1 -- 172.21.15.49:0/3571540027 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f3b08054e00 con 0x7f3b180cc3c0 2023-11-18T21:28:54.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.794+0000 7f3afffff640 1 --2- 172.21.15.49:0/3571540027 >> [v2:172.21.15.49:6808/2801920874,v1:172.21.15.49:6809/2801920874] conn(0x7f3b0406fb70 0x7f3b04071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.794+0000 7f3afffff640 1 -- 172.21.15.49:0/3571540027 --> [v2:172.21.15.49:6808/2801920874,v1:172.21.15.49:6809/2801920874] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b040726c0 con 0x7f3b0406fb70 2023-11-18T21:28:54.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.794+0000 7f3afffff640 1 -- 172.21.15.49:0/3571540027 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b08051140 con 0x7f3b180cc3c0 2023-11-18T21:28:54.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.794+0000 7f3b17fff640 1 --2- 172.21.15.49:0/3571540027 >> [v2:172.21.15.49:6808/2801920874,v1:172.21.15.49:6809/2801920874] conn(0x7f3b0406fb70 0x7f3b04071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.794+0000 7f3b17fff640 1 --2- 172.21.15.49:0/3571540027 >> [v2:172.21.15.49:6808/2801920874,v1:172.21.15.49:6809/2801920874] conn(0x7f3b0406fb70 0x7f3b04071ff0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:54.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.794+0000 7f3afffff640 1 -- 172.21.15.49:0/3571540027 <== osd.1 v2:172.21.15.49:6808/2801920874 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3b040726c0 con 0x7f3b0406fb70 2023-11-18T21:28:54.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.814+0000 7f3b1df35640 1 -- 172.21.15.49:0/3571540027 --> [v2:172.21.15.49:6808/2801920874,v1:172.21.15.49:6809/2801920874] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3b180cb3d0 con 0x7f3b0406fb70 2023-11-18T21:28:54.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.814+0000 7f3afffff640 1 -- 172.21.15.49:0/3571540027 <== osd.1 v2:172.21.15.49:6808/2801920874 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3b100ad440 con 0x7f3b0406fb70 2023-11-18T21:28:54.815 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T21:28:54.815 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T21:28:54.815 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T21:28:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.814+0000 7f3b1df35640 1 -- 172.21.15.49:0/3571540027 >> [v2:172.21.15.49:6808/2801920874,v1:172.21.15.49:6809/2801920874] conn(0x7f3b0406fb70 msgr2=0x7f3b04071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.814+0000 7f3b1df35640 1 --2- 172.21.15.49:0/3571540027 >> [v2:172.21.15.49:6808/2801920874,v1:172.21.15.49:6809/2801920874] conn(0x7f3b0406fb70 0x7f3b04071ff0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.814+0000 7f3b1df35640 1 -- 172.21.15.49:0/3571540027 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b040664f0 msgr2=0x7f3b040689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.814+0000 7f3b1df35640 1 --2- 172.21.15.49:0/3571540027 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3b040664f0 0x7f3b040689b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3b18157520 tx=0x7f3b0c009240 comp rx=0 tx=0).stop 2023-11-18T21:28:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.814+0000 7f3b1df35640 1 -- 172.21.15.49:0/3571540027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b180cc3c0 msgr2=0x7f3b181f0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.814+0000 7f3b1df35640 1 --2- 172.21.15.49:0/3571540027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b180cc3c0 0x7f3b181f0c90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800c3f0 tx=0x7f3b0800c8b0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.814+0000 7f3b17fff640 1 -- 172.21.15.49:0/3571540027 reap_dead start 2023-11-18T21:28:54.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.814+0000 7f3b1df35640 1 -- 172.21.15.49:0/3571540027 shutdown_connections 2023-11-18T21:28:54.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.814+0000 7f3b1df35640 1 -- 172.21.15.49:0/3571540027 >> 172.21.15.49:0/3571540027 conn(0x7f3b180b07c0 msgr2=0x7f3b18152100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:54.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.814+0000 7f3b1df35640 1 -- 172.21.15.49:0/3571540027 shutdown_connections 2023-11-18T21:28:54.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.814+0000 7f3b1df35640 1 -- 172.21.15.49:0/3571540027 wait complete. 2023-11-18T21:28:54.837 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-18T21:28:54.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.966+0000 7f41fb877640 1 Processor -- start 2023-11-18T21:28:54.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.966+0000 7f41fb877640 1 -- start start 2023-11-18T21:28:54.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.970+0000 7f41fb877640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f41f4151340 0x7f41f406ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.970+0000 7f41fb877640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f406f4a0 con 0x7f41f40c40e0 2023-11-18T21:28:54.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.970+0000 7f41fb877640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f4070be0 con 0x7f41f4151720 2023-11-18T21:28:54.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.970+0000 7f41fb877640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f4072570 con 0x7f41f4151340 2023-11-18T21:28:54.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.970+0000 7f41f9613640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f41f4151340 0x7f41f406ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.970+0000 7f41f9e14640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f41f40c40e0 0x7f41f40c70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55502/0 (socket says 172.21.15.49:55502) 2023-11-18T21:28:54.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.970+0000 7f41f9e14640 1 -- 172.21.15.49:0/2112915161 learned_addr learned my addr 172.21.15.49:0/2112915161 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:54.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.974+0000 7f41f9613640 1 -- 172.21.15.49:0/2112915161 >> v1:172.21.15.106:6789/0 conn(0x7f41f4151720 legacy=0x7f41f4157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.974+0000 7f41f9613640 1 -- 172.21.15.49:0/2112915161 >> v1:172.21.15.49:6789/0 conn(0x7f41f40c40e0 legacy=0x7f41f40c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.974+0000 7f41f9613640 1 -- 172.21.15.49:0/2112915161 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f4070e80 con 0x7f41f4151340 2023-11-18T21:28:54.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.978+0000 7f41f9613640 1 --2- 172.21.15.49:0/2112915161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41f4151340 0x7f41f406ee10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f41f00097c0 tx=0x7f41f001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd362e6e0b927c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:54.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.982+0000 7f41ebfff640 1 -- 172.21.15.49:0/2112915161 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f00ab650 con 0x7f41f4151340 2023-11-18T21:28:54.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.982+0000 7f41ebfff640 1 -- 172.21.15.49:0/2112915161 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f00ab7b0 con 0x7f41f4151340 2023-11-18T21:28:54.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.982+0000 7f41ebfff640 1 -- 172.21.15.49:0/2112915161 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f00abb40 con 0x7f41f4151340 2023-11-18T21:28:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.982+0000 7f41fb877640 1 -- 172.21.15.49:0/2112915161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41f4151340 msgr2=0x7f41f406ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.982+0000 7f41fb877640 1 --2- 172.21.15.49:0/2112915161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41f4151340 0x7f41f406ee10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f41f00097c0 tx=0x7f41f001c450 comp rx=0 tx=0).stop 2023-11-18T21:28:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.982+0000 7f41fb877640 1 -- 172.21.15.49:0/2112915161 shutdown_connections 2023-11-18T21:28:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.982+0000 7f41fb877640 1 --2- 172.21.15.49:0/2112915161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41f4151340 0x7f41f406ee10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.982+0000 7f41fb877640 1 -- 172.21.15.49:0/2112915161 >> 172.21.15.49:0/2112915161 conn(0x7f41f406c6a0 msgr2=0x7f41f406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.982+0000 7f41fb877640 1 -- 172.21.15.49:0/2112915161 shutdown_connections 2023-11-18T21:28:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.982+0000 7f41fb877640 1 -- 172.21.15.49:0/2112915161 wait complete. 2023-11-18T21:28:54.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.986+0000 7f41fb877640 1 Processor -- start 2023-11-18T21:28:54.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.986+0000 7f41fb877640 1 -- start start 2023-11-18T21:28:54.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.986+0000 7f41fb877640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41f40c40e0 0x7f41f40c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.986+0000 7f41fb877640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f4151340 0x7f41f414b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.986+0000 7f41fb877640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f4151720 0x7f41f4149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:54.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.986+0000 7f41fb877640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f414bed0 con 0x7f41f40c40e0 2023-11-18T21:28:54.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.986+0000 7f41fb877640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f41efd00 con 0x7f41f4151340 2023-11-18T21:28:54.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.986+0000 7f41fb877640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f41effe0 con 0x7f41f4151720 2023-11-18T21:28:54.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.986+0000 7f41f9613640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41f40c40e0 0x7f41f40c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.986+0000 7f41f9613640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41f40c40e0 0x7f41f40c5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40680/0 (socket says 172.21.15.49:40680) 2023-11-18T21:28:54.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.986+0000 7f41f9613640 1 -- 172.21.15.49:0/1474283949 learned_addr learned my addr 172.21.15.49:0/1474283949 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:54.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.986+0000 7f41f8e12640 1 --2- 172.21.15.49:0/1474283949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f4151340 0x7f41f414b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.986+0000 7f41f9e14640 1 --2- 172.21.15.49:0/1474283949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f4151720 0x7f41f4149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:54.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.990+0000 7f41f9613640 1 -- 172.21.15.49:0/1474283949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f4151720 msgr2=0x7f41f4149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.990+0000 7f41f9613640 1 --2- 172.21.15.49:0/1474283949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f4151720 0x7f41f4149d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.990+0000 7f41f9613640 1 -- 172.21.15.49:0/1474283949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f4151340 msgr2=0x7f41f414b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.990+0000 7f41f9613640 1 --2- 172.21.15.49:0/1474283949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f4151340 0x7f41f414b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.990+0000 7f41f9613640 1 -- 172.21.15.49:0/1474283949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f0009420 con 0x7f41f40c40e0 2023-11-18T21:28:54.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.994+0000 7f41f9613640 1 --2- 172.21.15.49:0/1474283949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41f40c40e0 0x7f41f40c5320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f41f00ad040 tx=0x7f41f001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.998+0000 7f41e9ffb640 1 -- 172.21.15.49:0/1474283949 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f00b5810 con 0x7f41f40c40e0 2023-11-18T21:28:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.998+0000 7f41e9ffb640 1 -- 172.21.15.49:0/1474283949 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f00b5970 con 0x7f41f40c40e0 2023-11-18T21:28:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.998+0000 7f41e9ffb640 1 -- 172.21.15.49:0/1474283949 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f00b5d20 con 0x7f41f40c40e0 2023-11-18T21:28:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.998+0000 7f41fb877640 1 -- 172.21.15.49:0/1474283949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f41f02c0 con 0x7f41f40c40e0 2023-11-18T21:28:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.998+0000 7f41fb877640 1 -- 172.21.15.49:0/1474283949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f41f0880 con 0x7f41f40c40e0 2023-11-18T21:28:54.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:54.998+0000 7f41fb877640 1 -- 172.21.15.49:0/1474283949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f41f0a70 con 0x7f41f40c40e0 2023-11-18T21:28:55.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.018+0000 7f41e9ffb640 1 -- 172.21.15.49:0/1474283949 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f41f00ca430 con 0x7f41f40c40e0 2023-11-18T21:28:55.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.018+0000 7f41e9ffb640 1 --2- 172.21.15.49:0/1474283949 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f41d80664a0 0x7f41d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:55.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.018+0000 7f41f8e12640 1 --2- 172.21.15.49:0/1474283949 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f41d80664a0 0x7f41d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:55.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.018+0000 7f41f8e12640 1 --2- 172.21.15.49:0/1474283949 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f41d80664a0 0x7f41d8068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f41f4162b30 tx=0x7f41e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.022+0000 7f41e9ffb640 1 -- 172.21.15.49:0/1474283949 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f41f00f0040 con 0x7f41f40c40e0 2023-11-18T21:28:55.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.298+0000 7f41e9ffb640 1 -- 172.21.15.49:0/1474283949 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41f00ec380 con 0x7f41f40c40e0 2023-11-18T21:28:55.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.470+0000 7f41fb877640 1 -- 172.21.15.49:0/1474283949 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f41f40c48d0 con 0x7f41d80664a0 2023-11-18T21:28:55.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.470+0000 7f41e9ffb640 1 -- 172.21.15.49:0/1474283949 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f41e4001450 con 0x7f41d80664a0 2023-11-18T21:28:55.473 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 1 to deep-scrub 2023-11-18T21:28:55.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.474+0000 7f41fb877640 1 -- 172.21.15.49:0/1474283949 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f41d80664a0 msgr2=0x7f41d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:55.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.474+0000 7f41fb877640 1 --2- 172.21.15.49:0/1474283949 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f41d80664a0 0x7f41d8068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f41f4162b30 tx=0x7f41e4009040 comp rx=0 tx=0).stop 2023-11-18T21:28:55.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.474+0000 7f41fb877640 1 -- 172.21.15.49:0/1474283949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41f40c40e0 msgr2=0x7f41f40c5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:55.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.474+0000 7f41fb877640 1 --2- 172.21.15.49:0/1474283949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41f40c40e0 0x7f41f40c5320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f41f00ad040 tx=0x7f41f001ac90 comp rx=0 tx=0).stop 2023-11-18T21:28:55.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.474+0000 7f41fb877640 1 -- 172.21.15.49:0/1474283949 shutdown_connections 2023-11-18T21:28:55.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.474+0000 7f41fb877640 1 --2- 172.21.15.49:0/1474283949 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f41d80664a0 0x7f41d8068960 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.474+0000 7f41fb877640 1 --2- 172.21.15.49:0/1474283949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f4151720 0x7f41f4149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.474+0000 7f41fb877640 1 --2- 172.21.15.49:0/1474283949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f4151340 0x7f41f414b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.474+0000 7f41fb877640 1 --2- 172.21.15.49:0/1474283949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41f40c40e0 0x7f41f40c5320 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.474+0000 7f41fb877640 1 -- 172.21.15.49:0/1474283949 >> 172.21.15.49:0/1474283949 conn(0x7f41f406c6a0 msgr2=0x7f41f4150650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:55.476 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.474+0000 7f41fb877640 1 -- 172.21.15.49:0/1474283949 shutdown_connections 2023-11-18T21:28:55.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.474+0000 7f41fb877640 1 -- 172.21.15.49:0/1474283949 wait complete. 2023-11-18T21:28:55.494 INFO:tasks.ceph:Scrubbing osd.2 2023-11-18T21:28:55.495 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-18T21:28:55.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.622+0000 7f7a0d9e7640 1 Processor -- start 2023-11-18T21:28:55.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.622+0000 7f7a0d9e7640 1 -- start start 2023-11-18T21:28:55.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.622+0000 7f7a0d9e7640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7a080ce0c0 0x7f7a080ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:55.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.622+0000 7f7a0d9e7640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a080cc3c0 0x7f7a08159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:55.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.622+0000 7f7a0d9e7640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7a080cdb70 0x7f7a0815a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:55.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.622+0000 7f7a0d9e7640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a080ca550 con 0x7f7a080ce0c0 2023-11-18T21:28:55.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.622+0000 7f7a0d9e7640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a080ce9e0 con 0x7f7a080cdb70 2023-11-18T21:28:55.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.622+0000 7f7a0d9e7640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080cd9a0 con 0x7f7a080cc3c0 2023-11-18T21:28:55.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.622+0000 7f7a06ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7a080ce0c0 0x7f7a080ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:55.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.622+0000 7f7a06ffd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7a080ce0c0 0x7f7a080ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41188/0 (socket says 172.21.15.49:41188) 2023-11-18T21:28:55.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.622+0000 7f7a06ffd640 1 -- 172.21.15.49:0/2390253868 learned_addr learned my addr 172.21.15.49:0/2390253868 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:55.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.626+0000 7f7a06ffd640 1 -- 172.21.15.49:0/2390253868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a080cc3c0 msgr2=0x7f7a08159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:55.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.626+0000 7f7a06ffd640 1 --2- 172.21.15.49:0/2390253868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a080cc3c0 0x7f7a08159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.626+0000 7f7a06ffd640 1 -- 172.21.15.49:0/2390253868 >> v2:172.21.15.106:3300/0 conn(0x7f7a080cdb70 msgr2=0x7f7a0815a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:55.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.626+0000 7f7a06ffd640 1 --2- 172.21.15.49:0/2390253868 >> v2:172.21.15.106:3300/0 conn(0x7f7a080cdb70 0x7f7a0815a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.626+0000 7f7a06ffd640 1 -- 172.21.15.49:0/2390253868 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a081596c0 con 0x7f7a080ce0c0 2023-11-18T21:28:55.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.630+0000 7f7a06ffd640 1 --2- 172.21.15.49:0/2390253868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a080ce0c0 0x7f7a080ce4a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7a0806cf50 tx=0x7f79f801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112f2a211a3163d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:55.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.634+0000 7f7a05ffb640 1 -- 172.21.15.49:0/2390253868 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f80aa640 con 0x7f7a080ce0c0 2023-11-18T21:28:55.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.634+0000 7f7a05ffb640 1 -- 172.21.15.49:0/2390253868 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f80aa7a0 con 0x7f7a080ce0c0 2023-11-18T21:28:55.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.634+0000 7f7a05ffb640 1 -- 172.21.15.49:0/2390253868 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f80aab30 con 0x7f7a080ce0c0 2023-11-18T21:28:55.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.634+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/2390253868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a080ce0c0 msgr2=0x7f7a080ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:55.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.634+0000 7f7a0d9e7640 1 --2- 172.21.15.49:0/2390253868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a080ce0c0 0x7f7a080ce4a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7a0806cf50 tx=0x7f79f801c500 comp rx=0 tx=0).stop 2023-11-18T21:28:55.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.634+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/2390253868 shutdown_connections 2023-11-18T21:28:55.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.634+0000 7f7a0d9e7640 1 --2- 172.21.15.49:0/2390253868 >> v2:172.21.15.106:3300/0 conn(0x7f7a080cdb70 0x7f7a0815a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.634+0000 7f7a0d9e7640 1 --2- 172.21.15.49:0/2390253868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a080cc3c0 0x7f7a08159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.634+0000 7f7a0d9e7640 1 --2- 172.21.15.49:0/2390253868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a080ce0c0 0x7f7a080ce4a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.634+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/2390253868 >> 172.21.15.49:0/2390253868 conn(0x7f7a080b07c0 msgr2=0x7f7a080b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:55.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.634+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/2390253868 shutdown_connections 2023-11-18T21:28:55.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.634+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/2390253868 wait complete. 2023-11-18T21:28:55.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.634+0000 7f7a0d9e7640 1 Processor -- start 2023-11-18T21:28:55.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.634+0000 7f7a0d9e7640 1 -- start start 2023-11-18T21:28:55.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.638+0000 7f7a0d9e7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a080cc3c0 0x7f7a081f6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:55.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.638+0000 7f7a0d9e7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a080cdb70 0x7f7a0806bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:55.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.638+0000 7f7a0d9e7640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a080ce0c0 0x7f7a0806c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:55.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.638+0000 7f7a0d9e7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a081f5790 con 0x7f7a080cdb70 2023-11-18T21:28:55.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.638+0000 7f7a0d9e7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a081f59c0 con 0x7f7a080cc3c0 2023-11-18T21:28:55.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.638+0000 7f7a0d9e7640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a081f6670 con 0x7f7a080ce0c0 2023-11-18T21:28:55.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.638+0000 7f7a067fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a080cdb70 0x7f7a0806bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:55.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.638+0000 7f7a067fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a080cdb70 0x7f7a0806bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41202/0 (socket says 172.21.15.49:41202) 2023-11-18T21:28:55.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.638+0000 7f7a067fc640 1 -- 172.21.15.49:0/3750378074 learned_addr learned my addr 172.21.15.49:0/3750378074 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.642+0000 7f7a067fc640 1 -- 172.21.15.49:0/3750378074 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a080ce0c0 msgr2=0x7f7a0806c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.642+0000 7f7a067fc640 1 --2- 172.21.15.49:0/3750378074 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a080ce0c0 0x7f7a0806c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.642+0000 7f7a067fc640 1 -- 172.21.15.49:0/3750378074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a080cc3c0 msgr2=0x7f7a081f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:55.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.642+0000 7f7a067fc640 1 --2- 172.21.15.49:0/3750378074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a080cc3c0 0x7f7a081f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.642+0000 7f7a067fc640 1 -- 172.21.15.49:0/3750378074 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f80094d0 con 0x7f7a080cdb70 2023-11-18T21:28:55.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.642+0000 7f7a067fc640 1 --2- 172.21.15.49:0/3750378074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a080cdb70 0x7f7a0806bb00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00b550 tx=0x7f79fc00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:55.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.646+0000 7f79effff640 1 -- 172.21.15.49:0/3750378074 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc010870 con 0x7f7a080cdb70 2023-11-18T21:28:55.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.646+0000 7f79effff640 1 -- 172.21.15.49:0/3750378074 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc0109f0 con 0x7f7a080cdb70 2023-11-18T21:28:55.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.646+0000 7f79effff640 1 -- 172.21.15.49:0/3750378074 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc010da0 con 0x7f7a080cdb70 2023-11-18T21:28:55.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.646+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/3750378074 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a081f2530 con 0x7f7a080cdb70 2023-11-18T21:28:55.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.646+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/3750378074 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a081f2af0 con 0x7f7a080cdb70 2023-11-18T21:28:55.650 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.650+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/3750378074 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7a080cb3d0 con 0x7f7a080cdb70 2023-11-18T21:28:55.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.674+0000 7f79effff640 1 -- 172.21.15.49:0/3750378074 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f79fc00f3c0 con 0x7f7a080cdb70 2023-11-18T21:28:55.677 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.678+0000 7f79effff640 1 --2- 172.21.15.49:0/3750378074 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f79f40664c0 0x7f79f4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:55.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.678+0000 7f7a06ffd640 1 --2- 172.21.15.49:0/3750378074 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f79f40664c0 0x7f79f4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:55.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.678+0000 7f7a06ffd640 1 --2- 172.21.15.49:0/3750378074 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f79f40664c0 0x7f79f4068980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f79f80ae000 tx=0x7f79f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.678+0000 7f79effff640 1 -- 172.21.15.49:0/3750378074 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f79fc055bc0 con 0x7f7a080cdb70 2023-11-18T21:28:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.678+0000 7f79effff640 1 --2- 172.21.15.49:0/3750378074 >> [v2:172.21.15.49:6816/3310490448,v1:172.21.15.49:6817/3310490448] conn(0x7f79f406fac0 0x7f79f4071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.678+0000 7f79effff640 1 -- 172.21.15.49:0/3750378074 --> [v2:172.21.15.49:6816/3310490448,v1:172.21.15.49:6817/3310490448] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79f4072610 con 0x7f79f406fac0 2023-11-18T21:28:55.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.682+0000 7f7a077fe640 1 --2- 172.21.15.49:0/3750378074 >> [v2:172.21.15.49:6816/3310490448,v1:172.21.15.49:6817/3310490448] conn(0x7f79f406fac0 0x7f79f4071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:55.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.682+0000 7f7a077fe640 1 --2- 172.21.15.49:0/3750378074 >> [v2:172.21.15.49:6816/3310490448,v1:172.21.15.49:6817/3310490448] conn(0x7f79f406fac0 0x7f79f4071f40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:55.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.682+0000 7f79effff640 1 -- 172.21.15.49:0/3750378074 <== osd.2 v2:172.21.15.49:6816/3310490448 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f79f4072610 con 0x7f79f406fac0 2023-11-18T21:28:55.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.686+0000 7f79effff640 1 -- 172.21.15.49:0/3750378074 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79fc051800 con 0x7f7a080cdb70 2023-11-18T21:28:55.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.694+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/3750378074 --> [v2:172.21.15.49:6816/3310490448,v1:172.21.15.49:6817/3310490448] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7a08067520 con 0x7f79f406fac0 2023-11-18T21:28:55.697 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.694+0000 7f79effff640 1 -- 172.21.15.49:0/3750378074 <== osd.2 v2:172.21.15.49:6816/3310490448 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7a08067520 con 0x7f79f406fac0 2023-11-18T21:28:55.697 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T21:28:55.698 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T21:28:55.698 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T21:28:55.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.698+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/3750378074 >> [v2:172.21.15.49:6816/3310490448,v1:172.21.15.49:6817/3310490448] conn(0x7f79f406fac0 msgr2=0x7f79f4071f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:55.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.698+0000 7f7a0d9e7640 1 --2- 172.21.15.49:0/3750378074 >> [v2:172.21.15.49:6816/3310490448,v1:172.21.15.49:6817/3310490448] conn(0x7f79f406fac0 0x7f79f4071f40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.698+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/3750378074 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f79f40664c0 msgr2=0x7f79f4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:55.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.698+0000 7f7a0d9e7640 1 --2- 172.21.15.49:0/3750378074 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f79f40664c0 0x7f79f4068980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f79f80ae000 tx=0x7f79f8008040 comp rx=0 tx=0).stop 2023-11-18T21:28:55.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.698+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/3750378074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a080cdb70 msgr2=0x7f7a0806bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:55.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.698+0000 7f7a0d9e7640 1 --2- 172.21.15.49:0/3750378074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a080cdb70 0x7f7a0806bb00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00b550 tx=0x7f79fc00ba10 comp rx=0 tx=0).stop 2023-11-18T21:28:55.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.698+0000 7f7a077fe640 1 -- 172.21.15.49:0/3750378074 reap_dead start 2023-11-18T21:28:55.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.698+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/3750378074 shutdown_connections 2023-11-18T21:28:55.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.698+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/3750378074 >> 172.21.15.49:0/3750378074 conn(0x7f7a080b07c0 msgr2=0x7f7a08147d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:55.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.698+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/3750378074 shutdown_connections 2023-11-18T21:28:55.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.698+0000 7f7a0d9e7640 1 -- 172.21.15.49:0/3750378074 wait complete. 2023-11-18T21:28:55.717 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-18T21:28:55.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.882+0000 7f7fd7734640 1 Processor -- start 2023-11-18T21:28:55.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.882+0000 7f7fd7734640 1 -- start start 2023-11-18T21:28:55.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.886+0000 7f7fd7734640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fd00cbd50 0x7f7fd00c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:55.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.886+0000 7f7fd7734640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7fd00cc130 0x7f7fd0156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:55.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.886+0000 7f7fd7734640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd00c1570 con 0x7f7fd00c0ee0 2023-11-18T21:28:55.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.886+0000 7f7fd7734640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd00c1370 con 0x7f7fd00cc130 2023-11-18T21:28:55.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.886+0000 7f7fd7734640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00c1810 con 0x7f7fd00cbd50 2023-11-18T21:28:55.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.886+0000 7f7fd4ccf640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7fd00cc130 0x7f7fd0156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:55.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.890+0000 7f7fd4ccf640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7fd00cc130 0x7f7fd0156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41204/0 (socket says 172.21.15.49:41204) 2023-11-18T21:28:55.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.890+0000 7f7fd4ccf640 1 -- 172.21.15.49:0/1059345012 learned_addr learned my addr 172.21.15.49:0/1059345012 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.890+0000 7f7fd4ccf640 1 -- 172.21.15.49:0/1059345012 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fd00cbd50 msgr2=0x7f7fd00c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.890+0000 7f7fd4ccf640 1 --2- 172.21.15.49:0/1059345012 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fd00cbd50 0x7f7fd00c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.890+0000 7f7fd4ccf640 1 -- 172.21.15.49:0/1059345012 >> v1:172.21.15.49:6789/0 conn(0x7f7fd00c0ee0 legacy=0x7f7fd00c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.890+0000 7f7fd4ccf640 1 -- 172.21.15.49:0/1059345012 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd00c1af0 con 0x7f7fd00cc130 2023-11-18T21:28:55.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.898+0000 7f7fd4ccf640 1 --2- 172.21.15.49:0/1059345012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd00cc130 0x7f7fd0156d50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009870 tx=0x7f7fc001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbccaefaa6e482a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:55.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.902+0000 7f7fc7fff640 1 -- 172.21.15.49:0/1059345012 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00ab600 con 0x7f7fd00cc130 2023-11-18T21:28:55.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.902+0000 7f7fc7fff640 1 -- 172.21.15.49:0/1059345012 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc00a7050 con 0x7f7fd00cc130 2023-11-18T21:28:55.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.902+0000 7f7fc7fff640 1 -- 172.21.15.49:0/1059345012 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00ab980 con 0x7f7fd00cc130 2023-11-18T21:28:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.902+0000 7f7fd7734640 1 -- 172.21.15.49:0/1059345012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd00cc130 msgr2=0x7f7fd0156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.902+0000 7f7fd7734640 1 --2- 172.21.15.49:0/1059345012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd00cc130 0x7f7fd0156d50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009870 tx=0x7f7fc001c4b0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.902+0000 7f7fd7734640 1 -- 172.21.15.49:0/1059345012 shutdown_connections 2023-11-18T21:28:55.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.902+0000 7f7fd7734640 1 --2- 172.21.15.49:0/1059345012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd00cc130 0x7f7fd0156d50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.902+0000 7f7fd7734640 1 --2- 172.21.15.49:0/1059345012 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fd00cbd50 0x7f7fd00c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.902+0000 7f7fd7734640 1 -- 172.21.15.49:0/1059345012 >> 172.21.15.49:0/1059345012 conn(0x7f7fd0070160 msgr2=0x7f7fd006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:55.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.902+0000 7f7fd7734640 1 -- 172.21.15.49:0/1059345012 shutdown_connections 2023-11-18T21:28:55.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.902+0000 7f7fd7734640 1 -- 172.21.15.49:0/1059345012 wait complete. 2023-11-18T21:28:55.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.906+0000 7f7fd7734640 1 Processor -- start 2023-11-18T21:28:55.906 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.906+0000 7f7fd7734640 1 -- start start 2023-11-18T21:28:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.906+0000 7f7fd7734640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fd00c0ee0 0x7f7fd01f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.906+0000 7f7fd7734640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fd00cbd50 0x7f7fd00c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.906+0000 7f7fd7734640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd00cc130 0x7f7fd014c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.906+0000 7f7fd7734640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00c7680 con 0x7f7fd00cc130 2023-11-18T21:28:55.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.906+0000 7f7fd7734640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00c7960 con 0x7f7fd00c0ee0 2023-11-18T21:28:55.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.906+0000 7f7fd7734640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00c3e50 con 0x7f7fd00cbd50 2023-11-18T21:28:55.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.906+0000 7f7fd5cd1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd00cc130 0x7f7fd014c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:55.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.906+0000 7f7fd5cd1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd00cc130 0x7f7fd014c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41216/0 (socket says 172.21.15.49:41216) 2023-11-18T21:28:55.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.906+0000 7f7fd5cd1640 1 -- 172.21.15.49:0/1710047240 learned_addr learned my addr 172.21.15.49:0/1710047240 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:55.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.910+0000 7f7fd5cd1640 1 -- 172.21.15.49:0/1710047240 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fd00cbd50 msgr2=0x7f7fd00c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:55.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.910+0000 7f7fd5cd1640 1 --2- 172.21.15.49:0/1710047240 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fd00cbd50 0x7f7fd00c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.910+0000 7f7fd5cd1640 1 -- 172.21.15.49:0/1710047240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fd00c0ee0 msgr2=0x7f7fd01f0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:55.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.910+0000 7f7fd5cd1640 1 --2- 172.21.15.49:0/1710047240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fd00c0ee0 0x7f7fd01f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:55.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.910+0000 7f7fd5cd1640 1 -- 172.21.15.49:0/1710047240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc00094d0 con 0x7f7fd00cc130 2023-11-18T21:28:55.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.914+0000 7f7fd5cd1640 1 --2- 172.21.15.49:0/1710047240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd00cc130 0x7f7fd014c2a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800c770 tx=0x7f7fc800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:55.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.918+0000 7f7fc5ffb640 1 -- 172.21.15.49:0/1710047240 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8003b80 con 0x7f7fd00cc130 2023-11-18T21:28:55.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.918+0000 7f7fc5ffb640 1 -- 172.21.15.49:0/1710047240 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc8003ce0 con 0x7f7fd00cc130 2023-11-18T21:28:55.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.918+0000 7f7fc5ffb640 1 -- 172.21.15.49:0/1710047240 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc800aa90 con 0x7f7fd00cc130 2023-11-18T21:28:55.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.918+0000 7f7fd7734640 1 -- 172.21.15.49:0/1710047240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd00c4130 con 0x7f7fd00cc130 2023-11-18T21:28:55.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.918+0000 7f7fd7734640 1 -- 172.21.15.49:0/1710047240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd00c7e20 con 0x7f7fd00cc130 2023-11-18T21:28:55.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:55.918+0000 7f7fd7734640 1 -- 172.21.15.49:0/1710047240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd00c3c80 con 0x7f7fd00cc130 2023-11-18T21:28:56.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.214+0000 7f7fc5ffb640 1 -- 172.21.15.49:0/1710047240 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7fc800abf0 con 0x7f7fd00cc130 2023-11-18T21:28:56.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.214+0000 7f7fc5ffb640 1 --2- 172.21.15.49:0/1710047240 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7fb40664a0 0x7f7fb4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:56.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.214+0000 7f7fd54d0640 1 --2- 172.21.15.49:0/1710047240 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7fb40664a0 0x7f7fb4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:56.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.214+0000 7f7fd54d0640 1 --2- 172.21.15.49:0/1710047240 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7fb40664a0 0x7f7fb4068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009730 tx=0x7f7fcc006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:56.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.254+0000 7f7fc5ffb640 1 -- 172.21.15.49:0/1710047240 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f7fc8055ff0 con 0x7f7fd00cc130 2023-11-18T21:28:56.255 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.254+0000 7f7fc5ffb640 1 -- 172.21.15.49:0/1710047240 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7fc8051c30 con 0x7f7fd00cc130 2023-11-18T21:28:56.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.418+0000 7f7fd7734640 1 -- 172.21.15.49:0/1710047240 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fd0072ba0 con 0x7f7fb40664a0 2023-11-18T21:28:56.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.422+0000 7f7fc5ffb640 1 -- 172.21.15.49:0/1710047240 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7fd0072ba0 con 0x7f7fb40664a0 2023-11-18T21:28:56.422 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 2 to deep-scrub 2023-11-18T21:28:56.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.422+0000 7f7fd7734640 1 -- 172.21.15.49:0/1710047240 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7fb40664a0 msgr2=0x7f7fb4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:56.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.422+0000 7f7fd7734640 1 --2- 172.21.15.49:0/1710047240 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7fb40664a0 0x7f7fb4068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009730 tx=0x7f7fcc006ca0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.422+0000 7f7fd7734640 1 -- 172.21.15.49:0/1710047240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd00cc130 msgr2=0x7f7fd014c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:56.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.422+0000 7f7fd7734640 1 --2- 172.21.15.49:0/1710047240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd00cc130 0x7f7fd014c2a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800c770 tx=0x7f7fc800cc30 comp rx=0 tx=0).stop 2023-11-18T21:28:56.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.422+0000 7f7fd7734640 1 -- 172.21.15.49:0/1710047240 shutdown_connections 2023-11-18T21:28:56.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.422+0000 7f7fd7734640 1 --2- 172.21.15.49:0/1710047240 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7fb40664a0 0x7f7fb4068960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.422+0000 7f7fd7734640 1 --2- 172.21.15.49:0/1710047240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fd00cc130 0x7f7fd014c2a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.422+0000 7f7fd7734640 1 --2- 172.21.15.49:0/1710047240 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fd00cbd50 0x7f7fd00c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.422+0000 7f7fd7734640 1 --2- 172.21.15.49:0/1710047240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fd00c0ee0 0x7f7fd01f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.422+0000 7f7fd7734640 1 -- 172.21.15.49:0/1710047240 >> 172.21.15.49:0/1710047240 conn(0x7f7fd0070160 msgr2=0x7f7fd0072490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:56.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.422+0000 7f7fd7734640 1 -- 172.21.15.49:0/1710047240 shutdown_connections 2023-11-18T21:28:56.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.422+0000 7f7fd7734640 1 -- 172.21.15.49:0/1710047240 wait complete. 2023-11-18T21:28:56.441 INFO:tasks.ceph:Scrubbing osd.3 2023-11-18T21:28:56.441 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-18T21:28:56.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.562+0000 7f54900b5640 1 Processor -- start 2023-11-18T21:28:56.564 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.562+0000 7f54900b5640 1 -- start start 2023-11-18T21:28:56.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.562+0000 7f54900b5640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5488151460 0x7f54880c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:56.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.562+0000 7f54900b5640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54880c9130 0x7f54880ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:56.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.562+0000 7f54900b5640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54880c21d0 con 0x7f5488157280 2023-11-18T21:28:56.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.562+0000 7f54900b5640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548806ec00 con 0x7f54880c9130 2023-11-18T21:28:56.565 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.562+0000 7f54900b5640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5488157750 con 0x7f5488151460 2023-11-18T21:28:56.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.566+0000 7f548e652640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54880c9130 0x7f54880ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:56.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.566+0000 7f548e652640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f54880c9130 0x7f54880ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41228/0 (socket says 172.21.15.49:41228) 2023-11-18T21:28:56.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.566+0000 7f548e652640 1 -- 172.21.15.49:0/2577937053 learned_addr learned my addr 172.21.15.49:0/2577937053 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:56.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.566+0000 7f548de51640 1 --2- 172.21.15.49:0/2577937053 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5488151460 0x7f54880c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:56.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.566+0000 7f548e652640 1 -- 172.21.15.49:0/2577937053 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5488151460 msgr2=0x7f54880c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:56.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.566+0000 7f548e652640 1 --2- 172.21.15.49:0/2577937053 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5488151460 0x7f54880c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.566+0000 7f548e652640 1 -- 172.21.15.49:0/2577937053 >> v1:172.21.15.49:6789/0 conn(0x7f5488157280 legacy=0x7f548806f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:56.569 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.566+0000 7f548e652640 1 -- 172.21.15.49:0/2577937053 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5488157a30 con 0x7f54880c9130 2023-11-18T21:28:56.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.574+0000 7f548e652640 1 --2- 172.21.15.49:0/2577937053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54880c9130 0x7f54880ccad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5480009e50 tx=0x7f548001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b3b284e24d0c0e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.574+0000 7f548ce4f640 1 -- 172.21.15.49:0/2577937053 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54800a5720 con 0x7f54880c9130 2023-11-18T21:28:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.574+0000 7f548ce4f640 1 -- 172.21.15.49:0/2577937053 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54800a5880 con 0x7f54880c9130 2023-11-18T21:28:56.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.574+0000 7f548ce4f640 1 -- 172.21.15.49:0/2577937053 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54800a5c10 con 0x7f54880c9130 2023-11-18T21:28:56.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 -- 172.21.15.49:0/2577937053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54880c9130 msgr2=0x7f54880ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:56.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 --2- 172.21.15.49:0/2577937053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54880c9130 0x7f54880ccad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5480009e50 tx=0x7f548001c950 comp rx=0 tx=0).stop 2023-11-18T21:28:56.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 -- 172.21.15.49:0/2577937053 shutdown_connections 2023-11-18T21:28:56.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 --2- 172.21.15.49:0/2577937053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54880c9130 0x7f54880ccad0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 --2- 172.21.15.49:0/2577937053 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5488151460 0x7f54880c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 -- 172.21.15.49:0/2577937053 >> 172.21.15.49:0/2577937053 conn(0x7f54880708a0 msgr2=0x7f5488070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:56.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 -- 172.21.15.49:0/2577937053 shutdown_connections 2023-11-18T21:28:56.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 -- 172.21.15.49:0/2577937053 wait complete. 2023-11-18T21:28:56.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 Processor -- start 2023-11-18T21:28:56.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 -- start start 2023-11-18T21:28:56.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54880c9130 0x7f5488143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:56.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5488151460 0x7f54880c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:56.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5488157280 0x7f5488141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:56.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548814c570 con 0x7f5488151460 2023-11-18T21:28:56.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5488144440 con 0x7f5488157280 2023-11-18T21:28:56.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f54900b5640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548814b590 con 0x7f54880c9130 2023-11-18T21:28:56.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f548d650640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5488151460 0x7f54880c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:56.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f548d650640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5488151460 0x7f54880c78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41240/0 (socket says 172.21.15.49:41240) 2023-11-18T21:28:56.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f548d650640 1 -- 172.21.15.49:0/946813287 learned_addr learned my addr 172.21.15.49:0/946813287 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:56.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.578+0000 7f548de51640 1 --2- 172.21.15.49:0/946813287 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54880c9130 0x7f5488143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:56.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.582+0000 7f548e652640 1 --2- 172.21.15.49:0/946813287 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5488157280 0x7f5488141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:56.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.582+0000 7f548d650640 1 -- 172.21.15.49:0/946813287 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54880c9130 msgr2=0x7f5488143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:56.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.582+0000 7f548d650640 1 --2- 172.21.15.49:0/946813287 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54880c9130 0x7f5488143f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.582+0000 7f548d650640 1 -- 172.21.15.49:0/946813287 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5488157280 msgr2=0x7f5488141aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:56.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.582+0000 7f548d650640 1 --2- 172.21.15.49:0/946813287 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5488157280 0x7f5488141aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.582+0000 7f548d650640 1 -- 172.21.15.49:0/946813287 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5480009b30 con 0x7f5488151460 2023-11-18T21:28:56.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.586+0000 7f548d650640 1 --2- 172.21.15.49:0/946813287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5488151460 0x7f54880c78c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f547800c390 tx=0x7f547800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:56.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.590+0000 7f547e7fc640 1 -- 172.21.15.49:0/946813287 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54780052d0 con 0x7f5488151460 2023-11-18T21:28:56.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.590+0000 7f547e7fc640 1 -- 172.21.15.49:0/946813287 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5478005430 con 0x7f5488151460 2023-11-18T21:28:56.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.590+0000 7f547e7fc640 1 -- 172.21.15.49:0/946813287 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478003820 con 0x7f5488151460 2023-11-18T21:28:56.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.590+0000 7f54900b5640 1 -- 172.21.15.49:0/946813287 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54881475d0 con 0x7f5488151460 2023-11-18T21:28:56.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.590+0000 7f54900b5640 1 -- 172.21.15.49:0/946813287 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548814ce30 con 0x7f5488151460 2023-11-18T21:28:56.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.590+0000 7f54900b5640 1 -- 172.21.15.49:0/946813287 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f54880c1ef0 con 0x7f5488151460 2023-11-18T21:28:56.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.610+0000 7f547e7fc640 1 -- 172.21.15.49:0/946813287 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5478003980 con 0x7f5488151460 2023-11-18T21:28:56.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.610+0000 7f547e7fc640 1 --2- 172.21.15.49:0/946813287 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f546c0664c0 0x7f546c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:56.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.610+0000 7f548de51640 1 --2- 172.21.15.49:0/946813287 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f546c0664c0 0x7f546c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:56.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.610+0000 7f548de51640 1 --2- 172.21.15.49:0/946813287 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f546c0664c0 0x7f546c068980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f54840079c0 tx=0x7f5484008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:56.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.614+0000 7f547e7fc640 1 -- 172.21.15.49:0/946813287 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f5478054ca0 con 0x7f5488151460 2023-11-18T21:28:56.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.614+0000 7f547e7fc640 1 --2- 172.21.15.49:0/946813287 >> [v2:172.21.15.49:6824/2157206456,v1:172.21.15.49:6825/2157206456] conn(0x7f546c06fac0 0x7f546c071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:56.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.614+0000 7f547e7fc640 1 -- 172.21.15.49:0/946813287 --> [v2:172.21.15.49:6824/2157206456,v1:172.21.15.49:6825/2157206456] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f546c072610 con 0x7f546c06fac0 2023-11-18T21:28:56.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.614+0000 7f548e652640 1 --2- 172.21.15.49:0/946813287 >> [v2:172.21.15.49:6824/2157206456,v1:172.21.15.49:6825/2157206456] conn(0x7f546c06fac0 0x7f546c071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:56.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.614+0000 7f548e652640 1 --2- 172.21.15.49:0/946813287 >> [v2:172.21.15.49:6824/2157206456,v1:172.21.15.49:6825/2157206456] conn(0x7f546c06fac0 0x7f546c071f40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:56.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.614+0000 7f547e7fc640 1 -- 172.21.15.49:0/946813287 <== osd.3 v2:172.21.15.49:6824/2157206456 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f546c072610 con 0x7f546c06fac0 2023-11-18T21:28:56.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.614+0000 7f547e7fc640 1 -- 172.21.15.49:0/946813287 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5478001130 con 0x7f5488151460 2023-11-18T21:28:56.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.626+0000 7f54900b5640 1 -- 172.21.15.49:0/946813287 --> [v2:172.21.15.49:6824/2157206456,v1:172.21.15.49:6825/2157206456] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5488143cc0 con 0x7f546c06fac0 2023-11-18T21:28:56.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.626+0000 7f547e7fc640 1 -- 172.21.15.49:0/946813287 <== osd.3 v2:172.21.15.49:6824/2157206456 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5488143cc0 con 0x7f546c06fac0 2023-11-18T21:28:56.629 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T21:28:56.629 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T21:28:56.629 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T21:28:56.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.626+0000 7f54900b5640 1 -- 172.21.15.49:0/946813287 >> [v2:172.21.15.49:6824/2157206456,v1:172.21.15.49:6825/2157206456] conn(0x7f546c06fac0 msgr2=0x7f546c071f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:56.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.626+0000 7f54900b5640 1 --2- 172.21.15.49:0/946813287 >> [v2:172.21.15.49:6824/2157206456,v1:172.21.15.49:6825/2157206456] conn(0x7f546c06fac0 0x7f546c071f40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.626+0000 7f54900b5640 1 -- 172.21.15.49:0/946813287 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f546c0664c0 msgr2=0x7f546c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:56.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.626+0000 7f54900b5640 1 --2- 172.21.15.49:0/946813287 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f546c0664c0 0x7f546c068980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f54840079c0 tx=0x7f5484008040 comp rx=0 tx=0).stop 2023-11-18T21:28:56.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.626+0000 7f54900b5640 1 -- 172.21.15.49:0/946813287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5488151460 msgr2=0x7f54880c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:56.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.626+0000 7f54900b5640 1 --2- 172.21.15.49:0/946813287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5488151460 0x7f54880c78c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f547800c390 tx=0x7f547800c850 comp rx=0 tx=0).stop 2023-11-18T21:28:56.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.626+0000 7f548e652640 1 -- 172.21.15.49:0/946813287 reap_dead start 2023-11-18T21:28:56.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.626+0000 7f54900b5640 1 -- 172.21.15.49:0/946813287 shutdown_connections 2023-11-18T21:28:56.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.626+0000 7f54900b5640 1 -- 172.21.15.49:0/946813287 >> 172.21.15.49:0/946813287 conn(0x7f54880708a0 msgr2=0x7f54881550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:56.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.630+0000 7f54900b5640 1 -- 172.21.15.49:0/946813287 shutdown_connections 2023-11-18T21:28:56.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.630+0000 7f54900b5640 1 -- 172.21.15.49:0/946813287 wait complete. 2023-11-18T21:28:56.646 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-18T21:28:56.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.762+0000 7fe0bebe8640 1 Processor -- start 2023-11-18T21:28:56.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.762+0000 7fe0bebe8640 1 -- start start 2023-11-18T21:28:56.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.766+0000 7fe0bebe8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe0b80ccfb0 0x7fe0b80cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:56.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.766+0000 7fe0bebe8640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0b81572c0 0x7fe0b80c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:56.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.766+0000 7fe0bebe8640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b80c9aa0 con 0x7fe0b815a830 2023-11-18T21:28:56.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.766+0000 7fe0bebe8640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b81576d0 con 0x7fe0b81572c0 2023-11-18T21:28:56.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.766+0000 7fe0bebe8640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b815adb0 con 0x7fe0b80ccfb0 2023-11-18T21:28:56.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.766+0000 7fe0bd185640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe0b81572c0 0x7fe0b80c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:56.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.766+0000 7fe0affff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe0b815a830 0x7fe0b8151160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35698/0 (socket says 172.21.15.49:35698) 2023-11-18T21:28:56.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.766+0000 7fe0affff640 1 -- 172.21.15.49:0/2113398172 learned_addr learned my addr 172.21.15.49:0/2113398172 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:56.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.774+0000 7fe0bd185640 1 -- 172.21.15.49:0/2113398172 >> v2:172.21.15.106:3300/0 conn(0x7fe0b80ccfb0 msgr2=0x7fe0b80cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:56.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.774+0000 7fe0bd185640 1 --2- 172.21.15.49:0/2113398172 >> v2:172.21.15.106:3300/0 conn(0x7fe0b80ccfb0 0x7fe0b80cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.774+0000 7fe0bd185640 1 -- 172.21.15.49:0/2113398172 >> v1:172.21.15.49:6789/0 conn(0x7fe0b815a830 legacy=0x7fe0b8151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:56.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.774+0000 7fe0bd185640 1 -- 172.21.15.49:0/2113398172 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b815b050 con 0x7fe0b81572c0 2023-11-18T21:28:56.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.786+0000 7fe0bd185640 1 --2- 172.21.15.49:0/2113398172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0b81572c0 0x7fe0b80c9f30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe0b80cdb80 tx=0x7fe0b001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954b822d4b734e56 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:56.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.798+0000 7fe0af7fe640 1 -- 172.21.15.49:0/2113398172 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b00b0440 con 0x7fe0b81572c0 2023-11-18T21:28:56.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.798+0000 7fe0af7fe640 1 -- 172.21.15.49:0/2113398172 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b00b05a0 con 0x7fe0b81572c0 2023-11-18T21:28:56.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.798+0000 7fe0af7fe640 1 -- 172.21.15.49:0/2113398172 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b00b0930 con 0x7fe0b81572c0 2023-11-18T21:28:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.798+0000 7fe0bebe8640 1 -- 172.21.15.49:0/2113398172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0b81572c0 msgr2=0x7fe0b80c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.798+0000 7fe0bebe8640 1 --2- 172.21.15.49:0/2113398172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0b81572c0 0x7fe0b80c9f30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe0b80cdb80 tx=0x7fe0b001f0f0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.798+0000 7fe0bebe8640 1 -- 172.21.15.49:0/2113398172 shutdown_connections 2023-11-18T21:28:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.798+0000 7fe0bebe8640 1 --2- 172.21.15.49:0/2113398172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0b81572c0 0x7fe0b80c9f30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.798+0000 7fe0bebe8640 1 --2- 172.21.15.49:0/2113398172 >> v2:172.21.15.106:3300/0 conn(0x7fe0b80ccfb0 0x7fe0b80cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.798+0000 7fe0bebe8640 1 -- 172.21.15.49:0/2113398172 >> 172.21.15.49:0/2113398172 conn(0x7fe0b8061400 msgr2=0x7fe0b8061810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.798+0000 7fe0bebe8640 1 -- 172.21.15.49:0/2113398172 shutdown_connections 2023-11-18T21:28:56.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.798+0000 7fe0bebe8640 1 -- 172.21.15.49:0/2113398172 wait complete. 2023-11-18T21:28:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.798+0000 7fe0bebe8640 1 Processor -- start 2023-11-18T21:28:56.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.798+0000 7fe0bebe8640 1 -- start start 2023-11-18T21:28:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.802+0000 7fe0bebe8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b80ccfb0 0x7fe0b80c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.802+0000 7fe0bebe8640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0b81572c0 0x7fe0b814ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.802+0000 7fe0bebe8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0b815a830 0x7fe0b814f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.802+0000 7fe0bebe8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b8150960 con 0x7fe0b815a830 2023-11-18T21:28:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.802+0000 7fe0bebe8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b814b8d0 con 0x7fe0b80ccfb0 2023-11-18T21:28:56.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.802+0000 7fe0bebe8640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b81540a0 con 0x7fe0b81572c0 2023-11-18T21:28:56.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.802+0000 7fe0bc984640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b80ccfb0 0x7fe0b80c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:56.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.802+0000 7fe0affff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0b81572c0 0x7fe0b814ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:56.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.802+0000 7fe0affff640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0b81572c0 0x7fe0b814ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:40870/0 (socket says 172.21.15.49:40870) 2023-11-18T21:28:56.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.802+0000 7fe0affff640 1 -- 172.21.15.49:0/840132099 learned_addr learned my addr 172.21.15.49:0/840132099 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:56.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.814+0000 7fe0affff640 1 -- 172.21.15.49:0/840132099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b80ccfb0 msgr2=0x7fe0b80c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:56.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.814+0000 7fe0affff640 1 --2- 172.21.15.49:0/840132099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b80ccfb0 0x7fe0b80c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.814+0000 7fe0affff640 1 -- 172.21.15.49:0/840132099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0b815a830 msgr2=0x7fe0b814f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:56.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.814+0000 7fe0affff640 1 --2- 172.21.15.49:0/840132099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0b815a830 0x7fe0b814f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:56.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.814+0000 7fe0affff640 1 -- 172.21.15.49:0/840132099 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b0009a70 con 0x7fe0b81572c0 2023-11-18T21:28:56.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.818+0000 7fe0affff640 1 --2- 172.21.15.49:0/840132099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0b81572c0 0x7fe0b814ecb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800c370 tx=0x7fe0a800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:56.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.830+0000 7fe0ad7fa640 1 -- 172.21.15.49:0/840132099 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8005cf0 con 0x7fe0b81572c0 2023-11-18T21:28:56.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.830+0000 7fe0ad7fa640 1 -- 172.21.15.49:0/840132099 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a8005e50 con 0x7fe0b81572c0 2023-11-18T21:28:56.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.830+0000 7fe0ad7fa640 1 -- 172.21.15.49:0/840132099 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a80072d0 con 0x7fe0b81572c0 2023-11-18T21:28:56.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.830+0000 7fe0bebe8640 1 -- 172.21.15.49:0/840132099 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b8154360 con 0x7fe0b81572c0 2023-11-18T21:28:56.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.830+0000 7fe0bebe8640 1 -- 172.21.15.49:0/840132099 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b814b5f0 con 0x7fe0b81572c0 2023-11-18T21:28:56.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:56.830+0000 7fe0bebe8640 1 -- 172.21.15.49:0/840132099 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b8073e70 con 0x7fe0b81572c0 2023-11-18T21:28:57.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.242+0000 7fe0ad7fa640 1 -- 172.21.15.49:0/840132099 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe0a8007430 con 0x7fe0b81572c0 2023-11-18T21:28:57.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.242+0000 7fe0ad7fa640 1 --2- 172.21.15.49:0/840132099 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe0a40664c0 0x7fe0a4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:57.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.242+0000 7fe0bc984640 1 --2- 172.21.15.49:0/840132099 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe0a40664c0 0x7fe0a4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:57.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.242+0000 7fe0bc984640 1 --2- 172.21.15.49:0/840132099 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe0a40664c0 0x7fe0a4068980 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40098f0 tx=0x7fe0b4006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:57.250 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.250+0000 7fe0ad7fa640 1 -- 172.21.15.49:0/840132099 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fe0a8054930 con 0x7fe0b81572c0 2023-11-18T21:28:57.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.278+0000 7fe0ad7fa640 1 -- 172.21.15.49:0/840132099 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe0a8050c70 con 0x7fe0b81572c0 2023-11-18T21:28:57.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.454+0000 7fe0bebe8640 1 -- 172.21.15.49:0/840132099 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0b80c6a10 con 0x7fe0a40664c0 2023-11-18T21:28:57.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.458+0000 7fe0ad7fa640 1 -- 172.21.15.49:0/840132099 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe0b80c6a10 con 0x7fe0a40664c0 2023-11-18T21:28:57.458 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 3 to deep-scrub 2023-11-18T21:28:57.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.458+0000 7fe0bebe8640 1 -- 172.21.15.49:0/840132099 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe0a40664c0 msgr2=0x7fe0a4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:57.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.458+0000 7fe0bebe8640 1 --2- 172.21.15.49:0/840132099 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe0a40664c0 0x7fe0a4068980 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40098f0 tx=0x7fe0b4006f90 comp rx=0 tx=0).stop 2023-11-18T21:28:57.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.458+0000 7fe0bebe8640 1 -- 172.21.15.49:0/840132099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0b81572c0 msgr2=0x7fe0b814ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:57.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.458+0000 7fe0bebe8640 1 --2- 172.21.15.49:0/840132099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0b81572c0 0x7fe0b814ecb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800c370 tx=0x7fe0a800c830 comp rx=0 tx=0).stop 2023-11-18T21:28:57.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.458+0000 7fe0bebe8640 1 -- 172.21.15.49:0/840132099 shutdown_connections 2023-11-18T21:28:57.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.458+0000 7fe0bebe8640 1 --2- 172.21.15.49:0/840132099 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fe0a40664c0 0x7fe0a4068980 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.458+0000 7fe0bebe8640 1 --2- 172.21.15.49:0/840132099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0b815a830 0x7fe0b814f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.458+0000 7fe0bebe8640 1 --2- 172.21.15.49:0/840132099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0b81572c0 0x7fe0b814ecb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.458+0000 7fe0bebe8640 1 --2- 172.21.15.49:0/840132099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b80ccfb0 0x7fe0b80c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.458+0000 7fe0bebe8640 1 -- 172.21.15.49:0/840132099 >> 172.21.15.49:0/840132099 conn(0x7fe0b8061400 msgr2=0x7fe0b8156aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:57.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.458+0000 7fe0bebe8640 1 -- 172.21.15.49:0/840132099 shutdown_connections 2023-11-18T21:28:57.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.458+0000 7fe0bebe8640 1 -- 172.21.15.49:0/840132099 wait complete. 2023-11-18T21:28:57.479 INFO:tasks.ceph:Scrubbing osd.4 2023-11-18T21:28:57.479 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-18T21:28:57.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.610+0000 7efea4b73640 1 Processor -- start 2023-11-18T21:28:57.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.610+0000 7efea4b73640 1 -- start start 2023-11-18T21:28:57.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.610+0000 7efea4b73640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efea00c4630 0x7efea00c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:57.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.610+0000 7efea4b73640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efea00c4a10 0x7efea01596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:57.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.610+0000 7efea4b73640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea0159c00 0x7efea014fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:57.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.610+0000 7efea4b73640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea00c4f40 con 0x7efea00c4a10 2023-11-18T21:28:57.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.610+0000 7efea4b73640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea015a6c0 con 0x7efea00c4630 2023-11-18T21:28:57.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.610+0000 7efea4b73640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea01560d0 con 0x7efea0159c00 2023-11-18T21:28:57.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.610+0000 7efe9dd9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efea00c4a10 0x7efea01596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:57.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.614+0000 7efe9ed9d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea0159c00 0x7efea014fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:57.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.614+0000 7efe9dd9b640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efea00c4a10 0x7efea01596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41266/0 (socket says 172.21.15.49:41266) 2023-11-18T21:28:57.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.614+0000 7efe9dd9b640 1 -- 172.21.15.49:0/3518442120 learned_addr learned my addr 172.21.15.49:0/3518442120 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:57.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.614+0000 7efe9dd9b640 1 -- 172.21.15.49:0/3518442120 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea0159c00 msgr2=0x7efea014fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:57.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.614+0000 7efe9dd9b640 1 --2- 172.21.15.49:0/3518442120 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea0159c00 0x7efea014fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.614+0000 7efe9dd9b640 1 -- 172.21.15.49:0/3518442120 >> v2:172.21.15.106:3300/0 conn(0x7efea00c4630 msgr2=0x7efea00c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:57.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.614+0000 7efe9dd9b640 1 --2- 172.21.15.49:0/3518442120 >> v2:172.21.15.106:3300/0 conn(0x7efea00c4630 0x7efea00c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.614+0000 7efe9dd9b640 1 -- 172.21.15.49:0/3518442120 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea00c72b0 con 0x7efea00c4a10 2023-11-18T21:28:57.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.618+0000 7efe9dd9b640 1 --2- 172.21.15.49:0/3518442120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efea00c4a10 0x7efea01596c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efea006f8a0 tx=0x7efe9001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492072823dfaf12f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:57.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.622+0000 7efe9d59a640 1 -- 172.21.15.49:0/3518442120 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe900a89b0 con 0x7efea00c4a10 2023-11-18T21:28:57.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.622+0000 7efe9d59a640 1 -- 172.21.15.49:0/3518442120 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe900a8b10 con 0x7efea00c4a10 2023-11-18T21:28:57.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.622+0000 7efe9d59a640 1 -- 172.21.15.49:0/3518442120 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe900a8ea0 con 0x7efea00c4a10 2023-11-18T21:28:57.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.622+0000 7efea4b73640 1 -- 172.21.15.49:0/3518442120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efea00c4a10 msgr2=0x7efea01596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:57.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.622+0000 7efea4b73640 1 --2- 172.21.15.49:0/3518442120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efea00c4a10 0x7efea01596c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efea006f8a0 tx=0x7efe9001ecf0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 -- 172.21.15.49:0/3518442120 shutdown_connections 2023-11-18T21:28:57.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 --2- 172.21.15.49:0/3518442120 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea0159c00 0x7efea014fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 --2- 172.21.15.49:0/3518442120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efea00c4a10 0x7efea01596c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 --2- 172.21.15.49:0/3518442120 >> v2:172.21.15.106:3300/0 conn(0x7efea00c4630 0x7efea00c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 -- 172.21.15.49:0/3518442120 >> 172.21.15.49:0/3518442120 conn(0x7efea006c6a0 msgr2=0x7efea006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:57.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 -- 172.21.15.49:0/3518442120 shutdown_connections 2023-11-18T21:28:57.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 -- 172.21.15.49:0/3518442120 wait complete. 2023-11-18T21:28:57.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 Processor -- start 2023-11-18T21:28:57.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 -- start start 2023-11-18T21:28:57.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efea00c4630 0x7efea0141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:57.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efea00c4a10 0x7efea0154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:57.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea0159c00 0x7efea01553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:57.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea00ca250 con 0x7efea00c4630 2023-11-18T21:28:57.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea00ca740 con 0x7efea00c4a10 2023-11-18T21:28:57.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efea4b73640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea01549f0 con 0x7efea0159c00 2023-11-18T21:28:57.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.626+0000 7efe9ed9d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea0159c00 0x7efea01553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:57.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.630+0000 7efe9ed9d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea0159c00 0x7efea01553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:40894/0 (socket says 172.21.15.49:40894) 2023-11-18T21:28:57.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.630+0000 7efe9ed9d640 1 -- 172.21.15.49:0/897516109 learned_addr learned my addr 172.21.15.49:0/897516109 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:57.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.630+0000 7efe9dd9b640 1 --2- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efea00c4a10 0x7efea0154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:57.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.638+0000 7efe9ed9d640 1 -- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efea00c4a10 msgr2=0x7efea0154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:57.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.638+0000 7efe9ed9d640 1 --2- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efea00c4a10 0x7efea0154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.638+0000 7efe9ed9d640 1 -- 172.21.15.49:0/897516109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efea00c4630 msgr2=0x7efea0141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:57.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.638+0000 7efe9ed9d640 1 --2- 172.21.15.49:0/897516109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efea00c4630 0x7efea0141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.638+0000 7efe9ed9d640 1 -- 172.21.15.49:0/897516109 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe900094d0 con 0x7efea0159c00 2023-11-18T21:28:57.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.642+0000 7efe9ed9d640 1 --2- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea0159c00 0x7efea01553c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe9800efc0 tx=0x7efe9800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:57.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.654+0000 7efe8effd640 1 -- 172.21.15.49:0/897516109 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98014480 con 0x7efea0159c00 2023-11-18T21:28:57.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.654+0000 7efe8effd640 1 -- 172.21.15.49:0/897516109 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9800f040 con 0x7efea0159c00 2023-11-18T21:28:57.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.654+0000 7efe8effd640 1 -- 172.21.15.49:0/897516109 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98014820 con 0x7efea0159c00 2023-11-18T21:28:57.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.654+0000 7efea4b73640 1 -- 172.21.15.49:0/897516109 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea013eaa0 con 0x7efea0159c00 2023-11-18T21:28:57.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.654+0000 7efea4b73640 1 -- 172.21.15.49:0/897516109 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea00ca460 con 0x7efea0159c00 2023-11-18T21:28:57.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.654+0000 7efea4b73640 1 -- 172.21.15.49:0/897516109 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efea01562e0 con 0x7efea0159c00 2023-11-18T21:28:57.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.710+0000 7efe8effd640 1 -- 172.21.15.49:0/897516109 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efe98014980 con 0x7efea0159c00 2023-11-18T21:28:57.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.710+0000 7efe8effd640 1 --2- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efe800664c0 0x7efe80068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:57.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.710+0000 7efe9e59c640 1 --2- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efe800664c0 0x7efe80068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:57.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.710+0000 7efe9e59c640 1 --2- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efe800664c0 0x7efe80068980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efe94009690 tx=0x7efe94006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:57.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.714+0000 7efe8effd640 1 -- 172.21.15.49:0/897516109 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7efe98056e80 con 0x7efea0159c00 2023-11-18T21:28:57.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.714+0000 7efe8effd640 1 --2- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:6818/3891839772,v1:172.21.15.106:6819/3891839772] conn(0x7efe8006fac0 0x7efe80071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:57.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.714+0000 7efe8effd640 1 -- 172.21.15.49:0/897516109 --> [v2:172.21.15.106:6818/3891839772,v1:172.21.15.106:6819/3891839772] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe80072610 con 0x7efe8006fac0 2023-11-18T21:28:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.714+0000 7efe8effd640 1 -- 172.21.15.49:0/897516109 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe98052ac0 con 0x7efea0159c00 2023-11-18T21:28:57.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.714+0000 7efe9dd9b640 1 --2- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:6818/3891839772,v1:172.21.15.106:6819/3891839772] conn(0x7efe8006fac0 0x7efe80071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:57.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.718+0000 7efe9dd9b640 1 --2- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:6818/3891839772,v1:172.21.15.106:6819/3891839772] conn(0x7efe8006fac0 0x7efe80071f40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:57.719 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.718+0000 7efe8effd640 1 -- 172.21.15.49:0/897516109 <== osd.4 v2:172.21.15.106:6818/3891839772 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efe80072610 con 0x7efe8006fac0 2023-11-18T21:28:57.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.734+0000 7efea4b73640 1 -- 172.21.15.49:0/897516109 --> [v2:172.21.15.106:6818/3891839772,v1:172.21.15.106:6819/3891839772] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efea015a3e0 con 0x7efe8006fac0 2023-11-18T21:28:57.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.738+0000 7efe8effd640 1 -- 172.21.15.49:0/897516109 <== osd.4 v2:172.21.15.106:6818/3891839772 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efe900a8950 con 0x7efe8006fac0 2023-11-18T21:28:57.738 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T21:28:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T21:28:57.739 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T21:28:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.738+0000 7efea4b73640 1 -- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:6818/3891839772,v1:172.21.15.106:6819/3891839772] conn(0x7efe8006fac0 msgr2=0x7efe80071f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.738+0000 7efea4b73640 1 --2- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:6818/3891839772,v1:172.21.15.106:6819/3891839772] conn(0x7efe8006fac0 0x7efe80071f40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.738+0000 7efea4b73640 1 -- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efe800664c0 msgr2=0x7efe80068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.738+0000 7efea4b73640 1 --2- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efe800664c0 0x7efe80068980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efe94009690 tx=0x7efe94006c00 comp rx=0 tx=0).stop 2023-11-18T21:28:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.738+0000 7efea4b73640 1 -- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea0159c00 msgr2=0x7efea01553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.738+0000 7efea4b73640 1 --2- 172.21.15.49:0/897516109 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efea0159c00 0x7efea01553c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe9800efc0 tx=0x7efe9800c490 comp rx=0 tx=0).stop 2023-11-18T21:28:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.738+0000 7efe9ed9d640 1 -- 172.21.15.49:0/897516109 reap_dead start 2023-11-18T21:28:57.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.738+0000 7efea4b73640 1 -- 172.21.15.49:0/897516109 shutdown_connections 2023-11-18T21:28:57.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.738+0000 7efea4b73640 1 -- 172.21.15.49:0/897516109 >> 172.21.15.49:0/897516109 conn(0x7efea006c6a0 msgr2=0x7efea014cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:57.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.738+0000 7efea4b73640 1 -- 172.21.15.49:0/897516109 shutdown_connections 2023-11-18T21:28:57.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.738+0000 7efea4b73640 1 -- 172.21.15.49:0/897516109 wait complete. 2023-11-18T21:28:57.759 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-18T21:28:57.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.890+0000 7f674673d640 1 Processor -- start 2023-11-18T21:28:57.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.890+0000 7f674673d640 1 -- start start 2023-11-18T21:28:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.894+0000 7f674673d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f67400cc3c0 0x7f67400ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.894+0000 7f674673d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f674015a280 0x7f6740163e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.894+0000 7f674673d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67400cd9a0 con 0x7f67400ce0c0 2023-11-18T21:28:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.894+0000 7f674673d640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67400ca550 con 0x7f67400cc3c0 2023-11-18T21:28:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.894+0000 7f674673d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67400ce9e0 con 0x7f674015a280 2023-11-18T21:28:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.894+0000 7f673f7fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f67400cc3c0 0x7f67400ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:57.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.894+0000 7f673ffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f67400ce0c0 0x7f6740159b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35702/0 (socket says 172.21.15.49:35702) 2023-11-18T21:28:57.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.894+0000 7f673ffff640 1 -- 172.21.15.49:0/867108358 learned_addr learned my addr 172.21.15.49:0/867108358 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:57.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.894+0000 7f6744cda640 1 --2- 172.21.15.49:0/867108358 >> v2:172.21.15.106:3300/0 conn(0x7f674015a280 0x7f6740163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:57.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.898+0000 7f673f7fe640 1 -- 172.21.15.49:0/867108358 >> v2:172.21.15.106:3300/0 conn(0x7f674015a280 msgr2=0x7f6740163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:57.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.898+0000 7f673f7fe640 1 --2- 172.21.15.49:0/867108358 >> v2:172.21.15.106:3300/0 conn(0x7f674015a280 0x7f6740163e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.898+0000 7f673f7fe640 1 -- 172.21.15.49:0/867108358 >> v1:172.21.15.49:6789/0 conn(0x7f67400ce0c0 legacy=0x7f6740159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:57.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.898+0000 7f673f7fe640 1 -- 172.21.15.49:0/867108358 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67401596c0 con 0x7f67400cc3c0 2023-11-18T21:28:57.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.902+0000 7f673f7fe640 1 --2- 172.21.15.49:0/867108358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cc3c0 0x7f67400ce4a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f67400ca7a0 tx=0x7f672801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a099d09f223df40 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:57.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.906+0000 7f673effd640 1 -- 172.21.15.49:0/867108358 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67280ab660 con 0x7f67400cc3c0 2023-11-18T21:28:57.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.906+0000 7f673effd640 1 -- 172.21.15.49:0/867108358 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67280ab7c0 con 0x7f67400cc3c0 2023-11-18T21:28:57.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.906+0000 7f673effd640 1 -- 172.21.15.49:0/867108358 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67280abb50 con 0x7f67400cc3c0 2023-11-18T21:28:57.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 -- 172.21.15.49:0/867108358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cc3c0 msgr2=0x7f67400ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:57.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 --2- 172.21.15.49:0/867108358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cc3c0 0x7f67400ce4a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f67400ca7a0 tx=0x7f672801c460 comp rx=0 tx=0).stop 2023-11-18T21:28:57.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 -- 172.21.15.49:0/867108358 shutdown_connections 2023-11-18T21:28:57.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 --2- 172.21.15.49:0/867108358 >> v2:172.21.15.106:3300/0 conn(0x7f674015a280 0x7f6740163e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 --2- 172.21.15.49:0/867108358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400cc3c0 0x7f67400ce4a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 -- 172.21.15.49:0/867108358 >> 172.21.15.49:0/867108358 conn(0x7f67400b07c0 msgr2=0x7f67400b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:57.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 -- 172.21.15.49:0/867108358 shutdown_connections 2023-11-18T21:28:57.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 -- 172.21.15.49:0/867108358 wait complete. 2023-11-18T21:28:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 Processor -- start 2023-11-18T21:28:57.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 -- start start 2023-11-18T21:28:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67400cc3c0 0x7f67400b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400ce0c0 0x7f674014deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f674015a280 0x7f674014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674015c7f0 con 0x7f67400ce0c0 2023-11-18T21:28:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674015b490 con 0x7f67400cc3c0 2023-11-18T21:28:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f674673d640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674014e930 con 0x7f674015a280 2023-11-18T21:28:57.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f673f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400ce0c0 0x7f674014deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:57.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f673f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400ce0c0 0x7f674014deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41294/0 (socket says 172.21.15.49:41294) 2023-11-18T21:28:57.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.910+0000 7f673f7fe640 1 -- 172.21.15.49:0/3631318155 learned_addr learned my addr 172.21.15.49:0/3631318155 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:57.914 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.914+0000 7f673ffff640 1 --2- 172.21.15.49:0/3631318155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67400cc3c0 0x7f67400b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.914+0000 7f6744cda640 1 --2- 172.21.15.49:0/3631318155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f674015a280 0x7f674014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:57.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.914+0000 7f673f7fe640 1 -- 172.21.15.49:0/3631318155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f674015a280 msgr2=0x7f674014d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:57.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.914+0000 7f673f7fe640 1 --2- 172.21.15.49:0/3631318155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f674015a280 0x7f674014d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.914+0000 7f673f7fe640 1 -- 172.21.15.49:0/3631318155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67400cc3c0 msgr2=0x7f67400b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:57.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.914+0000 7f673f7fe640 1 --2- 172.21.15.49:0/3631318155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67400cc3c0 0x7f67400b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:57.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.914+0000 7f673f7fe640 1 -- 172.21.15.49:0/3631318155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6728009420 con 0x7f67400ce0c0 2023-11-18T21:28:57.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.918+0000 7f673f7fe640 1 --2- 172.21.15.49:0/3631318155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400ce0c0 0x7f674014deb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f67280ad040 tx=0x7f672801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:57.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.922+0000 7f673cff9640 1 -- 172.21.15.49:0/3631318155 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67280bf610 con 0x7f67400ce0c0 2023-11-18T21:28:57.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.922+0000 7f673cff9640 1 -- 172.21.15.49:0/3631318155 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67280bf790 con 0x7f67400ce0c0 2023-11-18T21:28:57.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.922+0000 7f673cff9640 1 -- 172.21.15.49:0/3631318155 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67280bfb40 con 0x7f67400ce0c0 2023-11-18T21:28:57.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.922+0000 7f674673d640 1 -- 172.21.15.49:0/3631318155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674015ca40 con 0x7f67400ce0c0 2023-11-18T21:28:57.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.922+0000 7f674673d640 1 -- 172.21.15.49:0/3631318155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674015bae0 con 0x7f67400ce0c0 2023-11-18T21:28:57.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:57.922+0000 7f674673d640 1 -- 172.21.15.49:0/3631318155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6740067520 con 0x7f67400ce0c0 2023-11-18T21:28:58.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.210+0000 7f673cff9640 1 -- 172.21.15.49:0/3631318155 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f67280a9070 con 0x7f67400ce0c0 2023-11-18T21:28:58.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.214+0000 7f673cff9640 1 --2- 172.21.15.49:0/3631318155 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f67200664c0 0x7f6720068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.214+0000 7f673ffff640 1 --2- 172.21.15.49:0/3631318155 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f67200664c0 0x7f6720068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:58.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.214+0000 7f673ffff640 1 --2- 172.21.15.49:0/3631318155 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f67200664c0 0x7f6720068980 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6730005c10 tx=0x7f6730009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:58.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.254+0000 7f673cff9640 1 -- 172.21.15.49:0/3631318155 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f67280f0030 con 0x7f67400ce0c0 2023-11-18T21:28:58.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.254+0000 7f673cff9640 1 -- 172.21.15.49:0/3631318155 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f67280ec370 con 0x7f67400ce0c0 2023-11-18T21:28:58.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.430+0000 7f674673d640 1 -- 172.21.15.49:0/3631318155 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f67400cb3d0 con 0x7f67200664c0 2023-11-18T21:28:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.434+0000 7f673cff9640 1 -- 172.21.15.49:0/3631318155 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6730001f90 con 0x7f67200664c0 2023-11-18T21:28:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 4 to deep-scrub 2023-11-18T21:28:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.434+0000 7f674673d640 1 -- 172.21.15.49:0/3631318155 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f67200664c0 msgr2=0x7f6720068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.434+0000 7f674673d640 1 --2- 172.21.15.49:0/3631318155 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f67200664c0 0x7f6720068980 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6730005c10 tx=0x7f6730009040 comp rx=0 tx=0).stop 2023-11-18T21:28:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.434+0000 7f674673d640 1 -- 172.21.15.49:0/3631318155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400ce0c0 msgr2=0x7f674014deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.434+0000 7f674673d640 1 --2- 172.21.15.49:0/3631318155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400ce0c0 0x7f674014deb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f67280ad040 tx=0x7f672801aca0 comp rx=0 tx=0).stop 2023-11-18T21:28:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.434+0000 7f674673d640 1 -- 172.21.15.49:0/3631318155 shutdown_connections 2023-11-18T21:28:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.434+0000 7f674673d640 1 --2- 172.21.15.49:0/3631318155 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f67200664c0 0x7f6720068980 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.434+0000 7f674673d640 1 --2- 172.21.15.49:0/3631318155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f674015a280 0x7f674014d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.434+0000 7f674673d640 1 --2- 172.21.15.49:0/3631318155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67400ce0c0 0x7f674014deb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.434+0000 7f674673d640 1 --2- 172.21.15.49:0/3631318155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67400cc3c0 0x7f67400b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.434+0000 7f674673d640 1 -- 172.21.15.49:0/3631318155 >> 172.21.15.49:0/3631318155 conn(0x7f67400b07c0 msgr2=0x7f67401513a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.438+0000 7f674673d640 1 -- 172.21.15.49:0/3631318155 shutdown_connections 2023-11-18T21:28:58.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.438+0000 7f674673d640 1 -- 172.21.15.49:0/3631318155 wait complete. 2023-11-18T21:28:58.455 INFO:tasks.ceph:Scrubbing osd.5 2023-11-18T21:28:58.455 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-18T21:28:58.583 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.582+0000 7fcb0aa7f640 1 Processor -- start 2023-11-18T21:28:58.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.582+0000 7fcb0aa7f640 1 -- start start 2023-11-18T21:28:58.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.582+0000 7fcb0aa7f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcb04072890 0x7fcb040cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:58.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.582+0000 7fcb0aa7f640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb04072400 con 0x7fcb0406ad60 2023-11-18T21:28:58.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.582+0000 7fcb0aa7f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb04157cc0 con 0x7fcb041513c0 2023-11-18T21:28:58.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.582+0000 7fcb0aa7f640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb04157fa0 con 0x7fcb04072890 2023-11-18T21:28:58.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.586+0000 7fcb0901c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcb04072890 0x7fcb040cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:58.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.586+0000 7fcb0881b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fcb041513c0 0x7fcb041571c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:39390/0 (socket says 172.21.15.49:39390) 2023-11-18T21:28:58.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.586+0000 7fcb0881b640 1 -- 172.21.15.49:0/477169915 learned_addr learned my addr 172.21.15.49:0/477169915 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:58.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.594+0000 7fcb0901c640 1 -- 172.21.15.49:0/477169915 >> v1:172.21.15.106:6789/0 conn(0x7fcb041513c0 legacy=0x7fcb041571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:58.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.594+0000 7fcb0901c640 1 -- 172.21.15.49:0/477169915 >> v1:172.21.15.49:6789/0 conn(0x7fcb0406ad60 legacy=0x7fcb040c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:58.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.594+0000 7fcb0901c640 1 -- 172.21.15.49:0/477169915 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04071db0 con 0x7fcb04072890 2023-11-18T21:28:58.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.606+0000 7fcb0901c640 1 --2- 172.21.15.49:0/477169915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb04072890 0x7fcb040cb8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009d90 tx=0x7fcafc01f100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2242b6720ad9867 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:58.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.618+0000 7fcb037fe640 1 -- 172.21.15.49:0/477169915 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc0af600 con 0x7fcb04072890 2023-11-18T21:28:58.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.618+0000 7fcb037fe640 1 -- 172.21.15.49:0/477169915 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc0ab050 con 0x7fcb04072890 2023-11-18T21:28:58.619 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.618+0000 7fcb037fe640 1 -- 172.21.15.49:0/477169915 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc0af980 con 0x7fcb04072890 2023-11-18T21:28:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.618+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/477169915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb04072890 msgr2=0x7fcb040cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.618+0000 7fcb0aa7f640 1 --2- 172.21.15.49:0/477169915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb04072890 0x7fcb040cb8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009d90 tx=0x7fcafc01f100 comp rx=0 tx=0).stop 2023-11-18T21:28:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.618+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/477169915 shutdown_connections 2023-11-18T21:28:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.618+0000 7fcb0aa7f640 1 --2- 172.21.15.49:0/477169915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb04072890 0x7fcb040cb8f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.618+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/477169915 >> 172.21.15.49:0/477169915 conn(0x7fcb0406b670 msgr2=0x7fcb0406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.618+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/477169915 shutdown_connections 2023-11-18T21:28:58.621 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.618+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/477169915 wait complete. 2023-11-18T21:28:58.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.622+0000 7fcb0aa7f640 1 Processor -- start 2023-11-18T21:28:58.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.622+0000 7fcb0aa7f640 1 -- start start 2023-11-18T21:28:58.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.622+0000 7fcb0aa7f640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb0406ad60 0x7fcb041ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:58.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.622+0000 7fcb0aa7f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb04072890 0x7fcb040bb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:58.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.622+0000 7fcb0aa7f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb041513c0 0x7fcb041542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:58.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.622+0000 7fcb0aa7f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb040bbcd0 con 0x7fcb04072890 2023-11-18T21:28:58.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.622+0000 7fcb0aa7f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb040bbfb0 con 0x7fcb041513c0 2023-11-18T21:28:58.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.622+0000 7fcb0aa7f640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb040bc290 con 0x7fcb0406ad60 2023-11-18T21:28:58.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.622+0000 7fcb03fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb04072890 0x7fcb040bb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:58.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.622+0000 7fcb03fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb04072890 0x7fcb040bb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41306/0 (socket says 172.21.15.49:41306) 2023-11-18T21:28:58.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.622+0000 7fcb03fff640 1 -- 172.21.15.49:0/698394192 learned_addr learned my addr 172.21.15.49:0/698394192 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:58.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.622+0000 7fcb0881b640 1 --2- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb0406ad60 0x7fcb041ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:58.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.626+0000 7fcb0901c640 1 --2- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb041513c0 0x7fcb041542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:58.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.626+0000 7fcb03fff640 1 -- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb0406ad60 msgr2=0x7fcb041ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:58.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.626+0000 7fcb03fff640 1 --2- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb0406ad60 0x7fcb041ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:58.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.626+0000 7fcb03fff640 1 -- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb041513c0 msgr2=0x7fcb041542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:58.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.626+0000 7fcb03fff640 1 --2- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb041513c0 0x7fcb041542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:58.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.626+0000 7fcb03fff640 1 -- 172.21.15.49:0/698394192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc009a70 con 0x7fcb04072890 2023-11-18T21:28:58.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.630+0000 7fcb03fff640 1 --2- 172.21.15.49:0/698394192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb04072890 0x7fcb040bb6b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000c490 tx=0x7fcaf0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:58.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.634+0000 7fcb017fa640 1 -- 172.21.15.49:0/698394192 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0003600 con 0x7fcb04072890 2023-11-18T21:28:58.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.634+0000 7fcb017fa640 1 -- 172.21.15.49:0/698394192 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf0003780 con 0x7fcb04072890 2023-11-18T21:28:58.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.634+0000 7fcb017fa640 1 -- 172.21.15.49:0/698394192 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0003b70 con 0x7fcb04072890 2023-11-18T21:28:58.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.634+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/698394192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb04152550 con 0x7fcb04072890 2023-11-18T21:28:58.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.634+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/698394192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb04158310 con 0x7fcb04072890 2023-11-18T21:28:58.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.634+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/698394192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb041578d0 con 0x7fcb04072890 2023-11-18T21:28:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.658+0000 7fcb017fa640 1 -- 172.21.15.49:0/698394192 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcaf0003cd0 con 0x7fcb04072890 2023-11-18T21:28:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.658+0000 7fcb017fa640 1 --2- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcae80664c0 0x7fcae8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.658+0000 7fcb0881b640 1 --2- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcae80664c0 0x7fcae8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.658+0000 7fcb0881b640 1 --2- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcae80664c0 0x7fcae8068980 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8005890 tx=0x7fcaf8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:58.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.662+0000 7fcb017fa640 1 -- 172.21.15.49:0/698394192 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fcaf0054d40 con 0x7fcb04072890 2023-11-18T21:28:58.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.662+0000 7fcb017fa640 1 --2- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:6802/728068152,v1:172.21.15.106:6803/728068152] conn(0x7fcae806fac0 0x7fcae8071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:58.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.662+0000 7fcb017fa640 1 -- 172.21.15.49:0/698394192 --> [v2:172.21.15.106:6802/728068152,v1:172.21.15.106:6803/728068152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcae8072610 con 0x7fcae806fac0 2023-11-18T21:28:58.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.662+0000 7fcb017fa640 1 -- 172.21.15.49:0/698394192 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcaf0001150 con 0x7fcb04072890 2023-11-18T21:28:58.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.662+0000 7fcb0901c640 1 --2- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:6802/728068152,v1:172.21.15.106:6803/728068152] conn(0x7fcae806fac0 0x7fcae8071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:58.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.662+0000 7fcb0901c640 1 --2- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:6802/728068152,v1:172.21.15.106:6803/728068152] conn(0x7fcae806fac0 0x7fcae8071f40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:58.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.662+0000 7fcb017fa640 1 -- 172.21.15.49:0/698394192 <== osd.5 v2:172.21.15.106:6802/728068152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fcae8072610 con 0x7fcae806fac0 2023-11-18T21:28:58.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.682+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/698394192 --> [v2:172.21.15.106:6802/728068152,v1:172.21.15.106:6803/728068152] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcb04073e70 con 0x7fcae806fac0 2023-11-18T21:28:58.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.682+0000 7fcb017fa640 1 -- 172.21.15.49:0/698394192 <== osd.5 v2:172.21.15.106:6802/728068152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcb04073e70 con 0x7fcae806fac0 2023-11-18T21:28:58.686 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T21:28:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T21:28:58.687 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T21:28:58.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.682+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:6802/728068152,v1:172.21.15.106:6803/728068152] conn(0x7fcae806fac0 msgr2=0x7fcae8071f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:58.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.682+0000 7fcb0aa7f640 1 --2- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:6802/728068152,v1:172.21.15.106:6803/728068152] conn(0x7fcae806fac0 0x7fcae8071f40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:58.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.686+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcae80664c0 msgr2=0x7fcae8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:58.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.686+0000 7fcb0aa7f640 1 --2- 172.21.15.49:0/698394192 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fcae80664c0 0x7fcae8068980 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8005890 tx=0x7fcaf8009040 comp rx=0 tx=0).stop 2023-11-18T21:28:58.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.686+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/698394192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb04072890 msgr2=0x7fcb040bb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:58.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.686+0000 7fcb0aa7f640 1 --2- 172.21.15.49:0/698394192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb04072890 0x7fcb040bb6b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000c490 tx=0x7fcaf0001e80 comp rx=0 tx=0).stop 2023-11-18T21:28:58.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.686+0000 7fcb0901c640 1 -- 172.21.15.49:0/698394192 reap_dead start 2023-11-18T21:28:58.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.686+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/698394192 shutdown_connections 2023-11-18T21:28:58.689 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.686+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/698394192 >> 172.21.15.49:0/698394192 conn(0x7fcb0406b670 msgr2=0x7fcb040c82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:58.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.686+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/698394192 shutdown_connections 2023-11-18T21:28:58.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.686+0000 7fcb0aa7f640 1 -- 172.21.15.49:0/698394192 wait complete. 2023-11-18T21:28:58.706 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-18T21:28:58.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.830+0000 7fee0ccbc640 1 Processor -- start 2023-11-18T21:28:58.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.830+0000 7fee0ccbc640 1 -- start start 2023-11-18T21:28:58.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.830+0000 7fee0ccbc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fee081505d0 0x7fee0815a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:58.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.830+0000 7fee0ccbc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee080c6c50 0x7fee081560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:58.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.830+0000 7fee0ccbc640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee080c27d0 con 0x7fee081501f0 2023-11-18T21:28:58.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.830+0000 7fee0ccbc640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee080c3270 con 0x7fee080c6c50 2023-11-18T21:28:58.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.830+0000 7fee0ccbc640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee080c25e0 con 0x7fee081505d0 2023-11-18T21:28:58.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.834+0000 7fee06d9d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fee080c6c50 0x7fee081560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:58.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.834+0000 7fee0659c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fee081501f0 0x7fee080c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35722/0 (socket says 172.21.15.49:35722) 2023-11-18T21:28:58.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.834+0000 7fee0659c640 1 -- 172.21.15.49:0/929731518 learned_addr learned my addr 172.21.15.49:0/929731518 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:58.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.834+0000 7fee05d9b640 1 --2- 172.21.15.49:0/929731518 >> v2:172.21.15.106:3300/0 conn(0x7fee081505d0 0x7fee0815a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:58.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.838+0000 7fee06d9d640 1 -- 172.21.15.49:0/929731518 >> v2:172.21.15.106:3300/0 conn(0x7fee081505d0 msgr2=0x7fee0815a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:58.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.838+0000 7fee06d9d640 1 --2- 172.21.15.49:0/929731518 >> v2:172.21.15.106:3300/0 conn(0x7fee081505d0 0x7fee0815a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:58.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.838+0000 7fee06d9d640 1 -- 172.21.15.49:0/929731518 >> v1:172.21.15.49:6789/0 conn(0x7fee081501f0 legacy=0x7fee080c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:58.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.838+0000 7fee06d9d640 1 -- 172.21.15.49:0/929731518 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee080c2ab0 con 0x7fee080c6c50 2023-11-18T21:28:58.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.842+0000 7fee06d9d640 1 --2- 172.21.15.49:0/929731518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee080c6c50 0x7fee081560c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee0806f880 tx=0x7fee0001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc60ce89bdafc46f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:58.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.846+0000 7fee0559a640 1 -- 172.21.15.49:0/929731518 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee000a5910 con 0x7fee080c6c50 2023-11-18T21:28:58.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.846+0000 7fee0559a640 1 -- 172.21.15.49:0/929731518 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee000a5a70 con 0x7fee080c6c50 2023-11-18T21:28:58.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.846+0000 7fee0559a640 1 -- 172.21.15.49:0/929731518 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee000a5e00 con 0x7fee080c6c50 2023-11-18T21:28:58.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.846+0000 7fee0ccbc640 1 -- 172.21.15.49:0/929731518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee080c6c50 msgr2=0x7fee081560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:58.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.846+0000 7fee0ccbc640 1 --2- 172.21.15.49:0/929731518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee080c6c50 0x7fee081560c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee0806f880 tx=0x7fee0001c850 comp rx=0 tx=0).stop 2023-11-18T21:28:58.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.846+0000 7fee0ccbc640 1 -- 172.21.15.49:0/929731518 shutdown_connections 2023-11-18T21:28:58.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.846+0000 7fee0ccbc640 1 --2- 172.21.15.49:0/929731518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee080c6c50 0x7fee081560c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:58.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.846+0000 7fee0ccbc640 1 --2- 172.21.15.49:0/929731518 >> v2:172.21.15.106:3300/0 conn(0x7fee081505d0 0x7fee0815a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:58.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.846+0000 7fee0ccbc640 1 -- 172.21.15.49:0/929731518 >> 172.21.15.49:0/929731518 conn(0x7fee0806c6a0 msgr2=0x7fee0806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:58.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.846+0000 7fee0ccbc640 1 -- 172.21.15.49:0/929731518 shutdown_connections 2023-11-18T21:28:58.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.846+0000 7fee0ccbc640 1 -- 172.21.15.49:0/929731518 wait complete. 2023-11-18T21:28:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.850+0000 7fee0ccbc640 1 Processor -- start 2023-11-18T21:28:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.850+0000 7fee0ccbc640 1 -- start start 2023-11-18T21:28:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.850+0000 7fee0ccbc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee080c6c50 0x7fee081f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.850+0000 7fee0ccbc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee081501f0 0x7fee0814d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.850+0000 7fee0ccbc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee081505d0 0x7fee0813d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.850+0000 7fee0ccbc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee08072520 con 0x7fee080c6c50 2023-11-18T21:28:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.850+0000 7fee0ccbc640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee080727e0 con 0x7fee081501f0 2023-11-18T21:28:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.850+0000 7fee0ccbc640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee08072010 con 0x7fee081505d0 2023-11-18T21:28:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.850+0000 7fee0659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee080c6c50 0x7fee081f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:58.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.850+0000 7fee0659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee080c6c50 0x7fee081f3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41324/0 (socket says 172.21.15.49:41324) 2023-11-18T21:28:58.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.850+0000 7fee0659c640 1 -- 172.21.15.49:0/4083673787 learned_addr learned my addr 172.21.15.49:0/4083673787 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:58.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.850+0000 7fee05d9b640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee081501f0 0x7fee0814d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:58.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.854+0000 7fee06d9d640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee081505d0 0x7fee0813d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:58.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.854+0000 7fee0659c640 1 -- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee081505d0 msgr2=0x7fee0813d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:58.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.854+0000 7fee0659c640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee081505d0 0x7fee0813d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:58.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.854+0000 7fee0659c640 1 -- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee081501f0 msgr2=0x7fee0814d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:58.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.854+0000 7fee0659c640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee081501f0 0x7fee0814d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:58.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.854+0000 7fee0659c640 1 -- 172.21.15.49:0/4083673787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee00009a70 con 0x7fee080c6c50 2023-11-18T21:28:58.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.854+0000 7fee06d9d640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee081505d0 0x7fee0813d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T21:28:58.859 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.858+0000 7fee0659c640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee080c6c50 0x7fee081f3620 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fedf800c500 tx=0x7fedf800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:58.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.862+0000 7fedf6ffd640 1 -- 172.21.15.49:0/4083673787 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf8005cf0 con 0x7fee080c6c50 2023-11-18T21:28:58.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.862+0000 7fedf6ffd640 1 -- 172.21.15.49:0/4083673787 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf8005e50 con 0x7fee080c6c50 2023-11-18T21:28:58.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.862+0000 7fedf6ffd640 1 -- 172.21.15.49:0/4083673787 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf80072f0 con 0x7fee080c6c50 2023-11-18T21:28:58.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.862+0000 7fee0ccbc640 1 -- 172.21.15.49:0/4083673787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee081f2e20 con 0x7fee080c6c50 2023-11-18T21:28:58.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.862+0000 7fee0ccbc640 1 -- 172.21.15.49:0/4083673787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee081432f0 con 0x7fee080c6c50 2023-11-18T21:28:58.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:58.866+0000 7fee0ccbc640 1 -- 172.21.15.49:0/4083673787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee08067520 con 0x7fee080c6c50 2023-11-18T21:28:59.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.198+0000 7fedf6ffd640 1 -- 172.21.15.49:0/4083673787 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fedf8007450 con 0x7fee080c6c50 2023-11-18T21:28:59.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.198+0000 7fedf6ffd640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fede80664c0 0x7fede8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:59.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.198+0000 7fee05d9b640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fede80664c0 0x7fede8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:59.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.202+0000 7fee05d9b640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fede80664c0 0x7fede8068980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fee081454a0 tx=0x7fedfc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:59.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.218+0000 7fedf6ffd640 1 -- 172.21.15.49:0/4083673787 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fedf8054a50 con 0x7fee080c6c50 2023-11-18T21:28:59.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.218+0000 7fedf6ffd640 1 -- 172.21.15.49:0/4083673787 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fedf8050d90 con 0x7fee080c6c50 2023-11-18T21:28:59.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.398+0000 7fee0ccbc640 1 -- 172.21.15.49:0/4083673787 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fee080c2d90 con 0x7fede80664c0 2023-11-18T21:28:59.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.398+0000 7fedf6ffd640 1 -- 172.21.15.49:0/4083673787 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fedfc004020 con 0x7fede80664c0 2023-11-18T21:28:59.399 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 5 to deep-scrub 2023-11-18T21:28:59.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.398+0000 7fee0ccbc640 1 -- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fede80664c0 msgr2=0x7fede8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:59.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.398+0000 7fee0ccbc640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fede80664c0 0x7fede8068980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fee081454a0 tx=0x7fedfc009190 comp rx=0 tx=0).stop 2023-11-18T21:28:59.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.398+0000 7fee0ccbc640 1 -- 172.21.15.49:0/4083673787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee080c6c50 msgr2=0x7fee081f3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:59.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.398+0000 7fee0ccbc640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee080c6c50 0x7fee081f3620 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fedf800c500 tx=0x7fedf800c9c0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.398+0000 7fee0ccbc640 1 -- 172.21.15.49:0/4083673787 shutdown_connections 2023-11-18T21:28:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.398+0000 7fee0ccbc640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fede80664c0 0x7fede8068980 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.398+0000 7fee0ccbc640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee081505d0 0x7fee0813d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.398+0000 7fee0ccbc640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee081501f0 0x7fee0814d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.398+0000 7fee0ccbc640 1 --2- 172.21.15.49:0/4083673787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee080c6c50 0x7fee081f3620 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.398+0000 7fee0ccbc640 1 -- 172.21.15.49:0/4083673787 >> 172.21.15.49:0/4083673787 conn(0x7fee0806c6a0 msgr2=0x7fee08154670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.398+0000 7fee0ccbc640 1 -- 172.21.15.49:0/4083673787 shutdown_connections 2023-11-18T21:28:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.402+0000 7fee0ccbc640 1 -- 172.21.15.49:0/4083673787 wait complete. 2023-11-18T21:28:59.419 INFO:tasks.ceph:Scrubbing osd.6 2023-11-18T21:28:59.420 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-18T21:28:59.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.558+0000 7f9ac6a97640 1 Processor -- start 2023-11-18T21:28:59.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.558+0000 7f9ac6a97640 1 -- start start 2023-11-18T21:28:59.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.558+0000 7f9ac6a97640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9ac006ad60 0x7f9ac00cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:59.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.558+0000 7f9ac6a97640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac0072890 0x7f9ac00c5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:59.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.558+0000 7f9ac6a97640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac0072400 con 0x7f9ac01513c0 2023-11-18T21:28:59.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.558+0000 7f9ac6a97640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac0157cc0 con 0x7f9ac006ad60 2023-11-18T21:28:59.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.558+0000 7f9ac6a97640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac0157fa0 con 0x7f9ac0072890 2023-11-18T21:28:59.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.566+0000 7f9ac4833640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9ac01513c0 0x7f9ac01571c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:39398/0 (socket says 172.21.15.49:39398) 2023-11-18T21:28:59.570 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.570+0000 7f9ac4833640 1 -- 172.21.15.49:0/3555226614 learned_addr learned my addr 172.21.15.49:0/3555226614 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:28:59.592 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.590+0000 7f9abffff640 1 --2- 172.21.15.49:0/3555226614 >> v2:172.21.15.49:3300/0 conn(0x7f9ac006ad60 0x7f9ac00cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:59.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.598+0000 7f9abffff640 1 -- 172.21.15.49:0/3555226614 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac0072890 msgr2=0x7f9ac00c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:59.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.598+0000 7f9abffff640 1 --2- 172.21.15.49:0/3555226614 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac0072890 0x7f9ac00c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.598+0000 7f9abffff640 1 -- 172.21.15.49:0/3555226614 >> v1:172.21.15.106:6789/0 conn(0x7f9ac01513c0 legacy=0x7f9ac01571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:59.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.598+0000 7f9abffff640 1 -- 172.21.15.49:0/3555226614 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac0071db0 con 0x7f9ac006ad60 2023-11-18T21:28:59.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.602+0000 7f9abffff640 1 --2- 172.21.15.49:0/3555226614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ac006ad60 0x7f9ac00cb8f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40097c0 tx=0x7f9ab401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc811fe390a8b90d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:59.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.610+0000 7f9abf7fe640 1 -- 172.21.15.49:0/3555226614 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40ad640 con 0x7f9ac006ad60 2023-11-18T21:28:59.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.610+0000 7f9abf7fe640 1 -- 172.21.15.49:0/3555226614 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab40ad7a0 con 0x7f9ac006ad60 2023-11-18T21:28:59.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.610+0000 7f9abf7fe640 1 -- 172.21.15.49:0/3555226614 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40adb30 con 0x7f9ac006ad60 2023-11-18T21:28:59.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 -- 172.21.15.49:0/3555226614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ac006ad60 msgr2=0x7f9ac00cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:59.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 --2- 172.21.15.49:0/3555226614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ac006ad60 0x7f9ac00cb8f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40097c0 tx=0x7f9ab401c480 comp rx=0 tx=0).stop 2023-11-18T21:28:59.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 -- 172.21.15.49:0/3555226614 shutdown_connections 2023-11-18T21:28:59.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 --2- 172.21.15.49:0/3555226614 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac0072890 0x7f9ac00c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 --2- 172.21.15.49:0/3555226614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ac006ad60 0x7f9ac00cb8f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 -- 172.21.15.49:0/3555226614 >> 172.21.15.49:0/3555226614 conn(0x7f9ac006b670 msgr2=0x7f9ac006ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:59.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 -- 172.21.15.49:0/3555226614 shutdown_connections 2023-11-18T21:28:59.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 -- 172.21.15.49:0/3555226614 wait complete. 2023-11-18T21:28:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 Processor -- start 2023-11-18T21:28:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 -- start start 2023-11-18T21:28:59.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ac006ad60 0x7f9ac01f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:59.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ac0072890 0x7f9ac00c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:59.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac01513c0 0x7f9ac01564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:59.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac014c760 con 0x7f9ac006ad60 2023-11-18T21:28:59.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac0155a80 con 0x7f9ac0072890 2023-11-18T21:28:59.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.614+0000 7f9ac6a97640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac01f2c50 con 0x7f9ac01513c0 2023-11-18T21:28:59.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.618+0000 7f9ac4833640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ac006ad60 0x7f9ac01f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:59.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.618+0000 7f9ac4833640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ac006ad60 0x7f9ac01f23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41350/0 (socket says 172.21.15.49:41350) 2023-11-18T21:28:59.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.618+0000 7f9ac4833640 1 -- 172.21.15.49:0/1747508803 learned_addr learned my addr 172.21.15.49:0/1747508803 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.622+0000 7f9ac4833640 1 -- 172.21.15.49:0/1747508803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac01513c0 msgr2=0x7f9ac01564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.622+0000 7f9ac4833640 1 --2- 172.21.15.49:0/1747508803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac01513c0 0x7f9ac01564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.622+0000 7f9ac4833640 1 -- 172.21.15.49:0/1747508803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ac0072890 msgr2=0x7f9ac00c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.622+0000 7f9ac4833640 1 --2- 172.21.15.49:0/1747508803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ac0072890 0x7f9ac00c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.622+0000 7f9ac4833640 1 -- 172.21.15.49:0/1747508803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab4009420 con 0x7f9ac006ad60 2023-11-18T21:28:59.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.626+0000 7f9ac4833640 1 --2- 172.21.15.49:0/1747508803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ac006ad60 0x7f9ac01f23a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000cbc0 tx=0x7f9ab000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:59.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.630+0000 7f9abd7fa640 1 -- 172.21.15.49:0/1747508803 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000aca0 con 0x7f9ac006ad60 2023-11-18T21:28:59.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.630+0000 7f9abd7fa640 1 -- 172.21.15.49:0/1747508803 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab000ae00 con 0x7f9ac006ad60 2023-11-18T21:28:59.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.630+0000 7f9abd7fa640 1 -- 172.21.15.49:0/1747508803 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0012600 con 0x7f9ac006ad60 2023-11-18T21:28:59.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.630+0000 7f9ac6a97640 1 -- 172.21.15.49:0/1747508803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac01f2f30 con 0x7f9ac006ad60 2023-11-18T21:28:59.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.630+0000 7f9ac6a97640 1 -- 172.21.15.49:0/1747508803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac0155cd0 con 0x7f9ac006ad60 2023-11-18T21:28:59.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.634+0000 7f9ac6a97640 1 -- 172.21.15.49:0/1747508803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ac0154b90 con 0x7f9ac006ad60 2023-11-18T21:28:59.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.654+0000 7f9abd7fa640 1 -- 172.21.15.49:0/1747508803 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9ab0007070 con 0x7f9ac006ad60 2023-11-18T21:28:59.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.654+0000 7f9abd7fa640 1 --2- 172.21.15.49:0/1747508803 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9aac0664c0 0x7f9aac068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:59.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.654+0000 7f9abffff640 1 --2- 172.21.15.49:0/1747508803 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9aac0664c0 0x7f9aac068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:59.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.654+0000 7f9abffff640 1 --2- 172.21.15.49:0/1747508803 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9aac0664c0 0x7f9aac068980 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40af000 tx=0x7f9ab4004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:59.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.658+0000 7f9abd7fa640 1 -- 172.21.15.49:0/1747508803 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f9ab0055760 con 0x7f9ac006ad60 2023-11-18T21:28:59.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.658+0000 7f9abd7fa640 1 --2- 172.21.15.49:0/1747508803 >> [v2:172.21.15.106:6826/283622084,v1:172.21.15.106:6827/283622084] conn(0x7f9aac06fb40 0x7f9aac071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:59.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.658+0000 7f9abd7fa640 1 -- 172.21.15.49:0/1747508803 --> [v2:172.21.15.106:6826/283622084,v1:172.21.15.106:6827/283622084] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9aac072690 con 0x7f9aac06fb40 2023-11-18T21:28:59.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.658+0000 7f9abd7fa640 1 -- 172.21.15.49:0/1747508803 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ab0001bf0 con 0x7f9ac006ad60 2023-11-18T21:28:59.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.658+0000 7f9ac5034640 1 --2- 172.21.15.49:0/1747508803 >> [v2:172.21.15.106:6826/283622084,v1:172.21.15.106:6827/283622084] conn(0x7f9aac06fb40 0x7f9aac071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:59.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.658+0000 7f9ac5034640 1 --2- 172.21.15.49:0/1747508803 >> [v2:172.21.15.106:6826/283622084,v1:172.21.15.106:6827/283622084] conn(0x7f9aac06fb40 0x7f9aac071fc0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:59.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.662+0000 7f9abd7fa640 1 -- 172.21.15.49:0/1747508803 <== osd.6 v2:172.21.15.106:6826/283622084 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9aac072690 con 0x7f9aac06fb40 2023-11-18T21:28:59.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.678+0000 7f9ac6a97640 1 -- 172.21.15.49:0/1747508803 --> [v2:172.21.15.106:6826/283622084,v1:172.21.15.106:6827/283622084] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9ac00c83e0 con 0x7f9aac06fb40 2023-11-18T21:28:59.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.682+0000 7f9abd7fa640 1 -- 172.21.15.49:0/1747508803 <== osd.6 v2:172.21.15.106:6826/283622084 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9ac00c83e0 con 0x7f9aac06fb40 2023-11-18T21:28:59.682 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T21:28:59.682 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T21:28:59.682 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T21:28:59.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.682+0000 7f9ac6a97640 1 -- 172.21.15.49:0/1747508803 >> [v2:172.21.15.106:6826/283622084,v1:172.21.15.106:6827/283622084] conn(0x7f9aac06fb40 msgr2=0x7f9aac071fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:59.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.682+0000 7f9ac6a97640 1 --2- 172.21.15.49:0/1747508803 >> [v2:172.21.15.106:6826/283622084,v1:172.21.15.106:6827/283622084] conn(0x7f9aac06fb40 0x7f9aac071fc0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.682+0000 7f9ac6a97640 1 -- 172.21.15.49:0/1747508803 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9aac0664c0 msgr2=0x7f9aac068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:59.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.682+0000 7f9ac6a97640 1 --2- 172.21.15.49:0/1747508803 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f9aac0664c0 0x7f9aac068980 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40af000 tx=0x7f9ab4004740 comp rx=0 tx=0).stop 2023-11-18T21:28:59.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.682+0000 7f9ac6a97640 1 -- 172.21.15.49:0/1747508803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ac006ad60 msgr2=0x7f9ac01f23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:59.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.682+0000 7f9ac6a97640 1 --2- 172.21.15.49:0/1747508803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ac006ad60 0x7f9ac01f23a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000cbc0 tx=0x7f9ab000a060 comp rx=0 tx=0).stop 2023-11-18T21:28:59.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.682+0000 7f9ac5034640 1 -- 172.21.15.49:0/1747508803 reap_dead start 2023-11-18T21:28:59.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.682+0000 7f9ac6a97640 1 -- 172.21.15.49:0/1747508803 shutdown_connections 2023-11-18T21:28:59.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.682+0000 7f9ac6a97640 1 -- 172.21.15.49:0/1747508803 >> 172.21.15.49:0/1747508803 conn(0x7f9ac006b670 msgr2=0x7f9ac00ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:59.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.682+0000 7f9ac6a97640 1 -- 172.21.15.49:0/1747508803 shutdown_connections 2023-11-18T21:28:59.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.682+0000 7f9ac6a97640 1 -- 172.21.15.49:0/1747508803 wait complete. 2023-11-18T21:28:59.704 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-18T21:28:59.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.826+0000 7f252fedc640 1 Processor -- start 2023-11-18T21:28:59.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.826+0000 7f252fedc640 1 -- start start 2023-11-18T21:28:59.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.826+0000 7f252fedc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25280cd210 0x7f252806fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:59.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.826+0000 7f252fedc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f25280cd5f0 0x7f2528153210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:59.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.826+0000 7f252fedc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252815a350 con 0x7f25280cc4b0 2023-11-18T21:28:59.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.826+0000 7f252fedc640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25281594f0 con 0x7f25280cd5f0 2023-11-18T21:28:59.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.826+0000 7f252fedc640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25281597d0 con 0x7f25280cd210 2023-11-18T21:28:59.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.878+0000 7f252d477640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f25280cd5f0 0x7f2528153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:59.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.878+0000 7f252d477640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f25280cd5f0 0x7f2528153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41356/0 (socket says 172.21.15.49:41356) 2023-11-18T21:28:59.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.878+0000 7f252d477640 1 -- 172.21.15.49:0/2466075375 learned_addr learned my addr 172.21.15.49:0/2466075375 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:59.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.882+0000 7f252d477640 1 -- 172.21.15.49:0/2466075375 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25280cd210 msgr2=0x7f252806fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:59.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.882+0000 7f252d477640 1 --2- 172.21.15.49:0/2466075375 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25280cd210 0x7f252806fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.882+0000 7f252d477640 1 -- 172.21.15.49:0/2466075375 >> v1:172.21.15.106:6789/0 conn(0x7f25280cc4b0 legacy=0x7f252815ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:28:59.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.882+0000 7f252d477640 1 -- 172.21.15.49:0/2466075375 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528159ab0 con 0x7f25280cd5f0 2023-11-18T21:28:59.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.890+0000 7f252d477640 1 --2- 172.21.15.49:0/2466075375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25280cd5f0 0x7f2528153210 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2518009870 tx=0x7f251801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98fe464c57e588 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:59.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.898+0000 7f252cc76640 1 -- 172.21.15.49:0/2466075375 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25180a89b0 con 0x7f25280cd5f0 2023-11-18T21:28:59.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.898+0000 7f252cc76640 1 -- 172.21.15.49:0/2466075375 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25180a8b10 con 0x7f25280cd5f0 2023-11-18T21:28:59.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.898+0000 7f252cc76640 1 -- 172.21.15.49:0/2466075375 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25180a8ea0 con 0x7f25280cd5f0 2023-11-18T21:28:59.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.898+0000 7f252fedc640 1 -- 172.21.15.49:0/2466075375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25280cd5f0 msgr2=0x7f2528153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:59.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.898+0000 7f252fedc640 1 --2- 172.21.15.49:0/2466075375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25280cd5f0 0x7f2528153210 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2518009870 tx=0x7f251801ecf0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.898+0000 7f252fedc640 1 -- 172.21.15.49:0/2466075375 shutdown_connections 2023-11-18T21:28:59.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.898+0000 7f252fedc640 1 --2- 172.21.15.49:0/2466075375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25280cd5f0 0x7f2528153210 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.898+0000 7f252fedc640 1 --2- 172.21.15.49:0/2466075375 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25280cd210 0x7f252806fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.902+0000 7f252fedc640 1 -- 172.21.15.49:0/2466075375 >> 172.21.15.49:0/2466075375 conn(0x7f2528061400 msgr2=0x7f2528061810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:28:59.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.902+0000 7f252fedc640 1 -- 172.21.15.49:0/2466075375 shutdown_connections 2023-11-18T21:28:59.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.902+0000 7f252fedc640 1 -- 172.21.15.49:0/2466075375 wait complete. 2023-11-18T21:28:59.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.902+0000 7f252fedc640 1 Processor -- start 2023-11-18T21:28:59.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.902+0000 7f252fedc640 1 -- start start 2023-11-18T21:28:59.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.906+0000 7f252fedc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25280cc4b0 0x7f252815c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:59.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.906+0000 7f252fedc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25280cd210 0x7f252815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:59.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.906+0000 7f252fedc640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25280cd5f0 0x7f252814ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:28:59.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.906+0000 7f252fedc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25281eff80 con 0x7f25280cd210 2023-11-18T21:28:59.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.906+0000 7f252fedc640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252815c8e0 con 0x7f25280cc4b0 2023-11-18T21:28:59.907 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.906+0000 7f252fedc640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25281efa00 con 0x7f25280cd5f0 2023-11-18T21:28:59.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.906+0000 7f252d477640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25280cd210 0x7f252815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:28:59.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.906+0000 7f252d477640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25280cd210 0x7f252815ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41364/0 (socket says 172.21.15.49:41364) 2023-11-18T21:28:59.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.906+0000 7f252d477640 1 -- 172.21.15.49:0/3759128157 learned_addr learned my addr 172.21.15.49:0/3759128157 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:28:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.910+0000 7f252d477640 1 -- 172.21.15.49:0/3759128157 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25280cd5f0 msgr2=0x7f252814ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.910+0000 7f252d477640 1 --2- 172.21.15.49:0/3759128157 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25280cd5f0 0x7f252814ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.910+0000 7f252d477640 1 -- 172.21.15.49:0/3759128157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25280cc4b0 msgr2=0x7f252815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:28:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.910+0000 7f252d477640 1 --2- 172.21.15.49:0/3759128157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25280cc4b0 0x7f252815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:28:59.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.910+0000 7f252d477640 1 -- 172.21.15.49:0/3759128157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180094d0 con 0x7f25280cd210 2023-11-18T21:28:59.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.914+0000 7f252d477640 1 --2- 172.21.15.49:0/3759128157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25280cd210 0x7f252815ba70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f251801c920 tx=0x7f251801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:28:59.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.918+0000 7f251e7fc640 1 -- 172.21.15.49:0/3759128157 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25180b0e60 con 0x7f25280cd210 2023-11-18T21:28:59.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.918+0000 7f251e7fc640 1 -- 172.21.15.49:0/3759128157 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25180ba440 con 0x7f25280cd210 2023-11-18T21:28:59.919 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.918+0000 7f251e7fc640 1 -- 172.21.15.49:0/3759128157 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25180ba7f0 con 0x7f25280cd210 2023-11-18T21:28:59.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.918+0000 7f252fedc640 1 -- 172.21.15.49:0/3759128157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25281efca0 con 0x7f25280cd210 2023-11-18T21:28:59.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.918+0000 7f252fedc640 1 -- 172.21.15.49:0/3759128157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252815aa00 con 0x7f25280cd210 2023-11-18T21:28:59.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:28:59.918+0000 7f252fedc640 1 -- 172.21.15.49:0/3759128157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2528073e70 con 0x7f25280cd210 2023-11-18T21:29:00.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.218+0000 7f251e7fc640 1 -- 172.21.15.49:0/3759128157 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25180ba950 con 0x7f25280cd210 2023-11-18T21:29:00.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.218+0000 7f251e7fc640 1 --2- 172.21.15.49:0/3759128157 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f250c0664c0 0x7f250c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:00.221 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.222+0000 7f252dc78640 1 --2- 172.21.15.49:0/3759128157 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f250c0664c0 0x7f250c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:00.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.222+0000 7f252dc78640 1 --2- 172.21.15.49:0/3759128157 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f250c0664c0 0x7f250c068980 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2524009730 tx=0x7f2524006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:00.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.262+0000 7f251e7fc640 1 -- 172.21.15.49:0/3759128157 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f25180f4100 con 0x7f25280cd210 2023-11-18T21:29:00.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.270+0000 7f251e7fc640 1 -- 172.21.15.49:0/3759128157 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25180efd40 con 0x7f25280cd210 2023-11-18T21:29:00.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.466+0000 7f252fedc640 1 -- 172.21.15.49:0/3759128157 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f25280cab30 con 0x7f250c0664c0 2023-11-18T21:29:00.466 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.466+0000 7f251e7fc640 1 -- 172.21.15.49:0/3759128157 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f252400b4b0 con 0x7f250c0664c0 2023-11-18T21:29:00.466 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 6 to deep-scrub 2023-11-18T21:29:00.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.466+0000 7f252fedc640 1 -- 172.21.15.49:0/3759128157 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f250c0664c0 msgr2=0x7f250c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.466+0000 7f252fedc640 1 --2- 172.21.15.49:0/3759128157 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f250c0664c0 0x7f250c068980 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2524009730 tx=0x7f2524006ca0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.466+0000 7f252fedc640 1 -- 172.21.15.49:0/3759128157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25280cd210 msgr2=0x7f252815ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.466+0000 7f252fedc640 1 --2- 172.21.15.49:0/3759128157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25280cd210 0x7f252815ba70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f251801c920 tx=0x7f251801ba90 comp rx=0 tx=0).stop 2023-11-18T21:29:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.470+0000 7f252fedc640 1 -- 172.21.15.49:0/3759128157 shutdown_connections 2023-11-18T21:29:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.470+0000 7f252fedc640 1 --2- 172.21.15.49:0/3759128157 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f250c0664c0 0x7f250c068980 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.470+0000 7f252fedc640 1 --2- 172.21.15.49:0/3759128157 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25280cd5f0 0x7f252814ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.470+0000 7f252fedc640 1 --2- 172.21.15.49:0/3759128157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25280cd210 0x7f252815ba70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.470+0000 7f252fedc640 1 --2- 172.21.15.49:0/3759128157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25280cc4b0 0x7f252815c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.470+0000 7f252fedc640 1 -- 172.21.15.49:0/3759128157 >> 172.21.15.49:0/3759128157 conn(0x7f2528061400 msgr2=0x7f2528157a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:29:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.470+0000 7f252fedc640 1 -- 172.21.15.49:0/3759128157 shutdown_connections 2023-11-18T21:29:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.470+0000 7f252fedc640 1 -- 172.21.15.49:0/3759128157 wait complete. 2023-11-18T21:29:00.487 INFO:tasks.ceph:Scrubbing osd.7 2023-11-18T21:29:00.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-18T21:29:00.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.610+0000 7f7afd91a640 1 Processor -- start 2023-11-18T21:29:00.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.610+0000 7f7afd91a640 1 -- start start 2023-11-18T21:29:00.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.610+0000 7f7afd91a640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7af80c6c50 0x7f7af815a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:00.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.610+0000 7f7afd91a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af80c27d0 con 0x7f7af81501f0 2023-11-18T21:29:00.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.610+0000 7f7afd91a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af80c2ab0 con 0x7f7af81505d0 2023-11-18T21:29:00.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.610+0000 7f7afd91a640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af80c3270 con 0x7f7af80c6c50 2023-11-18T21:29:00.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.610+0000 7f7af77fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7af80c6c50 0x7f7af815a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:00.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.610+0000 7f7af77fe640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7af80c6c50 0x7f7af815a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41374/0 (socket says 172.21.15.49:41374) 2023-11-18T21:29:00.612 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.610+0000 7f7af77fe640 1 -- 172.21.15.49:0/3533722328 learned_addr learned my addr 172.21.15.49:0/3533722328 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:29:00.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.614+0000 7f7af77fe640 1 -- 172.21.15.49:0/3533722328 >> v1:172.21.15.106:6789/0 conn(0x7f7af81505d0 legacy=0x7f7af80c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:00.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.614+0000 7f7af77fe640 1 -- 172.21.15.49:0/3533722328 >> v1:172.21.15.49:6789/0 conn(0x7f7af81501f0 legacy=0x7f7af80c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:00.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.614+0000 7f7af77fe640 1 -- 172.21.15.49:0/3533722328 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af8159750 con 0x7f7af80c6c50 2023-11-18T21:29:00.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.622+0000 7f7af77fe640 1 --2- 172.21.15.49:0/3533722328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af80c6c50 0x7f7af815a230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009e50 tx=0x7f7af001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142d66409072e67e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:00.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.638+0000 7f7af5ffb640 1 -- 172.21.15.49:0/3533722328 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00a57d0 con 0x7f7af80c6c50 2023-11-18T21:29:00.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.638+0000 7f7af5ffb640 1 -- 172.21.15.49:0/3533722328 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af00a5930 con 0x7f7af80c6c50 2023-11-18T21:29:00.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.638+0000 7f7af5ffb640 1 -- 172.21.15.49:0/3533722328 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00a5cc0 con 0x7f7af80c6c50 2023-11-18T21:29:00.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.638+0000 7f7afd91a640 1 -- 172.21.15.49:0/3533722328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af80c6c50 msgr2=0x7f7af815a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:00.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.638+0000 7f7afd91a640 1 --2- 172.21.15.49:0/3533722328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af80c6c50 0x7f7af815a230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009e50 tx=0x7f7af001ca10 comp rx=0 tx=0).stop 2023-11-18T21:29:00.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.638+0000 7f7afd91a640 1 -- 172.21.15.49:0/3533722328 shutdown_connections 2023-11-18T21:29:00.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.638+0000 7f7afd91a640 1 --2- 172.21.15.49:0/3533722328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af80c6c50 0x7f7af815a230 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.638+0000 7f7afd91a640 1 -- 172.21.15.49:0/3533722328 >> 172.21.15.49:0/3533722328 conn(0x7f7af806c6a0 msgr2=0x7f7af806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:29:00.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.638+0000 7f7afd91a640 1 -- 172.21.15.49:0/3533722328 shutdown_connections 2023-11-18T21:29:00.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.638+0000 7f7afd91a640 1 -- 172.21.15.49:0/3533722328 wait complete. 2023-11-18T21:29:00.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.642+0000 7f7afd91a640 1 Processor -- start 2023-11-18T21:29:00.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.642+0000 7f7afd91a640 1 -- start start 2023-11-18T21:29:00.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.642+0000 7f7afd91a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7af80c6c50 0x7f7af814b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:00.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.642+0000 7f7afd91a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7af81501f0 0x7f7af81f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:00.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.642+0000 7f7afd91a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af81505d0 0x7f7af81f4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:00.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.642+0000 7f7afd91a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af80c8c60 con 0x7f7af81505d0 2023-11-18T21:29:00.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.642+0000 7f7afd91a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af81f3a30 con 0x7f7af80c6c50 2023-11-18T21:29:00.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.642+0000 7f7afd91a640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af80c3870 con 0x7f7af81501f0 2023-11-18T21:29:00.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.642+0000 7f7af77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af81505d0 0x7f7af81f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:00.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.642+0000 7f7af77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af81505d0 0x7f7af81f4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41378/0 (socket says 172.21.15.49:41378) 2023-11-18T21:29:00.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.642+0000 7f7af77fe640 1 -- 172.21.15.49:0/2376271695 learned_addr learned my addr 172.21.15.49:0/2376271695 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:29:00.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.642+0000 7f7af6ffd640 1 --2- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7af80c6c50 0x7f7af814b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:00.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.642+0000 7f7af67fc640 1 --2- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7af81501f0 0x7f7af81f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:00.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.646+0000 7f7af77fe640 1 -- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7af81501f0 msgr2=0x7f7af81f3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:00.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.646+0000 7f7af77fe640 1 --2- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7af81501f0 0x7f7af81f3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.646+0000 7f7af77fe640 1 -- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7af80c6c50 msgr2=0x7f7af814b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:00.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.646+0000 7f7af77fe640 1 --2- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7af80c6c50 0x7f7af814b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.646+0000 7f7af77fe640 1 -- 172.21.15.49:0/2376271695 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af0009b30 con 0x7f7af81505d0 2023-11-18T21:29:00.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.650+0000 7f7af77fe640 1 --2- 172.21.15.49:0/2376271695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af81505d0 0x7f7af81f4400 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7af00af040 tx=0x7f7af00197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:00.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.654+0000 7f7adffff640 1 -- 172.21.15.49:0/2376271695 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00b8670 con 0x7f7af81505d0 2023-11-18T21:29:00.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.654+0000 7f7adffff640 1 -- 172.21.15.49:0/2376271695 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af00b87d0 con 0x7f7af81505d0 2023-11-18T21:29:00.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.654+0000 7f7adffff640 1 -- 172.21.15.49:0/2376271695 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00b8b60 con 0x7f7af81505d0 2023-11-18T21:29:00.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.654+0000 7f7afd91a640 1 -- 172.21.15.49:0/2376271695 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af814c4f0 con 0x7f7af81505d0 2023-11-18T21:29:00.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.654+0000 7f7afd91a640 1 -- 172.21.15.49:0/2376271695 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af80cb7c0 con 0x7f7af81505d0 2023-11-18T21:29:00.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.654+0000 7f7afd91a640 1 -- 172.21.15.49:0/2376271695 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7af80c2d90 con 0x7f7af81505d0 2023-11-18T21:29:00.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.678+0000 7f7adffff640 1 -- 172.21.15.49:0/2376271695 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7af00b8cc0 con 0x7f7af81505d0 2023-11-18T21:29:00.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.678+0000 7f7adffff640 1 --2- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7ae40664f0 0x7f7ae40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:00.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.678+0000 7f7af6ffd640 1 --2- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7ae40664f0 0x7f7ae40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.678+0000 7f7af6ffd640 1 --2- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7ae40664f0 0x7f7ae40689b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7aec007fd0 tx=0x7f7aec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:00.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.682+0000 7f7adffff640 1 -- 172.21.15.49:0/2376271695 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f7af00f0d80 con 0x7f7af81505d0 2023-11-18T21:29:00.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.682+0000 7f7adffff640 1 --2- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:6810/2002613814,v1:172.21.15.106:6811/2002613814] conn(0x7f7ae406fb70 0x7f7ae4071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:00.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.682+0000 7f7adffff640 1 -- 172.21.15.49:0/2376271695 --> [v2:172.21.15.106:6810/2002613814,v1:172.21.15.106:6811/2002613814] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ae40726c0 con 0x7f7ae406fb70 2023-11-18T21:29:00.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.682+0000 7f7adffff640 1 -- 172.21.15.49:0/2376271695 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7af00ed0c0 con 0x7f7af81505d0 2023-11-18T21:29:00.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.682+0000 7f7af67fc640 1 --2- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:6810/2002613814,v1:172.21.15.106:6811/2002613814] conn(0x7f7ae406fb70 0x7f7ae4071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:00.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.682+0000 7f7af67fc640 1 --2- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:6810/2002613814,v1:172.21.15.106:6811/2002613814] conn(0x7f7ae406fb70 0x7f7ae4071ff0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.682+0000 7f7adffff640 1 -- 172.21.15.49:0/2376271695 <== osd.7 v2:172.21.15.106:6810/2002613814 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7ae40726c0 con 0x7f7ae406fb70 2023-11-18T21:29:00.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.698+0000 7f7afd91a640 1 -- 172.21.15.49:0/2376271695 --> [v2:172.21.15.106:6810/2002613814,v1:172.21.15.106:6811/2002613814] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7af80c4e00 con 0x7f7ae406fb70 2023-11-18T21:29:00.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.698+0000 7f7adffff640 1 -- 172.21.15.49:0/2376271695 <== osd.7 v2:172.21.15.106:6810/2002613814 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7ae80013b0 con 0x7f7ae406fb70 2023-11-18T21:29:00.701 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-11-18T21:29:00.701 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T21:29:00.701 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-11-18T21:29:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.702+0000 7f7afd91a640 1 -- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:6810/2002613814,v1:172.21.15.106:6811/2002613814] conn(0x7f7ae406fb70 msgr2=0x7f7ae4071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.702+0000 7f7afd91a640 1 --2- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:6810/2002613814,v1:172.21.15.106:6811/2002613814] conn(0x7f7ae406fb70 0x7f7ae4071ff0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.702+0000 7f7afd91a640 1 -- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7ae40664f0 msgr2=0x7f7ae40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:00.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.702+0000 7f7afd91a640 1 --2- 172.21.15.49:0/2376271695 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f7ae40664f0 0x7f7ae40689b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7aec007fd0 tx=0x7f7aec009040 comp rx=0 tx=0).stop 2023-11-18T21:29:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.702+0000 7f7afd91a640 1 -- 172.21.15.49:0/2376271695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af81505d0 msgr2=0x7f7af81f4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.702+0000 7f7afd91a640 1 --2- 172.21.15.49:0/2376271695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af81505d0 0x7f7af81f4400 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7af00af040 tx=0x7f7af00197b0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.702+0000 7f7af77fe640 1 -- 172.21.15.49:0/2376271695 reap_dead start 2023-11-18T21:29:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.702+0000 7f7afd91a640 1 -- 172.21.15.49:0/2376271695 shutdown_connections 2023-11-18T21:29:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.702+0000 7f7afd91a640 1 -- 172.21.15.49:0/2376271695 >> 172.21.15.49:0/2376271695 conn(0x7f7af806c6a0 msgr2=0x7f7af8155550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:29:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.702+0000 7f7afd91a640 1 -- 172.21.15.49:0/2376271695 shutdown_connections 2023-11-18T21:29:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.702+0000 7f7afd91a640 1 -- 172.21.15.49:0/2376271695 wait complete. 2023-11-18T21:29:00.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-18T21:29:00.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.846+0000 7f5ba3d1d640 1 Processor -- start 2023-11-18T21:29:00.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.846+0000 7f5ba3d1d640 1 -- start start 2023-11-18T21:29:00.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.846+0000 7f5ba3d1d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5b9c0726d0 0x7f5b9c159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.846+0000 7f5ba3d1d640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b9c159f60 0x7f5b9c160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.846+0000 7f5ba3d1d640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9c159590 con 0x7f5b9c0722f0 2023-11-18T21:29:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.846+0000 7f5ba3d1d640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9c155fa0 con 0x7f5b9c159f60 2023-11-18T21:29:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.846+0000 7f5ba3d1d640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9c15a390 con 0x7f5b9c0726d0 2023-11-18T21:29:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.846+0000 7f5ba22ba640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b9c159f60 0x7f5b9c160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:00.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.850+0000 7f5ba1ab9640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5b9c0722f0 0x7f5b9c0c66d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35738/0 (socket says 172.21.15.49:35738) 2023-11-18T21:29:00.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.850+0000 7f5ba1ab9640 1 -- 172.21.15.49:0/2214607388 learned_addr learned my addr 172.21.15.49:0/2214607388 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:29:00.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.850+0000 7f5ba22ba640 1 -- 172.21.15.49:0/2214607388 >> v2:172.21.15.106:3300/0 conn(0x7f5b9c0726d0 msgr2=0x7f5b9c159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:29:00.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.850+0000 7f5ba22ba640 1 --2- 172.21.15.49:0/2214607388 >> v2:172.21.15.106:3300/0 conn(0x7f5b9c0726d0 0x7f5b9c159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.850+0000 7f5ba22ba640 1 -- 172.21.15.49:0/2214607388 >> v1:172.21.15.49:6789/0 conn(0x7f5b9c0722f0 legacy=0x7f5b9c0c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:00.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.850+0000 7f5ba22ba640 1 -- 172.21.15.49:0/2214607388 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c156190 con 0x7f5b9c159f60 2023-11-18T21:29:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.854+0000 7f5ba22ba640 1 --2- 172.21.15.49:0/2214607388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b9c159f60 0x7f5b9c160920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c06f140 tx=0x7f5b9401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8936a554a3f21f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:00.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.858+0000 7f5ba0ab7640 1 -- 172.21.15.49:0/2214607388 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940a5910 con 0x7f5b9c159f60 2023-11-18T21:29:00.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba0ab7640 1 -- 172.21.15.49:0/2214607388 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b940a5a70 con 0x7f5b9c159f60 2023-11-18T21:29:00.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba0ab7640 1 -- 172.21.15.49:0/2214607388 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940a5e00 con 0x7f5b9c159f60 2023-11-18T21:29:00.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2214607388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b9c159f60 msgr2=0x7f5b9c160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:00.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 --2- 172.21.15.49:0/2214607388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b9c159f60 0x7f5b9c160920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c06f140 tx=0x7f5b9401c850 comp rx=0 tx=0).stop 2023-11-18T21:29:00.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2214607388 shutdown_connections 2023-11-18T21:29:00.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 --2- 172.21.15.49:0/2214607388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b9c159f60 0x7f5b9c160920 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.862 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 --2- 172.21.15.49:0/2214607388 >> v2:172.21.15.106:3300/0 conn(0x7f5b9c0726d0 0x7f5b9c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2214607388 >> 172.21.15.49:0/2214607388 conn(0x7f5b9c06b670 msgr2=0x7f5b9c06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:29:00.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2214607388 shutdown_connections 2023-11-18T21:29:00.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2214607388 wait complete. 2023-11-18T21:29:00.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 Processor -- start 2023-11-18T21:29:00.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 -- start start 2023-11-18T21:29:00.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b9c0722f0 0x7f5b9c1451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:00.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b9c0726d0 0x7f5b9c1f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:00.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b9c159f60 0x7f5b9c1f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:00.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c14ac60 con 0x7f5b9c0726d0 2023-11-18T21:29:00.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c14a9c0 con 0x7f5b9c159f60 2023-11-18T21:29:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba3d1d640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c145e10 con 0x7f5b9c0722f0 2023-11-18T21:29:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba12b8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b9c0726d0 0x7f5b9c1f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba12b8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b9c0726d0 0x7f5b9c1f1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41394/0 (socket says 172.21.15.49:41394) 2023-11-18T21:29:00.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.862+0000 7f5ba12b8640 1 -- 172.21.15.49:0/2935108619 learned_addr learned my addr 172.21.15.49:0/2935108619 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:29:00.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.866+0000 7f5ba12b8640 1 -- 172.21.15.49:0/2935108619 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b9c0722f0 msgr2=0x7f5b9c1451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:00.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.866+0000 7f5ba12b8640 1 --2- 172.21.15.49:0/2935108619 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b9c0722f0 0x7f5b9c1451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.866+0000 7f5ba12b8640 1 -- 172.21.15.49:0/2935108619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b9c159f60 msgr2=0x7f5b9c1f23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:00.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.866+0000 7f5ba12b8640 1 --2- 172.21.15.49:0/2935108619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b9c159f60 0x7f5b9c1f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:00.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.866+0000 7f5ba12b8640 1 -- 172.21.15.49:0/2935108619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b94009a70 con 0x7f5b9c0726d0 2023-11-18T21:29:00.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.870+0000 7f5ba12b8640 1 --2- 172.21.15.49:0/2935108619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b9c0726d0 0x7f5b9c1f1e70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00b410 tx=0x7f5b8c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:00.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.874+0000 7f5b927fc640 1 -- 172.21.15.49:0/2935108619 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c011830 con 0x7f5b9c0726d0 2023-11-18T21:29:00.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.874+0000 7f5b927fc640 1 -- 172.21.15.49:0/2935108619 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c0119b0 con 0x7f5b9c0726d0 2023-11-18T21:29:00.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.874+0000 7f5b927fc640 1 -- 172.21.15.49:0/2935108619 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c011d60 con 0x7f5b9c0726d0 2023-11-18T21:29:00.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.874+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2935108619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9c1f58f0 con 0x7f5b9c0726d0 2023-11-18T21:29:00.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.874+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2935108619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9c1f5bd0 con 0x7f5b9c0726d0 2023-11-18T21:29:00.875 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:00.874+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2935108619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9c1f1b20 con 0x7f5b9c0726d0 2023-11-18T21:29:01.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.210+0000 7f5b927fc640 1 -- 172.21.15.49:0/2935108619 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5b8c01a400 con 0x7f5b9c0726d0 2023-11-18T21:29:01.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.214+0000 7f5b927fc640 1 --2- 172.21.15.49:0/2935108619 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f5b800664c0 0x7f5b80068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:01.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.214+0000 7f5ba1ab9640 1 --2- 172.21.15.49:0/2935108619 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f5b800664c0 0x7f5b80068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:01.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.214+0000 7f5ba1ab9640 1 --2- 172.21.15.49:0/2935108619 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f5b800664c0 0x7f5b80068980 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5b98000f70 tx=0x7f5b98007a90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:01.253 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.254+0000 7f5b927fc640 1 -- 172.21.15.49:0/2935108619 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f5b8c055de0 con 0x7f5b9c0726d0 2023-11-18T21:29:01.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.262+0000 7f5b927fc640 1 -- 172.21.15.49:0/2935108619 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5b8c051a20 con 0x7f5b9c0726d0 2023-11-18T21:29:01.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.430+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2935108619 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b9c072b20 con 0x7f5b800664c0 2023-11-18T21:29:01.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.434+0000 7f5b927fc640 1 -- 172.21.15.49:0/2935108619 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5b98001260 con 0x7f5b800664c0 2023-11-18T21:29:01.434 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 7 to deep-scrub 2023-11-18T21:29:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.434+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2935108619 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f5b800664c0 msgr2=0x7f5b80068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.434+0000 7f5ba3d1d640 1 --2- 172.21.15.49:0/2935108619 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f5b800664c0 0x7f5b80068980 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5b98000f70 tx=0x7f5b98007a90 comp rx=0 tx=0).stop 2023-11-18T21:29:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.434+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2935108619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b9c0726d0 msgr2=0x7f5b9c1f1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.434+0000 7f5ba3d1d640 1 --2- 172.21.15.49:0/2935108619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b9c0726d0 0x7f5b9c1f1e70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00b410 tx=0x7f5b8c00b8d0 comp rx=0 tx=0).stop 2023-11-18T21:29:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.434+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2935108619 shutdown_connections 2023-11-18T21:29:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.434+0000 7f5ba3d1d640 1 --2- 172.21.15.49:0/2935108619 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f5b800664c0 0x7f5b80068980 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.434+0000 7f5ba3d1d640 1 --2- 172.21.15.49:0/2935108619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b9c159f60 0x7f5b9c1f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.434+0000 7f5ba3d1d640 1 --2- 172.21.15.49:0/2935108619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b9c0726d0 0x7f5b9c1f1e70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.434+0000 7f5ba3d1d640 1 --2- 172.21.15.49:0/2935108619 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b9c0722f0 0x7f5b9c1451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.434+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2935108619 >> 172.21.15.49:0/2935108619 conn(0x7f5b9c06b670 msgr2=0x7f5b9c146370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:29:01.437 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.434+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2935108619 shutdown_connections 2023-11-18T21:29:01.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.434+0000 7f5ba3d1d640 1 -- 172.21.15.49:0/2935108619 wait complete. 2023-11-18T21:29:01.456 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T21:29:01.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.574+0000 7feb89645640 1 Processor -- start 2023-11-18T21:29:01.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.574+0000 7feb89645640 1 -- start start 2023-11-18T21:29:01.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.574+0000 7feb89645640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feb841505a0 0x7feb840c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:01.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.574+0000 7feb89645640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb840c72b0 con 0x7feb840c4a10 2023-11-18T21:29:01.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.574+0000 7feb89645640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8415a100 con 0x7feb840c4630 2023-11-18T21:29:01.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.574+0000 7feb89645640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb840c4f40 con 0x7feb841505a0 2023-11-18T21:29:01.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.578+0000 7feb827fc640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feb840c4a10 0x7feb8414fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35754/0 (socket says 172.21.15.49:35754) 2023-11-18T21:29:01.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.578+0000 7feb827fc640 1 -- 172.21.15.49:0/2268760356 learned_addr learned my addr 172.21.15.49:0/2268760356 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:29:01.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.578+0000 7feb81ffb640 1 -- 172.21.15.49:0/2268760356 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517468054 0 0) 0x7feb840c72b0 con 0x7feb840c4a10 2023-11-18T21:29:01.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.578+0000 7feb81ffb640 1 -- 172.21.15.49:0/2268760356 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb6c003530 con 0x7feb840c4a10 2023-11-18T21:29:01.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.582+0000 7feb81ffb640 1 -- 172.21.15.49:0/2268760356 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1070666899 0 0) 0x7feb6c003530 con 0x7feb840c4a10 2023-11-18T21:29:01.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.582+0000 7feb81ffb640 1 -- 172.21.15.49:0/2268760356 >> v2:172.21.15.106:3300/0 conn(0x7feb841505a0 msgr2=0x7feb840c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:29:01.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.582+0000 7feb81ffb640 1 --2- 172.21.15.49:0/2268760356 >> v2:172.21.15.106:3300/0 conn(0x7feb841505a0 0x7feb840c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:01.584 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.582+0000 7feb81ffb640 1 -- 172.21.15.49:0/2268760356 >> v1:172.21.15.106:6789/0 conn(0x7feb840c4630 legacy=0x7feb841596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:29:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.582+0000 7feb81ffb640 1 -- 172.21.15.49:0/2268760356 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8415a3e0 con 0x7feb840c4a10 2023-11-18T21:29:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.582+0000 7feb81ffb640 1 -- 172.21.15.49:0/2268760356 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7feb78001680 con 0x7feb840c4a10 2023-11-18T21:29:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.582+0000 7feb81ffb640 1 -- 172.21.15.49:0/2268760356 >> v1:172.21.15.49:6789/0 conn(0x7feb840c4a10 legacy=0x7feb8414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.582+0000 7feb81ffb640 1 --2- 172.21.15.49:0/2268760356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb6c003a40 0x7feb6c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.582+0000 7feb81ffb640 1 --2- 172.21.15.49:0/2268760356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb6c0047d0 0x7feb6c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.582+0000 7feb81ffb640 1 --2- 172.21.15.49:0/2268760356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb6c005390 0x7feb6c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.582+0000 7feb81ffb640 1 -- 172.21.15.49:0/2268760356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c00c210 con 0x7feb6c003a40 2023-11-18T21:29:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.582+0000 7feb81ffb640 1 -- 172.21.15.49:0/2268760356 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c00c380 con 0x7feb6c005390 2023-11-18T21:29:01.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.582+0000 7feb81ffb640 1 -- 172.21.15.49:0/2268760356 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c00c540 con 0x7feb6c0047d0 2023-11-18T21:29:01.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.586+0000 7feb82ffd640 1 --2- 172.21.15.49:0/2268760356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb6c003a40 0x7feb6c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:01.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.586+0000 7feb827fc640 1 --2- 172.21.15.49:0/2268760356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb6c0047d0 0x7feb6c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:01.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.590+0000 7feb82ffd640 1 -- 172.21.15.49:0/2268760356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb6c0047d0 msgr2=0x7feb6c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:29:01.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.590+0000 7feb82ffd640 1 --2- 172.21.15.49:0/2268760356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb6c0047d0 0x7feb6c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:01.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.590+0000 7feb82ffd640 1 -- 172.21.15.49:0/2268760356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb6c005390 msgr2=0x7feb6c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:29:01.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.590+0000 7feb82ffd640 1 --2- 172.21.15.49:0/2268760356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb6c005390 0x7feb6c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:01.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.590+0000 7feb82ffd640 1 -- 172.21.15.49:0/2268760356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6c003530 con 0x7feb6c003a40 2023-11-18T21:29:01.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.590+0000 7feb837fe640 1 -- 172.21.15.49:0/2268760356 reap_dead start 2023-11-18T21:29:01.595 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.594+0000 7feb82ffd640 1 --2- 172.21.15.49:0/2268760356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb6c003a40 0x7feb6c003e40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feb74001650 tx=0x7feb7401c2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4983e831bff3c4d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:01.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb81ffb640 1 -- 172.21.15.49:0/2268760356 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74005270 con 0x7feb6c003a40 2023-11-18T21:29:01.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb81ffb640 1 -- 172.21.15.49:0/2268760356 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb740a7070 con 0x7feb6c003a40 2023-11-18T21:29:01.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb81ffb640 1 -- 172.21.15.49:0/2268760356 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74003620 con 0x7feb6c003a40 2023-11-18T21:29:01.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 -- 172.21.15.49:0/2268760356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb6c003a40 msgr2=0x7feb6c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:01.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 --2- 172.21.15.49:0/2268760356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb6c003a40 0x7feb6c003e40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feb74001650 tx=0x7feb7401c2c0 comp rx=0 tx=0).stop 2023-11-18T21:29:01.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 -- 172.21.15.49:0/2268760356 shutdown_connections 2023-11-18T21:29:01.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 --2- 172.21.15.49:0/2268760356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb6c003a40 0x7feb6c003e40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:01.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 -- 172.21.15.49:0/2268760356 >> 172.21.15.49:0/2268760356 conn(0x7feb8406c6a0 msgr2=0x7feb8406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:29:01.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 -- 172.21.15.49:0/2268760356 shutdown_connections 2023-11-18T21:29:01.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 -- 172.21.15.49:0/2268760356 wait complete. 2023-11-18T21:29:01.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 Processor -- start 2023-11-18T21:29:01.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 -- start start 2023-11-18T21:29:01.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb6c003a40 0x7feb84071e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:01.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb84153ea0 0x7feb841f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:01.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb8406f170 0x7feb841f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:01.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb84151d20 con 0x7feb8406f170 2023-11-18T21:29:01.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8413c7a0 con 0x7feb84153ea0 2023-11-18T21:29:01.609 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.606+0000 7feb89645640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb84154370 con 0x7feb6c003a40 2023-11-18T21:29:01.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.610+0000 7feb837fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb8406f170 0x7feb841f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:01.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.610+0000 7feb82ffd640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb6c003a40 0x7feb84071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:01.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.610+0000 7feb837fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb8406f170 0x7feb841f27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41410/0 (socket says 172.21.15.49:41410) 2023-11-18T21:29:01.610 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.610+0000 7feb837fe640 1 -- 172.21.15.49:0/3198593209 learned_addr learned my addr 172.21.15.49:0/3198593209 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:29:01.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.614+0000 7feb827fc640 1 --2- 172.21.15.49:0/3198593209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb84153ea0 0x7feb841f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:01.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.614+0000 7feb837fe640 1 -- 172.21.15.49:0/3198593209 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb6c003a40 msgr2=0x7feb84071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:01.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.614+0000 7feb837fe640 1 --2- 172.21.15.49:0/3198593209 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb6c003a40 0x7feb84071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:01.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.614+0000 7feb837fe640 1 -- 172.21.15.49:0/3198593209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb84153ea0 msgr2=0x7feb841f22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:01.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.614+0000 7feb837fe640 1 --2- 172.21.15.49:0/3198593209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb84153ea0 0x7feb841f22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:01.615 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.614+0000 7feb837fe640 1 -- 172.21.15.49:0/3198593209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8413bb90 con 0x7feb8406f170 2023-11-18T21:29:01.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.614+0000 7feb837fe640 1 --2- 172.21.15.49:0/3198593209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb8406f170 0x7feb841f27f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feb840c6b70 tx=0x7feb7c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:01.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.622+0000 7feb6b7fe640 1 -- 172.21.15.49:0/3198593209 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c00aa20 con 0x7feb8406f170 2023-11-18T21:29:01.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.622+0000 7feb6b7fe640 1 -- 172.21.15.49:0/3198593209 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c00aba0 con 0x7feb8406f170 2023-11-18T21:29:01.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.622+0000 7feb6b7fe640 1 -- 172.21.15.49:0/3198593209 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c00ce50 con 0x7feb8406f170 2023-11-18T21:29:01.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.622+0000 7feb89645640 1 -- 172.21.15.49:0/3198593209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8413be70 con 0x7feb8406f170 2023-11-18T21:29:01.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.622+0000 7feb89645640 1 -- 172.21.15.49:0/3198593209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8413c430 con 0x7feb8406f170 2023-11-18T21:29:01.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.622+0000 7feb89645640 1 -- 172.21.15.49:0/3198593209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8413c5f0 con 0x7feb8406f170 2023-11-18T21:29:01.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.918+0000 7feb6b7fe640 1 -- 172.21.15.49:0/3198593209 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb7c005d50 con 0x7feb8406f170 2023-11-18T21:29:01.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.922+0000 7feb6b7fe640 1 --2- 172.21.15.49:0/3198593209 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7feb700664f0 0x7feb700689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:01.922 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.922+0000 7feb82ffd640 1 --2- 172.21.15.49:0/3198593209 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7feb700664f0 0x7feb700689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:01.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.922+0000 7feb82ffd640 1 --2- 172.21.15.49:0/3198593209 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7feb700664f0 0x7feb700689b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feb740aa000 tx=0x7feb74005040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.962+0000 7feb6b7fe640 1 -- 172.21.15.49:0/3198593209 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7feb7c054e70 con 0x7feb8406f170 2023-11-18T21:29:01.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:01.962+0000 7feb6b7fe640 1 -- 172.21.15.49:0/3198593209 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb7c0511b0 con 0x7feb8406f170 2023-11-18T21:29:02.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:02.126+0000 7feb89645640 1 -- 172.21.15.49:0/3198593209 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb841568a0 con 0x7feb700664f0 2023-11-18T21:29:02.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:02.154+0000 7feb6b7fe640 1 -- 172.21.15.49:0/3198593209 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+366558 (secure 0 0 0) 0x7feb740b3040 con 0x7feb700664f0 2023-11-18T21:29:02.160 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:29:02.162 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-18T21:29:02.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:02.162+0000 7feb89645640 1 -- 172.21.15.49:0/3198593209 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7feb700664f0 msgr2=0x7feb700689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:02.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:02.162+0000 7feb89645640 1 --2- 172.21.15.49:0/3198593209 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7feb700664f0 0x7feb700689b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feb740aa000 tx=0x7feb74005040 comp rx=0 tx=0).stop 2023-11-18T21:29:02.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:02.162+0000 7feb89645640 1 -- 172.21.15.49:0/3198593209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb8406f170 msgr2=0x7feb841f27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:02.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:02.162+0000 7feb89645640 1 --2- 172.21.15.49:0/3198593209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb8406f170 0x7feb841f27f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feb840c6b70 tx=0x7feb7c00cc00 comp rx=0 tx=0).stop 2023-11-18T21:29:02.163 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:02.162+0000 7feb89645640 1 -- 172.21.15.49:0/3198593209 shutdown_connections 2023-11-18T21:29:02.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:02.162+0000 7feb89645640 1 --2- 172.21.15.49:0/3198593209 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7feb700664f0 0x7feb700689b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:02.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:02.162+0000 7feb89645640 1 --2- 172.21.15.49:0/3198593209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb8406f170 0x7feb841f27f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:02.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:02.162+0000 7feb89645640 1 --2- 172.21.15.49:0/3198593209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb84153ea0 0x7feb841f22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:02.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:02.162+0000 7feb89645640 1 --2- 172.21.15.49:0/3198593209 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb6c003a40 0x7feb84071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:02.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:02.162+0000 7feb89645640 1 -- 172.21.15.49:0/3198593209 >> 172.21.15.49:0/3198593209 conn(0x7feb8406c6a0 msgr2=0x7feb840735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:29:02.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:02.162+0000 7feb89645640 1 -- 172.21.15.49:0/3198593209 shutdown_connections 2023-11-18T21:29:02.164 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:02.162+0000 7feb89645640 1 -- 172.21.15.49:0/3198593209 wait complete. 2023-11-18T21:29:02.183 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":938,"stamp":"2023-11-18T21:29:00.543686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24262386,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":804,"num_read_kb":1243,"num_write":12291,"num_write_kb":281645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14775,"ondisk_log_size":14775,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":388472,"kb_used_data":50232,"kb_used_omap":12,"kb_used_meta":338163,"kb_avail":754586248,"statfs":{"total":773094113280,"available":772696317952,"internally_reserved":0,"allocated":51437568,"data_stored":49613892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":346279473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005248"},"pg_stats":[{"pgid":"2.1f","version":"31'73","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.047934+0000","last_change":"2023-11-18T20:59:25.350113+0000","last_active":"2023-11-18T21:28:43.047934+0000","last_peered":"2023-11-18T21:28:43.047934+0000","last_clean":"2023-11-18T21:28:43.047934+0000","last_became_active":"2023-11-18T20:59:25.349869+0000","last_became_peered":"2023-11-18T20:59:25.349869+0000","last_unstale":"2023-11-18T21:28:43.047934+0000","last_undegraded":"2023-11-18T21:28:43.047934+0000","last_fullsized":"2023-11-18T21:28:43.047934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'45","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.673746+0000","last_change":"2023-11-18T20:59:27.895973+0000","last_active":"2023-11-18T21:28:43.673746+0000","last_peered":"2023-11-18T21:28:43.673746+0000","last_clean":"2023-11-18T21:28:43.673746+0000","last_became_active":"2023-11-18T20:59:27.895678+0000","last_became_peered":"2023-11-18T20:59:27.895678+0000","last_unstale":"2023-11-18T21:28:43.673746+0000","last_undegraded":"2023-11-18T21:28:43.673746+0000","last_fullsized":"2023-11-18T21:28:43.673746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"31'87","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.055420+0000","last_change":"2023-11-18T20:59:35.848621+0000","last_active":"2023-11-18T21:27:28.055420+0000","last_peered":"2023-11-18T21:27:28.055420+0000","last_clean":"2023-11-18T21:27:28.055420+0000","last_became_active":"2023-11-18T20:59:35.848140+0000","last_became_peered":"2023-11-18T20:59:35.848140+0000","last_unstale":"2023-11-18T21:27:28.055420+0000","last_undegraded":"2023-11-18T21:27:28.055420+0000","last_fullsized":"2023-11-18T21:27:28.055420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:12.962470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:59.358340+0000","last_change":"2023-11-18T20:59:25.463657+0000","last_active":"2023-11-18T21:27:59.358340+0000","last_peered":"2023-11-18T21:27:59.358340+0000","last_clean":"2023-11-18T21:27:59.358340+0000","last_became_active":"2023-11-18T20:59:25.463001+0000","last_became_peered":"2023-11-18T20:59:25.463001+0000","last_unstale":"2023-11-18T21:27:59.358340+0000","last_undegraded":"2023-11-18T21:27:59.358340+0000","last_fullsized":"2023-11-18T21:27:59.358340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:25:06.497645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"31'59","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630833+0000","last_change":"2023-11-18T20:59:27.837801+0000","last_active":"2023-11-18T21:28:43.630833+0000","last_peered":"2023-11-18T21:28:43.630833+0000","last_clean":"2023-11-18T21:28:43.630833+0000","last_became_active":"2023-11-18T20:59:27.836937+0000","last_became_peered":"2023-11-18T20:59:27.836937+0000","last_unstale":"2023-11-18T21:28:43.630833+0000","last_undegraded":"2023-11-18T21:28:43.630833+0000","last_fullsized":"2023-11-18T21:28:43.630833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:24.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"31'91","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:37.523328+0000","last_change":"2023-11-18T20:59:35.843015+0000","last_active":"2023-11-18T21:28:37.523328+0000","last_peered":"2023-11-18T21:28:37.523328+0000","last_clean":"2023-11-18T21:28:37.523328+0000","last_became_active":"2023-11-18T20:59:35.842552+0000","last_became_peered":"2023-11-18T20:59:35.842552+0000","last_unstale":"2023-11-18T21:28:37.523328+0000","last_undegraded":"2023-11-18T21:28:37.523328+0000","last_fullsized":"2023-11-18T21:28:37.523328+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"31'175","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.287609+0000","last_change":"2023-11-18T20:59:25.497907+0000","last_active":"2023-11-18T21:28:32.287609+0000","last_peered":"2023-11-18T21:28:32.287609+0000","last_clean":"2023-11-18T21:28:32.287609+0000","last_became_active":"2023-11-18T20:59:25.497070+0000","last_became_peered":"2023-11-18T20:59:25.497070+0000","last_unstale":"2023-11-18T21:28:32.287609+0000","last_undegraded":"2023-11-18T21:28:32.287609+0000","last_fullsized":"2023-11-18T21:28:32.287609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"31'56","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.671902+0000","last_change":"2023-11-18T20:59:27.868161+0000","last_active":"2023-11-18T21:28:43.671902+0000","last_peered":"2023-11-18T21:28:43.671902+0000","last_clean":"2023-11-18T21:28:43.671902+0000","last_became_active":"2023-11-18T20:59:27.867021+0000","last_became_peered":"2023-11-18T20:59:27.867021+0000","last_unstale":"2023-11-18T21:28:43.671902+0000","last_undegraded":"2023-11-18T21:28:43.671902+0000","last_fullsized":"2023-11-18T21:28:43.671902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'88","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.967589+0000","last_change":"2023-11-18T20:59:35.830210+0000","last_active":"2023-11-18T21:27:27.967589+0000","last_peered":"2023-11-18T21:27:27.967589+0000","last_clean":"2023-11-18T21:27:27.967589+0000","last_became_active":"2023-11-18T20:59:35.829636+0000","last_became_peered":"2023-11-18T20:59:35.829636+0000","last_unstale":"2023-11-18T21:27:27.967589+0000","last_undegraded":"2023-11-18T21:27:27.967589+0000","last_fullsized":"2023-11-18T21:27:27.967589+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":32,"num_write":84,"num_write_kb":9481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"31'10","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.288478+0000","last_change":"2023-11-18T20:59:25.493859+0000","last_active":"2023-11-18T21:28:32.288478+0000","last_peered":"2023-11-18T21:28:32.288478+0000","last_clean":"2023-11-18T21:28:32.288478+0000","last_became_active":"2023-11-18T20:59:25.493087+0000","last_became_peered":"2023-11-18T20:59:25.493087+0000","last_unstale":"2023-11-18T21:28:32.288478+0000","last_undegraded":"2023-11-18T21:28:32.288478+0000","last_fullsized":"2023-11-18T21:28:32.288478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"31'65","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.677740+0000","last_change":"2023-11-18T20:59:27.871929+0000","last_active":"2023-11-18T21:28:43.677740+0000","last_peered":"2023-11-18T21:28:43.677740+0000","last_clean":"2023-11-18T21:28:43.677740+0000","last_became_active":"2023-11-18T20:59:27.871076+0000","last_became_peered":"2023-11-18T20:59:27.871076+0000","last_unstale":"2023-11-18T21:28:43.677740+0000","last_undegraded":"2023-11-18T21:28:43.677740+0000","last_fullsized":"2023-11-18T21:28:43.677740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:24:09.546791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"31'63","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:23.952233+0000","last_change":"2023-11-18T20:59:35.833547+0000","last_active":"2023-11-18T21:27:23.952233+0000","last_peered":"2023-11-18T21:27:23.952233+0000","last_clean":"2023-11-18T21:27:23.952233+0000","last_became_active":"2023-11-18T20:59:35.833016+0000","last_became_peered":"2023-11-18T20:59:35.833016+0000","last_unstale":"2023-11-18T21:27:23.952233+0000","last_undegraded":"2023-11-18T21:27:23.952233+0000","last_fullsized":"2023-11-18T21:27:23.952233+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":5002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"31'56","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.634810+0000","last_change":"2023-11-18T20:59:27.682005+0000","last_active":"2023-11-18T21:28:43.634810+0000","last_peered":"2023-11-18T21:28:43.634810+0000","last_clean":"2023-11-18T21:28:43.634810+0000","last_became_active":"2023-11-18T20:59:27.681154+0000","last_became_peered":"2023-11-18T20:59:27.681154+0000","last_unstale":"2023-11-18T21:28:43.634810+0000","last_undegraded":"2023-11-18T21:28:43.634810+0000","last_fullsized":"2023-11-18T21:28:43.634810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:10.426499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"31'142","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.042960+0000","last_change":"2023-11-18T20:59:25.339269+0000","last_active":"2023-11-18T21:28:43.042960+0000","last_peered":"2023-11-18T21:28:43.042960+0000","last_clean":"2023-11-18T21:28:43.042960+0000","last_became_active":"2023-11-18T20:59:25.338067+0000","last_became_peered":"2023-11-18T20:59:25.338067+0000","last_unstale":"2023-11-18T21:28:43.042960+0000","last_undegraded":"2023-11-18T21:28:43.042960+0000","last_fullsized":"2023-11-18T21:28:43.042960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:33:57.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395570,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'89","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:32.458469+0000","last_change":"2023-11-18T21:00:28.755990+0000","last_active":"2023-11-18T21:27:32.458469+0000","last_peered":"2023-11-18T21:27:32.458469+0000","last_clean":"2023-11-18T21:27:32.458469+0000","last_became_active":"2023-11-18T21:00:28.755606+0000","last_became_peered":"2023-11-18T21:00:28.755606+0000","last_unstale":"2023-11-18T21:27:32.458469+0000","last_undegraded":"2023-11-18T21:27:32.458469+0000","last_fullsized":"2023-11-18T21:27:32.458469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":4704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'54","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.476664+0000","last_change":"2023-11-18T20:59:27.861550+0000","last_active":"2023-11-18T21:28:43.476664+0000","last_peered":"2023-11-18T21:28:43.476664+0000","last_clean":"2023-11-18T21:28:43.476664+0000","last_became_active":"2023-11-18T20:59:27.861045+0000","last_became_peered":"2023-11-18T20:59:27.861045+0000","last_unstale":"2023-11-18T21:28:43.476664+0000","last_undegraded":"2023-11-18T21:28:43.476664+0000","last_fullsized":"2023-11-18T21:28:43.476664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:09.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"31'407","reported_seq":442,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:37.390812+0000","last_change":"2023-11-18T20:59:25.458601+0000","last_active":"2023-11-18T21:28:37.390812+0000","last_peered":"2023-11-18T21:28:37.390812+0000","last_clean":"2023-11-18T21:28:37.390812+0000","last_became_active":"2023-11-18T20:59:25.457871+0000","last_became_peered":"2023-11-18T20:59:25.457871+0000","last_unstale":"2023-11-18T21:28:37.390812+0000","last_undegraded":"2023-11-18T21:28:37.390812+0000","last_fullsized":"2023-11-18T21:28:37.390812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:27:09.387812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":996,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"31'93","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:52.475280+0000","last_change":"2023-11-18T20:59:35.842967+0000","last_active":"2023-11-18T21:28:52.475280+0000","last_peered":"2023-11-18T21:28:52.475280+0000","last_clean":"2023-11-18T21:28:52.475280+0000","last_became_active":"2023-11-18T20:59:35.842583+0000","last_became_peered":"2023-11-18T20:59:35.842583+0000","last_unstale":"2023-11-18T21:28:52.475280+0000","last_undegraded":"2023-11-18T21:28:52.475280+0000","last_fullsized":"2023-11-18T21:28:52.475280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'46","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.574412+0000","last_change":"2023-11-18T20:59:27.688043+0000","last_active":"2023-11-18T21:28:43.574412+0000","last_peered":"2023-11-18T21:28:43.574412+0000","last_clean":"2023-11-18T21:28:43.574412+0000","last_became_active":"2023-11-18T20:59:27.687250+0000","last_became_peered":"2023-11-18T20:59:27.687250+0000","last_unstale":"2023-11-18T21:28:43.574412+0000","last_undegraded":"2023-11-18T21:28:43.574412+0000","last_fullsized":"2023-11-18T21:28:43.574412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"31'202","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.315737+0000","last_change":"2023-11-18T20:59:25.351927+0000","last_active":"2023-11-18T21:28:32.315737+0000","last_peered":"2023-11-18T21:28:32.315737+0000","last_clean":"2023-11-18T21:28:32.315737+0000","last_became_active":"2023-11-18T20:59:25.351318+0000","last_became_peered":"2023-11-18T20:59:25.351318+0000","last_unstale":"2023-11-18T21:28:32.315737+0000","last_undegraded":"2023-11-18T21:28:32.315737+0000","last_fullsized":"2023-11-18T21:28:32.315737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'80","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.908455+0000","last_change":"2023-11-18T20:59:35.835375+0000","last_active":"2023-11-18T21:27:18.908455+0000","last_peered":"2023-11-18T21:27:18.908455+0000","last_clean":"2023-11-18T21:27:18.908455+0000","last_became_active":"2023-11-18T20:59:35.834894+0000","last_became_peered":"2023-11-18T20:59:35.834894+0000","last_unstale":"2023-11-18T21:27:18.908455+0000","last_undegraded":"2023-11-18T21:27:18.908455+0000","last_fullsized":"2023-11-18T21:27:18.908455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:33.448377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":144,"num_write":72,"num_write_kb":6857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"31'48","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.628688+0000","last_change":"2023-11-18T20:59:27.687356+0000","last_active":"2023-11-18T21:28:43.628688+0000","last_peered":"2023-11-18T21:28:43.628688+0000","last_clean":"2023-11-18T21:28:43.628688+0000","last_became_active":"2023-11-18T20:59:27.686692+0000","last_became_peered":"2023-11-18T20:59:27.686692+0000","last_unstale":"2023-11-18T21:28:43.628688+0000","last_undegraded":"2023-11-18T21:28:43.628688+0000","last_fullsized":"2023-11-18T21:28:43.628688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:20:58.633153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.090301+0000","last_change":"2023-11-18T20:59:25.347589+0000","last_active":"2023-11-18T21:28:26.090301+0000","last_peered":"2023-11-18T21:28:26.090301+0000","last_clean":"2023-11-18T21:28:26.090301+0000","last_became_active":"2023-11-18T20:59:25.347022+0000","last_became_peered":"2023-11-18T20:59:25.347022+0000","last_unstale":"2023-11-18T21:28:26.090301+0000","last_undegraded":"2023-11-18T21:28:26.090301+0000","last_fullsized":"2023-11-18T21:28:26.090301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'120","reported_seq":149,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:52.349868+0000","last_change":"2023-11-18T20:59:35.771398+0000","last_active":"2023-11-18T21:28:52.349868+0000","last_peered":"2023-11-18T21:28:52.349868+0000","last_clean":"2023-11-18T21:28:52.349868+0000","last_became_active":"2023-11-18T20:59:35.770923+0000","last_became_peered":"2023-11-18T20:59:35.770923+0000","last_unstale":"2023-11-18T21:28:52.349868+0000","last_undegraded":"2023-11-18T21:28:52.349868+0000","last_fullsized":"2023-11-18T21:28:52.349868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'44","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.574110+0000","last_change":"2023-11-18T20:59:27.689972+0000","last_active":"2023-11-18T21:28:43.574110+0000","last_peered":"2023-11-18T21:28:43.574110+0000","last_clean":"2023-11-18T21:28:43.574110+0000","last_became_active":"2023-11-18T20:59:27.689156+0000","last_became_peered":"2023-11-18T20:59:27.689156+0000","last_unstale":"2023-11-18T21:28:43.574110+0000","last_undegraded":"2023-11-18T21:28:43.574110+0000","last_fullsized":"2023-11-18T21:28:43.574110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"31'12","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:18.009596+0000","last_change":"2023-11-18T20:59:25.348005+0000","last_active":"2023-11-18T21:28:18.009596+0000","last_peered":"2023-11-18T21:28:18.009596+0000","last_clean":"2023-11-18T21:28:18.009596+0000","last_became_active":"2023-11-18T20:59:25.346318+0000","last_became_peered":"2023-11-18T20:59:25.346318+0000","last_unstale":"2023-11-18T21:28:18.009596+0000","last_undegraded":"2023-11-18T21:28:18.009596+0000","last_fullsized":"2023-11-18T21:28:18.009596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:24:37.045716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"31'81","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:47.348761+0000","last_change":"2023-11-18T20:59:35.833754+0000","last_active":"2023-11-18T21:28:47.348761+0000","last_peered":"2023-11-18T21:28:47.348761+0000","last_clean":"2023-11-18T21:28:47.348761+0000","last_became_active":"2023-11-18T20:59:35.833407+0000","last_became_peered":"2023-11-18T20:59:35.833407+0000","last_unstale":"2023-11-18T21:28:47.348761+0000","last_undegraded":"2023-11-18T21:28:47.348761+0000","last_fullsized":"2023-11-18T21:28:47.348761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":9489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'53","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.574125+0000","last_change":"2023-11-18T20:59:27.863887+0000","last_active":"2023-11-18T21:28:43.574125+0000","last_peered":"2023-11-18T21:28:43.574125+0000","last_clean":"2023-11-18T21:28:43.574125+0000","last_became_active":"2023-11-18T20:59:27.863358+0000","last_became_peered":"2023-11-18T20:59:27.863358+0000","last_unstale":"2023-11-18T21:28:43.574125+0000","last_undegraded":"2023-11-18T21:28:43.574125+0000","last_fullsized":"2023-11-18T21:28:43.574125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"31'150","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:41.791354+0000","last_change":"2023-11-18T20:59:25.351394+0000","last_active":"2023-11-18T21:28:41.791354+0000","last_peered":"2023-11-18T21:28:41.791354+0000","last_clean":"2023-11-18T21:28:41.791354+0000","last_became_active":"2023-11-18T20:59:25.350705+0000","last_became_peered":"2023-11-18T20:59:25.350705+0000","last_unstale":"2023-11-18T21:28:41.791354+0000","last_undegraded":"2023-11-18T21:28:41.791354+0000","last_fullsized":"2023-11-18T21:28:41.791354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:40.332634+0000","last_change":"2023-11-18T20:59:35.840991+0000","last_active":"2023-11-18T21:27:40.332634+0000","last_peered":"2023-11-18T21:27:40.332634+0000","last_clean":"2023-11-18T21:27:40.332634+0000","last_became_active":"2023-11-18T20:59:35.840533+0000","last_became_peered":"2023-11-18T20:59:35.840533+0000","last_unstale":"2023-11-18T21:27:40.332634+0000","last_undegraded":"2023-11-18T21:27:40.332634+0000","last_fullsized":"2023-11-18T21:27:40.332634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":9026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"31'60","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.582868+0000","last_change":"2023-11-18T20:59:27.869100+0000","last_active":"2023-11-18T21:28:43.582868+0000","last_peered":"2023-11-18T21:28:43.582868+0000","last_clean":"2023-11-18T21:28:43.582868+0000","last_became_active":"2023-11-18T20:59:27.868355+0000","last_became_peered":"2023-11-18T20:59:27.868355+0000","last_unstale":"2023-11-18T21:28:43.582868+0000","last_undegraded":"2023-11-18T21:28:43.582868+0000","last_fullsized":"2023-11-18T21:28:43.582868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:01:25.235096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"31'94","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:19.874168+0000","last_change":"2023-11-18T20:59:25.350304+0000","last_active":"2023-11-18T21:28:19.874168+0000","last_peered":"2023-11-18T21:28:19.874168+0000","last_clean":"2023-11-18T21:28:19.874168+0000","last_became_active":"2023-11-18T20:59:25.349346+0000","last_became_peered":"2023-11-18T20:59:25.349346+0000","last_unstale":"2023-11-18T21:28:19.874168+0000","last_undegraded":"2023-11-18T21:28:19.874168+0000","last_fullsized":"2023-11-18T21:28:19.874168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:41.179268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"31'98","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.020859+0000","last_change":"2023-11-18T20:59:35.847005+0000","last_active":"2023-11-18T21:27:27.020859+0000","last_peered":"2023-11-18T21:27:27.020859+0000","last_clean":"2023-11-18T21:27:27.020859+0000","last_became_active":"2023-11-18T20:59:35.846458+0000","last_became_peered":"2023-11-18T20:59:35.846458+0000","last_unstale":"2023-11-18T21:27:27.020859+0000","last_undegraded":"2023-11-18T21:27:27.020859+0000","last_fullsized":"2023-11-18T21:27:27.020859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:47.887705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":10588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"31'50","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:47.348914+0000","last_change":"2023-11-18T20:59:27.889369+0000","last_active":"2023-11-18T21:28:47.348914+0000","last_peered":"2023-11-18T21:28:47.348914+0000","last_clean":"2023-11-18T21:28:47.348914+0000","last_became_active":"2023-11-18T20:59:27.887876+0000","last_became_peered":"2023-11-18T20:59:27.887876+0000","last_unstale":"2023-11-18T21:28:47.348914+0000","last_undegraded":"2023-11-18T21:28:47.348914+0000","last_fullsized":"2023-11-18T21:28:47.348914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"31'6","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:18.000761+0000","last_change":"2023-11-18T20:59:25.459620+0000","last_active":"2023-11-18T21:28:18.000761+0000","last_peered":"2023-11-18T21:28:18.000761+0000","last_clean":"2023-11-18T21:28:18.000761+0000","last_became_active":"2023-11-18T20:59:25.459235+0000","last_became_peered":"2023-11-18T20:59:25.459235+0000","last_unstale":"2023-11-18T21:28:18.000761+0000","last_undegraded":"2023-11-18T21:28:18.000761+0000","last_fullsized":"2023-11-18T21:28:18.000761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:02.325885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:20.899113+0000","last_change":"2023-11-18T20:59:35.835800+0000","last_active":"2023-11-18T21:27:20.899113+0000","last_peered":"2023-11-18T21:27:20.899113+0000","last_clean":"2023-11-18T21:27:20.899113+0000","last_became_active":"2023-11-18T20:59:35.834275+0000","last_became_peered":"2023-11-18T20:59:35.834275+0000","last_unstale":"2023-11-18T21:27:20.899113+0000","last_undegraded":"2023-11-18T21:27:20.899113+0000","last_fullsized":"2023-11-18T21:27:20.899113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:24.584128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'61","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.476976+0000","last_change":"2023-11-18T21:00:28.721070+0000","last_active":"2023-11-18T21:28:43.476976+0000","last_peered":"2023-11-18T21:28:43.476976+0000","last_clean":"2023-11-18T21:28:43.476976+0000","last_became_active":"2023-11-18T21:00:28.720412+0000","last_became_peered":"2023-11-18T21:00:28.720412+0000","last_unstale":"2023-11-18T21:28:43.476976+0000","last_undegraded":"2023-11-18T21:28:43.476976+0000","last_fullsized":"2023-11-18T21:28:43.476976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:32.674700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"31'655","reported_seq":691,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.048563+0000","last_change":"2023-11-18T20:59:25.355096+0000","last_active":"2023-11-18T21:28:43.048563+0000","last_peered":"2023-11-18T21:28:43.048563+0000","last_clean":"2023-11-18T21:28:43.048563+0000","last_became_active":"2023-11-18T20:59:25.354716+0000","last_became_peered":"2023-11-18T20:59:25.354716+0000","last_unstale":"2023-11-18T21:28:43.048563+0000","last_undegraded":"2023-11-18T21:28:43.048563+0000","last_fullsized":"2023-11-18T21:28:43.048563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:51:51.039181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":3369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'79","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.120724+0000","last_change":"2023-11-18T20:59:35.839218+0000","last_active":"2023-11-18T21:27:28.120724+0000","last_peered":"2023-11-18T21:27:28.120724+0000","last_clean":"2023-11-18T21:27:28.120724+0000","last_became_active":"2023-11-18T20:59:35.838732+0000","last_became_peered":"2023-11-18T20:59:35.838732+0000","last_unstale":"2023-11-18T21:27:28.120724+0000","last_undegraded":"2023-11-18T21:27:28.120724+0000","last_fullsized":"2023-11-18T21:27:28.120724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:50.416246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"31'54","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.634030+0000","last_change":"2023-11-18T20:59:27.839403+0000","last_active":"2023-11-18T21:28:43.634030+0000","last_peered":"2023-11-18T21:28:43.634030+0000","last_clean":"2023-11-18T21:28:43.634030+0000","last_became_active":"2023-11-18T20:59:27.838664+0000","last_became_peered":"2023-11-18T20:59:27.838664+0000","last_unstale":"2023-11-18T21:28:43.634030+0000","last_undegraded":"2023-11-18T21:28:43.634030+0000","last_fullsized":"2023-11-18T21:28:43.634030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:10:42.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"31'164","reported_seq":273,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:38.912485+0000","last_change":"2023-11-18T20:59:25.458840+0000","last_active":"2023-11-18T21:28:38.912485+0000","last_peered":"2023-11-18T21:28:38.912485+0000","last_clean":"2023-11-18T21:28:38.912485+0000","last_became_active":"2023-11-18T20:59:25.458075+0000","last_became_peered":"2023-11-18T20:59:25.458075+0000","last_unstale":"2023-11-18T21:28:38.912485+0000","last_undegraded":"2023-11-18T21:28:38.912485+0000","last_fullsized":"2023-11-18T21:28:38.912485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:48.644992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18647,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":79,"num_write":158,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"31'81","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:24.941939+0000","last_change":"2023-11-18T20:59:35.833736+0000","last_active":"2023-11-18T21:27:24.941939+0000","last_peered":"2023-11-18T21:27:24.941939+0000","last_clean":"2023-11-18T21:27:24.941939+0000","last_became_active":"2023-11-18T20:59:35.832891+0000","last_became_peered":"2023-11-18T20:59:35.832891+0000","last_unstale":"2023-11-18T21:27:24.941939+0000","last_undegraded":"2023-11-18T21:27:24.941939+0000","last_fullsized":"2023-11-18T21:27:24.941939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:12.929672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"31'58","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.597860+0000","last_change":"2023-11-18T20:59:27.889690+0000","last_active":"2023-11-18T21:28:43.597860+0000","last_peered":"2023-11-18T21:28:43.597860+0000","last_clean":"2023-11-18T21:28:43.597860+0000","last_became_active":"2023-11-18T20:59:27.889115+0000","last_became_peered":"2023-11-18T20:59:27.889115+0000","last_unstale":"2023-11-18T21:28:43.597860+0000","last_undegraded":"2023-11-18T21:28:43.597860+0000","last_fullsized":"2023-11-18T21:28:43.597860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:57:08.995074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:10.915862+0000","last_change":"2023-11-18T20:59:25.460190+0000","last_active":"2023-11-18T21:28:10.915862+0000","last_peered":"2023-11-18T21:28:10.915862+0000","last_clean":"2023-11-18T21:28:10.915862+0000","last_became_active":"2023-11-18T20:59:25.459405+0000","last_became_peered":"2023-11-18T20:59:25.459405+0000","last_unstale":"2023-11-18T21:28:10.915862+0000","last_undegraded":"2023-11-18T21:28:10.915862+0000","last_fullsized":"2023-11-18T21:28:10.915862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:37.162686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"31'64","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:25.970399+0000","last_change":"2023-11-18T20:59:35.842229+0000","last_active":"2023-11-18T21:27:25.970399+0000","last_peered":"2023-11-18T21:27:25.970399+0000","last_clean":"2023-11-18T21:27:25.970399+0000","last_became_active":"2023-11-18T20:59:35.835644+0000","last_became_peered":"2023-11-18T20:59:35.835644+0000","last_unstale":"2023-11-18T21:27:25.970399+0000","last_undegraded":"2023-11-18T21:27:25.970399+0000","last_fullsized":"2023-11-18T21:27:25.970399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:28.212029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"31'47","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.613325+0000","last_change":"2023-11-18T20:59:27.890885+0000","last_active":"2023-11-18T21:28:43.613325+0000","last_peered":"2023-11-18T21:28:43.613325+0000","last_clean":"2023-11-18T21:28:43.613325+0000","last_became_active":"2023-11-18T20:59:27.890499+0000","last_became_peered":"2023-11-18T20:59:27.890499+0000","last_unstale":"2023-11-18T21:28:43.613325+0000","last_undegraded":"2023-11-18T21:28:43.613325+0000","last_fullsized":"2023-11-18T21:28:43.613325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:04.464620+0000","last_change":"2023-11-18T20:59:25.339255+0000","last_active":"2023-11-18T21:28:04.464620+0000","last_peered":"2023-11-18T21:28:04.464620+0000","last_clean":"2023-11-18T21:28:04.464620+0000","last_became_active":"2023-11-18T20:59:25.338020+0000","last_became_peered":"2023-11-18T20:59:25.338020+0000","last_unstale":"2023-11-18T21:28:04.464620+0000","last_undegraded":"2023-11-18T21:28:04.464620+0000","last_fullsized":"2023-11-18T21:28:04.464620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:07.183625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:55.904332+0000","last_change":"2023-11-18T21:28:55.904332+0000","last_active":"2023-11-18T21:28:55.904332+0000","last_peered":"2023-11-18T21:28:55.904332+0000","last_clean":"2023-11-18T21:28:55.904332+0000","last_became_active":"2023-11-18T20:58:44.731076+0000","last_became_peered":"2023-11-18T20:58:44.731076+0000","last_unstale":"2023-11-18T21:28:55.904332+0000","last_undegraded":"2023-11-18T21:28:55.904332+0000","last_fullsized":"2023-11-18T21:28:55.904332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-11-18T21:28:55.904224+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-11-18T21:28:55.904224+0000","last_clean_scrub_stamp":"2023-11-18T21:28:55.904224+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:05:55.057907+0000","scrub_duration":0.010934374,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'66","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:25.978546+0000","last_change":"2023-11-18T20:59:35.771637+0000","last_active":"2023-11-18T21:27:25.978546+0000","last_peered":"2023-11-18T21:27:25.978546+0000","last_clean":"2023-11-18T21:27:25.978546+0000","last_became_active":"2023-11-18T20:59:35.771146+0000","last_became_peered":"2023-11-18T20:59:35.771146+0000","last_unstale":"2023-11-18T21:27:25.978546+0000","last_undegraded":"2023-11-18T21:27:25.978546+0000","last_fullsized":"2023-11-18T21:27:25.978546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:15.290602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":6116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"31'58","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.654090+0000","last_change":"2023-11-18T20:59:27.684091+0000","last_active":"2023-11-18T21:28:43.654090+0000","last_peered":"2023-11-18T21:28:43.654090+0000","last_clean":"2023-11-18T21:28:43.654090+0000","last_became_active":"2023-11-18T20:59:27.683316+0000","last_became_peered":"2023-11-18T20:59:27.683316+0000","last_unstale":"2023-11-18T21:28:43.654090+0000","last_undegraded":"2023-11-18T21:28:43.654090+0000","last_fullsized":"2023-11-18T21:28:43.654090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:52:02.757528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"31'666","reported_seq":701,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.066698+0000","last_change":"2023-11-18T20:59:25.357198+0000","last_active":"2023-11-18T21:28:43.066698+0000","last_peered":"2023-11-18T21:28:43.066698+0000","last_clean":"2023-11-18T21:28:43.066698+0000","last_became_active":"2023-11-18T20:59:25.356883+0000","last_became_peered":"2023-11-18T20:59:25.356883+0000","last_unstale":"2023-11-18T21:28:43.066698+0000","last_undegraded":"2023-11-18T21:28:43.066698+0000","last_fullsized":"2023-11-18T21:28:43.066698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:09.508737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3370313,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"31'82","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:52.514072+0000","last_change":"2023-11-18T20:59:35.834266+0000","last_active":"2023-11-18T21:27:52.514072+0000","last_peered":"2023-11-18T21:27:52.514072+0000","last_clean":"2023-11-18T21:27:52.514072+0000","last_became_active":"2023-11-18T20:59:35.833790+0000","last_became_peered":"2023-11-18T20:59:35.833790+0000","last_unstale":"2023-11-18T21:27:52.514072+0000","last_undegraded":"2023-11-18T21:27:52.514072+0000","last_fullsized":"2023-11-18T21:27:52.514072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":7460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'56","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678926+0000","last_change":"2023-11-18T20:59:27.873828+0000","last_active":"2023-11-18T21:28:43.678926+0000","last_peered":"2023-11-18T21:28:43.678926+0000","last_clean":"2023-11-18T21:28:43.678926+0000","last_became_active":"2023-11-18T20:59:27.872733+0000","last_became_peered":"2023-11-18T20:59:27.872733+0000","last_unstale":"2023-11-18T21:28:43.678926+0000","last_undegraded":"2023-11-18T21:28:43.678926+0000","last_fullsized":"2023-11-18T21:28:43.678926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"31'7","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.098478+0000","last_change":"2023-11-18T20:59:25.497529+0000","last_active":"2023-11-18T21:28:26.098478+0000","last_peered":"2023-11-18T21:28:26.098478+0000","last_clean":"2023-11-18T21:28:26.098478+0000","last_became_active":"2023-11-18T20:59:25.496694+0000","last_became_peered":"2023-11-18T20:59:25.496694+0000","last_unstale":"2023-11-18T21:28:26.098478+0000","last_undegraded":"2023-11-18T21:28:26.098478+0000","last_fullsized":"2023-11-18T21:28:26.098478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'95","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:25.972621+0000","last_change":"2023-11-18T20:59:35.829393+0000","last_active":"2023-11-18T21:27:25.972621+0000","last_peered":"2023-11-18T21:27:25.972621+0000","last_clean":"2023-11-18T21:27:25.972621+0000","last_became_active":"2023-11-18T20:59:35.828446+0000","last_became_peered":"2023-11-18T20:59:35.828446+0000","last_unstale":"2023-11-18T21:27:25.972621+0000","last_undegraded":"2023-11-18T21:27:25.972621+0000","last_fullsized":"2023-11-18T21:27:25.972621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:33.544336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":11010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"31'55","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:56.199386+0000","last_change":"2023-11-18T21:28:56.199412+0000","last_active":"2023-11-18T21:28:56.199386+0000","last_peered":"2023-11-18T21:28:56.199386+0000","last_clean":"2023-11-18T21:28:56.199386+0000","last_became_active":"2023-11-18T20:59:27.870220+0000","last_became_peered":"2023-11-18T20:59:27.870220+0000","last_unstale":"2023-11-18T21:28:56.199386+0000","last_undegraded":"2023-11-18T21:28:56.199386+0000","last_fullsized":"2023-11-18T21:28:56.199386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'55","last_scrub_stamp":"2023-11-18T21:28:56.199297+0000","last_deep_scrub":"31'55","last_deep_scrub_stamp":"2023-11-18T21:28:56.199297+0000","last_clean_scrub_stamp":"2023-11-18T21:28:56.199297+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:51:50.633425+0000","scrub_duration":0.003736053,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"31'12","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:40.158906+0000","last_change":"2023-11-18T20:59:25.457826+0000","last_active":"2023-11-18T21:28:40.158906+0000","last_peered":"2023-11-18T21:28:40.158906+0000","last_clean":"2023-11-18T21:28:40.158906+0000","last_became_active":"2023-11-18T20:59:25.457392+0000","last_became_peered":"2023-11-18T20:59:25.457392+0000","last_unstale":"2023-11-18T21:28:40.158906+0000","last_undegraded":"2023-11-18T21:28:40.158906+0000","last_fullsized":"2023-11-18T21:28:40.158906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"31'70","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.074726+0000","last_change":"2023-11-18T20:59:35.831579+0000","last_active":"2023-11-18T21:27:28.074726+0000","last_peered":"2023-11-18T21:27:28.074726+0000","last_clean":"2023-11-18T21:27:28.074726+0000","last_became_active":"2023-11-18T20:59:35.831147+0000","last_became_peered":"2023-11-18T20:59:35.831147+0000","last_unstale":"2023-11-18T21:27:28.074726+0000","last_undegraded":"2023-11-18T21:27:28.074726+0000","last_fullsized":"2023-11-18T21:27:28.074726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:27:08.730686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"31'58","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.694727+0000","last_change":"2023-11-18T20:59:27.895618+0000","last_active":"2023-11-18T21:28:43.694727+0000","last_peered":"2023-11-18T21:28:43.694727+0000","last_clean":"2023-11-18T21:28:43.694727+0000","last_became_active":"2023-11-18T20:59:27.894931+0000","last_became_peered":"2023-11-18T20:59:27.894931+0000","last_unstale":"2023-11-18T21:28:43.694727+0000","last_undegraded":"2023-11-18T21:28:43.694727+0000","last_fullsized":"2023-11-18T21:28:43.694727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"31'206","reported_seq":242,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:47.474550+0000","last_change":"2023-11-18T20:59:25.458603+0000","last_active":"2023-11-18T21:28:47.474550+0000","last_peered":"2023-11-18T21:28:47.474550+0000","last_clean":"2023-11-18T21:28:47.474550+0000","last_became_active":"2023-11-18T20:59:25.457932+0000","last_became_peered":"2023-11-18T20:59:25.457932+0000","last_unstale":"2023-11-18T21:28:47.474550+0000","last_undegraded":"2023-11-18T21:28:47.474550+0000","last_fullsized":"2023-11-18T21:28:47.474550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":499,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"31'58","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:47.479881+0000","last_change":"2023-11-18T20:59:35.832209+0000","last_active":"2023-11-18T21:27:47.479881+0000","last_peered":"2023-11-18T21:27:47.479881+0000","last_clean":"2023-11-18T21:27:47.479881+0000","last_became_active":"2023-11-18T20:59:35.831804+0000","last_became_peered":"2023-11-18T20:59:35.831804+0000","last_unstale":"2023-11-18T21:27:47.479881+0000","last_undegraded":"2023-11-18T21:27:47.479881+0000","last_fullsized":"2023-11-18T21:27:47.479881+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":9539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'55","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.664165+0000","last_change":"2023-11-18T20:59:27.884733+0000","last_active":"2023-11-18T21:28:43.664165+0000","last_peered":"2023-11-18T21:28:43.664165+0000","last_clean":"2023-11-18T21:28:43.664165+0000","last_became_active":"2023-11-18T20:59:27.884143+0000","last_became_peered":"2023-11-18T20:59:27.884143+0000","last_unstale":"2023-11-18T21:28:43.664165+0000","last_undegraded":"2023-11-18T21:28:43.664165+0000","last_fullsized":"2023-11-18T21:28:43.664165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:22:32.466816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"31'147","reported_seq":182,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:38.920232+0000","last_change":"2023-11-18T20:59:25.362761+0000","last_active":"2023-11-18T21:28:38.920232+0000","last_peered":"2023-11-18T21:28:38.920232+0000","last_clean":"2023-11-18T21:28:38.920232+0000","last_became_active":"2023-11-18T20:59:25.362350+0000","last_became_peered":"2023-11-18T20:59:25.362350+0000","last_unstale":"2023-11-18T21:28:38.920232+0000","last_undegraded":"2023-11-18T21:28:38.920232+0000","last_fullsized":"2023-11-18T21:28:38.920232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"31'80","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.936662+0000","last_change":"2023-11-18T20:59:35.836797+0000","last_active":"2023-11-18T21:27:27.936662+0000","last_peered":"2023-11-18T21:27:27.936662+0000","last_clean":"2023-11-18T21:27:27.936662+0000","last_became_active":"2023-11-18T20:59:35.834153+0000","last_became_peered":"2023-11-18T20:59:35.834153+0000","last_unstale":"2023-11-18T21:27:27.936662+0000","last_undegraded":"2023-11-18T21:27:27.936662+0000","last_fullsized":"2023-11-18T21:27:27.936662+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:22:18.639780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'47","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630804+0000","last_change":"2023-11-18T20:59:27.841401+0000","last_active":"2023-11-18T21:28:43.630804+0000","last_peered":"2023-11-18T21:28:43.630804+0000","last_clean":"2023-11-18T21:28:43.630804+0000","last_became_active":"2023-11-18T20:59:27.840852+0000","last_became_peered":"2023-11-18T20:59:27.840852+0000","last_unstale":"2023-11-18T21:28:43.630804+0000","last_undegraded":"2023-11-18T21:28:43.630804+0000","last_fullsized":"2023-11-18T21:28:43.630804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"31'840","reported_seq":875,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.832883+0000","last_change":"2023-11-18T20:59:25.351707+0000","last_active":"2023-11-18T21:28:43.832883+0000","last_peered":"2023-11-18T21:28:43.832883+0000","last_clean":"2023-11-18T21:28:43.832883+0000","last_became_active":"2023-11-18T20:59:25.351149+0000","last_became_peered":"2023-11-18T20:59:25.351149+0000","last_unstale":"2023-11-18T21:28:43.832883+0000","last_undegraded":"2023-11-18T21:28:43.832883+0000","last_fullsized":"2023-11-18T21:28:43.832883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3704571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":4031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"31'77","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.952612+0000","last_change":"2023-11-18T20:59:35.844046+0000","last_active":"2023-11-18T21:27:27.952612+0000","last_peered":"2023-11-18T21:27:27.952612+0000","last_clean":"2023-11-18T21:27:27.952612+0000","last_became_active":"2023-11-18T20:59:35.843208+0000","last_became_peered":"2023-11-18T20:59:35.843208+0000","last_unstale":"2023-11-18T21:27:27.952612+0000","last_undegraded":"2023-11-18T21:27:27.952612+0000","last_fullsized":"2023-11-18T21:27:27.952612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:21:06.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":6277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'59","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.670708+0000","last_change":"2023-11-18T20:59:27.866997+0000","last_active":"2023-11-18T21:28:43.670708+0000","last_peered":"2023-11-18T21:28:43.670708+0000","last_clean":"2023-11-18T21:28:43.670708+0000","last_became_active":"2023-11-18T20:59:27.866233+0000","last_became_peered":"2023-11-18T20:59:27.866233+0000","last_unstale":"2023-11-18T21:28:43.670708+0000","last_undegraded":"2023-11-18T21:28:43.670708+0000","last_fullsized":"2023-11-18T21:28:43.670708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:32:19.998748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"31'93","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.127406+0000","last_change":"2023-11-18T20:59:25.362589+0000","last_active":"2023-11-18T21:28:26.127406+0000","last_peered":"2023-11-18T21:28:26.127406+0000","last_clean":"2023-11-18T21:28:26.127406+0000","last_became_active":"2023-11-18T20:59:25.362287+0000","last_became_peered":"2023-11-18T20:59:25.362287+0000","last_unstale":"2023-11-18T21:28:26.127406+0000","last_undegraded":"2023-11-18T21:28:26.127406+0000","last_fullsized":"2023-11-18T21:28:26.127406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:24.791294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"31'78","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:18.501676+0000","last_change":"2023-11-18T20:59:35.846859+0000","last_active":"2023-11-18T21:27:18.501676+0000","last_peered":"2023-11-18T21:27:18.501676+0000","last_clean":"2023-11-18T21:27:18.501676+0000","last_became_active":"2023-11-18T20:59:35.845378+0000","last_became_peered":"2023-11-18T20:59:35.845378+0000","last_unstale":"2023-11-18T21:27:18.501676+0000","last_undegraded":"2023-11-18T21:27:18.501676+0000","last_fullsized":"2023-11-18T21:27:18.501676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:31.476200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"31'57","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.633140+0000","last_change":"2023-11-18T20:59:27.863967+0000","last_active":"2023-11-18T21:28:43.633140+0000","last_peered":"2023-11-18T21:28:43.633140+0000","last_clean":"2023-11-18T21:28:43.633140+0000","last_became_active":"2023-11-18T20:59:27.863435+0000","last_became_peered":"2023-11-18T20:59:27.863435+0000","last_unstale":"2023-11-18T21:28:43.633140+0000","last_undegraded":"2023-11-18T21:28:43.633140+0000","last_fullsized":"2023-11-18T21:28:43.633140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:04.837624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"31'121","reported_seq":263,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.070745+0000","last_change":"2023-11-18T20:59:25.361677+0000","last_active":"2023-11-18T21:28:26.070745+0000","last_peered":"2023-11-18T21:28:26.070745+0000","last_clean":"2023-11-18T21:28:26.070745+0000","last_became_active":"2023-11-18T20:59:25.361313+0000","last_became_peered":"2023-11-18T20:59:25.361313+0000","last_unstale":"2023-11-18T21:28:26.070745+0000","last_undegraded":"2023-11-18T21:28:26.070745+0000","last_fullsized":"2023-11-18T21:28:26.070745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:02:00.310422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25371,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":112,"num_write":121,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"31'82","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.965955+0000","last_change":"2023-11-18T20:59:35.832893+0000","last_active":"2023-11-18T21:27:27.965955+0000","last_peered":"2023-11-18T21:27:27.965955+0000","last_clean":"2023-11-18T21:27:27.965955+0000","last_became_active":"2023-11-18T20:59:35.832562+0000","last_became_peered":"2023-11-18T20:59:35.832562+0000","last_unstale":"2023-11-18T21:27:27.965955+0000","last_undegraded":"2023-11-18T21:27:27.965955+0000","last_fullsized":"2023-11-18T21:27:27.965955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:53:05.127511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":7445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'55","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678202+0000","last_change":"2023-11-18T20:59:27.874128+0000","last_active":"2023-11-18T21:28:43.678202+0000","last_peered":"2023-11-18T21:28:43.678202+0000","last_clean":"2023-11-18T21:28:43.678202+0000","last_became_active":"2023-11-18T20:59:27.865971+0000","last_became_peered":"2023-11-18T20:59:27.865971+0000","last_unstale":"2023-11-18T21:28:43.678202+0000","last_undegraded":"2023-11-18T21:28:43.678202+0000","last_fullsized":"2023-11-18T21:28:43.678202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"31'1150","reported_seq":1185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:36.785862+0000","last_change":"2023-11-18T20:59:25.350262+0000","last_active":"2023-11-18T21:28:36.785862+0000","last_peered":"2023-11-18T21:28:36.785862+0000","last_clean":"2023-11-18T21:28:36.785862+0000","last_became_active":"2023-11-18T20:59:25.349577+0000","last_became_peered":"2023-11-18T20:59:25.349577+0000","last_unstale":"2023-11-18T21:28:36.785862+0000","last_undegraded":"2023-11-18T21:28:36.785862+0000","last_fullsized":"2023-11-18T21:28:36.785862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":4577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"31'99","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:35.331475+0000","last_change":"2023-11-18T20:59:35.849720+0000","last_active":"2023-11-18T21:27:35.331475+0000","last_peered":"2023-11-18T21:27:35.331475+0000","last_clean":"2023-11-18T21:27:35.331475+0000","last_became_active":"2023-11-18T20:59:35.848000+0000","last_became_peered":"2023-11-18T20:59:35.848000+0000","last_unstale":"2023-11-18T21:27:35.331475+0000","last_undegraded":"2023-11-18T21:27:35.331475+0000","last_fullsized":"2023-11-18T21:27:35.331475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":10947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"31'51","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.641202+0000","last_change":"2023-11-18T20:59:27.891817+0000","last_active":"2023-11-18T21:28:43.641202+0000","last_peered":"2023-11-18T21:28:43.641202+0000","last_clean":"2023-11-18T21:28:43.641202+0000","last_became_active":"2023-11-18T20:59:27.891260+0000","last_became_peered":"2023-11-18T20:59:27.891260+0000","last_unstale":"2023-11-18T21:28:43.641202+0000","last_undegraded":"2023-11-18T21:28:43.641202+0000","last_fullsized":"2023-11-18T21:28:43.641202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:25.331055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"31'67","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:33.868078+0000","last_change":"2023-11-18T20:59:25.363983+0000","last_active":"2023-11-18T21:28:33.868078+0000","last_peered":"2023-11-18T21:28:33.868078+0000","last_clean":"2023-11-18T21:28:33.868078+0000","last_became_active":"2023-11-18T20:59:25.363289+0000","last_became_peered":"2023-11-18T20:59:25.363289+0000","last_unstale":"2023-11-18T21:28:33.868078+0000","last_undegraded":"2023-11-18T21:28:33.868078+0000","last_fullsized":"2023-11-18T21:28:33.868078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:02.577661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"31'68","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:37.511221+0000","last_change":"2023-11-18T20:59:35.771712+0000","last_active":"2023-11-18T21:27:37.511221+0000","last_peered":"2023-11-18T21:27:37.511221+0000","last_clean":"2023-11-18T21:27:37.511221+0000","last_became_active":"2023-11-18T20:59:35.771263+0000","last_became_peered":"2023-11-18T20:59:35.771263+0000","last_unstale":"2023-11-18T21:27:37.511221+0000","last_undegraded":"2023-11-18T21:27:37.511221+0000","last_fullsized":"2023-11-18T21:27:37.511221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":272,"num_write":61,"num_write_kb":11998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"31'64","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.648283+0000","last_change":"2023-11-18T20:59:27.834172+0000","last_active":"2023-11-18T21:28:43.648283+0000","last_peered":"2023-11-18T21:28:43.648283+0000","last_clean":"2023-11-18T21:28:43.648283+0000","last_became_active":"2023-11-18T20:59:27.832589+0000","last_became_peered":"2023-11-18T20:59:27.832589+0000","last_unstale":"2023-11-18T21:28:43.648283+0000","last_undegraded":"2023-11-18T21:28:43.648283+0000","last_fullsized":"2023-11-18T21:28:43.648283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:27.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"31'116","reported_seq":260,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:27.470466+0000","last_change":"2023-11-18T20:59:25.494236+0000","last_active":"2023-11-18T21:28:27.470466+0000","last_peered":"2023-11-18T21:28:27.470466+0000","last_clean":"2023-11-18T21:28:27.470466+0000","last_became_active":"2023-11-18T20:59:25.493373+0000","last_became_peered":"2023-11-18T20:59:25.493373+0000","last_unstale":"2023-11-18T21:28:27.470466+0000","last_undegraded":"2023-11-18T21:28:27.470466+0000","last_fullsized":"2023-11-18T21:28:27.470466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20332,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":112,"num_write":115,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'93","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:21.763452+0000","last_change":"2023-11-18T20:59:35.773319+0000","last_active":"2023-11-18T21:27:21.763452+0000","last_peered":"2023-11-18T21:27:21.763452+0000","last_clean":"2023-11-18T21:27:21.763452+0000","last_became_active":"2023-11-18T20:59:35.772563+0000","last_became_peered":"2023-11-18T20:59:35.772563+0000","last_unstale":"2023-11-18T21:27:21.763452+0000","last_undegraded":"2023-11-18T21:27:21.763452+0000","last_fullsized":"2023-11-18T21:27:21.763452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:12.287749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":9621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'57","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.695348+0000","last_change":"2023-11-18T20:59:27.892789+0000","last_active":"2023-11-18T21:28:43.695348+0000","last_peered":"2023-11-18T21:28:43.695348+0000","last_clean":"2023-11-18T21:28:43.695348+0000","last_became_active":"2023-11-18T20:59:27.891883+0000","last_became_peered":"2023-11-18T20:59:27.891883+0000","last_unstale":"2023-11-18T21:28:43.695348+0000","last_undegraded":"2023-11-18T21:28:43.695348+0000","last_fullsized":"2023-11-18T21:28:43.695348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"31'158","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.066710+0000","last_change":"2023-11-18T20:59:25.497309+0000","last_active":"2023-11-18T21:28:43.066710+0000","last_peered":"2023-11-18T21:28:43.066710+0000","last_clean":"2023-11-18T21:28:43.066710+0000","last_became_active":"2023-11-18T20:59:25.496680+0000","last_became_peered":"2023-11-18T20:59:25.496680+0000","last_unstale":"2023-11-18T21:28:43.066710+0000","last_undegraded":"2023-11-18T21:28:43.066710+0000","last_fullsized":"2023-11-18T21:28:43.066710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"31'67","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:35.331403+0000","last_change":"2023-11-18T20:59:35.842258+0000","last_active":"2023-11-18T21:27:35.331403+0000","last_peered":"2023-11-18T21:27:35.331403+0000","last_clean":"2023-11-18T21:27:35.331403+0000","last_became_active":"2023-11-18T20:59:35.838830+0000","last_became_peered":"2023-11-18T20:59:35.838830+0000","last_unstale":"2023-11-18T21:27:35.331403+0000","last_undegraded":"2023-11-18T21:27:35.331403+0000","last_fullsized":"2023-11-18T21:27:35.331403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":8132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"31'63","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:40.333019+0000","last_change":"2023-11-18T20:59:35.839178+0000","last_active":"2023-11-18T21:27:40.333019+0000","last_peered":"2023-11-18T21:27:40.333019+0000","last_clean":"2023-11-18T21:27:40.333019+0000","last_became_active":"2023-11-18T20:59:35.838375+0000","last_became_peered":"2023-11-18T20:59:35.838375+0000","last_unstale":"2023-11-18T21:27:40.333019+0000","last_undegraded":"2023-11-18T21:27:40.333019+0000","last_fullsized":"2023-11-18T21:27:40.333019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"31'61","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.578862+0000","last_change":"2023-11-18T20:59:27.689539+0000","last_active":"2023-11-18T21:28:43.578862+0000","last_peered":"2023-11-18T21:28:43.578862+0000","last_clean":"2023-11-18T21:28:43.578862+0000","last_became_active":"2023-11-18T20:59:27.688522+0000","last_became_peered":"2023-11-18T20:59:27.688522+0000","last_unstale":"2023-11-18T21:28:43.578862+0000","last_undegraded":"2023-11-18T21:28:43.578862+0000","last_fullsized":"2023-11-18T21:28:43.578862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"31'7","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:51.862615+0000","last_change":"2023-11-18T20:59:25.494125+0000","last_active":"2023-11-18T21:27:51.862615+0000","last_peered":"2023-11-18T21:27:51.862615+0000","last_clean":"2023-11-18T21:27:51.862615+0000","last_became_active":"2023-11-18T20:59:25.493357+0000","last_became_peered":"2023-11-18T20:59:25.493357+0000","last_unstale":"2023-11-18T21:27:51.862615+0000","last_undegraded":"2023-11-18T21:27:51.862615+0000","last_fullsized":"2023-11-18T21:27:51.862615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:45:47.691570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'97","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.014725+0000","last_change":"2023-11-18T20:59:35.776653+0000","last_active":"2023-11-18T21:27:27.014725+0000","last_peered":"2023-11-18T21:27:27.014725+0000","last_clean":"2023-11-18T21:27:27.014725+0000","last_became_active":"2023-11-18T20:59:35.776138+0000","last_became_peered":"2023-11-18T20:59:35.776138+0000","last_unstale":"2023-11-18T21:27:27.014725+0000","last_undegraded":"2023-11-18T21:27:27.014725+0000","last_fullsized":"2023-11-18T21:27:27.014725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:08:25.933599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'54","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.642467+0000","last_change":"2023-11-18T20:59:27.860987+0000","last_active":"2023-11-18T21:28:43.642467+0000","last_peered":"2023-11-18T21:28:43.642467+0000","last_clean":"2023-11-18T21:28:43.642467+0000","last_became_active":"2023-11-18T20:59:27.860537+0000","last_became_peered":"2023-11-18T20:59:27.860537+0000","last_unstale":"2023-11-18T21:28:43.642467+0000","last_undegraded":"2023-11-18T21:28:43.642467+0000","last_fullsized":"2023-11-18T21:28:43.642467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:27:09.695363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"31'228","reported_seq":485,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.255998+0000","last_change":"2023-11-18T20:59:25.354967+0000","last_active":"2023-11-18T21:28:32.255998+0000","last_peered":"2023-11-18T21:28:32.255998+0000","last_clean":"2023-11-18T21:28:32.255998+0000","last_became_active":"2023-11-18T20:59:25.354690+0000","last_became_peered":"2023-11-18T20:59:25.354690+0000","last_unstale":"2023-11-18T21:28:32.255998+0000","last_undegraded":"2023-11-18T21:28:32.255998+0000","last_fullsized":"2023-11-18T21:28:32.255998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:04:50.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34720,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":223,"num_read_kb":227,"num_write":228,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"31'175","reported_seq":370,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:26.108932+0000","last_change":"2023-11-18T20:59:25.346493+0000","last_active":"2023-11-18T21:28:26.108932+0000","last_peered":"2023-11-18T21:28:26.108932+0000","last_clean":"2023-11-18T21:28:26.108932+0000","last_became_active":"2023-11-18T20:59:25.346192+0000","last_became_peered":"2023-11-18T20:59:25.346192+0000","last_unstale":"2023-11-18T21:28:26.108932+0000","last_undegraded":"2023-11-18T21:28:26.108932+0000","last_fullsized":"2023-11-18T21:28:26.108932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:14:30.162962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":165,"num_write":171,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'63","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.671235+0000","last_change":"2023-11-18T20:59:27.868460+0000","last_active":"2023-11-18T21:28:43.671235+0000","last_peered":"2023-11-18T21:28:43.671235+0000","last_clean":"2023-11-18T21:28:43.671235+0000","last_became_active":"2023-11-18T20:59:27.867886+0000","last_became_peered":"2023-11-18T20:59:27.867886+0000","last_unstale":"2023-11-18T21:28:43.671235+0000","last_undegraded":"2023-11-18T21:28:43.671235+0000","last_fullsized":"2023-11-18T21:28:43.671235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'95","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.106820+0000","last_change":"2023-11-18T20:59:35.851163+0000","last_active":"2023-11-18T21:27:28.106820+0000","last_peered":"2023-11-18T21:27:28.106820+0000","last_clean":"2023-11-18T21:27:28.106820+0000","last_became_active":"2023-11-18T20:59:35.850427+0000","last_became_peered":"2023-11-18T20:59:35.850427+0000","last_unstale":"2023-11-18T21:27:28.106820+0000","last_undegraded":"2023-11-18T21:27:28.106820+0000","last_fullsized":"2023-11-18T21:27:28.106820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2343","reported_seq":2376,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.081692+0000","last_change":"2023-11-18T20:59:25.462276+0000","last_active":"2023-11-18T21:28:43.081692+0000","last_peered":"2023-11-18T21:28:43.081692+0000","last_clean":"2023-11-18T21:28:43.081692+0000","last_became_active":"2023-11-18T20:59:25.460449+0000","last_became_peered":"2023-11-18T20:59:25.460449+0000","last_unstale":"2023-11-18T21:28:43.081692+0000","last_undegraded":"2023-11-18T21:28:43.081692+0000","last_fullsized":"2023-11-18T21:28:43.081692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":2343,"log_dups_size":0,"ondisk_log_size":2343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:25:57.950600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8759326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2333,"num_write_kb":9750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"31'69","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630507+0000","last_change":"2023-11-18T20:59:27.841332+0000","last_active":"2023-11-18T21:28:43.630507+0000","last_peered":"2023-11-18T21:28:43.630507+0000","last_clean":"2023-11-18T21:28:43.630507+0000","last_became_active":"2023-11-18T20:59:27.840528+0000","last_became_peered":"2023-11-18T20:59:27.840528+0000","last_unstale":"2023-11-18T21:28:43.630507+0000","last_undegraded":"2023-11-18T21:28:43.630507+0000","last_fullsized":"2023-11-18T21:28:43.630507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"31'65","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:26.984823+0000","last_change":"2023-11-18T20:59:35.776844+0000","last_active":"2023-11-18T21:27:26.984823+0000","last_peered":"2023-11-18T21:27:26.984823+0000","last_clean":"2023-11-18T21:27:26.984823+0000","last_became_active":"2023-11-18T20:59:35.775977+0000","last_became_peered":"2023-11-18T20:59:35.775977+0000","last_unstale":"2023-11-18T21:27:26.984823+0000","last_undegraded":"2023-11-18T21:27:26.984823+0000","last_fullsized":"2023-11-18T21:27:26.984823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:06:00.187752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"31'59","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.669874+0000","last_change":"2023-11-18T20:59:27.888673+0000","last_active":"2023-11-18T21:28:43.669874+0000","last_peered":"2023-11-18T21:28:43.669874+0000","last_clean":"2023-11-18T21:28:43.669874+0000","last_became_active":"2023-11-18T20:59:27.887716+0000","last_became_peered":"2023-11-18T20:59:27.887716+0000","last_unstale":"2023-11-18T21:28:43.669874+0000","last_undegraded":"2023-11-18T21:28:43.669874+0000","last_fullsized":"2023-11-18T21:28:43.669874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"31'67","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.471935+0000","last_change":"2023-11-18T20:59:27.684810+0000","last_active":"2023-11-18T21:28:43.471935+0000","last_peered":"2023-11-18T21:28:43.471935+0000","last_clean":"2023-11-18T21:28:43.471935+0000","last_became_active":"2023-11-18T20:59:27.680712+0000","last_became_peered":"2023-11-18T20:59:27.680712+0000","last_unstale":"2023-11-18T21:28:43.471935+0000","last_undegraded":"2023-11-18T21:28:43.471935+0000","last_fullsized":"2023-11-18T21:28:43.471935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:35:31.576179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"31'57","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.646654+0000","last_change":"2023-11-18T20:59:27.835960+0000","last_active":"2023-11-18T21:28:43.646654+0000","last_peered":"2023-11-18T21:28:43.646654+0000","last_clean":"2023-11-18T21:28:43.646654+0000","last_became_active":"2023-11-18T20:59:27.835120+0000","last_became_peered":"2023-11-18T20:59:27.835120+0000","last_unstale":"2023-11-18T21:28:43.646654+0000","last_undegraded":"2023-11-18T21:28:43.646654+0000","last_fullsized":"2023-11-18T21:28:43.646654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:35:51.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"31'59","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.632517+0000","last_change":"2023-11-18T20:59:27.833652+0000","last_active":"2023-11-18T21:28:43.632517+0000","last_peered":"2023-11-18T21:28:43.632517+0000","last_clean":"2023-11-18T21:28:43.632517+0000","last_became_active":"2023-11-18T20:59:27.833049+0000","last_became_peered":"2023-11-18T20:59:27.833049+0000","last_unstale":"2023-11-18T21:28:43.632517+0000","last_undegraded":"2023-11-18T21:28:43.632517+0000","last_fullsized":"2023-11-18T21:28:43.632517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:06:23.262919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"31'40","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.654877+0000","last_change":"2023-11-18T20:59:27.878824+0000","last_active":"2023-11-18T21:28:43.654877+0000","last_peered":"2023-11-18T21:28:43.654877+0000","last_clean":"2023-11-18T21:28:43.654877+0000","last_became_active":"2023-11-18T20:59:27.878353+0000","last_became_peered":"2023-11-18T20:59:27.878353+0000","last_unstale":"2023-11-18T21:28:43.654877+0000","last_undegraded":"2023-11-18T21:28:43.654877+0000","last_fullsized":"2023-11-18T21:28:43.654877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:59:04.074467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'50","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.581622+0000","last_change":"2023-11-18T20:59:27.866570+0000","last_active":"2023-11-18T21:28:43.581622+0000","last_peered":"2023-11-18T21:28:43.581622+0000","last_clean":"2023-11-18T21:28:43.581622+0000","last_became_active":"2023-11-18T20:59:27.866165+0000","last_became_peered":"2023-11-18T20:59:27.866165+0000","last_unstale":"2023-11-18T21:28:43.581622+0000","last_undegraded":"2023-11-18T21:28:43.581622+0000","last_fullsized":"2023-11-18T21:28:43.581622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:05:51.974471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"31'55","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.694083+0000","last_change":"2023-11-18T20:59:27.895340+0000","last_active":"2023-11-18T21:28:43.694083+0000","last_peered":"2023-11-18T21:28:43.694083+0000","last_clean":"2023-11-18T21:28:43.694083+0000","last_became_active":"2023-11-18T20:59:27.893918+0000","last_became_peered":"2023-11-18T20:59:27.893918+0000","last_unstale":"2023-11-18T21:28:43.694083+0000","last_undegraded":"2023-11-18T21:28:43.694083+0000","last_fullsized":"2023-11-18T21:28:43.694083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"31'49","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630693+0000","last_change":"2023-11-18T20:59:27.839127+0000","last_active":"2023-11-18T21:28:43.630693+0000","last_peered":"2023-11-18T21:28:43.630693+0000","last_clean":"2023-11-18T21:28:43.630693+0000","last_became_active":"2023-11-18T20:59:27.838509+0000","last_became_peered":"2023-11-18T20:59:27.838509+0000","last_unstale":"2023-11-18T21:28:43.630693+0000","last_undegraded":"2023-11-18T21:28:43.630693+0000","last_fullsized":"2023-11-18T21:28:43.630693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:43.691006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"31'60","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.628797+0000","last_change":"2023-11-18T20:59:27.836167+0000","last_active":"2023-11-18T21:28:43.628797+0000","last_peered":"2023-11-18T21:28:43.628797+0000","last_clean":"2023-11-18T21:28:43.628797+0000","last_became_active":"2023-11-18T20:59:27.835226+0000","last_became_peered":"2023-11-18T20:59:27.835226+0000","last_unstale":"2023-11-18T21:28:43.628797+0000","last_undegraded":"2023-11-18T21:28:43.628797+0000","last_fullsized":"2023-11-18T21:28:43.628797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:23:46.608216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'73","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.661836+0000","last_change":"2023-11-18T20:59:27.889937+0000","last_active":"2023-11-18T21:28:43.661836+0000","last_peered":"2023-11-18T21:28:43.661836+0000","last_clean":"2023-11-18T21:28:43.661836+0000","last_became_active":"2023-11-18T20:59:27.889325+0000","last_became_peered":"2023-11-18T20:59:27.889325+0000","last_unstale":"2023-11-18T21:28:43.661836+0000","last_undegraded":"2023-11-18T21:28:43.661836+0000","last_fullsized":"2023-11-18T21:28:43.661836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:56:39.674424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"31'63","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.672148+0000","last_change":"2023-11-18T20:59:27.867439+0000","last_active":"2023-11-18T21:28:43.672148+0000","last_peered":"2023-11-18T21:28:43.672148+0000","last_clean":"2023-11-18T21:28:43.672148+0000","last_became_active":"2023-11-18T20:59:27.866609+0000","last_became_peered":"2023-11-18T20:59:27.866609+0000","last_unstale":"2023-11-18T21:28:43.672148+0000","last_undegraded":"2023-11-18T21:28:43.672148+0000","last_fullsized":"2023-11-18T21:28:43.672148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'64","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:45.159912+0000","last_change":"2023-11-18T20:59:27.883416+0000","last_active":"2023-11-18T21:28:45.159912+0000","last_peered":"2023-11-18T21:28:45.159912+0000","last_clean":"2023-11-18T21:28:45.159912+0000","last_became_active":"2023-11-18T20:59:27.882976+0000","last_became_peered":"2023-11-18T20:59:27.882976+0000","last_unstale":"2023-11-18T21:28:45.159912+0000","last_undegraded":"2023-11-18T21:28:45.159912+0000","last_fullsized":"2023-11-18T21:28:45.159912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"31'51","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.679236+0000","last_change":"2023-11-18T20:59:27.873520+0000","last_active":"2023-11-18T21:28:43.679236+0000","last_peered":"2023-11-18T21:28:43.679236+0000","last_clean":"2023-11-18T21:28:43.679236+0000","last_became_active":"2023-11-18T20:59:27.872627+0000","last_became_peered":"2023-11-18T20:59:27.872627+0000","last_unstale":"2023-11-18T21:28:43.679236+0000","last_undegraded":"2023-11-18T21:28:43.679236+0000","last_fullsized":"2023-11-18T21:28:43.679236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"31'60","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.654160+0000","last_change":"2023-11-18T20:59:27.687118+0000","last_active":"2023-11-18T21:28:43.654160+0000","last_peered":"2023-11-18T21:28:43.654160+0000","last_clean":"2023-11-18T21:28:43.654160+0000","last_became_active":"2023-11-18T20:59:27.686311+0000","last_became_peered":"2023-11-18T20:59:27.686311+0000","last_unstale":"2023-11-18T21:28:43.654160+0000","last_undegraded":"2023-11-18T21:28:43.654160+0000","last_fullsized":"2023-11-18T21:28:43.654160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:25:27.490214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'65","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.471465+0000","last_change":"2023-11-18T20:59:27.892404+0000","last_active":"2023-11-18T21:28:43.471465+0000","last_peered":"2023-11-18T21:28:43.471465+0000","last_clean":"2023-11-18T21:28:43.471465+0000","last_became_active":"2023-11-18T20:59:27.891767+0000","last_became_peered":"2023-11-18T20:59:27.891767+0000","last_unstale":"2023-11-18T21:28:43.471465+0000","last_undegraded":"2023-11-18T21:28:43.471465+0000","last_fullsized":"2023-11-18T21:28:43.471465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:46.991003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"31'51","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.669452+0000","last_change":"2023-11-18T20:59:27.866920+0000","last_active":"2023-11-18T21:28:43.669452+0000","last_peered":"2023-11-18T21:28:43.669452+0000","last_clean":"2023-11-18T21:28:43.669452+0000","last_became_active":"2023-11-18T20:59:27.866153+0000","last_became_peered":"2023-11-18T20:59:27.866153+0000","last_unstale":"2023-11-18T21:28:43.669452+0000","last_undegraded":"2023-11-18T21:28:43.669452+0000","last_fullsized":"2023-11-18T21:28:43.669452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:50:43.894365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'60","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.664304+0000","last_change":"2023-11-18T20:59:27.890399+0000","last_active":"2023-11-18T21:28:43.664304+0000","last_peered":"2023-11-18T21:28:43.664304+0000","last_clean":"2023-11-18T21:28:43.664304+0000","last_became_active":"2023-11-18T20:59:27.889704+0000","last_became_peered":"2023-11-18T20:59:27.889704+0000","last_unstale":"2023-11-18T21:28:43.664304+0000","last_undegraded":"2023-11-18T21:28:43.664304+0000","last_fullsized":"2023-11-18T21:28:43.664304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:34:37.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"31'63","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.670763+0000","last_change":"2023-11-18T20:59:27.871794+0000","last_active":"2023-11-18T21:28:43.670763+0000","last_peered":"2023-11-18T21:28:43.670763+0000","last_clean":"2023-11-18T21:28:43.670763+0000","last_became_active":"2023-11-18T20:59:27.871337+0000","last_became_peered":"2023-11-18T20:59:27.871337+0000","last_unstale":"2023-11-18T21:28:43.670763+0000","last_undegraded":"2023-11-18T21:28:43.670763+0000","last_fullsized":"2023-11-18T21:28:43.670763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:33:16.370847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"31'53","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.584958+0000","last_change":"2023-11-18T20:59:27.867288+0000","last_active":"2023-11-18T21:28:43.584958+0000","last_peered":"2023-11-18T21:28:43.584958+0000","last_clean":"2023-11-18T21:28:43.584958+0000","last_became_active":"2023-11-18T20:59:27.866560+0000","last_became_peered":"2023-11-18T20:59:27.866560+0000","last_unstale":"2023-11-18T21:28:43.584958+0000","last_undegraded":"2023-11-18T21:28:43.584958+0000","last_fullsized":"2023-11-18T21:28:43.584958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:02:19.245935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"31'52","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.669336+0000","last_change":"2023-11-18T20:59:27.878944+0000","last_active":"2023-11-18T21:28:43.669336+0000","last_peered":"2023-11-18T21:28:43.669336+0000","last_clean":"2023-11-18T21:28:43.669336+0000","last_became_active":"2023-11-18T20:59:27.878485+0000","last_became_peered":"2023-11-18T20:59:27.878485+0000","last_unstale":"2023-11-18T21:28:43.669336+0000","last_undegraded":"2023-11-18T21:28:43.669336+0000","last_fullsized":"2023-11-18T21:28:43.669336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:04.749189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"31'53","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.679159+0000","last_change":"2023-11-18T20:59:27.874019+0000","last_active":"2023-11-18T21:28:43.679159+0000","last_peered":"2023-11-18T21:28:43.679159+0000","last_clean":"2023-11-18T21:28:43.679159+0000","last_became_active":"2023-11-18T20:59:27.873255+0000","last_became_peered":"2023-11-18T20:59:27.873255+0000","last_unstale":"2023-11-18T21:28:43.679159+0000","last_undegraded":"2023-11-18T21:28:43.679159+0000","last_fullsized":"2023-11-18T21:28:43.679159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"31'53","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.677600+0000","last_change":"2023-11-18T20:59:27.868086+0000","last_active":"2023-11-18T21:28:43.677600+0000","last_peered":"2023-11-18T21:28:43.677600+0000","last_clean":"2023-11-18T21:28:43.677600+0000","last_became_active":"2023-11-18T20:59:27.866901+0000","last_became_peered":"2023-11-18T20:59:27.866901+0000","last_unstale":"2023-11-18T21:28:43.677600+0000","last_undegraded":"2023-11-18T21:28:43.677600+0000","last_fullsized":"2023-11-18T21:28:43.677600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"31'59","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.676080+0000","last_change":"2023-11-18T20:59:27.888617+0000","last_active":"2023-11-18T21:28:43.676080+0000","last_peered":"2023-11-18T21:28:43.676080+0000","last_clean":"2023-11-18T21:28:43.676080+0000","last_became_active":"2023-11-18T20:59:27.888068+0000","last_became_peered":"2023-11-18T20:59:27.888068+0000","last_unstale":"2023-11-18T21:28:43.676080+0000","last_undegraded":"2023-11-18T21:28:43.676080+0000","last_fullsized":"2023-11-18T21:28:43.676080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"31'46","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.633064+0000","last_change":"2023-11-18T20:59:27.684428+0000","last_active":"2023-11-18T21:28:43.633064+0000","last_peered":"2023-11-18T21:28:43.633064+0000","last_clean":"2023-11-18T21:28:43.633064+0000","last_became_active":"2023-11-18T20:59:27.682936+0000","last_became_peered":"2023-11-18T20:59:27.682936+0000","last_unstale":"2023-11-18T21:28:43.633064+0000","last_undegraded":"2023-11-18T21:28:43.633064+0000","last_fullsized":"2023-11-18T21:28:43.633064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"31'66","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.672196+0000","last_change":"2023-11-18T20:59:27.865937+0000","last_active":"2023-11-18T21:28:43.672196+0000","last_peered":"2023-11-18T21:28:43.672196+0000","last_clean":"2023-11-18T21:28:43.672196+0000","last_became_active":"2023-11-18T20:59:27.865401+0000","last_became_peered":"2023-11-18T20:59:27.865401+0000","last_unstale":"2023-11-18T21:28:43.672196+0000","last_undegraded":"2023-11-18T21:28:43.672196+0000","last_fullsized":"2023-11-18T21:28:43.672196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:34:00.251369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"31'51","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.668540+0000","last_change":"2023-11-18T20:59:27.865748+0000","last_active":"2023-11-18T21:28:43.668540+0000","last_peered":"2023-11-18T21:28:43.668540+0000","last_clean":"2023-11-18T21:28:43.668540+0000","last_became_active":"2023-11-18T20:59:27.864956+0000","last_became_peered":"2023-11-18T20:59:27.864956+0000","last_unstale":"2023-11-18T21:28:43.668540+0000","last_undegraded":"2023-11-18T21:28:43.668540+0000","last_fullsized":"2023-11-18T21:28:43.668540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"31'38","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.669829+0000","last_change":"2023-11-18T20:59:27.889838+0000","last_active":"2023-11-18T21:28:43.669829+0000","last_peered":"2023-11-18T21:28:43.669829+0000","last_clean":"2023-11-18T21:28:43.669829+0000","last_became_active":"2023-11-18T20:59:27.889307+0000","last_became_peered":"2023-11-18T20:59:27.889307+0000","last_unstale":"2023-11-18T21:28:43.669829+0000","last_undegraded":"2023-11-18T21:28:43.669829+0000","last_fullsized":"2023-11-18T21:28:43.669829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'47","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.671558+0000","last_change":"2023-11-18T20:59:27.866394+0000","last_active":"2023-11-18T21:28:43.671558+0000","last_peered":"2023-11-18T21:28:43.671558+0000","last_clean":"2023-11-18T21:28:43.671558+0000","last_became_active":"2023-11-18T20:59:27.865625+0000","last_became_peered":"2023-11-18T20:59:27.865625+0000","last_unstale":"2023-11-18T21:28:43.671558+0000","last_undegraded":"2023-11-18T21:28:43.671558+0000","last_fullsized":"2023-11-18T21:28:43.671558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"31'54","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.667233+0000","last_change":"2023-11-18T20:59:27.892765+0000","last_active":"2023-11-18T21:28:43.667233+0000","last_peered":"2023-11-18T21:28:43.667233+0000","last_clean":"2023-11-18T21:28:43.667233+0000","last_became_active":"2023-11-18T20:59:27.891753+0000","last_became_peered":"2023-11-18T20:59:27.891753+0000","last_unstale":"2023-11-18T21:28:43.667233+0000","last_undegraded":"2023-11-18T21:28:43.667233+0000","last_fullsized":"2023-11-18T21:28:43.667233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"31'63","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630861+0000","last_change":"2023-11-18T20:59:27.837531+0000","last_active":"2023-11-18T21:28:43.630861+0000","last_peered":"2023-11-18T21:28:43.630861+0000","last_clean":"2023-11-18T21:28:43.630861+0000","last_became_active":"2023-11-18T20:59:27.836899+0000","last_became_peered":"2023-11-18T20:59:27.836899+0000","last_unstale":"2023-11-18T21:28:43.630861+0000","last_undegraded":"2023-11-18T21:28:43.630861+0000","last_fullsized":"2023-11-18T21:28:43.630861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:58:04.716391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"31'58","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.639720+0000","last_change":"2023-11-18T20:59:27.864494+0000","last_active":"2023-11-18T21:28:43.639720+0000","last_peered":"2023-11-18T21:28:43.639720+0000","last_clean":"2023-11-18T21:28:43.639720+0000","last_became_active":"2023-11-18T20:59:27.863732+0000","last_became_peered":"2023-11-18T20:59:27.863732+0000","last_unstale":"2023-11-18T21:28:43.639720+0000","last_undegraded":"2023-11-18T21:28:43.639720+0000","last_fullsized":"2023-11-18T21:28:43.639720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:18.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"31'63","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.678250+0000","last_change":"2023-11-18T20:59:27.873605+0000","last_active":"2023-11-18T21:28:43.678250+0000","last_peered":"2023-11-18T21:28:43.678250+0000","last_clean":"2023-11-18T21:28:43.678250+0000","last_became_active":"2023-11-18T20:59:27.871167+0000","last_became_peered":"2023-11-18T20:59:27.871167+0000","last_unstale":"2023-11-18T21:28:43.678250+0000","last_undegraded":"2023-11-18T21:28:43.678250+0000","last_fullsized":"2023-11-18T21:28:43.678250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":448,"num_write":2451,"num_write_kb":251040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2621,"ondisk_log_size":2621,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3577,"ondisk_log_size":3577,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23672018,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":675,"num_read_kb":695,"num_write":9681,"num_write_kb":28189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47595520,"data_stored":47344036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8458,"ondisk_log_size":8458,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509809,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":181032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.90100000000000002,"15min":0.89700000000000002},"min":{"1min":0.51000000000000001,"5min":0.44,"15min":0.34799999999999998},"max":{"1min":1.3280000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.90800000000000003,"15min":0.93200000000000005},"min":{"1min":0.46100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.393,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.875}]},{"osd":1,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92200000000000004,"15min":0.92900000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.3320000000000001,"5min":1.6579999999999999,"15min":1.7210000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92100000000000004,"15min":0.93500000000000005},"min":{"1min":0.41599999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4319999999999999,"5min":1.51,"15min":2.524},"last":1.333}]},{"osd":2,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.052,"15min":1.052},"min":{"1min":0.53400000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.585,"5min":1.585,"15min":1.694},"last":1.107},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.97699999999999998,"15min":1.01},"min":{"1min":0.47999999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.589},"last":0.60499999999999998}]},{"osd":3,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.014,"15min":1.0109999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4219999999999999,"5min":1.7509999999999999,"15min":1.831},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.073,"5min":1.0389999999999999,"15min":1.0529999999999999},"min":{"1min":0.57599999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.627,"5min":1.627,"15min":2.4430000000000001},"last":1.2390000000000001}]},{"osd":4,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.92800000000000005,"15min":0.95199999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4299999999999999,"5min":1.45,"15min":1.601},"last":1.022},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0760000000000001,"15min":1.0700000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.40100000000000002},"max":{"1min":1.617,"5min":2.266,"15min":2.266},"last":0.96399999999999997}]},{"osd":5,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.024,"15min":1.0309999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.40300000000000002},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.7509999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1040000000000001,"15min":1.1060000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.434},"max":{"1min":1.643,"5min":1.716,"15min":2.0619999999999998},"last":1.1759999999999999}]},{"osd":6,"last update":"Sat Nov 18 21:27:54 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.127,"15min":1.149},"min":{"1min":0.59199999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":2.1659999999999999},"last":1.28},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.1850000000000001,"15min":1.1910000000000001},"min":{"1min":0.54600000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.698,"5min":2.181,"15min":2.2080000000000002},"last":1.0649999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509809,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72804,"kb_used_data":15260,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299036,"statfs":{"total":96636764160,"available":96562212864,"internally_reserved":0,"allocated":15626240,"data_stored":15415703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.91300000000000003},"min":{"1min":0.629,"5min":0.312,"15min":0.312},"max":{"1min":1.4990000000000001,"5min":1.52,"15min":1.72},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.95499999999999996,"15min":0.95599999999999996},"min":{"1min":0.626,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5029999999999999,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.002}]},{"osd":1,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.65700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.397,"5min":1.3999999999999999,"15min":1.887},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.111,"5min":0.98699999999999999,"15min":0.99099999999999999},"min":{"1min":0.71699999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.3899999999999999,"5min":3.73,"15min":3.73},"last":1.077}]},{"osd":2,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.95599999999999996,"15min":0.95899999999999996},"min":{"1min":0.69499999999999995,"5min":0.51600000000000001,"15min":0.498},"max":{"1min":1.3580000000000001,"5min":1.48,"15min":1.6459999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.0069999999999999,"15min":1.044},"min":{"1min":0.66800000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.4970000000000001,"5min":1.964,"15min":1.964},"last":1.0429999999999999}]},{"osd":3,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.056,"15min":1.0469999999999999},"min":{"1min":0.77700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3400000000000001,"5min":1.7330000000000001,"15min":1.8759999999999999},"last":1.167},{"interface":"front","average":{"1min":1.105,"5min":1.0780000000000001,"15min":1.0629999999999999},"min":{"1min":0.80600000000000005,"5min":0.55400000000000005,"15min":0.42399999999999999},"max":{"1min":1.2949999999999999,"5min":3.9889999999999999,"15min":3.9889999999999999},"last":0.86799999999999999}]},{"osd":4,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0269999999999999,"15min":1.0329999999999999},"min":{"1min":0.504,"5min":0.35099999999999998,"15min":0.318},"max":{"1min":1.413,"5min":1.7529999999999999,"15min":2.1030000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.1040000000000001,"15min":1.1000000000000001},"min":{"1min":0.68600000000000005,"5min":0.50700000000000001,"15min":0.38900000000000001},"max":{"1min":1.577,"5min":1.873,"15min":1.873},"last":1.1259999999999999}]},{"osd":5,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.70199999999999996,"5min":0.621,"15min":0.38600000000000001},"max":{"1min":1.6850000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.159,"15min":1.1699999999999999},"min":{"1min":0.61599999999999999,"5min":0.55000000000000004,"15min":0.35999999999999999},"max":{"1min":1.7789999999999999,"5min":2.194,"15min":2.3700000000000001},"last":0.81699999999999995}]},{"osd":7,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1679999999999999,"15min":1.1910000000000001},"min":{"1min":0.73899999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.909,"5min":1.909,"15min":2.1379999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.198,"15min":1.2050000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.45300000000000001},"max":{"1min":1.855,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.94499999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509809,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62884,"kb_used_data":9500,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308956,"statfs":{"total":96636764160,"available":96572370944,"internally_reserved":0,"allocated":9728000,"data_stored":9504573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.88200000000000001,"15min":0.90700000000000003},"min":{"1min":0.55400000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2909999999999999,"5min":1.3899999999999999,"15min":1.494},"last":1.046},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.91300000000000003,"15min":0.94499999999999995},"min":{"1min":0.70599999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.496,"5min":1.5940000000000001,"15min":2.0600000000000001},"last":0.54100000000000004}]},{"osd":1,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.94599999999999995,"15min":0.91800000000000004},"min":{"1min":0.54500000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.4470000000000001,"5min":1.6419999999999999,"15min":1.79},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.91500000000000004,"15min":0.97199999999999998},"min":{"1min":0.76400000000000001,"5min":0.441,"15min":0.39700000000000002},"max":{"1min":1.391,"5min":1.474,"15min":1.794},"last":0.92400000000000004}]},{"osd":2,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.69099999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4059999999999999,"5min":1.504,"15min":2.1379999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.034,"5min":1.026,"15min":1.0149999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.41199999999999998},"max":{"1min":1.3500000000000001,"5min":1.53,"15min":1.6659999999999999},"last":0.77400000000000002}]},{"osd":3,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.0209999999999999,"15min":1.026},"min":{"1min":0.70599999999999996,"5min":0.60199999999999998,"15min":0.53700000000000003},"max":{"1min":1.2709999999999999,"5min":1.472,"15min":1.5960000000000001},"last":1.137},{"interface":"front","average":{"1min":1.145,"5min":1.0629999999999999,"15min":1.0940000000000001},"min":{"1min":0.78200000000000003,"5min":0.51600000000000001,"15min":0.38100000000000001},"max":{"1min":1.5449999999999999,"5min":1.766,"15min":2.2080000000000002},"last":1.0940000000000001}]},{"osd":4,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97099999999999997,"15min":0.98199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.42699999999999999},"max":{"1min":1.2729999999999999,"5min":1.849,"15min":1.9099999999999999},"last":0.871},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.077,"15min":1.089},"min":{"1min":0.64900000000000002,"5min":0.501,"15min":0.439},"max":{"1min":1.3080000000000001,"5min":1.585,"15min":2.4359999999999999},"last":1.3320000000000001}]},{"osd":6,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.054,"15min":1.081},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.32500000000000001},"max":{"1min":1.6240000000000001,"5min":1.6299999999999999,"15min":2.2909999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.105,"15min":1.115},"min":{"1min":0.60899999999999999,"5min":0.58999999999999997,"15min":0.36299999999999999},"max":{"1min":1.405,"5min":1.883,"15min":2.0019999999999998},"last":0.99299999999999999}]},{"osd":7,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.147,"15min":1.171},"min":{"1min":0.74199999999999999,"5min":0.52000000000000002,"15min":0.50700000000000001},"max":{"1min":1.4850000000000001,"5min":1.6839999999999999,"15min":2.0209999999999999},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.1819999999999999,"15min":1.2230000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.41499999999999998},"max":{"1min":1.5860000000000001,"5min":1.732,"15min":2.2789999999999999},"last":1.2849999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509808,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60828,"kb_used_data":7444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311012,"statfs":{"total":96636764160,"available":96574476288,"internally_reserved":0,"allocated":7622656,"data_stored":7382745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.52800000000000002,"5min":0.33700000000000002,"15min":0.309},"max":{"1min":1.052,"5min":1.458,"15min":1.458},"last":0.753},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.57299999999999995,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":1.353,"5min":1.3540000000000001,"15min":1.605},"last":0.57999999999999996}]},{"osd":1,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84299999999999997,"15min":0.84499999999999997},"min":{"1min":0.52400000000000002,"5min":0.372,"15min":0.34899999999999998},"max":{"1min":1.2190000000000001,"5min":1.4510000000000001,"15min":1.7549999999999999},"last":0.624},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76100000000000001,"15min":0.77100000000000002},"min":{"1min":0.48999999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.93700000000000006,"5min":1.629,"15min":1.629},"last":0.67500000000000004}]},{"osd":2,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.99399999999999999,"15min":1.022},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.847},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.98599999999999999,"15min":1.014},"min":{"1min":0.627,"5min":0.36699999999999999,"15min":0.32900000000000001},"max":{"1min":1.5900000000000001,"5min":1.609,"15min":1.794},"last":0.48099999999999998}]},{"osd":4,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0509999999999999,"15min":1.0840000000000001},"min":{"1min":0.71699999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.522,"5min":1.613,"15min":2.0630000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.069,"5min":1.034,"15min":1.0569999999999999},"min":{"1min":0.81799999999999995,"5min":0.55500000000000005,"15min":0.439},"max":{"1min":1.2809999999999999,"5min":1.5900000000000001,"15min":1.968},"last":0.95099999999999996}]},{"osd":5,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.099,"15min":1.117},"min":{"1min":0.875,"5min":0.52700000000000002,"15min":0.45200000000000001},"max":{"1min":1.3839999999999999,"5min":1.7090000000000001,"15min":2.1709999999999998},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.097,"5min":1.1020000000000001,"15min":1.1100000000000001},"min":{"1min":0.79700000000000004,"5min":0.58299999999999996,"15min":0.54900000000000004},"max":{"1min":1.494,"5min":1.736,"15min":1.798},"last":0.82999999999999996}]},{"osd":6,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.115,"15min":1.155},"min":{"1min":0.83399999999999996,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":1.46,"5min":1.5680000000000001,"15min":1.927},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.147,"15min":1.1539999999999999},"min":{"1min":0.70799999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.383,"5min":1.8600000000000001,"15min":1.929},"last":0.80700000000000005}]},{"osd":7,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1970000000000001,"15min":1.214},"min":{"1min":0.96499999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.5189999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.268,"5min":1.2450000000000001,"15min":1.2609999999999999},"min":{"1min":0.85199999999999998,"5min":0.61599999999999999,"15min":0.60299999999999998},"max":{"1min":1.5780000000000001,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.0940000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509808,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36000,"kb_used_data":4824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335840,"statfs":{"total":96636764160,"available":96599900160,"internally_reserved":0,"allocated":4939776,"data_stored":4726754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.72199999999999998,"15min":0.73999999999999999},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.24299999999999999},"max":{"1min":0.98899999999999999,"5min":1.405,"15min":2.04},"last":0.754},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.28999999999999998,"15min":0.27300000000000002},"max":{"1min":1.2410000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.85399999999999998,"15min":0.86699999999999999},"min":{"1min":0.48799999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.3029999999999999,"5min":1.5129999999999999,"15min":1.978},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.84899999999999998,"15min":0.88600000000000001},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":1.3320000000000001,"5min":1.552,"15min":1.919},"last":0.65300000000000002}]},{"osd":3,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.83999999999999997,"15min":0.83499999999999996},"min":{"1min":0.54000000000000004,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.377,"5min":1.7090000000000001,"15min":1.8740000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0229999999999999,"15min":1.018},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.309},"max":{"1min":1.3540000000000001,"5min":1.7809999999999999,"15min":2.0960000000000001},"last":0.83199999999999996}]},{"osd":4,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0960000000000001,"15min":1.115},"min":{"1min":0.77900000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.4630000000000001,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.1399999999999999,"15min":1.1659999999999999},"min":{"1min":0.69399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6080000000000001,"5min":2.161,"15min":2.161},"last":1.016}]},{"osd":5,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1539999999999999,"15min":1.1899999999999999},"min":{"1min":0.76200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.492,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.206},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.141},"min":{"1min":0.79800000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4370000000000001,"5min":1.7390000000000001,"15min":1.8009999999999999},"last":0.96399999999999997}]},{"osd":6,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.163,"15min":1.173},"min":{"1min":0.78700000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.482,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.264,"15min":1.2589999999999999},"min":{"1min":0.72699999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.794,"5min":1.994,"15min":2.1800000000000002},"last":1.101}]},{"osd":7,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.248,"15min":1.286},"min":{"1min":0.84199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.645,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2310000000000001,"15min":1.254},"min":{"1min":0.95199999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.536,"5min":1.96,"15min":1.992},"last":1.1830000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509807,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":966656,"data_stored":748254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.45500000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":1.341,"5min":1.359,"15min":1.4330000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.47199999999999998,"5min":0.318,"15min":0.318},"max":{"1min":1.329,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.59099999999999997}]},{"osd":2,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.99399999999999999,"5min":1.6859999999999999,"15min":1.706},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90600000000000003,"15min":0.91500000000000004},"min":{"1min":0.52000000000000002,"5min":0.41599999999999998,"15min":0.35099999999999998},"max":{"1min":1.4550000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.92300000000000004}]},{"osd":3,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.96299999999999997,"15min":0.98199999999999998},"min":{"1min":0.51400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.5660000000000001,"5min":1.7170000000000001,"15min":1.881},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.94599999999999995,"15min":0.95899999999999996},"min":{"1min":0.68300000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4419999999999999,"5min":1.6519999999999999,"15min":1.73},"last":0.877}]},{"osd":4,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.77000000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.867},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.171,"15min":1.1839999999999999},"min":{"1min":0.76900000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5249999999999999,"5min":1.716,"15min":1.9039999999999999},"last":1.236}]},{"osd":5,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1539999999999999,"15min":1.165},"min":{"1min":0.88700000000000001,"5min":0.54000000000000004,"15min":0.53200000000000003},"max":{"1min":1.4410000000000001,"5min":1.8660000000000001,"15min":2.0230000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.1200000000000001,"15min":1.1379999999999999},"min":{"1min":0.85299999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.639,"5min":1.6819999999999999,"15min":1.8400000000000001},"last":1.087}]},{"osd":6,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.274,"15min":1.2709999999999999},"min":{"1min":0.84899999999999998,"5min":0.64200000000000002,"15min":0.59999999999999998},"max":{"1min":1.5920000000000001,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.296},{"interface":"front","average":{"1min":1.208,"5min":1.2070000000000001,"15min":1.24},"min":{"1min":0.75,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5840000000000001,"5min":1.8819999999999999,"15min":2.0600000000000001},"last":1.3779999999999999}]},{"osd":7,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2589999999999999,"15min":1.292},"min":{"1min":0.85199999999999998,"5min":0.79800000000000004,"15min":0.73499999999999999},"max":{"1min":1.5309999999999999,"5min":1.9530000000000001,"15min":2.1389999999999998},"last":1.26},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.22,"15min":1.2490000000000001},"min":{"1min":0.83299999999999996,"5min":0.66000000000000003,"15min":0.65400000000000003},"max":{"1min":1.7769999999999999,"5min":1.806,"15min":1.988},"last":0.97599999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509807,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60764,"kb_used_data":7380,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311076,"statfs":{"total":96636764160,"available":96574541824,"internally_reserved":0,"allocated":7557120,"data_stored":7321877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71099999999999997,"15min":0.745},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0680000000000001,"5min":1.4750000000000001,"15min":1.7370000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.29799999999999999},"max":{"1min":1.1220000000000001,"5min":1.536,"15min":1.8560000000000001},"last":0.60799999999999998}]},{"osd":2,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.85999999999999999,"15min":0.878},"min":{"1min":0.432,"5min":0.43099999999999999,"15min":0.29199999999999998},"max":{"1min":1.2569999999999999,"5min":1.3720000000000001,"15min":1.7190000000000001},"last":1.375},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.89900000000000002,"15min":0.91000000000000003},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.317},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.8959999999999999},"last":0.83699999999999997}]},{"osd":3,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90200000000000002,"15min":0.89200000000000002},"min":{"1min":0.33700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3979999999999999,"5min":1.756,"15min":1.869},"last":1.288},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.034,"15min":1.0189999999999999},"min":{"1min":0.51700000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3600000000000001,"5min":1.6180000000000001,"15min":1.9259999999999999},"last":1.109}]},{"osd":4,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.022,"15min":1.0189999999999999},"min":{"1min":0.57599999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.458,"5min":1.5529999999999999,"15min":1.9610000000000001},"last":0.879},{"interface":"front","average":{"1min":1.161,"5min":1.129,"15min":1.1220000000000001},"min":{"1min":0.74099999999999999,"5min":0.57999999999999996,"15min":0.47899999999999998},"max":{"1min":1.5860000000000001,"5min":2.101,"15min":2.101},"last":0.79500000000000004}]},{"osd":5,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1319999999999999,"15min":1.1659999999999999},"min":{"1min":0.81000000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.667,"5min":1.667,"15min":2.1669999999999998},"last":1.234},{"interface":"front","average":{"1min":1.117,"5min":1.0840000000000001,"15min":1.0980000000000001},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4490000000000001,"5min":1.728,"15min":2.1280000000000001},"last":1.1699999999999999}]},{"osd":6,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.177,"15min":1.2110000000000001},"min":{"1min":0.71199999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.637,"5min":1.9910000000000001,"15min":2.101},"last":1.502},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.212,"15min":1.2370000000000001},"min":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.718,"5min":1.831,"15min":2.2480000000000002},"last":1.0620000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.272,"15min":1.292},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.764,"5min":1.792,"15min":2.2410000000000001},"last":1.339},{"interface":"front","average":{"1min":1.28,"5min":1.2130000000000001,"15min":1.1970000000000001},"min":{"1min":0.83499999999999996,"5min":0.64400000000000002,"15min":0.60099999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.4450000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542512,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35648,"kb_used_data":4472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336192,"statfs":{"total":96636764160,"available":96600260608,"internally_reserved":0,"allocated":4579328,"data_stored":4332954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.88900000000000001,"15min":0.90300000000000002},"min":{"1min":0.53800000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3280000000000001,"5min":1.544,"15min":1.544},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.878,"15min":0.90400000000000003},"min":{"1min":0.58799999999999997,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":1.347,"5min":1.4139999999999999,"15min":1.6319999999999999},"last":0.79500000000000004}]},{"osd":1,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.89700000000000002,"15min":0.92100000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.302,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93799999999999994,"15min":0.95999999999999996},"min":{"1min":0.505,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.262,"5min":1.454,"15min":1.7689999999999999},"last":0.95999999999999996}]},{"osd":2,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.94299999999999995,"15min":0.97599999999999998},"min":{"1min":0.55400000000000005,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":1.302,"5min":1.613,"15min":1.708},"last":1.137},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.997,"15min":1.012},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.29,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":1.05}]},{"osd":3,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.97299999999999998,"15min":0.996},"min":{"1min":0.621,"5min":0.52800000000000002,"15min":0.44500000000000001},"max":{"1min":1.2390000000000001,"5min":1.5349999999999999,"15min":2.2370000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0800000000000001,"15min":1.103},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2250000000000001,"5min":1.752,"15min":1.8220000000000001},"last":0.91200000000000003}]},{"osd":5,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.98599999999999999,"15min":1.0089999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.38500000000000001},"max":{"1min":1.6279999999999999,"5min":1.6779999999999999,"15min":2.016},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.01,"5min":0.995,"15min":1.026},"min":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.34300000000000003},"max":{"1min":1.5369999999999999,"5min":1.5880000000000001,"15min":1.821},"last":0.98899999999999999}]},{"osd":6,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.0349999999999999,"15min":1.0720000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":1.387,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.165,"15min":1.194},"min":{"1min":0.54000000000000004,"5min":0.53100000000000003,"15min":0.44500000000000001},"max":{"1min":1.5640000000000001,"5min":1.76,"15min":2.1230000000000002},"last":1.3620000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1279999999999999,"15min":1.149},"min":{"1min":0.64800000000000002,"5min":0.439,"15min":0.379},"max":{"1min":1.806,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.081},{"interface":"front","average":{"1min":1.194,"5min":1.218,"15min":1.2549999999999999},"min":{"1min":0.60599999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.7290000000000001,"5min":1.996,"15min":2.1160000000000001},"last":1.22}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7225344,"data_stored":7185737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":21746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4608000,"data_stored":4590614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7290880,"data_stored":7246605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4247552,"data_stored":4196814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8802304,"data_stored":8778065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15294464,"data_stored":15279563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":44892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T21:29:02.191 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.191 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.191 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.191 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.191 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.191 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.191 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.191 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.192 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.192 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.192 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.192 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.192 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.192 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.192 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.192 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.192 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.193 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.193 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.193 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.193 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.193 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.193 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.193 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.193 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.193 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.193 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.194 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.194 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.194 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.194 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.194 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.194 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.194 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.194 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.195 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.195 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.195 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.195 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.195 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.195 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.195 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.195 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.195 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.196 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.196 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.196 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.196 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.196 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.196 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.196 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.196 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.196 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.197 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.197 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.197 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.197 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.197 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.197 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.197 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.197 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.197 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.198 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.198 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.198 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.198 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.198 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.198 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.198 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.198 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.199 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.199 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.199 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.199 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.199 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.199 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.199 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.199 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.199 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.200 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.200 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.200 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.200 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.200 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.200 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.200 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.200 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.200 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.200 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.201 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.201 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.201 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.201 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.201 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.201 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.201 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.201 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.201 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.202 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.202 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.202 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.202 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.202 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.202 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.202 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.202 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.203 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.203 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.203 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.203 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.203 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.203 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.203 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.203 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.203 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.204 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.204 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.204 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.204 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.204 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.204 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.204 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.204 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.204 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.205 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.205 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.205 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:02.205 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-18T21:29:02.957 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:29:02.960 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:29:22.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T21:29:22.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.337+0000 7f4544eac640 1 Processor -- start 2023-11-18T21:29:22.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.337+0000 7f4544eac640 1 -- start start 2023-11-18T21:29:22.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.341+0000 7f4544eac640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45401501f0 0x7f454015a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:22.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.341+0000 7f4544eac640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45400c6c50 0x7f45401560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:22.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.341+0000 7f4544eac640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45400c27d0 con 0x7f45401505d0 2023-11-18T21:29:22.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.341+0000 7f4544eac640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45400c3270 con 0x7f45401501f0 2023-11-18T21:29:22.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.341+0000 7f4544eac640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45400c25e0 con 0x7f45400c6c50 2023-11-18T21:29:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.341+0000 7f453e59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45401501f0 0x7f454015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.341+0000 7f453e59c640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45401501f0 0x7f454015a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36452/0 (socket says 172.21.15.49:36452) 2023-11-18T21:29:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.341+0000 7f453e59c640 1 -- 172.21.15.49:0/4231854907 learned_addr learned my addr 172.21.15.49:0/4231854907 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:29:22.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.341+0000 7f453ed9d640 1 --2- 172.21.15.49:0/4231854907 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45400c6c50 0x7f45401560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:22.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.345+0000 7f453e59c640 1 -- 172.21.15.49:0/4231854907 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45400c6c50 msgr2=0x7f45401560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:29:22.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.345+0000 7f453e59c640 1 --2- 172.21.15.49:0/4231854907 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45400c6c50 0x7f45401560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:22.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.345+0000 7f453e59c640 1 -- 172.21.15.49:0/4231854907 >> v1:172.21.15.106:6789/0 conn(0x7f45401505d0 legacy=0x7f45400c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:22.347 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.345+0000 7f453e59c640 1 -- 172.21.15.49:0/4231854907 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45400c2ab0 con 0x7f45401501f0 2023-11-18T21:29:22.351 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.349+0000 7f453e59c640 1 --2- 172.21.15.49:0/4231854907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45401501f0 0x7f454015a230 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f453000bb10 tx=0x7f453001ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e363eb28dc3b6e96 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:22.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.353+0000 7f453dd9b640 1 -- 172.21.15.49:0/4231854907 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45300a7cb0 con 0x7f45401501f0 2023-11-18T21:29:22.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.353+0000 7f453dd9b640 1 -- 172.21.15.49:0/4231854907 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45300a7e10 con 0x7f45401501f0 2023-11-18T21:29:22.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.353+0000 7f453dd9b640 1 -- 172.21.15.49:0/4231854907 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45300af660 con 0x7f45401501f0 2023-11-18T21:29:22.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.353+0000 7f4544eac640 1 -- 172.21.15.49:0/4231854907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45401501f0 msgr2=0x7f454015a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:22.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.353+0000 7f4544eac640 1 --2- 172.21.15.49:0/4231854907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45401501f0 0x7f454015a230 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f453000bb10 tx=0x7f453001ebe0 comp rx=0 tx=0).stop 2023-11-18T21:29:22.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.353+0000 7f4544eac640 1 -- 172.21.15.49:0/4231854907 shutdown_connections 2023-11-18T21:29:22.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.353+0000 7f4544eac640 1 --2- 172.21.15.49:0/4231854907 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45400c6c50 0x7f45401560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:22.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.353+0000 7f4544eac640 1 --2- 172.21.15.49:0/4231854907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45401501f0 0x7f454015a230 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:22.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.353+0000 7f4544eac640 1 -- 172.21.15.49:0/4231854907 >> 172.21.15.49:0/4231854907 conn(0x7f454006c6a0 msgr2=0x7f454006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:29:22.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.353+0000 7f4544eac640 1 -- 172.21.15.49:0/4231854907 shutdown_connections 2023-11-18T21:29:22.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.353+0000 7f4544eac640 1 -- 172.21.15.49:0/4231854907 wait complete. 2023-11-18T21:29:22.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.357+0000 7f4544eac640 1 Processor -- start 2023-11-18T21:29:22.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.357+0000 7f4544eac640 1 -- start start 2023-11-18T21:29:22.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.357+0000 7f4544eac640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45400c6c50 0x7f4540158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:22.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.357+0000 7f4544eac640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45401501f0 0x7f45401f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:22.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.357+0000 7f4544eac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45401505d0 0x7f45401f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:22.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.357+0000 7f4544eac640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45401f1430 con 0x7f45401505d0 2023-11-18T21:29:22.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.357+0000 7f4544eac640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45401540b0 con 0x7f45400c6c50 2023-11-18T21:29:22.359 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.357+0000 7f4544eac640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4540154370 con 0x7f45401501f0 2023-11-18T21:29:22.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.357+0000 7f453ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45401505d0 0x7f45401f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:22.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.357+0000 7f453ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45401505d0 0x7f45401f1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36454/0 (socket says 172.21.15.49:36454) 2023-11-18T21:29:22.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.357+0000 7f453ed9d640 1 -- 172.21.15.49:0/423333712 learned_addr learned my addr 172.21.15.49:0/423333712 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:29:22.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.357+0000 7f4535d9b640 1 --2- 172.21.15.49:0/423333712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45401501f0 0x7f45401f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:22.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.357+0000 7f453e59c640 1 --2- 172.21.15.49:0/423333712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45400c6c50 0x7f4540158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:22.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.361+0000 7f453ed9d640 1 -- 172.21.15.49:0/423333712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45401501f0 msgr2=0x7f45401f18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:22.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.361+0000 7f453ed9d640 1 --2- 172.21.15.49:0/423333712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45401501f0 0x7f45401f18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:22.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.361+0000 7f453ed9d640 1 -- 172.21.15.49:0/423333712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45400c6c50 msgr2=0x7f4540158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:22.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.361+0000 7f453ed9d640 1 --2- 172.21.15.49:0/423333712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45400c6c50 0x7f4540158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:22.364 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.361+0000 7f453ed9d640 1 -- 172.21.15.49:0/423333712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453000b770 con 0x7f45401505d0 2023-11-18T21:29:22.366 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.365+0000 7f453ed9d640 1 --2- 172.21.15.49:0/423333712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45401505d0 0x7f45401f1e00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4538007e40 tx=0x7f453800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.369+0000 7f45377fe640 1 -- 172.21.15.49:0/423333712 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538014620 con 0x7f45401505d0 2023-11-18T21:29:22.370 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.369+0000 7f45377fe640 1 -- 172.21.15.49:0/423333712 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453800ee90 con 0x7f45401505d0 2023-11-18T21:29:22.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.369+0000 7f45377fe640 1 -- 172.21.15.49:0/423333712 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45380149e0 con 0x7f45401505d0 2023-11-18T21:29:22.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.369+0000 7f4544eac640 1 -- 172.21.15.49:0/423333712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4540154650 con 0x7f45401505d0 2023-11-18T21:29:22.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.369+0000 7f4544eac640 1 -- 172.21.15.49:0/423333712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4540154c10 con 0x7f45401505d0 2023-11-18T21:29:22.371 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.369+0000 7f4544eac640 1 -- 172.21.15.49:0/423333712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45401f15e0 con 0x7f45401505d0 2023-11-18T21:29:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.681+0000 7f45377fe640 1 -- 172.21.15.49:0/423333712 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4538014b40 con 0x7f45401505d0 2023-11-18T21:29:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.681+0000 7f45377fe640 1 --2- 172.21.15.49:0/423333712 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f45200664c0 0x7f4520068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.681+0000 7f453e59c640 1 --2- 172.21.15.49:0/423333712 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f45200664c0 0x7f4520068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.685+0000 7f453e59c640 1 --2- 172.21.15.49:0/423333712 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f45200664c0 0x7f4520068980 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f45300b1000 tx=0x7f45300a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:22.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.725+0000 7f45377fe640 1 -- 172.21.15.49:0/423333712 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f45380565e0 con 0x7f45401505d0 2023-11-18T21:29:22.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.725+0000 7f45377fe640 1 -- 172.21.15.49:0/423333712 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4538052920 con 0x7f45401505d0 2023-11-18T21:29:22.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.901+0000 7f4544eac640 1 -- 172.21.15.49:0/423333712 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f45400c2d90 con 0x7f45200664c0 2023-11-18T21:29:22.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.933+0000 7f45377fe640 1 -- 172.21.15.49:0/423333712 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368106 (secure 0 0 0) 0x7f45300be070 con 0x7f45200664c0 2023-11-18T21:29:22.935 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:29:22.941 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-18T21:29:22.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.941+0000 7f4544eac640 1 -- 172.21.15.49:0/423333712 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f45200664c0 msgr2=0x7f4520068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:22.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.941+0000 7f4544eac640 1 --2- 172.21.15.49:0/423333712 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f45200664c0 0x7f4520068980 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f45300b1000 tx=0x7f45300a9070 comp rx=0 tx=0).stop 2023-11-18T21:29:22.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.941+0000 7f4544eac640 1 -- 172.21.15.49:0/423333712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45401505d0 msgr2=0x7f45401f1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:22.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.941+0000 7f4544eac640 1 --2- 172.21.15.49:0/423333712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45401505d0 0x7f45401f1e00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4538007e40 tx=0x7f453800e4b0 comp rx=0 tx=0).stop 2023-11-18T21:29:22.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.941+0000 7f4544eac640 1 -- 172.21.15.49:0/423333712 shutdown_connections 2023-11-18T21:29:22.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.941+0000 7f4544eac640 1 --2- 172.21.15.49:0/423333712 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f45200664c0 0x7f4520068980 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:22.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.941+0000 7f4544eac640 1 --2- 172.21.15.49:0/423333712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45401505d0 0x7f45401f1e00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:22.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.941+0000 7f4544eac640 1 --2- 172.21.15.49:0/423333712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45401501f0 0x7f45401f18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:22.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.941+0000 7f4544eac640 1 --2- 172.21.15.49:0/423333712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45400c6c50 0x7f4540158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:22.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.941+0000 7f4544eac640 1 -- 172.21.15.49:0/423333712 >> 172.21.15.49:0/423333712 conn(0x7f454006c6a0 msgr2=0x7f4540142d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:29:22.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.941+0000 7f4544eac640 1 -- 172.21.15.49:0/423333712 shutdown_connections 2023-11-18T21:29:22.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:22.941+0000 7f4544eac640 1 -- 172.21.15.49:0/423333712 wait complete. 2023-11-18T21:29:22.967 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":949,"stamp":"2023-11-18T21:29:22.552921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24262386,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":804,"num_read_kb":1243,"num_write":12291,"num_write_kb":281645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20000,"num_omap_keys":40,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14846,"ondisk_log_size":14846,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":388472,"kb_used_data":50232,"kb_used_omap":12,"kb_used_meta":338163,"kb_avail":754586248,"statfs":{"total":773094113280,"available":772696317952,"internally_reserved":0,"allocated":51437568,"data_stored":49613892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":346279473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004989"},"pg_stats":[{"pgid":"2.1f","version":"31'78","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:03.460546+0000","last_change":"2023-11-18T21:29:03.460610+0000","last_active":"2023-11-18T21:29:03.460546+0000","last_peered":"2023-11-18T21:29:03.460546+0000","last_clean":"2023-11-18T21:29:03.460546+0000","last_became_active":"2023-11-18T20:59:25.349869+0000","last_became_peered":"2023-11-18T20:59:25.349869+0000","last_unstale":"2023-11-18T21:29:03.460546+0000","last_undegraded":"2023-11-18T21:29:03.460546+0000","last_fullsized":"2023-11-18T21:29:03.460546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'78","last_scrub_stamp":"2023-11-18T21:29:03.460361+0000","last_deep_scrub":"31'78","last_deep_scrub_stamp":"2023-11-18T21:29:03.460361+0000","last_clean_scrub_stamp":"2023-11-18T21:29:03.460361+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:24:19.786896+0000","scrub_duration":0.011799875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'45","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.673895+0000","last_change":"2023-11-18T20:59:27.895973+0000","last_active":"2023-11-18T21:28:43.673895+0000","last_peered":"2023-11-18T21:28:43.673895+0000","last_clean":"2023-11-18T21:28:43.673895+0000","last_became_active":"2023-11-18T20:59:27.895678+0000","last_became_peered":"2023-11-18T20:59:27.895678+0000","last_unstale":"2023-11-18T21:28:43.673895+0000","last_undegraded":"2023-11-18T21:28:43.673895+0000","last_fullsized":"2023-11-18T21:28:43.673895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"31'87","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:47.211523+0000","last_change":"2023-11-18T20:59:35.848621+0000","last_active":"2023-11-18T21:28:47.211523+0000","last_peered":"2023-11-18T21:28:47.211523+0000","last_clean":"2023-11-18T21:28:47.211523+0000","last_became_active":"2023-11-18T20:59:35.848140+0000","last_became_peered":"2023-11-18T20:59:35.848140+0000","last_unstale":"2023-11-18T21:28:47.211523+0000","last_undegraded":"2023-11-18T21:28:47.211523+0000","last_fullsized":"2023-11-18T21:28:47.211523+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"31'8","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:13.501903+0000","last_change":"2023-11-18T21:29:13.501955+0000","last_active":"2023-11-18T21:29:13.501903+0000","last_peered":"2023-11-18T21:29:13.501903+0000","last_clean":"2023-11-18T21:29:13.501903+0000","last_became_active":"2023-11-18T20:59:25.463001+0000","last_became_peered":"2023-11-18T20:59:25.463001+0000","last_unstale":"2023-11-18T21:29:13.501903+0000","last_undegraded":"2023-11-18T21:29:13.501903+0000","last_fullsized":"2023-11-18T21:29:13.501903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-11-18T21:29:13.501715+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-11-18T21:29:13.501715+0000","last_clean_scrub_stamp":"2023-11-18T21:29:13.501715+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:31.013864+0000","scrub_duration":0.0034647580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"31'59","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:59.668147+0000","last_change":"2023-11-18T21:28:59.668198+0000","last_active":"2023-11-18T21:28:59.668147+0000","last_peered":"2023-11-18T21:28:59.668147+0000","last_clean":"2023-11-18T21:28:59.668147+0000","last_became_active":"2023-11-18T20:59:27.836937+0000","last_became_peered":"2023-11-18T20:59:27.836937+0000","last_unstale":"2023-11-18T21:28:59.668147+0000","last_undegraded":"2023-11-18T21:28:59.668147+0000","last_fullsized":"2023-11-18T21:28:59.668147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:28:59.667928+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:28:59.667928+0000","last_clean_scrub_stamp":"2023-11-18T21:28:59.667928+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:50.770327+0000","scrub_duration":0.0051257619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"31'91","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:20.239104+0000","last_change":"2023-11-18T21:29:20.239161+0000","last_active":"2023-11-18T21:29:20.239104+0000","last_peered":"2023-11-18T21:29:20.239104+0000","last_clean":"2023-11-18T21:29:20.239104+0000","last_became_active":"2023-11-18T20:59:35.842552+0000","last_became_peered":"2023-11-18T20:59:35.842552+0000","last_unstale":"2023-11-18T21:29:20.239104+0000","last_undegraded":"2023-11-18T21:29:20.239104+0000","last_fullsized":"2023-11-18T21:29:20.239104+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'91","last_scrub_stamp":"2023-11-18T21:29:20.238911+0000","last_deep_scrub":"31'91","last_deep_scrub_stamp":"2023-11-18T21:29:20.238911+0000","last_clean_scrub_stamp":"2023-11-18T21:29:20.238911+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:09.774889+0000","scrub_duration":0.010430183000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"31'182","reported_seq":224,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:06.070723+0000","last_change":"2023-11-18T21:29:06.070791+0000","last_active":"2023-11-18T21:29:06.070723+0000","last_peered":"2023-11-18T21:29:06.070723+0000","last_clean":"2023-11-18T21:29:06.070723+0000","last_became_active":"2023-11-18T20:59:25.497070+0000","last_became_peered":"2023-11-18T20:59:25.497070+0000","last_unstale":"2023-11-18T21:29:06.070723+0000","last_undegraded":"2023-11-18T21:29:06.070723+0000","last_fullsized":"2023-11-18T21:29:06.070723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'182","last_scrub_stamp":"2023-11-18T21:29:06.070530+0000","last_deep_scrub":"31'182","last_deep_scrub_stamp":"2023-11-18T21:29:06.070530+0000","last_clean_scrub_stamp":"2023-11-18T21:29:06.070530+0000","objects_scrubbed":7,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:03.287156+0000","scrub_duration":0.017219693000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"31'56","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:19.095362+0000","last_change":"2023-11-18T21:29:19.095416+0000","last_active":"2023-11-18T21:29:19.095362+0000","last_peered":"2023-11-18T21:29:19.095362+0000","last_clean":"2023-11-18T21:29:19.095362+0000","last_became_active":"2023-11-18T20:59:27.867021+0000","last_became_peered":"2023-11-18T20:59:27.867021+0000","last_unstale":"2023-11-18T21:29:19.095362+0000","last_undegraded":"2023-11-18T21:29:19.095362+0000","last_fullsized":"2023-11-18T21:29:19.095362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'56","last_scrub_stamp":"2023-11-18T21:29:19.095175+0000","last_deep_scrub":"31'56","last_deep_scrub_stamp":"2023-11-18T21:29:19.095175+0000","last_clean_scrub_stamp":"2023-11-18T21:29:19.095175+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:24:47.739315+0000","scrub_duration":0.0033730069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'88","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:27.967589+0000","last_change":"2023-11-18T20:59:35.830210+0000","last_active":"2023-11-18T21:27:27.967589+0000","last_peered":"2023-11-18T21:27:27.967589+0000","last_clean":"2023-11-18T21:27:27.967589+0000","last_became_active":"2023-11-18T20:59:35.829636+0000","last_became_peered":"2023-11-18T20:59:35.829636+0000","last_unstale":"2023-11-18T21:27:27.967589+0000","last_undegraded":"2023-11-18T21:27:27.967589+0000","last_fullsized":"2023-11-18T21:27:27.967589+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":32,"num_write":84,"num_write_kb":9481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"31'13","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.970312+0000","last_change":"2023-11-18T21:29:10.970375+0000","last_active":"2023-11-18T21:29:10.970312+0000","last_peered":"2023-11-18T21:29:10.970312+0000","last_clean":"2023-11-18T21:29:10.970312+0000","last_became_active":"2023-11-18T20:59:25.493087+0000","last_became_peered":"2023-11-18T20:59:25.493087+0000","last_unstale":"2023-11-18T21:29:10.970312+0000","last_undegraded":"2023-11-18T21:29:10.970312+0000","last_fullsized":"2023-11-18T21:29:10.970312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2023-11-18T21:29:10.970102+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2023-11-18T21:29:10.970102+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.970102+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:28.482252+0000","scrub_duration":0.0099144660000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"31'65","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:05.584060+0000","last_change":"2023-11-18T21:29:05.584178+0000","last_active":"2023-11-18T21:29:05.584060+0000","last_peered":"2023-11-18T21:29:05.584060+0000","last_clean":"2023-11-18T21:29:05.584060+0000","last_became_active":"2023-11-18T20:59:27.871076+0000","last_became_peered":"2023-11-18T20:59:27.871076+0000","last_unstale":"2023-11-18T21:29:05.584060+0000","last_undegraded":"2023-11-18T21:29:05.584060+0000","last_fullsized":"2023-11-18T21:29:05.584060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'65","last_scrub_stamp":"2023-11-18T21:29:05.583742+0000","last_deep_scrub":"31'65","last_deep_scrub_stamp":"2023-11-18T21:29:05.583742+0000","last_clean_scrub_stamp":"2023-11-18T21:29:05.583742+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:14:13.537695+0000","scrub_duration":0.003124567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"31'63","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:23.952233+0000","last_change":"2023-11-18T20:59:35.833547+0000","last_active":"2023-11-18T21:27:23.952233+0000","last_peered":"2023-11-18T21:27:23.952233+0000","last_clean":"2023-11-18T21:27:23.952233+0000","last_became_active":"2023-11-18T20:59:35.833016+0000","last_became_peered":"2023-11-18T20:59:35.833016+0000","last_unstale":"2023-11-18T21:27:23.952233+0000","last_undegraded":"2023-11-18T21:27:23.952233+0000","last_fullsized":"2023-11-18T21:27:23.952233+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":5002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"31'56","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:12.489851+0000","last_change":"2023-11-18T21:29:12.489906+0000","last_active":"2023-11-18T21:29:12.489851+0000","last_peered":"2023-11-18T21:29:12.489851+0000","last_clean":"2023-11-18T21:29:12.489851+0000","last_became_active":"2023-11-18T20:59:27.681154+0000","last_became_peered":"2023-11-18T20:59:27.681154+0000","last_unstale":"2023-11-18T21:29:12.489851+0000","last_undegraded":"2023-11-18T21:29:12.489851+0000","last_fullsized":"2023-11-18T21:29:12.489851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'56","last_scrub_stamp":"2023-11-18T21:29:12.489669+0000","last_deep_scrub":"31'56","last_deep_scrub_stamp":"2023-11-18T21:29:12.489669+0000","last_clean_scrub_stamp":"2023-11-18T21:29:12.489669+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:46:08.217982+0000","scrub_duration":0.0041585340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"31'142","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.860148+0000","last_change":"2023-11-18T20:59:25.339269+0000","last_active":"2023-11-18T21:28:43.860148+0000","last_peered":"2023-11-18T21:28:43.860148+0000","last_clean":"2023-11-18T21:28:43.860148+0000","last_became_active":"2023-11-18T20:59:25.338067+0000","last_became_peered":"2023-11-18T20:59:25.338067+0000","last_unstale":"2023-11-18T21:28:43.860148+0000","last_undegraded":"2023-11-18T21:28:43.860148+0000","last_fullsized":"2023-11-18T21:28:43.860148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395570,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'89","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:32.458469+0000","last_change":"2023-11-18T21:00:28.755990+0000","last_active":"2023-11-18T21:27:32.458469+0000","last_peered":"2023-11-18T21:27:32.458469+0000","last_clean":"2023-11-18T21:27:32.458469+0000","last_became_active":"2023-11-18T21:00:28.755606+0000","last_became_peered":"2023-11-18T21:00:28.755606+0000","last_unstale":"2023-11-18T21:27:32.458469+0000","last_undegraded":"2023-11-18T21:27:32.458469+0000","last_fullsized":"2023-11-18T21:27:32.458469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":4704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'54","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:14.305497+0000","last_change":"2023-11-18T21:29:14.305549+0000","last_active":"2023-11-18T21:29:14.305497+0000","last_peered":"2023-11-18T21:29:14.305497+0000","last_clean":"2023-11-18T21:29:14.305497+0000","last_became_active":"2023-11-18T20:59:27.861045+0000","last_became_peered":"2023-11-18T20:59:27.861045+0000","last_unstale":"2023-11-18T21:29:14.305497+0000","last_undegraded":"2023-11-18T21:29:14.305497+0000","last_fullsized":"2023-11-18T21:29:14.305497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-11-18T21:29:14.305304+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-11-18T21:29:14.305304+0000","last_clean_scrub_stamp":"2023-11-18T21:29:14.305304+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:11:24.924936+0000","scrub_duration":0.0068830929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"31'409","reported_seq":453,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.296130+0000","last_change":"2023-11-18T21:29:10.296193+0000","last_active":"2023-11-18T21:29:10.296130+0000","last_peered":"2023-11-18T21:29:10.296130+0000","last_clean":"2023-11-18T21:29:10.296130+0000","last_became_active":"2023-11-18T20:59:25.457871+0000","last_became_peered":"2023-11-18T20:59:25.457871+0000","last_unstale":"2023-11-18T21:29:10.296130+0000","last_undegraded":"2023-11-18T21:29:10.296130+0000","last_fullsized":"2023-11-18T21:29:10.296130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'409","last_scrub_stamp":"2023-11-18T21:29:10.295947+0000","last_deep_scrub":"31'409","last_deep_scrub_stamp":"2023-11-18T21:29:10.295947+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.295947+0000","objects_scrubbed":2,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:46:51.703977+0000","scrub_duration":0.017910031999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":996,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"31'93","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:52.475280+0000","last_change":"2023-11-18T20:59:35.842967+0000","last_active":"2023-11-18T21:28:52.475280+0000","last_peered":"2023-11-18T21:28:52.475280+0000","last_clean":"2023-11-18T21:28:52.475280+0000","last_became_active":"2023-11-18T20:59:35.842583+0000","last_became_peered":"2023-11-18T20:59:35.842583+0000","last_unstale":"2023-11-18T21:28:52.475280+0000","last_undegraded":"2023-11-18T21:28:52.475280+0000","last_fullsized":"2023-11-18T21:28:52.475280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'46","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:11.348530+0000","last_change":"2023-11-18T21:29:11.348582+0000","last_active":"2023-11-18T21:29:11.348530+0000","last_peered":"2023-11-18T21:29:11.348530+0000","last_clean":"2023-11-18T21:29:11.348530+0000","last_became_active":"2023-11-18T20:59:27.687250+0000","last_became_peered":"2023-11-18T20:59:27.687250+0000","last_unstale":"2023-11-18T21:29:11.348530+0000","last_undegraded":"2023-11-18T21:29:11.348530+0000","last_fullsized":"2023-11-18T21:29:11.348530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-11-18T21:29:11.348342+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-11-18T21:29:11.348342+0000","last_clean_scrub_stamp":"2023-11-18T21:29:11.348342+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:38:22.498619+0000","scrub_duration":0.0033288079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"31'206","reported_seq":250,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.475085+0000","last_change":"2023-11-18T21:29:04.475145+0000","last_active":"2023-11-18T21:29:04.475085+0000","last_peered":"2023-11-18T21:29:04.475085+0000","last_clean":"2023-11-18T21:29:04.475085+0000","last_became_active":"2023-11-18T20:59:25.351318+0000","last_became_peered":"2023-11-18T20:59:25.351318+0000","last_unstale":"2023-11-18T21:29:04.475085+0000","last_undegraded":"2023-11-18T21:29:04.475085+0000","last_fullsized":"2023-11-18T21:29:04.475085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'206","last_scrub_stamp":"2023-11-18T21:29:04.474913+0000","last_deep_scrub":"31'206","last_deep_scrub_stamp":"2023-11-18T21:29:04.474913+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.474913+0000","objects_scrubbed":4,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:35.853099+0000","scrub_duration":0.010175724000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'80","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:01.438257+0000","last_change":"2023-11-18T20:59:35.835375+0000","last_active":"2023-11-18T21:29:01.438257+0000","last_peered":"2023-11-18T21:29:01.438257+0000","last_clean":"2023-11-18T21:29:01.438257+0000","last_became_active":"2023-11-18T20:59:35.834894+0000","last_became_peered":"2023-11-18T20:59:35.834894+0000","last_unstale":"2023-11-18T21:29:01.438257+0000","last_undegraded":"2023-11-18T21:29:01.438257+0000","last_fullsized":"2023-11-18T21:29:01.438257+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":144,"num_write":72,"num_write_kb":6857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"31'48","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:07.569373+0000","last_change":"2023-11-18T21:29:07.569471+0000","last_active":"2023-11-18T21:29:07.569373+0000","last_peered":"2023-11-18T21:29:07.569373+0000","last_clean":"2023-11-18T21:29:07.569373+0000","last_became_active":"2023-11-18T20:59:27.686692+0000","last_became_peered":"2023-11-18T20:59:27.686692+0000","last_unstale":"2023-11-18T21:29:07.569373+0000","last_undegraded":"2023-11-18T21:29:07.569373+0000","last_fullsized":"2023-11-18T21:29:07.569373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2023-11-18T21:29:07.568991+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2023-11-18T21:29:07.568991+0000","last_clean_scrub_stamp":"2023-11-18T21:29:07.568991+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:57:10.343662+0000","scrub_duration":0.0041715520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'9","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:00.073675+0000","last_change":"2023-11-18T21:29:00.073730+0000","last_active":"2023-11-18T21:29:00.073675+0000","last_peered":"2023-11-18T21:29:00.073675+0000","last_clean":"2023-11-18T21:29:00.073675+0000","last_became_active":"2023-11-18T20:59:25.347022+0000","last_became_peered":"2023-11-18T20:59:25.347022+0000","last_unstale":"2023-11-18T21:29:00.073675+0000","last_undegraded":"2023-11-18T21:29:00.073675+0000","last_fullsized":"2023-11-18T21:29:00.073675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2023-11-18T21:29:00.073501+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2023-11-18T21:29:00.073501+0000","last_clean_scrub_stamp":"2023-11-18T21:29:00.073501+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:11:30.795362+0000","scrub_duration":0.005583368,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'120","reported_seq":149,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:52.349868+0000","last_change":"2023-11-18T20:59:35.771398+0000","last_active":"2023-11-18T21:28:52.349868+0000","last_peered":"2023-11-18T21:28:52.349868+0000","last_clean":"2023-11-18T21:28:52.349868+0000","last_became_active":"2023-11-18T20:59:35.770923+0000","last_became_peered":"2023-11-18T20:59:35.770923+0000","last_unstale":"2023-11-18T21:28:52.349868+0000","last_undegraded":"2023-11-18T21:28:52.349868+0000","last_fullsized":"2023-11-18T21:28:52.349868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'44","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.574110+0000","last_change":"2023-11-18T20:59:27.689972+0000","last_active":"2023-11-18T21:28:43.574110+0000","last_peered":"2023-11-18T21:28:43.574110+0000","last_clean":"2023-11-18T21:28:43.574110+0000","last_became_active":"2023-11-18T20:59:27.689156+0000","last_became_peered":"2023-11-18T20:59:27.689156+0000","last_unstale":"2023-11-18T21:28:43.574110+0000","last_undegraded":"2023-11-18T21:28:43.574110+0000","last_fullsized":"2023-11-18T21:28:43.574110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"31'12","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:33.859903+0000","last_change":"2023-11-18T20:59:25.348005+0000","last_active":"2023-11-18T21:28:33.859903+0000","last_peered":"2023-11-18T21:28:33.859903+0000","last_clean":"2023-11-18T21:28:33.859903+0000","last_became_active":"2023-11-18T20:59:25.346318+0000","last_became_peered":"2023-11-18T20:59:25.346318+0000","last_unstale":"2023-11-18T21:28:33.859903+0000","last_undegraded":"2023-11-18T21:28:33.859903+0000","last_fullsized":"2023-11-18T21:28:33.859903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"31'81","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:19.205259+0000","last_change":"2023-11-18T21:29:19.205374+0000","last_active":"2023-11-18T21:29:19.205259+0000","last_peered":"2023-11-18T21:29:19.205259+0000","last_clean":"2023-11-18T21:29:19.205259+0000","last_became_active":"2023-11-18T20:59:35.833407+0000","last_became_peered":"2023-11-18T20:59:35.833407+0000","last_unstale":"2023-11-18T21:29:19.205259+0000","last_undegraded":"2023-11-18T21:29:19.205259+0000","last_fullsized":"2023-11-18T21:29:19.205259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'81","last_scrub_stamp":"2023-11-18T21:29:19.205015+0000","last_deep_scrub":"31'81","last_deep_scrub_stamp":"2023-11-18T21:29:19.205015+0000","last_clean_scrub_stamp":"2023-11-18T21:29:19.205015+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:16.421641+0000","scrub_duration":0.0093240909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":9489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'53","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.574125+0000","last_change":"2023-11-18T20:59:27.863887+0000","last_active":"2023-11-18T21:28:43.574125+0000","last_peered":"2023-11-18T21:28:43.574125+0000","last_clean":"2023-11-18T21:28:43.574125+0000","last_became_active":"2023-11-18T20:59:27.863358+0000","last_became_peered":"2023-11-18T20:59:27.863358+0000","last_unstale":"2023-11-18T21:28:43.574125+0000","last_undegraded":"2023-11-18T21:28:43.574125+0000","last_fullsized":"2023-11-18T21:28:43.574125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"31'153","reported_seq":197,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:06.548115+0000","last_change":"2023-11-18T21:29:06.548239+0000","last_active":"2023-11-18T21:29:06.548115+0000","last_peered":"2023-11-18T21:29:06.548115+0000","last_clean":"2023-11-18T21:29:06.548115+0000","last_became_active":"2023-11-18T20:59:25.350705+0000","last_became_peered":"2023-11-18T20:59:25.350705+0000","last_unstale":"2023-11-18T21:29:06.548115+0000","last_undegraded":"2023-11-18T21:29:06.548115+0000","last_fullsized":"2023-11-18T21:29:06.548115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-11-18T21:29:06.547908+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-11-18T21:29:06.547908+0000","last_clean_scrub_stamp":"2023-11-18T21:29:06.547908+0000","objects_scrubbed":4,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:17:24.614328+0000","scrub_duration":0.011886097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:40.332634+0000","last_change":"2023-11-18T20:59:35.840991+0000","last_active":"2023-11-18T21:27:40.332634+0000","last_peered":"2023-11-18T21:27:40.332634+0000","last_clean":"2023-11-18T21:27:40.332634+0000","last_became_active":"2023-11-18T20:59:35.840533+0000","last_became_peered":"2023-11-18T20:59:35.840533+0000","last_unstale":"2023-11-18T21:27:40.332634+0000","last_undegraded":"2023-11-18T21:27:40.332634+0000","last_fullsized":"2023-11-18T21:27:40.332634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":9026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"31'60","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.582966+0000","last_change":"2023-11-18T20:59:27.869100+0000","last_active":"2023-11-18T21:28:43.582966+0000","last_peered":"2023-11-18T21:28:43.582966+0000","last_clean":"2023-11-18T21:28:43.582966+0000","last_became_active":"2023-11-18T20:59:27.868355+0000","last_became_peered":"2023-11-18T20:59:27.868355+0000","last_unstale":"2023-11-18T21:28:43.582966+0000","last_undegraded":"2023-11-18T21:28:43.582966+0000","last_fullsized":"2023-11-18T21:28:43.582966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"31'94","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:47.353926+0000","last_change":"2023-11-18T20:59:25.350304+0000","last_active":"2023-11-18T21:28:47.353926+0000","last_peered":"2023-11-18T21:28:47.353926+0000","last_clean":"2023-11-18T21:28:47.353926+0000","last_became_active":"2023-11-18T20:59:25.349346+0000","last_became_peered":"2023-11-18T20:59:25.349346+0000","last_unstale":"2023-11-18T21:28:47.353926+0000","last_undegraded":"2023-11-18T21:28:47.353926+0000","last_fullsized":"2023-11-18T21:28:47.353926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"31'98","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:47.334088+0000","last_change":"2023-11-18T20:59:35.847005+0000","last_active":"2023-11-18T21:28:47.334088+0000","last_peered":"2023-11-18T21:28:47.334088+0000","last_clean":"2023-11-18T21:28:47.334088+0000","last_became_active":"2023-11-18T20:59:35.846458+0000","last_became_peered":"2023-11-18T20:59:35.846458+0000","last_unstale":"2023-11-18T21:28:47.334088+0000","last_undegraded":"2023-11-18T21:28:47.334088+0000","last_fullsized":"2023-11-18T21:28:47.334088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":10588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"31'50","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.160928+0000","last_change":"2023-11-18T21:29:04.160980+0000","last_active":"2023-11-18T21:29:04.160928+0000","last_peered":"2023-11-18T21:29:04.160928+0000","last_clean":"2023-11-18T21:29:04.160928+0000","last_became_active":"2023-11-18T20:59:27.887876+0000","last_became_peered":"2023-11-18T20:59:27.887876+0000","last_unstale":"2023-11-18T21:29:04.160928+0000","last_undegraded":"2023-11-18T21:29:04.160928+0000","last_fullsized":"2023-11-18T21:29:04.160928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'50","last_scrub_stamp":"2023-11-18T21:29:04.160739+0000","last_deep_scrub":"31'50","last_deep_scrub_stamp":"2023-11-18T21:29:04.160739+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.160739+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:11:22.163473+0000","scrub_duration":0.00435988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:12.457669+0000","last_change":"2023-11-18T21:29:12.457723+0000","last_active":"2023-11-18T21:29:12.457669+0000","last_peered":"2023-11-18T21:29:12.457669+0000","last_clean":"2023-11-18T21:29:12.457669+0000","last_became_active":"2023-11-18T20:59:25.459235+0000","last_became_peered":"2023-11-18T20:59:25.459235+0000","last_unstale":"2023-11-18T21:29:12.457669+0000","last_undegraded":"2023-11-18T21:29:12.457669+0000","last_fullsized":"2023-11-18T21:29:12.457669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-11-18T21:29:12.457455+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-11-18T21:29:12.457455+0000","last_clean_scrub_stamp":"2023-11-18T21:29:12.457455+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:52:11.157078+0000","scrub_duration":0.0039406650000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:47.333994+0000","last_change":"2023-11-18T20:59:35.835800+0000","last_active":"2023-11-18T21:28:47.333994+0000","last_peered":"2023-11-18T21:28:47.333994+0000","last_clean":"2023-11-18T21:28:47.333994+0000","last_became_active":"2023-11-18T20:59:35.834275+0000","last_became_peered":"2023-11-18T20:59:35.834275+0000","last_unstale":"2023-11-18T21:28:47.333994+0000","last_undegraded":"2023-11-18T21:28:47.333994+0000","last_fullsized":"2023-11-18T21:28:47.333994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'61","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.477037+0000","last_change":"2023-11-18T21:00:28.721070+0000","last_active":"2023-11-18T21:28:43.477037+0000","last_peered":"2023-11-18T21:28:43.477037+0000","last_clean":"2023-11-18T21:28:43.477037+0000","last_became_active":"2023-11-18T21:00:28.720412+0000","last_became_peered":"2023-11-18T21:00:28.720412+0000","last_unstale":"2023-11-18T21:28:43.477037+0000","last_undegraded":"2023-11-18T21:28:43.477037+0000","last_fullsized":"2023-11-18T21:28:43.477037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"31'655","reported_seq":692,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.886436+0000","last_change":"2023-11-18T20:59:25.355096+0000","last_active":"2023-11-18T21:28:43.886436+0000","last_peered":"2023-11-18T21:28:43.886436+0000","last_clean":"2023-11-18T21:28:43.886436+0000","last_became_active":"2023-11-18T20:59:25.354716+0000","last_became_peered":"2023-11-18T20:59:25.354716+0000","last_unstale":"2023-11-18T21:28:43.886436+0000","last_undegraded":"2023-11-18T21:28:43.886436+0000","last_fullsized":"2023-11-18T21:28:43.886436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":3369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'79","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:47.334147+0000","last_change":"2023-11-18T20:59:35.839218+0000","last_active":"2023-11-18T21:28:47.334147+0000","last_peered":"2023-11-18T21:28:47.334147+0000","last_clean":"2023-11-18T21:28:47.334147+0000","last_became_active":"2023-11-18T20:59:35.838732+0000","last_became_peered":"2023-11-18T20:59:35.838732+0000","last_unstale":"2023-11-18T21:28:47.334147+0000","last_undegraded":"2023-11-18T21:28:47.334147+0000","last_fullsized":"2023-11-18T21:28:47.334147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"31'54","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.634082+0000","last_change":"2023-11-18T20:59:27.839403+0000","last_active":"2023-11-18T21:28:43.634082+0000","last_peered":"2023-11-18T21:28:43.634082+0000","last_clean":"2023-11-18T21:28:43.634082+0000","last_became_active":"2023-11-18T20:59:27.838664+0000","last_became_peered":"2023-11-18T20:59:27.838664+0000","last_unstale":"2023-11-18T21:28:43.634082+0000","last_undegraded":"2023-11-18T21:28:43.634082+0000","last_fullsized":"2023-11-18T21:28:43.634082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"31'166","reported_seq":284,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.394094+0000","last_change":"2023-11-18T21:29:04.394160+0000","last_active":"2023-11-18T21:29:04.394094+0000","last_peered":"2023-11-18T21:29:04.394094+0000","last_clean":"2023-11-18T21:29:04.394094+0000","last_became_active":"2023-11-18T20:59:25.458075+0000","last_became_peered":"2023-11-18T20:59:25.458075+0000","last_unstale":"2023-11-18T21:29:04.394094+0000","last_undegraded":"2023-11-18T21:29:04.394094+0000","last_fullsized":"2023-11-18T21:29:04.394094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'166","last_scrub_stamp":"2023-11-18T21:29:04.393926+0000","last_deep_scrub":"31'166","last_deep_scrub_stamp":"2023-11-18T21:29:04.393926+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.393926+0000","objects_scrubbed":4,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:21:30.888691+0000","scrub_duration":0.0067038549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18647,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":79,"num_write":158,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"31'81","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:47.504067+0000","last_change":"2023-11-18T20:59:35.833736+0000","last_active":"2023-11-18T21:27:47.504067+0000","last_peered":"2023-11-18T21:27:47.504067+0000","last_clean":"2023-11-18T21:27:47.504067+0000","last_became_active":"2023-11-18T20:59:35.832891+0000","last_became_peered":"2023-11-18T20:59:35.832891+0000","last_unstale":"2023-11-18T21:27:47.504067+0000","last_undegraded":"2023-11-18T21:27:47.504067+0000","last_fullsized":"2023-11-18T21:27:47.504067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"31'58","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:11.258017+0000","last_change":"2023-11-18T21:29:11.258075+0000","last_active":"2023-11-18T21:29:11.258017+0000","last_peered":"2023-11-18T21:29:11.258017+0000","last_clean":"2023-11-18T21:29:11.258017+0000","last_became_active":"2023-11-18T20:59:27.889115+0000","last_became_peered":"2023-11-18T20:59:27.889115+0000","last_unstale":"2023-11-18T21:29:11.258017+0000","last_undegraded":"2023-11-18T21:29:11.258017+0000","last_fullsized":"2023-11-18T21:29:11.258017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'58","last_scrub_stamp":"2023-11-18T21:29:11.257818+0000","last_deep_scrub":"31'58","last_deep_scrub_stamp":"2023-11-18T21:29:11.257818+0000","last_clean_scrub_stamp":"2023-11-18T21:29:11.257818+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:12:06.078536+0000","scrub_duration":0.003715884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"31'8","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:18.662462+0000","last_change":"2023-11-18T20:59:25.460190+0000","last_active":"2023-11-18T21:28:18.662462+0000","last_peered":"2023-11-18T21:28:18.662462+0000","last_clean":"2023-11-18T21:28:18.662462+0000","last_became_active":"2023-11-18T20:59:25.459405+0000","last_became_peered":"2023-11-18T20:59:25.459405+0000","last_unstale":"2023-11-18T21:28:18.662462+0000","last_undegraded":"2023-11-18T21:28:18.662462+0000","last_fullsized":"2023-11-18T21:28:18.662462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"31'64","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:47.482888+0000","last_change":"2023-11-18T20:59:35.842229+0000","last_active":"2023-11-18T21:27:47.482888+0000","last_peered":"2023-11-18T21:27:47.482888+0000","last_clean":"2023-11-18T21:27:47.482888+0000","last_became_active":"2023-11-18T20:59:35.835644+0000","last_became_peered":"2023-11-18T20:59:35.835644+0000","last_unstale":"2023-11-18T21:27:47.482888+0000","last_undegraded":"2023-11-18T21:27:47.482888+0000","last_fullsized":"2023-11-18T21:27:47.482888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"31'47","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:19.284666+0000","last_change":"2023-11-18T21:29:19.284778+0000","last_active":"2023-11-18T21:29:19.284666+0000","last_peered":"2023-11-18T21:29:19.284666+0000","last_clean":"2023-11-18T21:29:19.284666+0000","last_became_active":"2023-11-18T20:59:27.890499+0000","last_became_peered":"2023-11-18T20:59:27.890499+0000","last_unstale":"2023-11-18T21:29:19.284666+0000","last_undegraded":"2023-11-18T21:29:19.284666+0000","last_fullsized":"2023-11-18T21:29:19.284666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-11-18T21:29:19.284440+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-11-18T21:29:19.284440+0000","last_clean_scrub_stamp":"2023-11-18T21:29:19.284440+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:18:47.615835+0000","scrub_duration":0.0039795910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"31'8","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:37.558749+0000","last_change":"2023-11-18T20:59:25.339255+0000","last_active":"2023-11-18T21:28:37.558749+0000","last_peered":"2023-11-18T21:28:37.558749+0000","last_clean":"2023-11-18T21:28:37.558749+0000","last_became_active":"2023-11-18T20:59:25.338020+0000","last_became_peered":"2023-11-18T20:59:25.338020+0000","last_unstale":"2023-11-18T21:28:37.558749+0000","last_undegraded":"2023-11-18T21:28:37.558749+0000","last_fullsized":"2023-11-18T21:28:37.558749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:55.904332+0000","last_change":"2023-11-18T21:28:55.904332+0000","last_active":"2023-11-18T21:28:55.904332+0000","last_peered":"2023-11-18T21:28:55.904332+0000","last_clean":"2023-11-18T21:28:55.904332+0000","last_became_active":"2023-11-18T20:58:44.731076+0000","last_became_peered":"2023-11-18T20:58:44.731076+0000","last_unstale":"2023-11-18T21:28:55.904332+0000","last_undegraded":"2023-11-18T21:28:55.904332+0000","last_fullsized":"2023-11-18T21:28:55.904332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-11-18T21:28:55.904224+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-11-18T21:28:55.904224+0000","last_clean_scrub_stamp":"2023-11-18T21:28:55.904224+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:05:55.057907+0000","scrub_duration":0.010934374,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'66","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:57.356173+0000","last_change":"2023-11-18T20:59:35.771637+0000","last_active":"2023-11-18T21:28:57.356173+0000","last_peered":"2023-11-18T21:28:57.356173+0000","last_clean":"2023-11-18T21:28:57.356173+0000","last_became_active":"2023-11-18T20:59:35.771146+0000","last_became_peered":"2023-11-18T20:59:35.771146+0000","last_unstale":"2023-11-18T21:28:57.356173+0000","last_undegraded":"2023-11-18T21:28:57.356173+0000","last_fullsized":"2023-11-18T21:28:57.356173+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":6116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"31'58","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.654234+0000","last_change":"2023-11-18T20:59:27.684091+0000","last_active":"2023-11-18T21:28:43.654234+0000","last_peered":"2023-11-18T21:28:43.654234+0000","last_clean":"2023-11-18T21:28:43.654234+0000","last_became_active":"2023-11-18T20:59:27.683316+0000","last_became_peered":"2023-11-18T20:59:27.683316+0000","last_unstale":"2023-11-18T21:28:43.654234+0000","last_undegraded":"2023-11-18T21:28:43.654234+0000","last_fullsized":"2023-11-18T21:28:43.654234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"31'668","reported_seq":712,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:08.356740+0000","last_change":"2023-11-18T21:29:08.356797+0000","last_active":"2023-11-18T21:29:08.356740+0000","last_peered":"2023-11-18T21:29:08.356740+0000","last_clean":"2023-11-18T21:29:08.356740+0000","last_became_active":"2023-11-18T20:59:25.356883+0000","last_became_peered":"2023-11-18T20:59:25.356883+0000","last_unstale":"2023-11-18T21:29:08.356740+0000","last_undegraded":"2023-11-18T21:29:08.356740+0000","last_fullsized":"2023-11-18T21:29:08.356740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'668","last_scrub_stamp":"2023-11-18T21:29:08.356563+0000","last_deep_scrub":"31'668","last_deep_scrub_stamp":"2023-11-18T21:29:08.356563+0000","last_clean_scrub_stamp":"2023-11-18T21:29:08.356563+0000","objects_scrubbed":3,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:31:33.757650+0000","scrub_duration":0.021449706999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3370313,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"31'82","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:52.514072+0000","last_change":"2023-11-18T20:59:35.834266+0000","last_active":"2023-11-18T21:27:52.514072+0000","last_peered":"2023-11-18T21:27:52.514072+0000","last_clean":"2023-11-18T21:27:52.514072+0000","last_became_active":"2023-11-18T20:59:35.833790+0000","last_became_peered":"2023-11-18T20:59:35.833790+0000","last_unstale":"2023-11-18T21:27:52.514072+0000","last_undegraded":"2023-11-18T21:27:52.514072+0000","last_fullsized":"2023-11-18T21:27:52.514072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":7460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'56","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:19.076942+0000","last_change":"2023-11-18T21:29:19.077045+0000","last_active":"2023-11-18T21:29:19.076942+0000","last_peered":"2023-11-18T21:29:19.076942+0000","last_clean":"2023-11-18T21:29:19.076942+0000","last_became_active":"2023-11-18T20:59:27.872733+0000","last_became_peered":"2023-11-18T20:59:27.872733+0000","last_unstale":"2023-11-18T21:29:19.076942+0000","last_undegraded":"2023-11-18T21:29:19.076942+0000","last_fullsized":"2023-11-18T21:29:19.076942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'56","last_scrub_stamp":"2023-11-18T21:29:19.076632+0000","last_deep_scrub":"31'56","last_deep_scrub_stamp":"2023-11-18T21:29:19.076632+0000","last_clean_scrub_stamp":"2023-11-18T21:29:19.076632+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:47:44.422123+0000","scrub_duration":0.0042975579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"31'8","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.425651+0000","last_change":"2023-11-18T21:29:10.425770+0000","last_active":"2023-11-18T21:29:10.425651+0000","last_peered":"2023-11-18T21:29:10.425651+0000","last_clean":"2023-11-18T21:29:10.425651+0000","last_became_active":"2023-11-18T20:59:25.496694+0000","last_became_peered":"2023-11-18T20:59:25.496694+0000","last_unstale":"2023-11-18T21:29:10.425651+0000","last_undegraded":"2023-11-18T21:29:10.425651+0000","last_fullsized":"2023-11-18T21:29:10.425651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-11-18T21:29:10.425430+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-11-18T21:29:10.425430+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.425430+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:35:04.927101+0000","scrub_duration":0.0074186599999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'95","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:52.294489+0000","last_change":"2023-11-18T20:59:35.829393+0000","last_active":"2023-11-18T21:28:52.294489+0000","last_peered":"2023-11-18T21:28:52.294489+0000","last_clean":"2023-11-18T21:28:52.294489+0000","last_became_active":"2023-11-18T20:59:35.828446+0000","last_became_peered":"2023-11-18T20:59:35.828446+0000","last_unstale":"2023-11-18T21:28:52.294489+0000","last_undegraded":"2023-11-18T21:28:52.294489+0000","last_fullsized":"2023-11-18T21:28:52.294489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":11010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"31'55","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:56.199386+0000","last_change":"2023-11-18T21:28:56.199412+0000","last_active":"2023-11-18T21:28:56.199386+0000","last_peered":"2023-11-18T21:28:56.199386+0000","last_clean":"2023-11-18T21:28:56.199386+0000","last_became_active":"2023-11-18T20:59:27.870220+0000","last_became_peered":"2023-11-18T20:59:27.870220+0000","last_unstale":"2023-11-18T21:28:56.199386+0000","last_undegraded":"2023-11-18T21:28:56.199386+0000","last_fullsized":"2023-11-18T21:28:56.199386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'55","last_scrub_stamp":"2023-11-18T21:28:56.199297+0000","last_deep_scrub":"31'55","last_deep_scrub_stamp":"2023-11-18T21:28:56.199297+0000","last_clean_scrub_stamp":"2023-11-18T21:28:56.199297+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:51:50.633425+0000","scrub_duration":0.003736053,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"31'14","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:07.506880+0000","last_change":"2023-11-18T21:29:07.506940+0000","last_active":"2023-11-18T21:29:07.506880+0000","last_peered":"2023-11-18T21:29:07.506880+0000","last_clean":"2023-11-18T21:29:07.506880+0000","last_became_active":"2023-11-18T20:59:25.457392+0000","last_became_peered":"2023-11-18T20:59:25.457392+0000","last_unstale":"2023-11-18T21:29:07.506880+0000","last_undegraded":"2023-11-18T21:29:07.506880+0000","last_fullsized":"2023-11-18T21:29:07.506880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-11-18T21:29:07.506693+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-11-18T21:29:07.506693+0000","last_clean_scrub_stamp":"2023-11-18T21:29:07.506693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:33:54.342375+0000","scrub_duration":0.0081357319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"31'70","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:47.545927+0000","last_change":"2023-11-18T20:59:35.831579+0000","last_active":"2023-11-18T21:27:47.545927+0000","last_peered":"2023-11-18T21:27:47.545927+0000","last_clean":"2023-11-18T21:27:47.545927+0000","last_became_active":"2023-11-18T20:59:35.831147+0000","last_became_peered":"2023-11-18T20:59:35.831147+0000","last_unstale":"2023-11-18T21:27:47.545927+0000","last_undegraded":"2023-11-18T21:27:47.545927+0000","last_fullsized":"2023-11-18T21:27:47.545927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"31'58","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.132781+0000","last_change":"2023-11-18T21:29:10.132883+0000","last_active":"2023-11-18T21:29:10.132781+0000","last_peered":"2023-11-18T21:29:10.132781+0000","last_clean":"2023-11-18T21:29:10.132781+0000","last_became_active":"2023-11-18T20:59:27.894931+0000","last_became_peered":"2023-11-18T20:59:27.894931+0000","last_unstale":"2023-11-18T21:29:10.132781+0000","last_undegraded":"2023-11-18T21:29:10.132781+0000","last_fullsized":"2023-11-18T21:29:10.132781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'58","last_scrub_stamp":"2023-11-18T21:29:10.132550+0000","last_deep_scrub":"31'58","last_deep_scrub_stamp":"2023-11-18T21:29:10.132550+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.132550+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:23:05.142528+0000","scrub_duration":0.0037235850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"31'208","reported_seq":252,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:09.031548+0000","last_change":"2023-11-18T21:29:09.031667+0000","last_active":"2023-11-18T21:29:09.031548+0000","last_peered":"2023-11-18T21:29:09.031548+0000","last_clean":"2023-11-18T21:29:09.031548+0000","last_became_active":"2023-11-18T20:59:25.457932+0000","last_became_peered":"2023-11-18T20:59:25.457932+0000","last_unstale":"2023-11-18T21:29:09.031548+0000","last_undegraded":"2023-11-18T21:29:09.031548+0000","last_fullsized":"2023-11-18T21:29:09.031548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'208","last_scrub_stamp":"2023-11-18T21:29:09.031320+0000","last_deep_scrub":"31'208","last_deep_scrub_stamp":"2023-11-18T21:29:09.031320+0000","last_clean_scrub_stamp":"2023-11-18T21:29:09.031320+0000","objects_scrubbed":2,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:35:03.532991+0000","scrub_duration":0.011462553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":499,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"31'58","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:47.479881+0000","last_change":"2023-11-18T20:59:35.832209+0000","last_active":"2023-11-18T21:27:47.479881+0000","last_peered":"2023-11-18T21:27:47.479881+0000","last_clean":"2023-11-18T21:27:47.479881+0000","last_became_active":"2023-11-18T20:59:35.831804+0000","last_became_peered":"2023-11-18T20:59:35.831804+0000","last_unstale":"2023-11-18T21:27:47.479881+0000","last_undegraded":"2023-11-18T21:27:47.479881+0000","last_fullsized":"2023-11-18T21:27:47.479881+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":9539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'55","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.664273+0000","last_change":"2023-11-18T20:59:27.884733+0000","last_active":"2023-11-18T21:28:43.664273+0000","last_peered":"2023-11-18T21:28:43.664273+0000","last_clean":"2023-11-18T21:28:43.664273+0000","last_became_active":"2023-11-18T20:59:27.884143+0000","last_became_peered":"2023-11-18T20:59:27.884143+0000","last_unstale":"2023-11-18T21:28:43.664273+0000","last_undegraded":"2023-11-18T21:28:43.664273+0000","last_fullsized":"2023-11-18T21:28:43.664273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"31'155","reported_seq":198,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.403625+0000","last_change":"2023-11-18T21:29:10.403695+0000","last_active":"2023-11-18T21:29:10.403625+0000","last_peered":"2023-11-18T21:29:10.403625+0000","last_clean":"2023-11-18T21:29:10.403625+0000","last_became_active":"2023-11-18T20:59:25.362350+0000","last_became_peered":"2023-11-18T20:59:25.362350+0000","last_unstale":"2023-11-18T21:29:10.403625+0000","last_undegraded":"2023-11-18T21:29:10.403625+0000","last_fullsized":"2023-11-18T21:29:10.403625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'155","last_scrub_stamp":"2023-11-18T21:29:10.403422+0000","last_deep_scrub":"31'155","last_deep_scrub_stamp":"2023-11-18T21:29:10.403422+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.403422+0000","objects_scrubbed":8,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:31:46.910785+0000","scrub_duration":0.016723597999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"31'80","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:37.496357+0000","last_change":"2023-11-18T20:59:35.836797+0000","last_active":"2023-11-18T21:28:37.496357+0000","last_peered":"2023-11-18T21:28:37.496357+0000","last_clean":"2023-11-18T21:28:37.496357+0000","last_became_active":"2023-11-18T20:59:35.834153+0000","last_became_peered":"2023-11-18T20:59:35.834153+0000","last_unstale":"2023-11-18T21:28:37.496357+0000","last_undegraded":"2023-11-18T21:28:37.496357+0000","last_fullsized":"2023-11-18T21:28:37.496357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'47","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:05.922625+0000","last_change":"2023-11-18T21:29:05.922677+0000","last_active":"2023-11-18T21:29:05.922625+0000","last_peered":"2023-11-18T21:29:05.922625+0000","last_clean":"2023-11-18T21:29:05.922625+0000","last_became_active":"2023-11-18T20:59:27.840852+0000","last_became_peered":"2023-11-18T20:59:27.840852+0000","last_unstale":"2023-11-18T21:29:05.922625+0000","last_undegraded":"2023-11-18T21:29:05.922625+0000","last_fullsized":"2023-11-18T21:29:05.922625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-11-18T21:29:05.922425+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-11-18T21:29:05.922425+0000","last_clean_scrub_stamp":"2023-11-18T21:29:05.922425+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:01:12.622028+0000","scrub_duration":0.004098544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"31'842","reported_seq":885,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:08.033951+0000","last_change":"2023-11-18T21:29:08.034015+0000","last_active":"2023-11-18T21:29:08.033951+0000","last_peered":"2023-11-18T21:29:08.033951+0000","last_clean":"2023-11-18T21:29:08.033951+0000","last_became_active":"2023-11-18T20:59:25.351149+0000","last_became_peered":"2023-11-18T20:59:25.351149+0000","last_unstale":"2023-11-18T21:29:08.033951+0000","last_undegraded":"2023-11-18T21:29:08.033951+0000","last_fullsized":"2023-11-18T21:29:08.033951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'842","last_scrub_stamp":"2023-11-18T21:29:08.033755+0000","last_deep_scrub":"31'842","last_deep_scrub_stamp":"2023-11-18T21:29:08.033755+0000","last_clean_scrub_stamp":"2023-11-18T21:29:08.033755+0000","objects_scrubbed":3,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:37:31.925547+0000","scrub_duration":0.027073499000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3704571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":4031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"31'77","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:37.496469+0000","last_change":"2023-11-18T20:59:35.844046+0000","last_active":"2023-11-18T21:28:37.496469+0000","last_peered":"2023-11-18T21:28:37.496469+0000","last_clean":"2023-11-18T21:28:37.496469+0000","last_became_active":"2023-11-18T20:59:35.843208+0000","last_became_peered":"2023-11-18T20:59:35.843208+0000","last_unstale":"2023-11-18T21:28:37.496469+0000","last_undegraded":"2023-11-18T21:28:37.496469+0000","last_fullsized":"2023-11-18T21:28:37.496469+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":6277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'59","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:58.427612+0000","last_change":"2023-11-18T21:28:58.427716+0000","last_active":"2023-11-18T21:28:58.427612+0000","last_peered":"2023-11-18T21:28:58.427612+0000","last_clean":"2023-11-18T21:28:58.427612+0000","last_became_active":"2023-11-18T20:59:27.866233+0000","last_became_peered":"2023-11-18T20:59:27.866233+0000","last_unstale":"2023-11-18T21:28:58.427612+0000","last_undegraded":"2023-11-18T21:28:58.427612+0000","last_fullsized":"2023-11-18T21:28:58.427612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:28:58.427386+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:28:58.427386+0000","last_clean_scrub_stamp":"2023-11-18T21:28:58.427386+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:17:54.424458+0000","scrub_duration":0.002651498,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"31'93","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:32.965073+0000","last_change":"2023-11-18T20:59:25.362589+0000","last_active":"2023-11-18T21:28:32.965073+0000","last_peered":"2023-11-18T21:28:32.965073+0000","last_clean":"2023-11-18T21:28:32.965073+0000","last_became_active":"2023-11-18T20:59:25.362287+0000","last_became_peered":"2023-11-18T20:59:25.362287+0000","last_unstale":"2023-11-18T21:28:32.965073+0000","last_undegraded":"2023-11-18T21:28:32.965073+0000","last_fullsized":"2023-11-18T21:28:32.965073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"31'78","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:42.503073+0000","last_change":"2023-11-18T20:59:35.846859+0000","last_active":"2023-11-18T21:27:42.503073+0000","last_peered":"2023-11-18T21:27:42.503073+0000","last_clean":"2023-11-18T21:27:42.503073+0000","last_became_active":"2023-11-18T20:59:35.845378+0000","last_became_peered":"2023-11-18T20:59:35.845378+0000","last_unstale":"2023-11-18T21:27:42.503073+0000","last_undegraded":"2023-11-18T21:27:42.503073+0000","last_fullsized":"2023-11-18T21:27:42.503073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"31'57","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:15.247166+0000","last_change":"2023-11-18T21:29:15.247218+0000","last_active":"2023-11-18T21:29:15.247166+0000","last_peered":"2023-11-18T21:29:15.247166+0000","last_clean":"2023-11-18T21:29:15.247166+0000","last_became_active":"2023-11-18T20:59:27.863435+0000","last_became_peered":"2023-11-18T20:59:27.863435+0000","last_unstale":"2023-11-18T21:29:15.247166+0000","last_undegraded":"2023-11-18T21:29:15.247166+0000","last_fullsized":"2023-11-18T21:29:15.247166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'57","last_scrub_stamp":"2023-11-18T21:29:15.246973+0000","last_deep_scrub":"31'57","last_deep_scrub_stamp":"2023-11-18T21:29:15.246973+0000","last_clean_scrub_stamp":"2023-11-18T21:29:15.246973+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:10:06.349372+0000","scrub_duration":0.0043063679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"31'128","reported_seq":279,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:09.391461+0000","last_change":"2023-11-18T21:29:09.391544+0000","last_active":"2023-11-18T21:29:09.391461+0000","last_peered":"2023-11-18T21:29:09.391461+0000","last_clean":"2023-11-18T21:29:09.391461+0000","last_became_active":"2023-11-18T20:59:25.361313+0000","last_became_peered":"2023-11-18T20:59:25.361313+0000","last_unstale":"2023-11-18T21:29:09.391461+0000","last_undegraded":"2023-11-18T21:29:09.391461+0000","last_fullsized":"2023-11-18T21:29:09.391461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'128","last_scrub_stamp":"2023-11-18T21:29:09.391288+0000","last_deep_scrub":"31'128","last_deep_scrub_stamp":"2023-11-18T21:29:09.391288+0000","last_clean_scrub_stamp":"2023-11-18T21:29:09.391288+0000","objects_scrubbed":7,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:23:14.357002+0000","scrub_duration":0.014106417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25371,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":112,"num_write":121,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"31'82","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:37.558768+0000","last_change":"2023-11-18T20:59:35.832893+0000","last_active":"2023-11-18T21:28:37.558768+0000","last_peered":"2023-11-18T21:28:37.558768+0000","last_clean":"2023-11-18T21:28:37.558768+0000","last_became_active":"2023-11-18T20:59:35.832562+0000","last_became_peered":"2023-11-18T20:59:35.832562+0000","last_unstale":"2023-11-18T21:28:37.558768+0000","last_undegraded":"2023-11-18T21:28:37.558768+0000","last_fullsized":"2023-11-18T21:28:37.558768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":7445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'55","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:20.042056+0000","last_change":"2023-11-18T21:29:20.042114+0000","last_active":"2023-11-18T21:29:20.042056+0000","last_peered":"2023-11-18T21:29:20.042056+0000","last_clean":"2023-11-18T21:29:20.042056+0000","last_became_active":"2023-11-18T20:59:27.865971+0000","last_became_peered":"2023-11-18T20:59:27.865971+0000","last_unstale":"2023-11-18T21:29:20.042056+0000","last_undegraded":"2023-11-18T21:29:20.042056+0000","last_fullsized":"2023-11-18T21:29:20.042056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'55","last_scrub_stamp":"2023-11-18T21:29:20.041863+0000","last_deep_scrub":"31'55","last_deep_scrub_stamp":"2023-11-18T21:29:20.041863+0000","last_clean_scrub_stamp":"2023-11-18T21:29:20.041863+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:57:22.816534+0000","scrub_duration":0.0043334610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"31'1155","reported_seq":1198,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:00.190019+0000","last_change":"2023-11-18T21:29:00.190050+0000","last_active":"2023-11-18T21:29:00.190019+0000","last_peered":"2023-11-18T21:29:00.190019+0000","last_clean":"2023-11-18T21:29:00.190019+0000","last_became_active":"2023-11-18T20:59:25.349577+0000","last_became_peered":"2023-11-18T20:59:25.349577+0000","last_unstale":"2023-11-18T21:29:00.190019+0000","last_undegraded":"2023-11-18T21:29:00.190019+0000","last_fullsized":"2023-11-18T21:29:00.190019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1155","last_scrub_stamp":"2023-11-18T21:29:00.189950+0000","last_deep_scrub":"31'1155","last_deep_scrub_stamp":"2023-11-18T21:29:00.189950+0000","last_clean_scrub_stamp":"2023-11-18T21:29:00.189950+0000","objects_scrubbed":6,"log_size":1155,"log_dups_size":0,"ondisk_log_size":1155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:24:28.834089+0000","scrub_duration":0.028314013999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":4577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"31'99","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:35.331475+0000","last_change":"2023-11-18T20:59:35.849720+0000","last_active":"2023-11-18T21:27:35.331475+0000","last_peered":"2023-11-18T21:27:35.331475+0000","last_clean":"2023-11-18T21:27:35.331475+0000","last_became_active":"2023-11-18T20:59:35.848000+0000","last_became_peered":"2023-11-18T20:59:35.848000+0000","last_unstale":"2023-11-18T21:27:35.331475+0000","last_undegraded":"2023-11-18T21:27:35.331475+0000","last_fullsized":"2023-11-18T21:27:35.331475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":10947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"31'51","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.379806+0000","last_change":"2023-11-18T21:29:21.379912+0000","last_active":"2023-11-18T21:29:21.379806+0000","last_peered":"2023-11-18T21:29:21.379806+0000","last_clean":"2023-11-18T21:29:21.379806+0000","last_became_active":"2023-11-18T20:59:27.891260+0000","last_became_peered":"2023-11-18T20:59:27.891260+0000","last_unstale":"2023-11-18T21:29:21.379806+0000","last_undegraded":"2023-11-18T21:29:21.379806+0000","last_fullsized":"2023-11-18T21:29:21.379806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2023-11-18T21:29:21.379550+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2023-11-18T21:29:21.379550+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.379550+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:03:51.816695+0000","scrub_duration":0.0038841679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"31'71","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:11.342090+0000","last_change":"2023-11-18T21:29:11.342215+0000","last_active":"2023-11-18T21:29:11.342090+0000","last_peered":"2023-11-18T21:29:11.342090+0000","last_clean":"2023-11-18T21:29:11.342090+0000","last_became_active":"2023-11-18T20:59:25.363289+0000","last_became_peered":"2023-11-18T20:59:25.363289+0000","last_unstale":"2023-11-18T21:29:11.342090+0000","last_undegraded":"2023-11-18T21:29:11.342090+0000","last_fullsized":"2023-11-18T21:29:11.342090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'71","last_scrub_stamp":"2023-11-18T21:29:11.341853+0000","last_deep_scrub":"31'71","last_deep_scrub_stamp":"2023-11-18T21:29:11.341853+0000","last_clean_scrub_stamp":"2023-11-18T21:29:11.341853+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:12.433430+0000","scrub_duration":0.011087723000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"31'68","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:37.511221+0000","last_change":"2023-11-18T20:59:35.771712+0000","last_active":"2023-11-18T21:27:37.511221+0000","last_peered":"2023-11-18T21:27:37.511221+0000","last_clean":"2023-11-18T21:27:37.511221+0000","last_became_active":"2023-11-18T20:59:35.771263+0000","last_became_peered":"2023-11-18T20:59:35.771263+0000","last_unstale":"2023-11-18T21:27:37.511221+0000","last_undegraded":"2023-11-18T21:27:37.511221+0000","last_fullsized":"2023-11-18T21:27:37.511221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":272,"num_write":61,"num_write_kb":11998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"31'64","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.648390+0000","last_change":"2023-11-18T20:59:27.834172+0000","last_active":"2023-11-18T21:28:43.648390+0000","last_peered":"2023-11-18T21:28:43.648390+0000","last_clean":"2023-11-18T21:28:43.648390+0000","last_became_active":"2023-11-18T20:59:27.832589+0000","last_became_peered":"2023-11-18T20:59:27.832589+0000","last_unstale":"2023-11-18T21:28:43.648390+0000","last_undegraded":"2023-11-18T21:28:43.648390+0000","last_fullsized":"2023-11-18T21:28:43.648390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"31'119","reported_seq":271,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.002973+0000","last_change":"2023-11-18T21:29:10.003016+0000","last_active":"2023-11-18T21:29:10.002973+0000","last_peered":"2023-11-18T21:29:10.002973+0000","last_clean":"2023-11-18T21:29:10.002973+0000","last_became_active":"2023-11-18T20:59:25.493373+0000","last_became_peered":"2023-11-18T20:59:25.493373+0000","last_unstale":"2023-11-18T21:29:10.002973+0000","last_undegraded":"2023-11-18T21:29:10.002973+0000","last_fullsized":"2023-11-18T21:29:10.002973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-11-18T21:29:10.002888+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-11-18T21:29:10.002888+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.002888+0000","objects_scrubbed":3,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:52:08.702511+0000","scrub_duration":0.0088310239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20332,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":112,"num_write":115,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'93","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:20.232616+0000","last_change":"2023-11-18T21:29:20.232660+0000","last_active":"2023-11-18T21:29:20.232616+0000","last_peered":"2023-11-18T21:29:20.232616+0000","last_clean":"2023-11-18T21:29:20.232616+0000","last_became_active":"2023-11-18T20:59:35.772563+0000","last_became_peered":"2023-11-18T20:59:35.772563+0000","last_unstale":"2023-11-18T21:29:20.232616+0000","last_undegraded":"2023-11-18T21:29:20.232616+0000","last_fullsized":"2023-11-18T21:29:20.232616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'93","last_scrub_stamp":"2023-11-18T21:29:20.232464+0000","last_deep_scrub":"31'93","last_deep_scrub_stamp":"2023-11-18T21:29:20.232464+0000","last_clean_scrub_stamp":"2023-11-18T21:29:20.232464+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:47:01.640494+0000","scrub_duration":0.01013846,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":9621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'57","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:13.159776+0000","last_change":"2023-11-18T21:29:13.159830+0000","last_active":"2023-11-18T21:29:13.159776+0000","last_peered":"2023-11-18T21:29:13.159776+0000","last_clean":"2023-11-18T21:29:13.159776+0000","last_became_active":"2023-11-18T20:59:27.891883+0000","last_became_peered":"2023-11-18T20:59:27.891883+0000","last_unstale":"2023-11-18T21:29:13.159776+0000","last_undegraded":"2023-11-18T21:29:13.159776+0000","last_fullsized":"2023-11-18T21:29:13.159776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'57","last_scrub_stamp":"2023-11-18T21:29:13.159570+0000","last_deep_scrub":"31'57","last_deep_scrub_stamp":"2023-11-18T21:29:13.159570+0000","last_clean_scrub_stamp":"2023-11-18T21:29:13.159570+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:07.593699+0000","scrub_duration":0.0038753820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"31'159","reported_seq":202,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:57.910143+0000","last_change":"2023-11-18T21:28:57.910171+0000","last_active":"2023-11-18T21:28:57.910143+0000","last_peered":"2023-11-18T21:28:57.910143+0000","last_clean":"2023-11-18T21:28:57.910143+0000","last_became_active":"2023-11-18T20:59:25.496680+0000","last_became_peered":"2023-11-18T20:59:25.496680+0000","last_unstale":"2023-11-18T21:28:57.910143+0000","last_undegraded":"2023-11-18T21:28:57.910143+0000","last_fullsized":"2023-11-18T21:28:57.910143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'159","last_scrub_stamp":"2023-11-18T21:28:57.910062+0000","last_deep_scrub":"31'159","last_deep_scrub_stamp":"2023-11-18T21:28:57.910062+0000","last_clean_scrub_stamp":"2023-11-18T21:28:57.910062+0000","objects_scrubbed":3,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:17.803669+0000","scrub_duration":0.0065099140000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"31'67","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:35.331403+0000","last_change":"2023-11-18T20:59:35.842258+0000","last_active":"2023-11-18T21:27:35.331403+0000","last_peered":"2023-11-18T21:27:35.331403+0000","last_clean":"2023-11-18T21:27:35.331403+0000","last_became_active":"2023-11-18T20:59:35.838830+0000","last_became_peered":"2023-11-18T20:59:35.838830+0000","last_unstale":"2023-11-18T21:27:35.331403+0000","last_undegraded":"2023-11-18T21:27:35.331403+0000","last_fullsized":"2023-11-18T21:27:35.331403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":8132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"31'63","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:40.333019+0000","last_change":"2023-11-18T20:59:35.839178+0000","last_active":"2023-11-18T21:27:40.333019+0000","last_peered":"2023-11-18T21:27:40.333019+0000","last_clean":"2023-11-18T21:27:40.333019+0000","last_became_active":"2023-11-18T20:59:35.838375+0000","last_became_peered":"2023-11-18T20:59:35.838375+0000","last_unstale":"2023-11-18T21:27:40.333019+0000","last_undegraded":"2023-11-18T21:27:40.333019+0000","last_fullsized":"2023-11-18T21:27:40.333019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"31'61","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:18.243224+0000","last_change":"2023-11-18T21:29:18.243275+0000","last_active":"2023-11-18T21:29:18.243224+0000","last_peered":"2023-11-18T21:29:18.243224+0000","last_clean":"2023-11-18T21:29:18.243224+0000","last_became_active":"2023-11-18T20:59:27.688522+0000","last_became_peered":"2023-11-18T20:59:27.688522+0000","last_unstale":"2023-11-18T21:29:18.243224+0000","last_undegraded":"2023-11-18T21:29:18.243224+0000","last_fullsized":"2023-11-18T21:29:18.243224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'61","last_scrub_stamp":"2023-11-18T21:29:18.243035+0000","last_deep_scrub":"31'61","last_deep_scrub_stamp":"2023-11-18T21:29:18.243035+0000","last_clean_scrub_stamp":"2023-11-18T21:29:18.243035+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:55.389095+0000","scrub_duration":0.00420858,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"31'7","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:27.557055+0000","last_change":"2023-11-18T20:59:25.494125+0000","last_active":"2023-11-18T21:28:27.557055+0000","last_peered":"2023-11-18T21:28:27.557055+0000","last_clean":"2023-11-18T21:28:27.557055+0000","last_became_active":"2023-11-18T20:59:25.493357+0000","last_became_peered":"2023-11-18T20:59:25.493357+0000","last_unstale":"2023-11-18T21:28:27.557055+0000","last_undegraded":"2023-11-18T21:28:27.557055+0000","last_fullsized":"2023-11-18T21:28:27.557055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'97","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:47.353961+0000","last_change":"2023-11-18T20:59:35.776653+0000","last_active":"2023-11-18T21:28:47.353961+0000","last_peered":"2023-11-18T21:28:47.353961+0000","last_clean":"2023-11-18T21:28:47.353961+0000","last_became_active":"2023-11-18T20:59:35.776138+0000","last_became_peered":"2023-11-18T20:59:35.776138+0000","last_unstale":"2023-11-18T21:28:47.353961+0000","last_undegraded":"2023-11-18T21:28:47.353961+0000","last_fullsized":"2023-11-18T21:28:47.353961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'54","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:00.665722+0000","last_change":"2023-11-18T21:29:00.665764+0000","last_active":"2023-11-18T21:29:00.665722+0000","last_peered":"2023-11-18T21:29:00.665722+0000","last_clean":"2023-11-18T21:29:00.665722+0000","last_became_active":"2023-11-18T20:59:27.860537+0000","last_became_peered":"2023-11-18T20:59:27.860537+0000","last_unstale":"2023-11-18T21:29:00.665722+0000","last_undegraded":"2023-11-18T21:29:00.665722+0000","last_fullsized":"2023-11-18T21:29:00.665722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-11-18T21:29:00.665560+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-11-18T21:29:00.665560+0000","last_clean_scrub_stamp":"2023-11-18T21:29:00.665560+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:11:31.387422+0000","scrub_duration":0.0036286529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"31'231","reported_seq":497,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:03.310448+0000","last_change":"2023-11-18T21:29:03.310510+0000","last_active":"2023-11-18T21:29:03.310448+0000","last_peered":"2023-11-18T21:29:03.310448+0000","last_clean":"2023-11-18T21:29:03.310448+0000","last_became_active":"2023-11-18T20:59:25.354690+0000","last_became_peered":"2023-11-18T20:59:25.354690+0000","last_unstale":"2023-11-18T21:29:03.310448+0000","last_undegraded":"2023-11-18T21:29:03.310448+0000","last_fullsized":"2023-11-18T21:29:03.310448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'231","last_scrub_stamp":"2023-11-18T21:29:03.310260+0000","last_deep_scrub":"31'231","last_deep_scrub_stamp":"2023-11-18T21:29:03.310260+0000","last_clean_scrub_stamp":"2023-11-18T21:29:03.310260+0000","objects_scrubbed":3,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:11:13.929892+0000","scrub_duration":0.0098773730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34720,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":223,"num_read_kb":227,"num_write":228,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"31'175","reported_seq":371,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:33.250188+0000","last_change":"2023-11-18T20:59:25.346493+0000","last_active":"2023-11-18T21:28:33.250188+0000","last_peered":"2023-11-18T21:28:33.250188+0000","last_clean":"2023-11-18T21:28:33.250188+0000","last_became_active":"2023-11-18T20:59:25.346192+0000","last_became_peered":"2023-11-18T20:59:25.346192+0000","last_unstale":"2023-11-18T21:28:33.250188+0000","last_undegraded":"2023-11-18T21:28:33.250188+0000","last_fullsized":"2023-11-18T21:28:33.250188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:23.603046+0000","last_clean_scrub_stamp":"2023-11-18T20:59:23.603046+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":165,"num_write":171,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'63","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:00.370600+0000","last_change":"2023-11-18T21:29:00.370654+0000","last_active":"2023-11-18T21:29:00.370600+0000","last_peered":"2023-11-18T21:29:00.370600+0000","last_clean":"2023-11-18T21:29:00.370600+0000","last_became_active":"2023-11-18T20:59:27.867886+0000","last_became_peered":"2023-11-18T20:59:27.867886+0000","last_unstale":"2023-11-18T21:29:00.370600+0000","last_undegraded":"2023-11-18T21:29:00.370600+0000","last_fullsized":"2023-11-18T21:29:00.370600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:00.370401+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:00.370401+0000","last_clean_scrub_stamp":"2023-11-18T21:29:00.370401+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:00:07.902842+0000","scrub_duration":0.0051850940000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'95","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.106820+0000","last_change":"2023-11-18T20:59:35.851163+0000","last_active":"2023-11-18T21:27:28.106820+0000","last_peered":"2023-11-18T21:27:28.106820+0000","last_clean":"2023-11-18T21:27:28.106820+0000","last_became_active":"2023-11-18T20:59:35.850427+0000","last_became_peered":"2023-11-18T20:59:35.850427+0000","last_unstale":"2023-11-18T21:27:28.106820+0000","last_undegraded":"2023-11-18T21:27:28.106820+0000","last_fullsized":"2023-11-18T21:27:28.106820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2347","reported_seq":2389,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:14.533157+0000","last_change":"2023-11-18T21:29:14.533218+0000","last_active":"2023-11-18T21:29:14.533157+0000","last_peered":"2023-11-18T21:29:14.533157+0000","last_clean":"2023-11-18T21:29:14.533157+0000","last_became_active":"2023-11-18T20:59:25.460449+0000","last_became_peered":"2023-11-18T20:59:25.460449+0000","last_unstale":"2023-11-18T21:29:14.533157+0000","last_undegraded":"2023-11-18T21:29:14.533157+0000","last_fullsized":"2023-11-18T21:29:14.533157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2347","last_scrub_stamp":"2023-11-18T21:29:14.532977+0000","last_deep_scrub":"31'2347","last_deep_scrub_stamp":"2023-11-18T21:29:14.532977+0000","last_clean_scrub_stamp":"2023-11-18T21:29:14.532977+0000","objects_scrubbed":4,"log_size":2347,"log_dups_size":0,"ondisk_log_size":2347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:11:42.664738+0000","scrub_duration":0.056368952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8759326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2333,"num_write_kb":9750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"31'69","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:16.019014+0000","last_change":"2023-11-18T21:29:16.019065+0000","last_active":"2023-11-18T21:29:16.019014+0000","last_peered":"2023-11-18T21:29:16.019014+0000","last_clean":"2023-11-18T21:29:16.019014+0000","last_became_active":"2023-11-18T20:59:27.840528+0000","last_became_peered":"2023-11-18T20:59:27.840528+0000","last_unstale":"2023-11-18T21:29:16.019014+0000","last_undegraded":"2023-11-18T21:29:16.019014+0000","last_fullsized":"2023-11-18T21:29:16.019014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'69","last_scrub_stamp":"2023-11-18T21:29:16.018825+0000","last_deep_scrub":"31'69","last_deep_scrub_stamp":"2023-11-18T21:29:16.018825+0000","last_clean_scrub_stamp":"2023-11-18T21:29:16.018825+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:40.995064+0000","scrub_duration":0.0034129389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"31'65","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:28.131718+0000","last_change":"2023-11-18T20:59:35.776844+0000","last_active":"2023-11-18T21:27:28.131718+0000","last_peered":"2023-11-18T21:27:28.131718+0000","last_clean":"2023-11-18T21:27:28.131718+0000","last_became_active":"2023-11-18T20:59:35.775977+0000","last_became_peered":"2023-11-18T20:59:35.775977+0000","last_unstale":"2023-11-18T21:27:28.131718+0000","last_undegraded":"2023-11-18T21:27:28.131718+0000","last_fullsized":"2023-11-18T21:27:28.131718+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"31'59","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:06.116859+0000","last_change":"2023-11-18T21:29:06.116910+0000","last_active":"2023-11-18T21:29:06.116859+0000","last_peered":"2023-11-18T21:29:06.116859+0000","last_clean":"2023-11-18T21:29:06.116859+0000","last_became_active":"2023-11-18T20:59:27.887716+0000","last_became_peered":"2023-11-18T20:59:27.887716+0000","last_unstale":"2023-11-18T21:29:06.116859+0000","last_undegraded":"2023-11-18T21:29:06.116859+0000","last_fullsized":"2023-11-18T21:29:06.116859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:29:06.116671+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:29:06.116671+0000","last_clean_scrub_stamp":"2023-11-18T21:29:06.116671+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:30:14.804753+0000","scrub_duration":0.0043744070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"31'67","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:13.326825+0000","last_change":"2023-11-18T21:29:13.326866+0000","last_active":"2023-11-18T21:29:13.326825+0000","last_peered":"2023-11-18T21:29:13.326825+0000","last_clean":"2023-11-18T21:29:13.326825+0000","last_became_active":"2023-11-18T20:59:27.680712+0000","last_became_peered":"2023-11-18T20:59:27.680712+0000","last_unstale":"2023-11-18T21:29:13.326825+0000","last_undegraded":"2023-11-18T21:29:13.326825+0000","last_fullsized":"2023-11-18T21:29:13.326825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'67","last_scrub_stamp":"2023-11-18T21:29:13.326649+0000","last_deep_scrub":"31'67","last_deep_scrub_stamp":"2023-11-18T21:29:13.326649+0000","last_clean_scrub_stamp":"2023-11-18T21:29:13.326649+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:24:41.970789+0000","scrub_duration":0.0032687520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"31'57","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.582692+0000","last_change":"2023-11-18T21:29:04.582839+0000","last_active":"2023-11-18T21:29:04.582692+0000","last_peered":"2023-11-18T21:29:04.582692+0000","last_clean":"2023-11-18T21:29:04.582692+0000","last_became_active":"2023-11-18T20:59:27.835120+0000","last_became_peered":"2023-11-18T20:59:27.835120+0000","last_unstale":"2023-11-18T21:29:04.582692+0000","last_undegraded":"2023-11-18T21:29:04.582692+0000","last_fullsized":"2023-11-18T21:29:04.582692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'57","last_scrub_stamp":"2023-11-18T21:29:04.582340+0000","last_deep_scrub":"31'57","last_deep_scrub_stamp":"2023-11-18T21:29:04.582340+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.582340+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:59:50.451724+0000","scrub_duration":0.0037119219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"31'59","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.454897+0000","last_change":"2023-11-18T21:29:21.454950+0000","last_active":"2023-11-18T21:29:21.454897+0000","last_peered":"2023-11-18T21:29:21.454897+0000","last_clean":"2023-11-18T21:29:21.454897+0000","last_became_active":"2023-11-18T20:59:27.833049+0000","last_became_peered":"2023-11-18T20:59:27.833049+0000","last_unstale":"2023-11-18T21:29:21.454897+0000","last_undegraded":"2023-11-18T21:29:21.454897+0000","last_fullsized":"2023-11-18T21:29:21.454897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:29:21.454712+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:29:21.454712+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.454712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:47:46.800202+0000","scrub_duration":0.0049077629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"31'40","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.654977+0000","last_change":"2023-11-18T20:59:27.878824+0000","last_active":"2023-11-18T21:28:43.654977+0000","last_peered":"2023-11-18T21:28:43.654977+0000","last_clean":"2023-11-18T21:28:43.654977+0000","last_became_active":"2023-11-18T20:59:27.878353+0000","last_became_peered":"2023-11-18T20:59:27.878353+0000","last_unstale":"2023-11-18T21:28:43.654977+0000","last_undegraded":"2023-11-18T21:28:43.654977+0000","last_fullsized":"2023-11-18T21:28:43.654977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'50","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:13.172428+0000","last_change":"2023-11-18T21:29:13.172491+0000","last_active":"2023-11-18T21:29:13.172428+0000","last_peered":"2023-11-18T21:29:13.172428+0000","last_clean":"2023-11-18T21:29:13.172428+0000","last_became_active":"2023-11-18T20:59:27.866165+0000","last_became_peered":"2023-11-18T20:59:27.866165+0000","last_unstale":"2023-11-18T21:29:13.172428+0000","last_undegraded":"2023-11-18T21:29:13.172428+0000","last_fullsized":"2023-11-18T21:29:13.172428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'50","last_scrub_stamp":"2023-11-18T21:29:13.172214+0000","last_deep_scrub":"31'50","last_deep_scrub_stamp":"2023-11-18T21:29:13.172214+0000","last_clean_scrub_stamp":"2023-11-18T21:29:13.172214+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:07.606343+0000","scrub_duration":0.0036780150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"31'55","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:17.154740+0000","last_change":"2023-11-18T21:29:17.154844+0000","last_active":"2023-11-18T21:29:17.154740+0000","last_peered":"2023-11-18T21:29:17.154740+0000","last_clean":"2023-11-18T21:29:17.154740+0000","last_became_active":"2023-11-18T20:59:27.893918+0000","last_became_peered":"2023-11-18T20:59:27.893918+0000","last_unstale":"2023-11-18T21:29:17.154740+0000","last_undegraded":"2023-11-18T21:29:17.154740+0000","last_fullsized":"2023-11-18T21:29:17.154740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'55","last_scrub_stamp":"2023-11-18T21:29:17.154505+0000","last_deep_scrub":"31'55","last_deep_scrub_stamp":"2023-11-18T21:29:17.154505+0000","last_clean_scrub_stamp":"2023-11-18T21:29:17.154505+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:11:47.876366+0000","scrub_duration":0.0043464080000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"31'49","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.630965+0000","last_change":"2023-11-18T20:59:27.839127+0000","last_active":"2023-11-18T21:28:43.630965+0000","last_peered":"2023-11-18T21:28:43.630965+0000","last_clean":"2023-11-18T21:28:43.630965+0000","last_became_active":"2023-11-18T20:59:27.838509+0000","last_became_peered":"2023-11-18T20:59:27.838509+0000","last_unstale":"2023-11-18T21:28:43.630965+0000","last_undegraded":"2023-11-18T21:28:43.630965+0000","last_fullsized":"2023-11-18T21:28:43.630965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"31'60","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.628865+0000","last_change":"2023-11-18T20:59:27.836167+0000","last_active":"2023-11-18T21:28:43.628865+0000","last_peered":"2023-11-18T21:28:43.628865+0000","last_clean":"2023-11-18T21:28:43.628865+0000","last_became_active":"2023-11-18T20:59:27.835226+0000","last_became_peered":"2023-11-18T20:59:27.835226+0000","last_unstale":"2023-11-18T21:28:43.628865+0000","last_undegraded":"2023-11-18T21:28:43.628865+0000","last_fullsized":"2023-11-18T21:28:43.628865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'73","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:17.463973+0000","last_change":"2023-11-18T21:29:17.463992+0000","last_active":"2023-11-18T21:29:17.463973+0000","last_peered":"2023-11-18T21:29:17.463973+0000","last_clean":"2023-11-18T21:29:17.463973+0000","last_became_active":"2023-11-18T20:59:27.889325+0000","last_became_peered":"2023-11-18T20:59:27.889325+0000","last_unstale":"2023-11-18T21:29:17.463973+0000","last_undegraded":"2023-11-18T21:29:17.463973+0000","last_fullsized":"2023-11-18T21:29:17.463973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2023-11-18T21:29:17.463894+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2023-11-18T21:29:17.463894+0000","last_clean_scrub_stamp":"2023-11-18T21:29:17.463894+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:46.668018+0000","scrub_duration":0.0034258880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"31'63","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:09.876728+0000","last_change":"2023-11-18T21:29:09.876832+0000","last_active":"2023-11-18T21:29:09.876728+0000","last_peered":"2023-11-18T21:29:09.876728+0000","last_clean":"2023-11-18T21:29:09.876728+0000","last_became_active":"2023-11-18T20:59:27.866609+0000","last_became_peered":"2023-11-18T20:59:27.866609+0000","last_unstale":"2023-11-18T21:29:09.876728+0000","last_undegraded":"2023-11-18T21:29:09.876728+0000","last_fullsized":"2023-11-18T21:29:09.876728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:09.876438+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:09.876438+0000","last_clean_scrub_stamp":"2023-11-18T21:29:09.876438+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:54:07.883741+0000","scrub_duration":0.0036686549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'64","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:45.159912+0000","last_change":"2023-11-18T20:59:27.883416+0000","last_active":"2023-11-18T21:28:45.159912+0000","last_peered":"2023-11-18T21:28:45.159912+0000","last_clean":"2023-11-18T21:28:45.159912+0000","last_became_active":"2023-11-18T20:59:27.882976+0000","last_became_peered":"2023-11-18T20:59:27.882976+0000","last_unstale":"2023-11-18T21:28:45.159912+0000","last_undegraded":"2023-11-18T21:28:45.159912+0000","last_fullsized":"2023-11-18T21:28:45.159912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"31'51","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.679236+0000","last_change":"2023-11-18T20:59:27.873520+0000","last_active":"2023-11-18T21:28:43.679236+0000","last_peered":"2023-11-18T21:28:43.679236+0000","last_clean":"2023-11-18T21:28:43.679236+0000","last_became_active":"2023-11-18T20:59:27.872627+0000","last_became_peered":"2023-11-18T20:59:27.872627+0000","last_unstale":"2023-11-18T21:28:43.679236+0000","last_undegraded":"2023-11-18T21:28:43.679236+0000","last_fullsized":"2023-11-18T21:28:43.679236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"31'60","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:52.354989+0000","last_change":"2023-11-18T20:59:27.687118+0000","last_active":"2023-11-18T21:28:52.354989+0000","last_peered":"2023-11-18T21:28:52.354989+0000","last_clean":"2023-11-18T21:28:52.354989+0000","last_became_active":"2023-11-18T20:59:27.686311+0000","last_became_peered":"2023-11-18T20:59:27.686311+0000","last_unstale":"2023-11-18T21:28:52.354989+0000","last_undegraded":"2023-11-18T21:28:52.354989+0000","last_fullsized":"2023-11-18T21:28:52.354989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'65","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:16.293918+0000","last_change":"2023-11-18T21:29:16.293970+0000","last_active":"2023-11-18T21:29:16.293918+0000","last_peered":"2023-11-18T21:29:16.293918+0000","last_clean":"2023-11-18T21:29:16.293918+0000","last_became_active":"2023-11-18T20:59:27.891767+0000","last_became_peered":"2023-11-18T20:59:27.891767+0000","last_unstale":"2023-11-18T21:29:16.293918+0000","last_undegraded":"2023-11-18T21:29:16.293918+0000","last_fullsized":"2023-11-18T21:29:16.293918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'65","last_scrub_stamp":"2023-11-18T21:29:16.293729+0000","last_deep_scrub":"31'65","last_deep_scrub_stamp":"2023-11-18T21:29:16.293729+0000","last_clean_scrub_stamp":"2023-11-18T21:29:16.293729+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:14.707891+0000","scrub_duration":0.0040253770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"31'51","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:02.549989+0000","last_change":"2023-11-18T21:29:02.550040+0000","last_active":"2023-11-18T21:29:02.549989+0000","last_peered":"2023-11-18T21:29:02.549989+0000","last_clean":"2023-11-18T21:29:02.549989+0000","last_became_active":"2023-11-18T20:59:27.866153+0000","last_became_peered":"2023-11-18T20:59:27.866153+0000","last_unstale":"2023-11-18T21:29:02.549989+0000","last_undegraded":"2023-11-18T21:29:02.549989+0000","last_fullsized":"2023-11-18T21:29:02.549989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2023-11-18T21:29:02.549808+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2023-11-18T21:29:02.549808+0000","last_clean_scrub_stamp":"2023-11-18T21:29:02.549808+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:40:23.065850+0000","scrub_duration":0.0075603520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'60","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:14.476356+0000","last_change":"2023-11-18T21:29:14.476409+0000","last_active":"2023-11-18T21:29:14.476356+0000","last_peered":"2023-11-18T21:29:14.476356+0000","last_clean":"2023-11-18T21:29:14.476356+0000","last_became_active":"2023-11-18T20:59:27.889704+0000","last_became_peered":"2023-11-18T20:59:27.889704+0000","last_unstale":"2023-11-18T21:29:14.476356+0000","last_undegraded":"2023-11-18T21:29:14.476356+0000","last_fullsized":"2023-11-18T21:29:14.476356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'60","last_scrub_stamp":"2023-11-18T21:29:14.476160+0000","last_deep_scrub":"31'60","last_deep_scrub_stamp":"2023-11-18T21:29:14.476160+0000","last_clean_scrub_stamp":"2023-11-18T21:29:14.476160+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:24.226769+0000","scrub_duration":0.0034077449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"31'63","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.670884+0000","last_change":"2023-11-18T20:59:27.871794+0000","last_active":"2023-11-18T21:28:43.670884+0000","last_peered":"2023-11-18T21:28:43.670884+0000","last_clean":"2023-11-18T21:28:43.670884+0000","last_became_active":"2023-11-18T20:59:27.871337+0000","last_became_peered":"2023-11-18T20:59:27.871337+0000","last_unstale":"2023-11-18T21:28:43.670884+0000","last_undegraded":"2023-11-18T21:28:43.670884+0000","last_fullsized":"2023-11-18T21:28:43.670884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"31'53","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.326477+0000","last_change":"2023-11-18T21:29:21.326574+0000","last_active":"2023-11-18T21:29:21.326477+0000","last_peered":"2023-11-18T21:29:21.326477+0000","last_clean":"2023-11-18T21:29:21.326477+0000","last_became_active":"2023-11-18T20:59:27.866560+0000","last_became_peered":"2023-11-18T20:59:27.866560+0000","last_unstale":"2023-11-18T21:29:21.326477+0000","last_undegraded":"2023-11-18T21:29:21.326477+0000","last_fullsized":"2023-11-18T21:29:21.326477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2023-11-18T21:29:21.326191+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2023-11-18T21:29:21.326191+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.326191+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:43:08.584061+0000","scrub_duration":0.0036324149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"31'52","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.669486+0000","last_change":"2023-11-18T20:59:27.878944+0000","last_active":"2023-11-18T21:28:43.669486+0000","last_peered":"2023-11-18T21:28:43.669486+0000","last_clean":"2023-11-18T21:28:43.669486+0000","last_became_active":"2023-11-18T20:59:27.878485+0000","last_became_peered":"2023-11-18T20:59:27.878485+0000","last_unstale":"2023-11-18T21:28:43.669486+0000","last_undegraded":"2023-11-18T21:28:43.669486+0000","last_fullsized":"2023-11-18T21:28:43.669486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"31'53","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.679159+0000","last_change":"2023-11-18T20:59:27.874019+0000","last_active":"2023-11-18T21:28:43.679159+0000","last_peered":"2023-11-18T21:28:43.679159+0000","last_clean":"2023-11-18T21:28:43.679159+0000","last_became_active":"2023-11-18T20:59:27.873255+0000","last_became_peered":"2023-11-18T20:59:27.873255+0000","last_unstale":"2023-11-18T21:28:43.679159+0000","last_undegraded":"2023-11-18T21:28:43.679159+0000","last_fullsized":"2023-11-18T21:28:43.679159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"31'53","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.677600+0000","last_change":"2023-11-18T20:59:27.868086+0000","last_active":"2023-11-18T21:28:43.677600+0000","last_peered":"2023-11-18T21:28:43.677600+0000","last_clean":"2023-11-18T21:28:43.677600+0000","last_became_active":"2023-11-18T20:59:27.866901+0000","last_became_peered":"2023-11-18T20:59:27.866901+0000","last_unstale":"2023-11-18T21:28:43.677600+0000","last_undegraded":"2023-11-18T21:28:43.677600+0000","last_fullsized":"2023-11-18T21:28:43.677600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"31'59","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:16.986904+0000","last_change":"2023-11-18T21:29:16.986958+0000","last_active":"2023-11-18T21:29:16.986904+0000","last_peered":"2023-11-18T21:29:16.986904+0000","last_clean":"2023-11-18T21:29:16.986904+0000","last_became_active":"2023-11-18T20:59:27.888068+0000","last_became_peered":"2023-11-18T20:59:27.888068+0000","last_unstale":"2023-11-18T21:29:16.986904+0000","last_undegraded":"2023-11-18T21:29:16.986904+0000","last_fullsized":"2023-11-18T21:29:16.986904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:29:16.986691+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:29:16.986691+0000","last_clean_scrub_stamp":"2023-11-18T21:29:16.986691+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:37.454968+0000","scrub_duration":0.0038750759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"31'46","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.156428+0000","last_change":"2023-11-18T21:29:21.156480+0000","last_active":"2023-11-18T21:29:21.156428+0000","last_peered":"2023-11-18T21:29:21.156428+0000","last_clean":"2023-11-18T21:29:21.156428+0000","last_became_active":"2023-11-18T20:59:27.682936+0000","last_became_peered":"2023-11-18T20:59:27.682936+0000","last_unstale":"2023-11-18T21:29:21.156428+0000","last_undegraded":"2023-11-18T21:29:21.156428+0000","last_fullsized":"2023-11-18T21:29:21.156428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-11-18T21:29:21.156224+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-11-18T21:29:21.156224+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.156224+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:45.036534+0000","scrub_duration":0.0072266860000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"31'66","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.675757+0000","last_change":"2023-11-18T20:59:27.865937+0000","last_active":"2023-11-18T21:28:43.675757+0000","last_peered":"2023-11-18T21:28:43.675757+0000","last_clean":"2023-11-18T21:28:43.675757+0000","last_became_active":"2023-11-18T20:59:27.865401+0000","last_became_peered":"2023-11-18T20:59:27.865401+0000","last_unstale":"2023-11-18T21:28:43.675757+0000","last_undegraded":"2023-11-18T21:28:43.675757+0000","last_fullsized":"2023-11-18T21:28:43.675757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"31'51","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:59.113329+0000","last_change":"2023-11-18T21:28:59.113381+0000","last_active":"2023-11-18T21:28:59.113329+0000","last_peered":"2023-11-18T21:28:59.113329+0000","last_clean":"2023-11-18T21:28:59.113329+0000","last_became_active":"2023-11-18T20:59:27.864956+0000","last_became_peered":"2023-11-18T20:59:27.864956+0000","last_unstale":"2023-11-18T21:28:59.113329+0000","last_undegraded":"2023-11-18T21:28:59.113329+0000","last_fullsized":"2023-11-18T21:28:59.113329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2023-11-18T21:28:59.113103+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2023-11-18T21:28:59.113103+0000","last_clean_scrub_stamp":"2023-11-18T21:28:59.113103+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:50.215502+0000","scrub_duration":0.0040903290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"31'38","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:05.149433+0000","last_change":"2023-11-18T21:29:05.149488+0000","last_active":"2023-11-18T21:29:05.149433+0000","last_peered":"2023-11-18T21:29:05.149433+0000","last_clean":"2023-11-18T21:29:05.149433+0000","last_became_active":"2023-11-18T20:59:27.889307+0000","last_became_peered":"2023-11-18T20:59:27.889307+0000","last_unstale":"2023-11-18T21:29:05.149433+0000","last_undegraded":"2023-11-18T21:29:05.149433+0000","last_fullsized":"2023-11-18T21:29:05.149433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2023-11-18T21:29:05.149232+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2023-11-18T21:29:05.149232+0000","last_clean_scrub_stamp":"2023-11-18T21:29:05.149232+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:03.563394+0000","scrub_duration":0.0040852270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'47","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:18.032968+0000","last_change":"2023-11-18T21:29:18.033021+0000","last_active":"2023-11-18T21:29:18.032968+0000","last_peered":"2023-11-18T21:29:18.032968+0000","last_clean":"2023-11-18T21:29:18.032968+0000","last_became_active":"2023-11-18T20:59:27.865625+0000","last_became_peered":"2023-11-18T20:59:27.865625+0000","last_unstale":"2023-11-18T21:29:18.032968+0000","last_undegraded":"2023-11-18T21:29:18.032968+0000","last_fullsized":"2023-11-18T21:29:18.032968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-11-18T21:29:18.032773+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-11-18T21:29:18.032773+0000","last_clean_scrub_stamp":"2023-11-18T21:29:18.032773+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:47.236897+0000","scrub_duration":0.004443911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"31'54","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:14.138510+0000","last_change":"2023-11-18T21:29:14.138618+0000","last_active":"2023-11-18T21:29:14.138510+0000","last_peered":"2023-11-18T21:29:14.138510+0000","last_clean":"2023-11-18T21:29:14.138510+0000","last_became_active":"2023-11-18T20:59:27.891753+0000","last_became_peered":"2023-11-18T20:59:27.891753+0000","last_unstale":"2023-11-18T21:29:14.138510+0000","last_undegraded":"2023-11-18T21:29:14.138510+0000","last_fullsized":"2023-11-18T21:29:14.138510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-11-18T21:29:14.138212+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-11-18T21:29:14.138212+0000","last_clean_scrub_stamp":"2023-11-18T21:29:14.138212+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:03:12.661609+0000","scrub_duration":0.0047151750000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"31'63","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.507019+0000","last_change":"2023-11-18T21:29:04.507071+0000","last_active":"2023-11-18T21:29:04.507019+0000","last_peered":"2023-11-18T21:29:04.507019+0000","last_clean":"2023-11-18T21:29:04.507019+0000","last_became_active":"2023-11-18T20:59:27.836899+0000","last_became_peered":"2023-11-18T20:59:27.836899+0000","last_unstale":"2023-11-18T21:29:04.507019+0000","last_undegraded":"2023-11-18T21:29:04.507019+0000","last_fullsized":"2023-11-18T21:29:04.507019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:04.506836+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:04.506836+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.506836+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:01.723462+0000","scrub_duration":0.003664133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"31'58","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:08.464394+0000","last_change":"2023-11-18T21:29:08.464448+0000","last_active":"2023-11-18T21:29:08.464394+0000","last_peered":"2023-11-18T21:29:08.464394+0000","last_clean":"2023-11-18T21:29:08.464394+0000","last_became_active":"2023-11-18T20:59:27.863732+0000","last_became_peered":"2023-11-18T20:59:27.863732+0000","last_unstale":"2023-11-18T21:29:08.464394+0000","last_undegraded":"2023-11-18T21:29:08.464394+0000","last_fullsized":"2023-11-18T21:29:08.464394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'58","last_scrub_stamp":"2023-11-18T21:29:08.464206+0000","last_deep_scrub":"31'58","last_deep_scrub_stamp":"2023-11-18T21:29:08.464206+0000","last_clean_scrub_stamp":"2023-11-18T21:29:08.464206+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:58.000184+0000","scrub_duration":0.0036243820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"31'63","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.067794+0000","last_change":"2023-11-18T21:29:21.067914+0000","last_active":"2023-11-18T21:29:21.067794+0000","last_peered":"2023-11-18T21:29:21.067794+0000","last_clean":"2023-11-18T21:29:21.067794+0000","last_became_active":"2023-11-18T20:59:27.871167+0000","last_became_peered":"2023-11-18T20:59:27.871167+0000","last_unstale":"2023-11-18T21:29:21.067794+0000","last_undegraded":"2023-11-18T21:29:21.067794+0000","last_fullsized":"2023-11-18T21:29:21.067794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:21.067516+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:21.067516+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.067516+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:39.715726+0000","scrub_duration":0.0077063610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":448,"num_write":2451,"num_write_kb":251040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2621,"ondisk_log_size":2621,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3577,"ondisk_log_size":3577,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23672018,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":675,"num_read_kb":695,"num_write":9681,"num_write_kb":28189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20000,"num_omap_keys":40,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47595520,"data_stored":47344036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8529,"ondisk_log_size":8529,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509814,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":181032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.91400000000000003,"15min":0.89200000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.34799999999999998},"max":{"1min":1.512,"5min":1.5589999999999999,"15min":1.7649999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.89400000000000002,"15min":0.93200000000000005},"min":{"1min":0.53900000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1739999999999999,"5min":1.4950000000000001,"15min":1.5449999999999999},"last":0.83299999999999996}]},{"osd":1,"last update":"Sat Nov 18 21:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.91300000000000003,"15min":0.92100000000000004},"min":{"1min":0.48899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.2290000000000001,"5min":1.6579999999999999,"15min":1.7210000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.91000000000000003,"15min":0.93300000000000005},"min":{"1min":0.47699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.333,"5min":1.4319999999999999,"15min":2.524},"last":0.872}]},{"osd":2,"last update":"Sat Nov 18 21:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.032,"15min":1.044},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.2929999999999999,"5min":1.585,"15min":1.694},"last":1.123},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.96999999999999997,"15min":1.0069999999999999},"min":{"1min":0.50700000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2330000000000001,"5min":1.524,"15min":1.589},"last":0.90500000000000003}]},{"osd":3,"last update":"Sat Nov 18 21:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.98399999999999999,"15min":1.002},"min":{"1min":0.55300000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.296,"5min":1.7509999999999999,"15min":1.831},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.042,"5min":1.036,"15min":1.0509999999999999},"min":{"1min":0.56599999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3560000000000001,"5min":1.627,"15min":2.4430000000000001},"last":0.94899999999999995}]},{"osd":4,"last update":"Sat Nov 18 21:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.94599999999999995},"min":{"1min":0.53600000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.399,"5min":1.4299999999999999,"15min":1.601},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0589999999999999,"15min":1.0640000000000001},"min":{"1min":0.59399999999999997,"5min":0.498,"15min":0.40100000000000002},"max":{"1min":1.3899999999999999,"5min":2.266,"15min":2.266},"last":1.3109999999999999}]},{"osd":5,"last update":"Sat Nov 18 21:28:57 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.006,"15min":1.028},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.4179999999999999,"5min":1.6799999999999999,"15min":1.7509999999999999},"last":1.042},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.081,"15min":1.109},"min":{"1min":0.46200000000000002,"5min":0.437,"15min":0.434},"max":{"1min":1.4810000000000001,"5min":1.643,"15min":2.0619999999999998},"last":1.004}]},{"osd":6,"last update":"Sat Nov 18 21:28:57 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.109,"15min":1.149},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4350000000000001,"5min":1.7150000000000001,"15min":2.1659999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.1659999999999999,"15min":1.1799999999999999},"min":{"1min":0.61899999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.7330000000000001,"5min":2.181,"15min":2.181},"last":1.4350000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509814,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72804,"kb_used_data":15260,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299036,"statfs":{"total":96636764160,"available":96562212864,"internally_reserved":0,"allocated":15626240,"data_stored":15415703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.91300000000000003},"min":{"1min":0.629,"5min":0.312,"15min":0.312},"max":{"1min":1.4990000000000001,"5min":1.52,"15min":1.72},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.95499999999999996,"15min":0.95599999999999996},"min":{"1min":0.626,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5029999999999999,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":0.81599999999999995}]},{"osd":1,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.65700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.397,"5min":1.3999999999999999,"15min":1.887},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.111,"5min":0.98699999999999999,"15min":0.99099999999999999},"min":{"1min":0.71699999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.3899999999999999,"5min":3.73,"15min":3.73},"last":0.97599999999999998}]},{"osd":2,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.95599999999999996,"15min":0.95899999999999996},"min":{"1min":0.69499999999999995,"5min":0.51600000000000001,"15min":0.498},"max":{"1min":1.3580000000000001,"5min":1.48,"15min":1.6459999999999999},"last":1.03},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.0069999999999999,"15min":1.044},"min":{"1min":0.66800000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.4970000000000001,"5min":1.964,"15min":1.964},"last":0.80000000000000004}]},{"osd":3,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.056,"15min":1.0469999999999999},"min":{"1min":0.77700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3400000000000001,"5min":1.7330000000000001,"15min":1.8759999999999999},"last":1.071},{"interface":"front","average":{"1min":1.105,"5min":1.0780000000000001,"15min":1.0629999999999999},"min":{"1min":0.80600000000000005,"5min":0.55400000000000005,"15min":0.42399999999999999},"max":{"1min":1.2949999999999999,"5min":3.9889999999999999,"15min":3.9889999999999999},"last":0.88900000000000001}]},{"osd":4,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0269999999999999,"15min":1.0329999999999999},"min":{"1min":0.504,"5min":0.35099999999999998,"15min":0.318},"max":{"1min":1.413,"5min":1.7529999999999999,"15min":2.1030000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.1040000000000001,"15min":1.1000000000000001},"min":{"1min":0.68600000000000005,"5min":0.50700000000000001,"15min":0.38900000000000001},"max":{"1min":1.577,"5min":1.873,"15min":1.873},"last":0.68100000000000005}]},{"osd":5,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.70199999999999996,"5min":0.621,"15min":0.38600000000000001},"max":{"1min":1.6850000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.159,"15min":1.1699999999999999},"min":{"1min":0.61599999999999999,"5min":0.55000000000000004,"15min":0.35999999999999999},"max":{"1min":1.7789999999999999,"5min":2.194,"15min":2.3700000000000001},"last":0.85899999999999999}]},{"osd":7,"last update":"Sat Nov 18 21:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1679999999999999,"15min":1.1910000000000001},"min":{"1min":0.73899999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.909,"5min":1.909,"15min":2.1379999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.198,"15min":1.2050000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.45300000000000001},"max":{"1min":1.855,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.1970000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509814,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62884,"kb_used_data":9500,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308956,"statfs":{"total":96636764160,"available":96572370944,"internally_reserved":0,"allocated":9728000,"data_stored":9504573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.88200000000000001,"15min":0.90700000000000003},"min":{"1min":0.55400000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2909999999999999,"5min":1.3899999999999999,"15min":1.494},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.91300000000000003,"15min":0.94499999999999995},"min":{"1min":0.70599999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.496,"5min":1.5940000000000001,"15min":2.0600000000000001},"last":0.70099999999999996}]},{"osd":1,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.94599999999999995,"15min":0.91800000000000004},"min":{"1min":0.54500000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.4470000000000001,"5min":1.6419999999999999,"15min":1.79},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.91500000000000004,"15min":0.97199999999999998},"min":{"1min":0.76400000000000001,"5min":0.441,"15min":0.39700000000000002},"max":{"1min":1.391,"5min":1.474,"15min":1.794},"last":1.2589999999999999}]},{"osd":2,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.69099999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4059999999999999,"5min":1.504,"15min":2.1379999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.034,"5min":1.026,"15min":1.0149999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.41199999999999998},"max":{"1min":1.3500000000000001,"5min":1.53,"15min":1.6659999999999999},"last":1.3109999999999999}]},{"osd":3,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.0209999999999999,"15min":1.026},"min":{"1min":0.70599999999999996,"5min":0.60199999999999998,"15min":0.53700000000000003},"max":{"1min":1.2709999999999999,"5min":1.472,"15min":1.5960000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.0629999999999999,"15min":1.0940000000000001},"min":{"1min":0.78200000000000003,"5min":0.51600000000000001,"15min":0.38100000000000001},"max":{"1min":1.5449999999999999,"5min":1.766,"15min":2.2080000000000002},"last":0.95199999999999996}]},{"osd":4,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97099999999999997,"15min":0.98199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.42699999999999999},"max":{"1min":1.2729999999999999,"5min":1.849,"15min":1.9099999999999999},"last":1.105},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.077,"15min":1.089},"min":{"1min":0.64900000000000002,"5min":0.501,"15min":0.439},"max":{"1min":1.3080000000000001,"5min":1.585,"15min":2.4359999999999999},"last":1.399}]},{"osd":6,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.054,"15min":1.081},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.32500000000000001},"max":{"1min":1.6240000000000001,"5min":1.6299999999999999,"15min":2.2909999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.105,"15min":1.115},"min":{"1min":0.60899999999999999,"5min":0.58999999999999997,"15min":0.36299999999999999},"max":{"1min":1.405,"5min":1.883,"15min":2.0019999999999998},"last":1.2150000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:28:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.147,"15min":1.171},"min":{"1min":0.74199999999999999,"5min":0.52000000000000002,"15min":0.50700000000000001},"max":{"1min":1.4850000000000001,"5min":1.6839999999999999,"15min":2.0209999999999999},"last":1.345},{"interface":"front","average":{"1min":1.165,"5min":1.1819999999999999,"15min":1.2230000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.41499999999999998},"max":{"1min":1.5860000000000001,"5min":1.732,"15min":2.2789999999999999},"last":1.077}]}]},{"osd":3,"up_from":15,"seq":64424509813,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60828,"kb_used_data":7444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311012,"statfs":{"total":96636764160,"available":96574476288,"internally_reserved":0,"allocated":7622656,"data_stored":7382745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.52800000000000002,"5min":0.33700000000000002,"15min":0.309},"max":{"1min":1.052,"5min":1.458,"15min":1.458},"last":1},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.57299999999999995,"5min":0.28899999999999998,"15min":0.27800000000000002},"max":{"1min":1.353,"5min":1.3540000000000001,"15min":1.605},"last":0.753}]},{"osd":1,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84299999999999997,"15min":0.84499999999999997},"min":{"1min":0.52400000000000002,"5min":0.372,"15min":0.34899999999999998},"max":{"1min":1.2190000000000001,"5min":1.4510000000000001,"15min":1.7549999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76100000000000001,"15min":0.77100000000000002},"min":{"1min":0.48999999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.93700000000000006,"5min":1.629,"15min":1.629},"last":0.84899999999999998}]},{"osd":2,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.99399999999999999,"15min":1.022},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.847},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.98599999999999999,"15min":1.014},"min":{"1min":0.627,"5min":0.36699999999999999,"15min":0.32900000000000001},"max":{"1min":1.5900000000000001,"5min":1.609,"15min":1.794},"last":0.94799999999999995}]},{"osd":4,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0509999999999999,"15min":1.0840000000000001},"min":{"1min":0.71699999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.522,"5min":1.613,"15min":2.0630000000000002},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.034,"15min":1.0569999999999999},"min":{"1min":0.81799999999999995,"5min":0.55500000000000005,"15min":0.439},"max":{"1min":1.2809999999999999,"5min":1.5900000000000001,"15min":1.968},"last":1.1599999999999999}]},{"osd":5,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.099,"15min":1.117},"min":{"1min":0.875,"5min":0.52700000000000002,"15min":0.45200000000000001},"max":{"1min":1.3839999999999999,"5min":1.7090000000000001,"15min":2.1709999999999998},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.1020000000000001,"15min":1.1100000000000001},"min":{"1min":0.79700000000000004,"5min":0.58299999999999996,"15min":0.54900000000000004},"max":{"1min":1.494,"5min":1.736,"15min":1.798},"last":1.081}]},{"osd":6,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.115,"15min":1.155},"min":{"1min":0.83399999999999996,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":1.46,"5min":1.5680000000000001,"15min":1.927},"last":1.274},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.147,"15min":1.1539999999999999},"min":{"1min":0.70799999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.383,"5min":1.8600000000000001,"15min":1.929},"last":1.2529999999999999}]},{"osd":7,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1970000000000001,"15min":1.214},"min":{"1min":0.96499999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.5189999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.196},{"interface":"front","average":{"1min":1.268,"5min":1.2450000000000001,"15min":1.2609999999999999},"min":{"1min":0.85199999999999998,"5min":0.61599999999999999,"15min":0.60299999999999998},"max":{"1min":1.5780000000000001,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.333}]}]},{"osd":2,"up_from":15,"seq":64424509813,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36000,"kb_used_data":4824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335840,"statfs":{"total":96636764160,"available":96599900160,"internally_reserved":0,"allocated":4939776,"data_stored":4726754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.72199999999999998,"15min":0.73999999999999999},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.24299999999999999},"max":{"1min":0.98899999999999999,"5min":1.405,"15min":2.04},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.28999999999999998,"15min":0.27300000000000002},"max":{"1min":1.2410000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.204}]},{"osd":1,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.85399999999999998,"15min":0.86699999999999999},"min":{"1min":0.48799999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.3029999999999999,"5min":1.5129999999999999,"15min":1.978},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.84899999999999998,"15min":0.88600000000000001},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":1.3320000000000001,"5min":1.552,"15min":1.919},"last":0.85799999999999998}]},{"osd":3,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.83999999999999997,"15min":0.83499999999999996},"min":{"1min":0.54000000000000004,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.377,"5min":1.7090000000000001,"15min":1.8740000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0229999999999999,"15min":1.018},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.309},"max":{"1min":1.3540000000000001,"5min":1.7809999999999999,"15min":2.0960000000000001},"last":0.93799999999999994}]},{"osd":4,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0960000000000001,"15min":1.115},"min":{"1min":0.77900000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.4630000000000001,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.1399999999999999,"15min":1.1659999999999999},"min":{"1min":0.69399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6080000000000001,"5min":2.161,"15min":2.161},"last":1.341}]},{"osd":5,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1539999999999999,"15min":1.1899999999999999},"min":{"1min":0.76200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.492,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.141},"min":{"1min":0.79800000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4370000000000001,"5min":1.7390000000000001,"15min":1.8009999999999999},"last":1.389}]},{"osd":6,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.163,"15min":1.173},"min":{"1min":0.78700000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.482,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.282},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.264,"15min":1.2589999999999999},"min":{"1min":0.72699999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.794,"5min":1.994,"15min":2.1800000000000002},"last":1.165}]},{"osd":7,"last update":"Sat Nov 18 21:28:39 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.248,"15min":1.286},"min":{"1min":0.84199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.645,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2310000000000001,"15min":1.254},"min":{"1min":0.95199999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.536,"5min":1.96,"15min":1.992},"last":1.4890000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509812,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":966656,"data_stored":748254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.45500000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":1.341,"5min":1.359,"15min":1.4330000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.47199999999999998,"5min":0.318,"15min":0.318},"max":{"1min":1.329,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.66900000000000004}]},{"osd":2,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.99399999999999999,"5min":1.6859999999999999,"15min":1.706},"last":0.876},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90600000000000003,"15min":0.91500000000000004},"min":{"1min":0.52000000000000002,"5min":0.41599999999999998,"15min":0.35099999999999998},"max":{"1min":1.4550000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.96299999999999997,"15min":0.98199999999999998},"min":{"1min":0.51400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.5660000000000001,"5min":1.7170000000000001,"15min":1.881},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.94599999999999995,"15min":0.95899999999999996},"min":{"1min":0.68300000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4419999999999999,"5min":1.6519999999999999,"15min":1.73},"last":0.95599999999999996}]},{"osd":4,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0409999999999999,"15min":1.0589999999999999},"min":{"1min":0.77000000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.867},"last":1.079},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.171,"15min":1.1839999999999999},"min":{"1min":0.76900000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.5249999999999999,"5min":1.716,"15min":1.9039999999999999},"last":1.0149999999999999}]},{"osd":5,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1539999999999999,"15min":1.165},"min":{"1min":0.88700000000000001,"5min":0.54000000000000004,"15min":0.53200000000000003},"max":{"1min":1.4410000000000001,"5min":1.8660000000000001,"15min":2.0230000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.1200000000000001,"15min":1.1379999999999999},"min":{"1min":0.85299999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.639,"5min":1.6819999999999999,"15min":1.8400000000000001},"last":1.2270000000000001}]},{"osd":6,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.274,"15min":1.2709999999999999},"min":{"1min":0.84899999999999998,"5min":0.64200000000000002,"15min":0.59999999999999998},"max":{"1min":1.5920000000000001,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.2070000000000001,"15min":1.24},"min":{"1min":0.75,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5840000000000001,"5min":1.8819999999999999,"15min":2.0600000000000001},"last":1.2749999999999999}]},{"osd":7,"last update":"Sat Nov 18 21:28:38 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2589999999999999,"15min":1.292},"min":{"1min":0.85199999999999998,"5min":0.79800000000000004,"15min":0.73499999999999999},"max":{"1min":1.5309999999999999,"5min":1.9530000000000001,"15min":2.1389999999999998},"last":1.339},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.22,"15min":1.2490000000000001},"min":{"1min":0.83299999999999996,"5min":0.66000000000000003,"15min":0.65400000000000003},"max":{"1min":1.7769999999999999,"5min":1.806,"15min":1.988},"last":1.4710000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509812,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60764,"kb_used_data":7380,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311076,"statfs":{"total":96636764160,"available":96574541824,"internally_reserved":0,"allocated":7557120,"data_stored":7321877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71099999999999997,"15min":0.745},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0680000000000001,"5min":1.4750000000000001,"15min":1.7370000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.29799999999999999},"max":{"1min":1.1220000000000001,"5min":1.536,"15min":1.8560000000000001},"last":0.498}]},{"osd":2,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.85999999999999999,"15min":0.878},"min":{"1min":0.432,"5min":0.43099999999999999,"15min":0.29199999999999998},"max":{"1min":1.2569999999999999,"5min":1.3720000000000001,"15min":1.7190000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.89900000000000002,"15min":0.91000000000000003},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.317},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.8959999999999999},"last":0.628}]},{"osd":3,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90200000000000002,"15min":0.89200000000000002},"min":{"1min":0.33700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3979999999999999,"5min":1.756,"15min":1.869},"last":0.55400000000000005},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.034,"15min":1.0189999999999999},"min":{"1min":0.51700000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3600000000000001,"5min":1.6180000000000001,"15min":1.9259999999999999},"last":0.58899999999999997}]},{"osd":4,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.022,"15min":1.0189999999999999},"min":{"1min":0.57599999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.458,"5min":1.5529999999999999,"15min":1.9610000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.161,"5min":1.129,"15min":1.1220000000000001},"min":{"1min":0.74099999999999999,"5min":0.57999999999999996,"15min":0.47899999999999998},"max":{"1min":1.5860000000000001,"5min":2.101,"15min":2.101},"last":0.83299999999999996}]},{"osd":5,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1319999999999999,"15min":1.1659999999999999},"min":{"1min":0.81000000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.667,"5min":1.667,"15min":2.1669999999999998},"last":0.745},{"interface":"front","average":{"1min":1.117,"5min":1.0840000000000001,"15min":1.0980000000000001},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4490000000000001,"5min":1.728,"15min":2.1280000000000001},"last":0.90500000000000003}]},{"osd":6,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.177,"15min":1.2110000000000001},"min":{"1min":0.71199999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.637,"5min":1.9910000000000001,"15min":2.101},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.212,"15min":1.2370000000000001},"min":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.718,"5min":1.831,"15min":2.2480000000000002},"last":0.81200000000000006}]},{"osd":7,"last update":"Sat Nov 18 21:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.272,"15min":1.292},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.764,"5min":1.792,"15min":2.2410000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.28,"5min":1.2130000000000001,"15min":1.1970000000000001},"min":{"1min":0.83499999999999996,"5min":0.64400000000000002,"15min":0.60099999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.70399999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542516,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35648,"kb_used_data":4472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336192,"statfs":{"total":96636764160,"available":96600260608,"internally_reserved":0,"allocated":4579328,"data_stored":4332954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.88900000000000001,"15min":0.90300000000000002},"min":{"1min":0.53800000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3280000000000001,"5min":1.544,"15min":1.544},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.878,"15min":0.90400000000000003},"min":{"1min":0.58799999999999997,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":1.347,"5min":1.4139999999999999,"15min":1.6319999999999999},"last":1.341}]},{"osd":1,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.89700000000000002,"15min":0.92100000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.302,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93799999999999994,"15min":0.95999999999999996},"min":{"1min":0.505,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.262,"5min":1.454,"15min":1.7689999999999999},"last":0.83299999999999996}]},{"osd":2,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.94299999999999995,"15min":0.97599999999999998},"min":{"1min":0.55400000000000005,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":1.302,"5min":1.613,"15min":1.708},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.997,"15min":1.012},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.29,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":1.175}]},{"osd":3,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.97299999999999998,"15min":0.996},"min":{"1min":0.621,"5min":0.52800000000000002,"15min":0.44500000000000001},"max":{"1min":1.2390000000000001,"5min":1.5349999999999999,"15min":2.2370000000000001},"last":1.204},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0800000000000001,"15min":1.103},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2250000000000001,"5min":1.752,"15min":1.8220000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.98599999999999999,"15min":1.0089999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.38500000000000001},"max":{"1min":1.6279999999999999,"5min":1.6779999999999999,"15min":2.016},"last":1.097},{"interface":"front","average":{"1min":1.01,"5min":0.995,"15min":1.026},"min":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.34300000000000003},"max":{"1min":1.5369999999999999,"5min":1.5880000000000001,"15min":1.821},"last":0.97999999999999998}]},{"osd":6,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.0349999999999999,"15min":1.0720000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":1.387,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.165,"15min":1.194},"min":{"1min":0.54000000000000004,"5min":0.53100000000000003,"15min":0.44500000000000001},"max":{"1min":1.5640000000000001,"5min":1.76,"15min":2.1230000000000002},"last":1.262}]},{"osd":7,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1279999999999999,"15min":1.149},"min":{"1min":0.64800000000000002,"5min":0.439,"15min":0.379},"max":{"1min":1.806,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.218,"15min":1.2549999999999999},"min":{"1min":0.60599999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.7290000000000001,"5min":1.996,"15min":2.1160000000000001},"last":1.143}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7225344,"data_stored":7185737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":21746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4608000,"data_stored":4590614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7290880,"data_stored":7246605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4247552,"data_stored":4196814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8802304,"data_stored":8778065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15294464,"data_stored":15279563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":44892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T21:29:22.974 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.974 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.975 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.975 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.975 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.975 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.975 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.976 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.976 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.976 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.976 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.976 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.977 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.977 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.977 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.977 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.977 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.978 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.978 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.978 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.978 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.978 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.979 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.979 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.979 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.979 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.979 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.979 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.980 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.980 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.980 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.980 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.981 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.981 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.981 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.981 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.981 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.982 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.982 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.982 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.982 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.982 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.983 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.983 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.983 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-11-18T20:59:23.603046+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=23, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.983 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.983 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.984 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.984 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.984 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.984 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.985 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.985 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.985 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.985 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.985 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.985 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.986 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:22.986 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-18T21:29:33.023 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:29:33.026 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:29:42.987 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T21:29:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.124+0000 7f3eaf810640 1 Processor -- start 2023-11-18T21:29:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.124+0000 7f3eaf810640 1 -- start start 2023-11-18T21:29:43.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.128+0000 7f3eaf810640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3ea8151460 0x7f3ea80c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:43.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.128+0000 7f3eaf810640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea80c21d0 con 0x7f3ea8157280 2023-11-18T21:29:43.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.128+0000 7f3eaf810640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea8157750 con 0x7f3ea80c9130 2023-11-18T21:29:43.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.128+0000 7f3eaf810640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea806ec00 con 0x7f3ea8151460 2023-11-18T21:29:43.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.128+0000 7f3eacdab640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3ea8157280 0x7f3ea806f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57374/0 (socket says 172.21.15.49:57374) 2023-11-18T21:29:43.127 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.128+0000 7f3eacdab640 1 -- 172.21.15.49:0/61546710 learned_addr learned my addr 172.21.15.49:0/61546710 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:29:43.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.128+0000 7f3e9ffff640 1 -- 172.21.15.49:0/61546710 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882562431 0 0) 0x7f3ea80c21d0 con 0x7f3ea8157280 2023-11-18T21:29:43.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.128+0000 7f3e9ffff640 1 -- 172.21.15.49:0/61546710 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e94003530 con 0x7f3ea8157280 2023-11-18T21:29:43.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.136+0000 7f3e9ffff640 1 -- 172.21.15.49:0/61546710 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 515387973 0 0) 0x7f3e94003530 con 0x7f3ea8157280 2023-11-18T21:29:43.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.136+0000 7f3e9ffff640 1 -- 172.21.15.49:0/61546710 >> v2:172.21.15.106:3300/0 conn(0x7f3ea8151460 msgr2=0x7f3ea80c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:29:43.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.136+0000 7f3e9ffff640 1 --2- 172.21.15.49:0/61546710 >> v2:172.21.15.106:3300/0 conn(0x7f3ea8151460 0x7f3ea80c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:43.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.136+0000 7f3e9ffff640 1 -- 172.21.15.49:0/61546710 >> v1:172.21.15.106:6789/0 conn(0x7f3ea80c9130 legacy=0x7f3ea80ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:29:43.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.136+0000 7f3e9ffff640 1 -- 172.21.15.49:0/61546710 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea8157a30 con 0x7f3ea8157280 2023-11-18T21:29:43.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.136+0000 7f3e9ffff640 1 -- 172.21.15.49:0/61546710 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7f3e98001680 con 0x7f3ea8157280 2023-11-18T21:29:43.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.136+0000 7f3e9ffff640 1 -- 172.21.15.49:0/61546710 >> v1:172.21.15.49:6789/0 conn(0x7f3ea8157280 legacy=0x7f3ea806f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:43.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.136+0000 7f3e9ffff640 1 --2- 172.21.15.49:0/61546710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e94003a40 0x7f3e94003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:43.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.136+0000 7f3e9ffff640 1 --2- 172.21.15.49:0/61546710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e940047d0 0x7f3e94004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:43.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.136+0000 7f3e9ffff640 1 --2- 172.21.15.49:0/61546710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e940053e0 0x7f3e9400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:43.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.136+0000 7f3e9ffff640 1 -- 172.21.15.49:0/61546710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea806ec00 con 0x7f3e940047d0 2023-11-18T21:29:43.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.136+0000 7f3e9ffff640 1 -- 172.21.15.49:0/61546710 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9400c2f0 con 0x7f3e940053e0 2023-11-18T21:29:43.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.136+0000 7f3e9ffff640 1 -- 172.21.15.49:0/61546710 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9400c4b0 con 0x7f3e94003a40 2023-11-18T21:29:43.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.140+0000 7f3eacdab640 1 --2- 172.21.15.49:0/61546710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e940047d0 0x7f3e94004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:43.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.144+0000 7f3eacdab640 1 -- 172.21.15.49:0/61546710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e94003a40 msgr2=0x7f3e94003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:29:43.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.144+0000 7f3eacdab640 1 --2- 172.21.15.49:0/61546710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e94003a40 0x7f3e94003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:43.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.144+0000 7f3eacdab640 1 -- 172.21.15.49:0/61546710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e940053e0 msgr2=0x7f3e9400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:29:43.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.144+0000 7f3eacdab640 1 --2- 172.21.15.49:0/61546710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e940053e0 0x7f3e9400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:43.145 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.144+0000 7f3eacdab640 1 -- 172.21.15.49:0/61546710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e94003530 con 0x7f3e940047d0 2023-11-18T21:29:43.146 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.144+0000 7f3eaddad640 1 -- 172.21.15.49:0/61546710 reap_dead start 2023-11-18T21:29:43.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.148+0000 7f3eacdab640 1 --2- 172.21.15.49:0/61546710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e940047d0 0x7f3e94004c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3e9800c160 tx=0x7f3e9801cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb97709e386b7d86 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:43.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.152+0000 7f3e9ffff640 1 -- 172.21.15.49:0/61546710 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e980058e0 con 0x7f3e940047d0 2023-11-18T21:29:43.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.152+0000 7f3e9ffff640 1 -- 172.21.15.49:0/61546710 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e98005a40 con 0x7f3e940047d0 2023-11-18T21:29:43.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.152+0000 7f3e9ffff640 1 -- 172.21.15.49:0/61546710 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98005e70 con 0x7f3e940047d0 2023-11-18T21:29:43.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.152+0000 7f3eaf810640 1 -- 172.21.15.49:0/61546710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e940047d0 msgr2=0x7f3e94004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:43.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.152+0000 7f3eaf810640 1 --2- 172.21.15.49:0/61546710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e940047d0 0x7f3e94004c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3e9800c160 tx=0x7f3e9801cbb0 comp rx=0 tx=0).stop 2023-11-18T21:29:43.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.152+0000 7f3eaf810640 1 -- 172.21.15.49:0/61546710 shutdown_connections 2023-11-18T21:29:43.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.152+0000 7f3eaf810640 1 --2- 172.21.15.49:0/61546710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e940047d0 0x7f3e94004c50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:43.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.152+0000 7f3eaf810640 1 -- 172.21.15.49:0/61546710 >> 172.21.15.49:0/61546710 conn(0x7f3ea80708a0 msgr2=0x7f3ea8070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:29:43.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.152+0000 7f3eaf810640 1 -- 172.21.15.49:0/61546710 shutdown_connections 2023-11-18T21:29:43.153 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.152+0000 7f3eaf810640 1 -- 172.21.15.49:0/61546710 wait complete. 2023-11-18T21:29:43.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.156+0000 7f3eaf810640 1 Processor -- start 2023-11-18T21:29:43.154 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.156+0000 7f3eaf810640 1 -- start start 2023-11-18T21:29:43.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.156+0000 7f3eaf810640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e940047d0 0x7f3ea81e71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:43.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.156+0000 7f3eaf810640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ea80c4e70 0x7f3ea815a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:43.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.156+0000 7f3eaf810640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea81f37c0 0x7f3ea81f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:43.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.156+0000 7f3eaf810640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80c6bb0 con 0x7f3ea81f37c0 2023-11-18T21:29:43.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.156+0000 7f3eaf810640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea81f4180 con 0x7f3ea80c4e70 2023-11-18T21:29:43.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.156+0000 7f3eaf810640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea81e77c0 con 0x7f3e940047d0 2023-11-18T21:29:43.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.156+0000 7f3eaddad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea81f37c0 0x7f3ea81f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:43.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.156+0000 7f3eaddad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea81f37c0 0x7f3ea81f3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48284/0 (socket says 172.21.15.49:48284) 2023-11-18T21:29:43.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.156+0000 7f3eaddad640 1 -- 172.21.15.49:0/2326886700 learned_addr learned my addr 172.21.15.49:0/2326886700 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:29:43.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.160+0000 7f3eaddad640 1 -- 172.21.15.49:0/2326886700 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e940047d0 msgr2=0x7f3ea81e71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:43.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.160+0000 7f3eaddad640 1 --2- 172.21.15.49:0/2326886700 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e940047d0 0x7f3ea81e71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:43.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.160+0000 7f3eaddad640 1 -- 172.21.15.49:0/2326886700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ea80c4e70 msgr2=0x7f3ea815a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:43.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.160+0000 7f3eaddad640 1 --2- 172.21.15.49:0/2326886700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ea80c4e70 0x7f3ea815a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:43.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.160+0000 7f3eaddad640 1 -- 172.21.15.49:0/2326886700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea80c5f70 con 0x7f3ea81f37c0 2023-11-18T21:29:43.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.164+0000 7f3eaddad640 1 --2- 172.21.15.49:0/2326886700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea81f37c0 0x7f3ea81f3c40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80c9580 tx=0x7f3ea000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:43.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.168+0000 7f3e9dffb640 1 -- 172.21.15.49:0/2326886700 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0007070 con 0x7f3ea81f37c0 2023-11-18T21:29:43.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.168+0000 7f3e9dffb640 1 -- 172.21.15.49:0/2326886700 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea00071f0 con 0x7f3ea81f37c0 2023-11-18T21:29:43.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.168+0000 7f3e9dffb640 1 -- 172.21.15.49:0/2326886700 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea00075a0 con 0x7f3ea81f37c0 2023-11-18T21:29:43.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.168+0000 7f3eaf810640 1 -- 172.21.15.49:0/2326886700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea80c6210 con 0x7f3ea81f37c0 2023-11-18T21:29:43.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.168+0000 7f3eaf810640 1 -- 172.21.15.49:0/2326886700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea80c67d0 con 0x7f3ea81f37c0 2023-11-18T21:29:43.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.168+0000 7f3eaf810640 1 -- 172.21.15.49:0/2326886700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea8073e70 con 0x7f3ea81f37c0 2023-11-18T21:29:43.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.188+0000 7f3e9dffb640 1 -- 172.21.15.49:0/2326886700 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ea0007700 con 0x7f3ea81f37c0 2023-11-18T21:29:43.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.188+0000 7f3e9dffb640 1 --2- 172.21.15.49:0/2326886700 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3e8c0664f0 0x7f3e8c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:29:43.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.188+0000 7f3ead5ac640 1 --2- 172.21.15.49:0/2326886700 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3e8c0664f0 0x7f3e8c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:29:43.189 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.188+0000 7f3ead5ac640 1 --2- 172.21.15.49:0/2326886700 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3e8c0664f0 0x7f3e8c0689b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009710 tx=0x7f3ea4006d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:29:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.192+0000 7f3e9dffb640 1 -- 172.21.15.49:0/2326886700 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f3ea0055500 con 0x7f3ea81f37c0 2023-11-18T21:29:43.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.480+0000 7f3e9dffb640 1 -- 172.21.15.49:0/2326886700 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ea0051140 con 0x7f3ea81f37c0 2023-11-18T21:29:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.644+0000 7f3eaf810640 1 -- 172.21.15.49:0/2326886700 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ea80b25a0 con 0x7f3e8c0664f0 2023-11-18T21:29:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.672+0000 7f3e9dffb640 1 -- 172.21.15.49:0/2326886700 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371062 (secure 0 0 0) 0x7f3ea80b25a0 con 0x7f3e8c0664f0 2023-11-18T21:29:43.674 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:29:43.677 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-18T21:29:43.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.676+0000 7f3eaf810640 1 -- 172.21.15.49:0/2326886700 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3e8c0664f0 msgr2=0x7f3e8c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:43.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.676+0000 7f3eaf810640 1 --2- 172.21.15.49:0/2326886700 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3e8c0664f0 0x7f3e8c0689b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009710 tx=0x7f3ea4006d10 comp rx=0 tx=0).stop 2023-11-18T21:29:43.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.676+0000 7f3eaf810640 1 -- 172.21.15.49:0/2326886700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea81f37c0 msgr2=0x7f3ea81f3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:29:43.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.676+0000 7f3eaf810640 1 --2- 172.21.15.49:0/2326886700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea81f37c0 0x7f3ea81f3c40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80c9580 tx=0x7f3ea000c890 comp rx=0 tx=0).stop 2023-11-18T21:29:43.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.676+0000 7f3eaf810640 1 -- 172.21.15.49:0/2326886700 shutdown_connections 2023-11-18T21:29:43.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.676+0000 7f3eaf810640 1 --2- 172.21.15.49:0/2326886700 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f3e8c0664f0 0x7f3e8c0689b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:43.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.676+0000 7f3eaf810640 1 --2- 172.21.15.49:0/2326886700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea81f37c0 0x7f3ea81f3c40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:43.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.676+0000 7f3eaf810640 1 --2- 172.21.15.49:0/2326886700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ea80c4e70 0x7f3ea815a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:43.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.676+0000 7f3eaf810640 1 --2- 172.21.15.49:0/2326886700 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e940047d0 0x7f3ea81e71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:29:43.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.676+0000 7f3eaf810640 1 -- 172.21.15.49:0/2326886700 >> 172.21.15.49:0/2326886700 conn(0x7f3ea80708a0 msgr2=0x7f3ea80c2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:29:43.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.676+0000 7f3eaf810640 1 -- 172.21.15.49:0/2326886700 shutdown_connections 2023-11-18T21:29:43.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:29:43.676+0000 7f3eaf810640 1 -- 172.21.15.49:0/2326886700 wait complete. 2023-11-18T21:29:43.697 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":959,"stamp":"2023-11-18T21:29:42.561320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24262386,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":804,"num_read_kb":1243,"num_write":12291,"num_write_kb":281645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14872,"ondisk_log_size":14872,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":388472,"kb_used_data":50232,"kb_used_omap":12,"kb_used_meta":338163,"kb_avail":754586248,"statfs":{"total":773094113280,"available":772696317952,"internally_reserved":0,"allocated":51437568,"data_stored":49613892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":346279473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004820"},"pg_stats":[{"pgid":"2.1f","version":"31'78","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:03.460546+0000","last_change":"2023-11-18T21:29:03.460610+0000","last_active":"2023-11-18T21:29:03.460546+0000","last_peered":"2023-11-18T21:29:03.460546+0000","last_clean":"2023-11-18T21:29:03.460546+0000","last_became_active":"2023-11-18T20:59:25.349869+0000","last_became_peered":"2023-11-18T20:59:25.349869+0000","last_unstale":"2023-11-18T21:29:03.460546+0000","last_undegraded":"2023-11-18T21:29:03.460546+0000","last_fullsized":"2023-11-18T21:29:03.460546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'78","last_scrub_stamp":"2023-11-18T21:29:03.460361+0000","last_deep_scrub":"31'78","last_deep_scrub_stamp":"2023-11-18T21:29:03.460361+0000","last_clean_scrub_stamp":"2023-11-18T21:29:03.460361+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:24:19.786896+0000","scrub_duration":0.011799875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'45","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:26.382457+0000","last_change":"2023-11-18T21:29:26.382457+0000","last_active":"2023-11-18T21:29:26.382457+0000","last_peered":"2023-11-18T21:29:26.382457+0000","last_clean":"2023-11-18T21:29:26.382457+0000","last_became_active":"2023-11-18T20:59:27.895678+0000","last_became_peered":"2023-11-18T20:59:27.895678+0000","last_unstale":"2023-11-18T21:29:26.382457+0000","last_undegraded":"2023-11-18T21:29:26.382457+0000","last_fullsized":"2023-11-18T21:29:26.382457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2023-11-18T21:29:26.382073+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2023-11-18T21:29:26.382073+0000","last_clean_scrub_stamp":"2023-11-18T21:29:26.382073+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:28.880730+0000","scrub_duration":0.0048445019999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"31'87","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:22.248822+0000","last_change":"2023-11-18T21:29:22.248881+0000","last_active":"2023-11-18T21:29:22.248822+0000","last_peered":"2023-11-18T21:29:22.248822+0000","last_clean":"2023-11-18T21:29:22.248822+0000","last_became_active":"2023-11-18T20:59:35.848140+0000","last_became_peered":"2023-11-18T20:59:35.848140+0000","last_unstale":"2023-11-18T21:29:22.248822+0000","last_undegraded":"2023-11-18T21:29:22.248822+0000","last_fullsized":"2023-11-18T21:29:22.248822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2023-11-18T21:29:22.248610+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2023-11-18T21:29:22.248610+0000","last_clean_scrub_stamp":"2023-11-18T21:29:22.248610+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:23:17.258588+0000","scrub_duration":0.0083978449999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:13.501955+0000","last_change":"2023-11-18T21:29:13.501955+0000","last_active":"2023-11-18T21:29:13.501955+0000","last_peered":"2023-11-18T21:29:13.501955+0000","last_clean":"2023-11-18T21:29:13.501955+0000","last_became_active":"2023-11-18T20:59:25.463001+0000","last_became_peered":"2023-11-18T20:59:25.463001+0000","last_unstale":"2023-11-18T21:29:13.501955+0000","last_undegraded":"2023-11-18T21:29:13.501955+0000","last_fullsized":"2023-11-18T21:29:13.501955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-11-18T21:29:13.501715+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-11-18T21:29:13.501715+0000","last_clean_scrub_stamp":"2023-11-18T21:29:13.501715+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:31.013864+0000","scrub_duration":0.0034647580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"31'59","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:59.668147+0000","last_change":"2023-11-18T21:28:59.668198+0000","last_active":"2023-11-18T21:28:59.668147+0000","last_peered":"2023-11-18T21:28:59.668147+0000","last_clean":"2023-11-18T21:28:59.668147+0000","last_became_active":"2023-11-18T20:59:27.836937+0000","last_became_peered":"2023-11-18T20:59:27.836937+0000","last_unstale":"2023-11-18T21:28:59.668147+0000","last_undegraded":"2023-11-18T21:28:59.668147+0000","last_fullsized":"2023-11-18T21:28:59.668147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:28:59.667928+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:28:59.667928+0000","last_clean_scrub_stamp":"2023-11-18T21:28:59.667928+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:50.770327+0000","scrub_duration":0.0051257619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"31'91","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:20.239104+0000","last_change":"2023-11-18T21:29:20.239161+0000","last_active":"2023-11-18T21:29:20.239104+0000","last_peered":"2023-11-18T21:29:20.239104+0000","last_clean":"2023-11-18T21:29:20.239104+0000","last_became_active":"2023-11-18T20:59:35.842552+0000","last_became_peered":"2023-11-18T20:59:35.842552+0000","last_unstale":"2023-11-18T21:29:20.239104+0000","last_undegraded":"2023-11-18T21:29:20.239104+0000","last_fullsized":"2023-11-18T21:29:20.239104+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'91","last_scrub_stamp":"2023-11-18T21:29:20.238911+0000","last_deep_scrub":"31'91","last_deep_scrub_stamp":"2023-11-18T21:29:20.238911+0000","last_clean_scrub_stamp":"2023-11-18T21:29:20.238911+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:09.774889+0000","scrub_duration":0.010430183000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"31'182","reported_seq":225,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:06.070791+0000","last_change":"2023-11-18T21:29:06.070791+0000","last_active":"2023-11-18T21:29:06.070791+0000","last_peered":"2023-11-18T21:29:06.070791+0000","last_clean":"2023-11-18T21:29:06.070791+0000","last_became_active":"2023-11-18T20:59:25.497070+0000","last_became_peered":"2023-11-18T20:59:25.497070+0000","last_unstale":"2023-11-18T21:29:06.070791+0000","last_undegraded":"2023-11-18T21:29:06.070791+0000","last_fullsized":"2023-11-18T21:29:06.070791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'182","last_scrub_stamp":"2023-11-18T21:29:06.070530+0000","last_deep_scrub":"31'182","last_deep_scrub_stamp":"2023-11-18T21:29:06.070530+0000","last_clean_scrub_stamp":"2023-11-18T21:29:06.070530+0000","objects_scrubbed":7,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:03.287156+0000","scrub_duration":0.017219693000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"31'56","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:19.095416+0000","last_change":"2023-11-18T21:29:19.095416+0000","last_active":"2023-11-18T21:29:19.095416+0000","last_peered":"2023-11-18T21:29:19.095416+0000","last_clean":"2023-11-18T21:29:19.095416+0000","last_became_active":"2023-11-18T20:59:27.867021+0000","last_became_peered":"2023-11-18T20:59:27.867021+0000","last_unstale":"2023-11-18T21:29:19.095416+0000","last_undegraded":"2023-11-18T21:29:19.095416+0000","last_fullsized":"2023-11-18T21:29:19.095416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'56","last_scrub_stamp":"2023-11-18T21:29:19.095175+0000","last_deep_scrub":"31'56","last_deep_scrub_stamp":"2023-11-18T21:29:19.095175+0000","last_clean_scrub_stamp":"2023-11-18T21:29:19.095175+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:24:47.739315+0000","scrub_duration":0.0033730069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'88","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:30.250057+0000","last_change":"2023-11-18T21:29:30.250057+0000","last_active":"2023-11-18T21:29:30.250057+0000","last_peered":"2023-11-18T21:29:30.250057+0000","last_clean":"2023-11-18T21:29:30.250057+0000","last_became_active":"2023-11-18T20:59:35.829636+0000","last_became_peered":"2023-11-18T20:59:35.829636+0000","last_unstale":"2023-11-18T21:29:30.250057+0000","last_undegraded":"2023-11-18T21:29:30.250057+0000","last_fullsized":"2023-11-18T21:29:30.250057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'88","last_scrub_stamp":"2023-11-18T21:29:30.249808+0000","last_deep_scrub":"31'88","last_deep_scrub_stamp":"2023-11-18T21:29:30.249808+0000","last_clean_scrub_stamp":"2023-11-18T21:29:30.249808+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:15:32.715371+0000","scrub_duration":0.0092954140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":32,"num_write":84,"num_write_kb":9481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"31'13","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.970375+0000","last_change":"2023-11-18T21:29:10.970375+0000","last_active":"2023-11-18T21:29:10.970375+0000","last_peered":"2023-11-18T21:29:10.970375+0000","last_clean":"2023-11-18T21:29:10.970375+0000","last_became_active":"2023-11-18T20:59:25.493087+0000","last_became_peered":"2023-11-18T20:59:25.493087+0000","last_unstale":"2023-11-18T21:29:10.970375+0000","last_undegraded":"2023-11-18T21:29:10.970375+0000","last_fullsized":"2023-11-18T21:29:10.970375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2023-11-18T21:29:10.970102+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2023-11-18T21:29:10.970102+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.970102+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:28.482252+0000","scrub_duration":0.0099144660000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"31'65","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:05.584178+0000","last_change":"2023-11-18T21:29:05.584178+0000","last_active":"2023-11-18T21:29:05.584178+0000","last_peered":"2023-11-18T21:29:05.584178+0000","last_clean":"2023-11-18T21:29:05.584178+0000","last_became_active":"2023-11-18T20:59:27.871076+0000","last_became_peered":"2023-11-18T20:59:27.871076+0000","last_unstale":"2023-11-18T21:29:05.584178+0000","last_undegraded":"2023-11-18T21:29:05.584178+0000","last_fullsized":"2023-11-18T21:29:05.584178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'65","last_scrub_stamp":"2023-11-18T21:29:05.583742+0000","last_deep_scrub":"31'65","last_deep_scrub_stamp":"2023-11-18T21:29:05.583742+0000","last_clean_scrub_stamp":"2023-11-18T21:29:05.583742+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:14:13.537695+0000","scrub_duration":0.003124567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"31'63","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:31.224674+0000","last_change":"2023-11-18T21:29:31.224674+0000","last_active":"2023-11-18T21:29:31.224674+0000","last_peered":"2023-11-18T21:29:31.224674+0000","last_clean":"2023-11-18T21:29:31.224674+0000","last_became_active":"2023-11-18T20:59:35.833016+0000","last_became_peered":"2023-11-18T20:59:35.833016+0000","last_unstale":"2023-11-18T21:29:31.224674+0000","last_undegraded":"2023-11-18T21:29:31.224674+0000","last_fullsized":"2023-11-18T21:29:31.224674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:31.224423+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:31.224423+0000","last_clean_scrub_stamp":"2023-11-18T21:29:31.224423+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:11:59.356184+0000","scrub_duration":0.0099963039999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":5002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"31'56","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:12.489851+0000","last_change":"2023-11-18T21:29:12.489906+0000","last_active":"2023-11-18T21:29:12.489851+0000","last_peered":"2023-11-18T21:29:12.489851+0000","last_clean":"2023-11-18T21:29:12.489851+0000","last_became_active":"2023-11-18T20:59:27.681154+0000","last_became_peered":"2023-11-18T20:59:27.681154+0000","last_unstale":"2023-11-18T21:29:12.489851+0000","last_undegraded":"2023-11-18T21:29:12.489851+0000","last_fullsized":"2023-11-18T21:29:12.489851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'56","last_scrub_stamp":"2023-11-18T21:29:12.489669+0000","last_deep_scrub":"31'56","last_deep_scrub_stamp":"2023-11-18T21:29:12.489669+0000","last_clean_scrub_stamp":"2023-11-18T21:29:12.489669+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:46:08.217982+0000","scrub_duration":0.0041585340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"31'145","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:31.368234+0000","last_change":"2023-11-18T21:29:31.368300+0000","last_active":"2023-11-18T21:29:31.368234+0000","last_peered":"2023-11-18T21:29:31.368234+0000","last_clean":"2023-11-18T21:29:31.368234+0000","last_became_active":"2023-11-18T20:59:25.338067+0000","last_became_peered":"2023-11-18T20:59:25.338067+0000","last_unstale":"2023-11-18T21:29:31.368234+0000","last_undegraded":"2023-11-18T21:29:31.368234+0000","last_fullsized":"2023-11-18T21:29:31.368234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'145","last_scrub_stamp":"2023-11-18T21:29:31.368043+0000","last_deep_scrub":"31'145","last_deep_scrub_stamp":"2023-11-18T21:29:31.368043+0000","last_clean_scrub_stamp":"2023-11-18T21:29:31.368043+0000","objects_scrubbed":3,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:00.208920+0000","scrub_duration":0.010539744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395570,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'89","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:33.232516+0000","last_change":"2023-11-18T21:29:33.232573+0000","last_active":"2023-11-18T21:29:33.232516+0000","last_peered":"2023-11-18T21:29:33.232516+0000","last_clean":"2023-11-18T21:29:33.232516+0000","last_became_active":"2023-11-18T21:00:28.755606+0000","last_became_peered":"2023-11-18T21:00:28.755606+0000","last_unstale":"2023-11-18T21:29:33.232516+0000","last_undegraded":"2023-11-18T21:29:33.232516+0000","last_fullsized":"2023-11-18T21:29:33.232516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'89","last_scrub_stamp":"2023-11-18T21:29:33.232313+0000","last_deep_scrub":"31'89","last_deep_scrub_stamp":"2023-11-18T21:29:33.232313+0000","last_clean_scrub_stamp":"2023-11-18T21:29:33.232313+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:17:16.429280+0000","scrub_duration":0.0086994629999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":4704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'54","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:14.305497+0000","last_change":"2023-11-18T21:29:14.305549+0000","last_active":"2023-11-18T21:29:14.305497+0000","last_peered":"2023-11-18T21:29:14.305497+0000","last_clean":"2023-11-18T21:29:14.305497+0000","last_became_active":"2023-11-18T20:59:27.861045+0000","last_became_peered":"2023-11-18T20:59:27.861045+0000","last_unstale":"2023-11-18T21:29:14.305497+0000","last_undegraded":"2023-11-18T21:29:14.305497+0000","last_fullsized":"2023-11-18T21:29:14.305497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-11-18T21:29:14.305304+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-11-18T21:29:14.305304+0000","last_clean_scrub_stamp":"2023-11-18T21:29:14.305304+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:11:24.924936+0000","scrub_duration":0.0068830929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"31'409","reported_seq":453,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.296130+0000","last_change":"2023-11-18T21:29:10.296193+0000","last_active":"2023-11-18T21:29:10.296130+0000","last_peered":"2023-11-18T21:29:10.296130+0000","last_clean":"2023-11-18T21:29:10.296130+0000","last_became_active":"2023-11-18T20:59:25.457871+0000","last_became_peered":"2023-11-18T20:59:25.457871+0000","last_unstale":"2023-11-18T21:29:10.296130+0000","last_undegraded":"2023-11-18T21:29:10.296130+0000","last_fullsized":"2023-11-18T21:29:10.296130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'409","last_scrub_stamp":"2023-11-18T21:29:10.295947+0000","last_deep_scrub":"31'409","last_deep_scrub_stamp":"2023-11-18T21:29:10.295947+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.295947+0000","objects_scrubbed":2,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:46:51.703977+0000","scrub_duration":0.017910031999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":996,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"31'93","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:32.223717+0000","last_change":"2023-11-18T21:29:32.223777+0000","last_active":"2023-11-18T21:29:32.223717+0000","last_peered":"2023-11-18T21:29:32.223717+0000","last_clean":"2023-11-18T21:29:32.223717+0000","last_became_active":"2023-11-18T20:59:35.842583+0000","last_became_peered":"2023-11-18T20:59:35.842583+0000","last_unstale":"2023-11-18T21:29:32.223717+0000","last_undegraded":"2023-11-18T21:29:32.223717+0000","last_fullsized":"2023-11-18T21:29:32.223717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'93","last_scrub_stamp":"2023-11-18T21:29:32.223517+0000","last_deep_scrub":"31'93","last_deep_scrub_stamp":"2023-11-18T21:29:32.223517+0000","last_clean_scrub_stamp":"2023-11-18T21:29:32.223517+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:29.249701+0000","scrub_duration":0.0088994439999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'46","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:11.348530+0000","last_change":"2023-11-18T21:29:11.348582+0000","last_active":"2023-11-18T21:29:11.348530+0000","last_peered":"2023-11-18T21:29:11.348530+0000","last_clean":"2023-11-18T21:29:11.348530+0000","last_became_active":"2023-11-18T20:59:27.687250+0000","last_became_peered":"2023-11-18T20:59:27.687250+0000","last_unstale":"2023-11-18T21:29:11.348530+0000","last_undegraded":"2023-11-18T21:29:11.348530+0000","last_fullsized":"2023-11-18T21:29:11.348530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-11-18T21:29:11.348342+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-11-18T21:29:11.348342+0000","last_clean_scrub_stamp":"2023-11-18T21:29:11.348342+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:38:22.498619+0000","scrub_duration":0.0033288079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"31'206","reported_seq":250,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.475085+0000","last_change":"2023-11-18T21:29:04.475145+0000","last_active":"2023-11-18T21:29:04.475085+0000","last_peered":"2023-11-18T21:29:04.475085+0000","last_clean":"2023-11-18T21:29:04.475085+0000","last_became_active":"2023-11-18T20:59:25.351318+0000","last_became_peered":"2023-11-18T20:59:25.351318+0000","last_unstale":"2023-11-18T21:29:04.475085+0000","last_undegraded":"2023-11-18T21:29:04.475085+0000","last_fullsized":"2023-11-18T21:29:04.475085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'206","last_scrub_stamp":"2023-11-18T21:29:04.474913+0000","last_deep_scrub":"31'206","last_deep_scrub_stamp":"2023-11-18T21:29:04.474913+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.474913+0000","objects_scrubbed":4,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:35.853099+0000","scrub_duration":0.010175724000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'80","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:27.249747+0000","last_change":"2023-11-18T21:29:27.249804+0000","last_active":"2023-11-18T21:29:27.249747+0000","last_peered":"2023-11-18T21:29:27.249747+0000","last_clean":"2023-11-18T21:29:27.249747+0000","last_became_active":"2023-11-18T20:59:35.834894+0000","last_became_peered":"2023-11-18T20:59:35.834894+0000","last_unstale":"2023-11-18T21:29:27.249747+0000","last_undegraded":"2023-11-18T21:29:27.249747+0000","last_fullsized":"2023-11-18T21:29:27.249747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'80","last_scrub_stamp":"2023-11-18T21:29:27.249554+0000","last_deep_scrub":"31'80","last_deep_scrub_stamp":"2023-11-18T21:29:27.249554+0000","last_clean_scrub_stamp":"2023-11-18T21:29:27.249554+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:21.683683+0000","scrub_duration":0.0092037430000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":144,"num_write":72,"num_write_kb":6857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"31'48","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:07.569373+0000","last_change":"2023-11-18T21:29:07.569471+0000","last_active":"2023-11-18T21:29:07.569373+0000","last_peered":"2023-11-18T21:29:07.569373+0000","last_clean":"2023-11-18T21:29:07.569373+0000","last_became_active":"2023-11-18T20:59:27.686692+0000","last_became_peered":"2023-11-18T20:59:27.686692+0000","last_unstale":"2023-11-18T21:29:07.569373+0000","last_undegraded":"2023-11-18T21:29:07.569373+0000","last_fullsized":"2023-11-18T21:29:07.569373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2023-11-18T21:29:07.568991+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2023-11-18T21:29:07.568991+0000","last_clean_scrub_stamp":"2023-11-18T21:29:07.568991+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:57:10.343662+0000","scrub_duration":0.0041715520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'9","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:00.073675+0000","last_change":"2023-11-18T21:29:00.073730+0000","last_active":"2023-11-18T21:29:00.073675+0000","last_peered":"2023-11-18T21:29:00.073675+0000","last_clean":"2023-11-18T21:29:00.073675+0000","last_became_active":"2023-11-18T20:59:25.347022+0000","last_became_peered":"2023-11-18T20:59:25.347022+0000","last_unstale":"2023-11-18T21:29:00.073675+0000","last_undegraded":"2023-11-18T21:29:00.073675+0000","last_fullsized":"2023-11-18T21:29:00.073675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2023-11-18T21:29:00.073501+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2023-11-18T21:29:00.073501+0000","last_clean_scrub_stamp":"2023-11-18T21:29:00.073501+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:11:30.795362+0000","scrub_duration":0.005583368,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'120","reported_seq":157,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:35.101741+0000","last_change":"2023-11-18T21:29:35.101857+0000","last_active":"2023-11-18T21:29:35.101741+0000","last_peered":"2023-11-18T21:29:35.101741+0000","last_clean":"2023-11-18T21:29:35.101741+0000","last_became_active":"2023-11-18T20:59:35.770923+0000","last_became_peered":"2023-11-18T20:59:35.770923+0000","last_unstale":"2023-11-18T21:29:35.101741+0000","last_undegraded":"2023-11-18T21:29:35.101741+0000","last_fullsized":"2023-11-18T21:29:35.101741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'120","last_scrub_stamp":"2023-11-18T21:29:35.101483+0000","last_deep_scrub":"31'120","last_deep_scrub_stamp":"2023-11-18T21:29:35.101483+0000","last_clean_scrub_stamp":"2023-11-18T21:29:35.101483+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:42:04.305607+0000","scrub_duration":0.012082028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'44","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:29.245034+0000","last_change":"2023-11-18T21:29:29.245086+0000","last_active":"2023-11-18T21:29:29.245034+0000","last_peered":"2023-11-18T21:29:29.245034+0000","last_clean":"2023-11-18T21:29:29.245034+0000","last_became_active":"2023-11-18T20:59:27.689156+0000","last_became_peered":"2023-11-18T20:59:27.689156+0000","last_unstale":"2023-11-18T21:29:29.245034+0000","last_undegraded":"2023-11-18T21:29:29.245034+0000","last_fullsized":"2023-11-18T21:29:29.245034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'44","last_scrub_stamp":"2023-11-18T21:29:29.244816+0000","last_deep_scrub":"31'44","last_deep_scrub_stamp":"2023-11-18T21:29:29.244816+0000","last_clean_scrub_stamp":"2023-11-18T21:29:29.244816+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:37.524227+0000","scrub_duration":0.0033979600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"31'16","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:36.400286+0000","last_change":"2023-11-18T21:29:36.400403+0000","last_active":"2023-11-18T21:29:36.400286+0000","last_peered":"2023-11-18T21:29:36.400286+0000","last_clean":"2023-11-18T21:29:36.400286+0000","last_became_active":"2023-11-18T20:59:25.346318+0000","last_became_peered":"2023-11-18T20:59:25.346318+0000","last_unstale":"2023-11-18T21:29:36.400286+0000","last_undegraded":"2023-11-18T21:29:36.400286+0000","last_fullsized":"2023-11-18T21:29:36.400286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2023-11-18T21:29:36.400067+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2023-11-18T21:29:36.400067+0000","last_clean_scrub_stamp":"2023-11-18T21:29:36.400067+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:07:10.357774+0000","scrub_duration":0.011649005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"31'81","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:19.205259+0000","last_change":"2023-11-18T21:29:19.205374+0000","last_active":"2023-11-18T21:29:19.205259+0000","last_peered":"2023-11-18T21:29:19.205259+0000","last_clean":"2023-11-18T21:29:19.205259+0000","last_became_active":"2023-11-18T20:59:35.833407+0000","last_became_peered":"2023-11-18T20:59:35.833407+0000","last_unstale":"2023-11-18T21:29:19.205259+0000","last_undegraded":"2023-11-18T21:29:19.205259+0000","last_fullsized":"2023-11-18T21:29:19.205259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'81","last_scrub_stamp":"2023-11-18T21:29:19.205015+0000","last_deep_scrub":"31'81","last_deep_scrub_stamp":"2023-11-18T21:29:19.205015+0000","last_clean_scrub_stamp":"2023-11-18T21:29:19.205015+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:16.421641+0000","scrub_duration":0.0093240909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":9489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'53","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:27.263871+0000","last_change":"2023-11-18T21:29:27.263926+0000","last_active":"2023-11-18T21:29:27.263871+0000","last_peered":"2023-11-18T21:29:27.263871+0000","last_clean":"2023-11-18T21:29:27.263871+0000","last_became_active":"2023-11-18T20:59:27.863358+0000","last_became_peered":"2023-11-18T20:59:27.863358+0000","last_unstale":"2023-11-18T21:29:27.263871+0000","last_undegraded":"2023-11-18T21:29:27.263871+0000","last_fullsized":"2023-11-18T21:29:27.263871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2023-11-18T21:29:27.263671+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2023-11-18T21:29:27.263671+0000","last_clean_scrub_stamp":"2023-11-18T21:29:27.263671+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:01:59.423966+0000","scrub_duration":0.0060545679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"31'153","reported_seq":197,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:06.548115+0000","last_change":"2023-11-18T21:29:06.548239+0000","last_active":"2023-11-18T21:29:06.548115+0000","last_peered":"2023-11-18T21:29:06.548115+0000","last_clean":"2023-11-18T21:29:06.548115+0000","last_became_active":"2023-11-18T20:59:25.350705+0000","last_became_peered":"2023-11-18T20:59:25.350705+0000","last_unstale":"2023-11-18T21:29:06.548115+0000","last_undegraded":"2023-11-18T21:29:06.548115+0000","last_fullsized":"2023-11-18T21:29:06.548115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-11-18T21:29:06.547908+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-11-18T21:29:06.547908+0000","last_clean_scrub_stamp":"2023-11-18T21:29:06.547908+0000","objects_scrubbed":4,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:17:24.614328+0000","scrub_duration":0.011886097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"31'89","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:40.145401+0000","last_change":"2023-11-18T21:29:40.145455+0000","last_active":"2023-11-18T21:29:40.145401+0000","last_peered":"2023-11-18T21:29:40.145401+0000","last_clean":"2023-11-18T21:29:40.145401+0000","last_became_active":"2023-11-18T20:59:35.840533+0000","last_became_peered":"2023-11-18T20:59:35.840533+0000","last_unstale":"2023-11-18T21:29:40.145401+0000","last_undegraded":"2023-11-18T21:29:40.145401+0000","last_fullsized":"2023-11-18T21:29:40.145401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'89","last_scrub_stamp":"2023-11-18T21:29:40.145195+0000","last_deep_scrub":"31'89","last_deep_scrub_stamp":"2023-11-18T21:29:40.145195+0000","last_clean_scrub_stamp":"2023-11-18T21:29:40.145195+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:27:09.819028+0000","scrub_duration":0.011320111000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":9026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"31'60","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:23.268453+0000","last_change":"2023-11-18T21:29:23.268503+0000","last_active":"2023-11-18T21:29:23.268453+0000","last_peered":"2023-11-18T21:29:23.268453+0000","last_clean":"2023-11-18T21:29:23.268453+0000","last_became_active":"2023-11-18T20:59:27.868355+0000","last_became_peered":"2023-11-18T20:59:27.868355+0000","last_unstale":"2023-11-18T21:29:23.268453+0000","last_undegraded":"2023-11-18T21:29:23.268453+0000","last_fullsized":"2023-11-18T21:29:23.268453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'60","last_scrub_stamp":"2023-11-18T21:29:23.268260+0000","last_deep_scrub":"31'60","last_deep_scrub_stamp":"2023-11-18T21:29:23.268260+0000","last_clean_scrub_stamp":"2023-11-18T21:29:23.268260+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:20.484886+0000","scrub_duration":0.0031106860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"31'97","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:29.323993+0000","last_change":"2023-11-18T21:29:29.324057+0000","last_active":"2023-11-18T21:29:29.323993+0000","last_peered":"2023-11-18T21:29:29.323993+0000","last_clean":"2023-11-18T21:29:29.323993+0000","last_became_active":"2023-11-18T20:59:25.349346+0000","last_became_peered":"2023-11-18T20:59:25.349346+0000","last_unstale":"2023-11-18T21:29:29.323993+0000","last_undegraded":"2023-11-18T21:29:29.323993+0000","last_fullsized":"2023-11-18T21:29:29.323993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'97","last_scrub_stamp":"2023-11-18T21:29:29.323804+0000","last_deep_scrub":"31'97","last_deep_scrub_stamp":"2023-11-18T21:29:29.323804+0000","last_clean_scrub_stamp":"2023-11-18T21:29:29.323804+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:27.515175+0000","scrub_duration":0.0095652810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"31'98","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:47.334088+0000","last_change":"2023-11-18T20:59:35.847005+0000","last_active":"2023-11-18T21:28:47.334088+0000","last_peered":"2023-11-18T21:28:47.334088+0000","last_clean":"2023-11-18T21:28:47.334088+0000","last_became_active":"2023-11-18T20:59:35.846458+0000","last_became_peered":"2023-11-18T20:59:35.846458+0000","last_unstale":"2023-11-18T21:28:47.334088+0000","last_undegraded":"2023-11-18T21:28:47.334088+0000","last_fullsized":"2023-11-18T21:28:47.334088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":10588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"31'50","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.160928+0000","last_change":"2023-11-18T21:29:04.160980+0000","last_active":"2023-11-18T21:29:04.160928+0000","last_peered":"2023-11-18T21:29:04.160928+0000","last_clean":"2023-11-18T21:29:04.160928+0000","last_became_active":"2023-11-18T20:59:27.887876+0000","last_became_peered":"2023-11-18T20:59:27.887876+0000","last_unstale":"2023-11-18T21:29:04.160928+0000","last_undegraded":"2023-11-18T21:29:04.160928+0000","last_fullsized":"2023-11-18T21:29:04.160928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'50","last_scrub_stamp":"2023-11-18T21:29:04.160739+0000","last_deep_scrub":"31'50","last_deep_scrub_stamp":"2023-11-18T21:29:04.160739+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.160739+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:11:22.163473+0000","scrub_duration":0.00435988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:12.457669+0000","last_change":"2023-11-18T21:29:12.457723+0000","last_active":"2023-11-18T21:29:12.457669+0000","last_peered":"2023-11-18T21:29:12.457669+0000","last_clean":"2023-11-18T21:29:12.457669+0000","last_became_active":"2023-11-18T20:59:25.459235+0000","last_became_peered":"2023-11-18T20:59:25.459235+0000","last_unstale":"2023-11-18T21:29:12.457669+0000","last_undegraded":"2023-11-18T21:29:12.457669+0000","last_fullsized":"2023-11-18T21:29:12.457669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-11-18T21:29:12.457455+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-11-18T21:29:12.457455+0000","last_clean_scrub_stamp":"2023-11-18T21:29:12.457455+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:52:11.157078+0000","scrub_duration":0.0039406650000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:35.492575+0000","last_change":"2023-11-18T21:29:35.492633+0000","last_active":"2023-11-18T21:29:35.492575+0000","last_peered":"2023-11-18T21:29:35.492575+0000","last_clean":"2023-11-18T21:29:35.492575+0000","last_became_active":"2023-11-18T20:59:35.834275+0000","last_became_peered":"2023-11-18T20:59:35.834275+0000","last_unstale":"2023-11-18T21:29:35.492575+0000","last_undegraded":"2023-11-18T21:29:35.492575+0000","last_fullsized":"2023-11-18T21:29:35.492575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'83","last_scrub_stamp":"2023-11-18T21:29:35.492360+0000","last_deep_scrub":"31'83","last_deep_scrub_stamp":"2023-11-18T21:29:35.492360+0000","last_clean_scrub_stamp":"2023-11-18T21:29:35.492360+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:18:31.489432+0000","scrub_duration":0.0095908969999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'61","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:30.233299+0000","last_change":"2023-11-18T21:29:30.233299+0000","last_active":"2023-11-18T21:29:30.233299+0000","last_peered":"2023-11-18T21:29:30.233299+0000","last_clean":"2023-11-18T21:29:30.233299+0000","last_became_active":"2023-11-18T21:00:28.720412+0000","last_became_peered":"2023-11-18T21:00:28.720412+0000","last_unstale":"2023-11-18T21:29:30.233299+0000","last_undegraded":"2023-11-18T21:29:30.233299+0000","last_fullsized":"2023-11-18T21:29:30.233299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'61","last_scrub_stamp":"2023-11-18T21:29:30.232988+0000","last_deep_scrub":"31'61","last_deep_scrub_stamp":"2023-11-18T21:29:30.232988+0000","last_clean_scrub_stamp":"2023-11-18T21:29:30.232988+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:12:00.954850+0000","scrub_duration":0.0059738029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"31'657","reported_seq":702,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:23.405929+0000","last_change":"2023-11-18T21:29:23.406084+0000","last_active":"2023-11-18T21:29:23.405929+0000","last_peered":"2023-11-18T21:29:23.405929+0000","last_clean":"2023-11-18T21:29:23.405929+0000","last_became_active":"2023-11-18T20:59:25.354716+0000","last_became_peered":"2023-11-18T20:59:25.354716+0000","last_unstale":"2023-11-18T21:29:23.405929+0000","last_undegraded":"2023-11-18T21:29:23.405929+0000","last_fullsized":"2023-11-18T21:29:23.405929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'657","last_scrub_stamp":"2023-11-18T21:29:23.405635+0000","last_deep_scrub":"31'657","last_deep_scrub_stamp":"2023-11-18T21:29:23.405635+0000","last_clean_scrub_stamp":"2023-11-18T21:29:23.405635+0000","objects_scrubbed":2,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:12:17.734571+0000","scrub_duration":0.022876138000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":3369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'79","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:38.514076+0000","last_change":"2023-11-18T21:29:38.514135+0000","last_active":"2023-11-18T21:29:38.514076+0000","last_peered":"2023-11-18T21:29:38.514076+0000","last_clean":"2023-11-18T21:29:38.514076+0000","last_became_active":"2023-11-18T20:59:35.838732+0000","last_became_peered":"2023-11-18T20:59:35.838732+0000","last_unstale":"2023-11-18T21:29:38.514076+0000","last_undegraded":"2023-11-18T21:29:38.514076+0000","last_fullsized":"2023-11-18T21:29:38.514076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'79","last_scrub_stamp":"2023-11-18T21:29:38.513857+0000","last_deep_scrub":"31'79","last_deep_scrub_stamp":"2023-11-18T21:29:38.513857+0000","last_clean_scrub_stamp":"2023-11-18T21:29:38.513857+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:40:59.029899+0000","scrub_duration":0.0080516670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"31'54","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:36.396805+0000","last_change":"2023-11-18T21:29:36.396805+0000","last_active":"2023-11-18T21:29:36.396805+0000","last_peered":"2023-11-18T21:29:36.396805+0000","last_clean":"2023-11-18T21:29:36.396805+0000","last_became_active":"2023-11-18T20:59:27.838664+0000","last_became_peered":"2023-11-18T20:59:27.838664+0000","last_unstale":"2023-11-18T21:29:36.396805+0000","last_undegraded":"2023-11-18T21:29:36.396805+0000","last_fullsized":"2023-11-18T21:29:36.396805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-11-18T21:29:36.396470+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-11-18T21:29:36.396470+0000","last_clean_scrub_stamp":"2023-11-18T21:29:36.396470+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:12:30.725407+0000","scrub_duration":0.0035553899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"31'166","reported_seq":284,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.394094+0000","last_change":"2023-11-18T21:29:04.394160+0000","last_active":"2023-11-18T21:29:04.394094+0000","last_peered":"2023-11-18T21:29:04.394094+0000","last_clean":"2023-11-18T21:29:04.394094+0000","last_became_active":"2023-11-18T20:59:25.458075+0000","last_became_peered":"2023-11-18T20:59:25.458075+0000","last_unstale":"2023-11-18T21:29:04.394094+0000","last_undegraded":"2023-11-18T21:29:04.394094+0000","last_fullsized":"2023-11-18T21:29:04.394094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'166","last_scrub_stamp":"2023-11-18T21:29:04.393926+0000","last_deep_scrub":"31'166","last_deep_scrub_stamp":"2023-11-18T21:29:04.393926+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.393926+0000","objects_scrubbed":4,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:21:30.888691+0000","scrub_duration":0.0067038549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18647,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":79,"num_write":158,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"31'81","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:32.437725+0000","last_change":"2023-11-18T21:29:32.437782+0000","last_active":"2023-11-18T21:29:32.437725+0000","last_peered":"2023-11-18T21:29:32.437725+0000","last_clean":"2023-11-18T21:29:32.437725+0000","last_became_active":"2023-11-18T20:59:35.832891+0000","last_became_peered":"2023-11-18T20:59:35.832891+0000","last_unstale":"2023-11-18T21:29:32.437725+0000","last_undegraded":"2023-11-18T21:29:32.437725+0000","last_fullsized":"2023-11-18T21:29:32.437725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'81","last_scrub_stamp":"2023-11-18T21:29:32.437527+0000","last_deep_scrub":"31'81","last_deep_scrub_stamp":"2023-11-18T21:29:32.437527+0000","last_clean_scrub_stamp":"2023-11-18T21:29:32.437527+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:18:04.554309+0000","scrub_duration":0.0090556939999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"31'58","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:11.258017+0000","last_change":"2023-11-18T21:29:11.258075+0000","last_active":"2023-11-18T21:29:11.258017+0000","last_peered":"2023-11-18T21:29:11.258017+0000","last_clean":"2023-11-18T21:29:11.258017+0000","last_became_active":"2023-11-18T20:59:27.889115+0000","last_became_peered":"2023-11-18T20:59:27.889115+0000","last_unstale":"2023-11-18T21:29:11.258017+0000","last_undegraded":"2023-11-18T21:29:11.258017+0000","last_fullsized":"2023-11-18T21:29:11.258017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'58","last_scrub_stamp":"2023-11-18T21:29:11.257818+0000","last_deep_scrub":"31'58","last_deep_scrub_stamp":"2023-11-18T21:29:11.257818+0000","last_clean_scrub_stamp":"2023-11-18T21:29:11.257818+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:12:06.078536+0000","scrub_duration":0.003715884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"31'9","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:37.358639+0000","last_change":"2023-11-18T21:29:37.358639+0000","last_active":"2023-11-18T21:29:37.358639+0000","last_peered":"2023-11-18T21:29:37.358639+0000","last_clean":"2023-11-18T21:29:37.358639+0000","last_became_active":"2023-11-18T20:59:25.459405+0000","last_became_peered":"2023-11-18T20:59:25.459405+0000","last_unstale":"2023-11-18T21:29:37.358639+0000","last_undegraded":"2023-11-18T21:29:37.358639+0000","last_fullsized":"2023-11-18T21:29:37.358639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2023-11-18T21:29:37.358401+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2023-11-18T21:29:37.358401+0000","last_clean_scrub_stamp":"2023-11-18T21:29:37.358401+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:07.232883+0000","scrub_duration":0.006636154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"31'64","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:47.482888+0000","last_change":"2023-11-18T20:59:35.842229+0000","last_active":"2023-11-18T21:27:47.482888+0000","last_peered":"2023-11-18T21:27:47.482888+0000","last_clean":"2023-11-18T21:27:47.482888+0000","last_became_active":"2023-11-18T20:59:35.835644+0000","last_became_peered":"2023-11-18T20:59:35.835644+0000","last_unstale":"2023-11-18T21:27:47.482888+0000","last_undegraded":"2023-11-18T21:27:47.482888+0000","last_fullsized":"2023-11-18T21:27:47.482888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"31'47","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:19.284666+0000","last_change":"2023-11-18T21:29:19.284778+0000","last_active":"2023-11-18T21:29:19.284666+0000","last_peered":"2023-11-18T21:29:19.284666+0000","last_clean":"2023-11-18T21:29:19.284666+0000","last_became_active":"2023-11-18T20:59:27.890499+0000","last_became_peered":"2023-11-18T20:59:27.890499+0000","last_unstale":"2023-11-18T21:29:19.284666+0000","last_undegraded":"2023-11-18T21:29:19.284666+0000","last_fullsized":"2023-11-18T21:29:19.284666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-11-18T21:29:19.284440+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-11-18T21:29:19.284440+0000","last_clean_scrub_stamp":"2023-11-18T21:29:19.284440+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:18:47.615835+0000","scrub_duration":0.0039795910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"31'13","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:32.389678+0000","last_change":"2023-11-18T21:29:32.389731+0000","last_active":"2023-11-18T21:29:32.389678+0000","last_peered":"2023-11-18T21:29:32.389678+0000","last_clean":"2023-11-18T21:29:32.389678+0000","last_became_active":"2023-11-18T20:59:25.338020+0000","last_became_peered":"2023-11-18T20:59:25.338020+0000","last_unstale":"2023-11-18T21:29:32.389678+0000","last_undegraded":"2023-11-18T21:29:32.389678+0000","last_fullsized":"2023-11-18T21:29:32.389678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2023-11-18T21:29:32.389550+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2023-11-18T21:29:32.389550+0000","last_clean_scrub_stamp":"2023-11-18T21:29:32.389550+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:37.143132+0000","scrub_duration":0.011491572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:55.904332+0000","last_change":"2023-11-18T21:28:55.904332+0000","last_active":"2023-11-18T21:28:55.904332+0000","last_peered":"2023-11-18T21:28:55.904332+0000","last_clean":"2023-11-18T21:28:55.904332+0000","last_became_active":"2023-11-18T20:58:44.731076+0000","last_became_peered":"2023-11-18T20:58:44.731076+0000","last_unstale":"2023-11-18T21:28:55.904332+0000","last_undegraded":"2023-11-18T21:28:55.904332+0000","last_fullsized":"2023-11-18T21:28:55.904332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-11-18T21:28:55.904224+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-11-18T21:28:55.904224+0000","last_clean_scrub_stamp":"2023-11-18T21:28:55.904224+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:05:55.057907+0000","scrub_duration":0.010934374,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'66","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:57.356173+0000","last_change":"2023-11-18T20:59:35.771637+0000","last_active":"2023-11-18T21:28:57.356173+0000","last_peered":"2023-11-18T21:28:57.356173+0000","last_clean":"2023-11-18T21:28:57.356173+0000","last_became_active":"2023-11-18T20:59:35.771146+0000","last_became_peered":"2023-11-18T20:59:35.771146+0000","last_unstale":"2023-11-18T21:28:57.356173+0000","last_undegraded":"2023-11-18T21:28:57.356173+0000","last_fullsized":"2023-11-18T21:28:57.356173+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":6116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"31'58","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:40.307000+0000","last_change":"2023-11-18T21:29:40.307040+0000","last_active":"2023-11-18T21:29:40.307000+0000","last_peered":"2023-11-18T21:29:40.307000+0000","last_clean":"2023-11-18T21:29:40.307000+0000","last_became_active":"2023-11-18T20:59:27.683316+0000","last_became_peered":"2023-11-18T20:59:27.683316+0000","last_unstale":"2023-11-18T21:29:40.307000+0000","last_undegraded":"2023-11-18T21:29:40.307000+0000","last_fullsized":"2023-11-18T21:29:40.307000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'58","last_scrub_stamp":"2023-11-18T21:29:40.306849+0000","last_deep_scrub":"31'58","last_deep_scrub_stamp":"2023-11-18T21:29:40.306849+0000","last_clean_scrub_stamp":"2023-11-18T21:29:40.306849+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:53:06.877436+0000","scrub_duration":0.0032485679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"31'668","reported_seq":712,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:08.356740+0000","last_change":"2023-11-18T21:29:08.356797+0000","last_active":"2023-11-18T21:29:08.356740+0000","last_peered":"2023-11-18T21:29:08.356740+0000","last_clean":"2023-11-18T21:29:08.356740+0000","last_became_active":"2023-11-18T20:59:25.356883+0000","last_became_peered":"2023-11-18T20:59:25.356883+0000","last_unstale":"2023-11-18T21:29:08.356740+0000","last_undegraded":"2023-11-18T21:29:08.356740+0000","last_fullsized":"2023-11-18T21:29:08.356740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'668","last_scrub_stamp":"2023-11-18T21:29:08.356563+0000","last_deep_scrub":"31'668","last_deep_scrub_stamp":"2023-11-18T21:29:08.356563+0000","last_clean_scrub_stamp":"2023-11-18T21:29:08.356563+0000","objects_scrubbed":3,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:31:33.757650+0000","scrub_duration":0.021449706999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3370313,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"31'82","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:28.221389+0000","last_change":"2023-11-18T21:29:28.221446+0000","last_active":"2023-11-18T21:29:28.221389+0000","last_peered":"2023-11-18T21:29:28.221389+0000","last_clean":"2023-11-18T21:29:28.221389+0000","last_became_active":"2023-11-18T20:59:35.833790+0000","last_became_peered":"2023-11-18T20:59:35.833790+0000","last_unstale":"2023-11-18T21:29:28.221389+0000","last_undegraded":"2023-11-18T21:29:28.221389+0000","last_fullsized":"2023-11-18T21:29:28.221389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'82","last_scrub_stamp":"2023-11-18T21:29:28.221111+0000","last_deep_scrub":"31'82","last_deep_scrub_stamp":"2023-11-18T21:29:28.221111+0000","last_clean_scrub_stamp":"2023-11-18T21:29:28.221111+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:52:26.920735+0000","scrub_duration":0.010842701,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":7460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'56","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:19.076942+0000","last_change":"2023-11-18T21:29:19.077045+0000","last_active":"2023-11-18T21:29:19.076942+0000","last_peered":"2023-11-18T21:29:19.076942+0000","last_clean":"2023-11-18T21:29:19.076942+0000","last_became_active":"2023-11-18T20:59:27.872733+0000","last_became_peered":"2023-11-18T20:59:27.872733+0000","last_unstale":"2023-11-18T21:29:19.076942+0000","last_undegraded":"2023-11-18T21:29:19.076942+0000","last_fullsized":"2023-11-18T21:29:19.076942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'56","last_scrub_stamp":"2023-11-18T21:29:19.076632+0000","last_deep_scrub":"31'56","last_deep_scrub_stamp":"2023-11-18T21:29:19.076632+0000","last_clean_scrub_stamp":"2023-11-18T21:29:19.076632+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:47:44.422123+0000","scrub_duration":0.0042975579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"31'8","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.425651+0000","last_change":"2023-11-18T21:29:10.425770+0000","last_active":"2023-11-18T21:29:10.425651+0000","last_peered":"2023-11-18T21:29:10.425651+0000","last_clean":"2023-11-18T21:29:10.425651+0000","last_became_active":"2023-11-18T20:59:25.496694+0000","last_became_peered":"2023-11-18T20:59:25.496694+0000","last_unstale":"2023-11-18T21:29:10.425651+0000","last_undegraded":"2023-11-18T21:29:10.425651+0000","last_fullsized":"2023-11-18T21:29:10.425651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-11-18T21:29:10.425430+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-11-18T21:29:10.425430+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.425430+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:35:04.927101+0000","scrub_duration":0.0074186599999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'95","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:52.294489+0000","last_change":"2023-11-18T20:59:35.829393+0000","last_active":"2023-11-18T21:28:52.294489+0000","last_peered":"2023-11-18T21:28:52.294489+0000","last_clean":"2023-11-18T21:28:52.294489+0000","last_became_active":"2023-11-18T20:59:35.828446+0000","last_became_peered":"2023-11-18T20:59:35.828446+0000","last_unstale":"2023-11-18T21:28:52.294489+0000","last_undegraded":"2023-11-18T21:28:52.294489+0000","last_fullsized":"2023-11-18T21:28:52.294489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":11010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"31'55","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:56.199386+0000","last_change":"2023-11-18T21:28:56.199412+0000","last_active":"2023-11-18T21:28:56.199386+0000","last_peered":"2023-11-18T21:28:56.199386+0000","last_clean":"2023-11-18T21:28:56.199386+0000","last_became_active":"2023-11-18T20:59:27.870220+0000","last_became_peered":"2023-11-18T20:59:27.870220+0000","last_unstale":"2023-11-18T21:28:56.199386+0000","last_undegraded":"2023-11-18T21:28:56.199386+0000","last_fullsized":"2023-11-18T21:28:56.199386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'55","last_scrub_stamp":"2023-11-18T21:28:56.199297+0000","last_deep_scrub":"31'55","last_deep_scrub_stamp":"2023-11-18T21:28:56.199297+0000","last_clean_scrub_stamp":"2023-11-18T21:28:56.199297+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:51:50.633425+0000","scrub_duration":0.003736053,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"31'14","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:07.506880+0000","last_change":"2023-11-18T21:29:07.506940+0000","last_active":"2023-11-18T21:29:07.506880+0000","last_peered":"2023-11-18T21:29:07.506880+0000","last_clean":"2023-11-18T21:29:07.506880+0000","last_became_active":"2023-11-18T20:59:25.457392+0000","last_became_peered":"2023-11-18T20:59:25.457392+0000","last_unstale":"2023-11-18T21:29:07.506880+0000","last_undegraded":"2023-11-18T21:29:07.506880+0000","last_fullsized":"2023-11-18T21:29:07.506880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-11-18T21:29:07.506693+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-11-18T21:29:07.506693+0000","last_clean_scrub_stamp":"2023-11-18T21:29:07.506693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:33:54.342375+0000","scrub_duration":0.0081357319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"31'70","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:47.545927+0000","last_change":"2023-11-18T20:59:35.831579+0000","last_active":"2023-11-18T21:27:47.545927+0000","last_peered":"2023-11-18T21:27:47.545927+0000","last_clean":"2023-11-18T21:27:47.545927+0000","last_became_active":"2023-11-18T20:59:35.831147+0000","last_became_peered":"2023-11-18T20:59:35.831147+0000","last_unstale":"2023-11-18T21:27:47.545927+0000","last_undegraded":"2023-11-18T21:27:47.545927+0000","last_fullsized":"2023-11-18T21:27:47.545927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"31'58","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.132781+0000","last_change":"2023-11-18T21:29:10.132883+0000","last_active":"2023-11-18T21:29:10.132781+0000","last_peered":"2023-11-18T21:29:10.132781+0000","last_clean":"2023-11-18T21:29:10.132781+0000","last_became_active":"2023-11-18T20:59:27.894931+0000","last_became_peered":"2023-11-18T20:59:27.894931+0000","last_unstale":"2023-11-18T21:29:10.132781+0000","last_undegraded":"2023-11-18T21:29:10.132781+0000","last_fullsized":"2023-11-18T21:29:10.132781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'58","last_scrub_stamp":"2023-11-18T21:29:10.132550+0000","last_deep_scrub":"31'58","last_deep_scrub_stamp":"2023-11-18T21:29:10.132550+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.132550+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:23:05.142528+0000","scrub_duration":0.0037235850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"31'208","reported_seq":252,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:09.031548+0000","last_change":"2023-11-18T21:29:09.031667+0000","last_active":"2023-11-18T21:29:09.031548+0000","last_peered":"2023-11-18T21:29:09.031548+0000","last_clean":"2023-11-18T21:29:09.031548+0000","last_became_active":"2023-11-18T20:59:25.457932+0000","last_became_peered":"2023-11-18T20:59:25.457932+0000","last_unstale":"2023-11-18T21:29:09.031548+0000","last_undegraded":"2023-11-18T21:29:09.031548+0000","last_fullsized":"2023-11-18T21:29:09.031548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'208","last_scrub_stamp":"2023-11-18T21:29:09.031320+0000","last_deep_scrub":"31'208","last_deep_scrub_stamp":"2023-11-18T21:29:09.031320+0000","last_clean_scrub_stamp":"2023-11-18T21:29:09.031320+0000","objects_scrubbed":2,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:35:03.532991+0000","scrub_duration":0.011462553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":499,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"31'58","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:23.107792+0000","last_change":"2023-11-18T21:29:23.107901+0000","last_active":"2023-11-18T21:29:23.107792+0000","last_peered":"2023-11-18T21:29:23.107792+0000","last_clean":"2023-11-18T21:29:23.107792+0000","last_became_active":"2023-11-18T20:59:35.831804+0000","last_became_peered":"2023-11-18T20:59:35.831804+0000","last_unstale":"2023-11-18T21:29:23.107792+0000","last_undegraded":"2023-11-18T21:29:23.107792+0000","last_fullsized":"2023-11-18T21:29:23.107792+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'58","last_scrub_stamp":"2023-11-18T21:29:23.107505+0000","last_deep_scrub":"31'58","last_deep_scrub_stamp":"2023-11-18T21:29:23.107505+0000","last_clean_scrub_stamp":"2023-11-18T21:29:23.107505+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:21.521667+0000","scrub_duration":0.0098175209999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":9539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'55","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.664273+0000","last_change":"2023-11-18T20:59:27.884733+0000","last_active":"2023-11-18T21:28:43.664273+0000","last_peered":"2023-11-18T21:28:43.664273+0000","last_clean":"2023-11-18T21:28:43.664273+0000","last_became_active":"2023-11-18T20:59:27.884143+0000","last_became_peered":"2023-11-18T20:59:27.884143+0000","last_unstale":"2023-11-18T21:28:43.664273+0000","last_undegraded":"2023-11-18T21:28:43.664273+0000","last_fullsized":"2023-11-18T21:28:43.664273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"31'155","reported_seq":198,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.403625+0000","last_change":"2023-11-18T21:29:10.403695+0000","last_active":"2023-11-18T21:29:10.403625+0000","last_peered":"2023-11-18T21:29:10.403625+0000","last_clean":"2023-11-18T21:29:10.403625+0000","last_became_active":"2023-11-18T20:59:25.362350+0000","last_became_peered":"2023-11-18T20:59:25.362350+0000","last_unstale":"2023-11-18T21:29:10.403625+0000","last_undegraded":"2023-11-18T21:29:10.403625+0000","last_fullsized":"2023-11-18T21:29:10.403625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'155","last_scrub_stamp":"2023-11-18T21:29:10.403422+0000","last_deep_scrub":"31'155","last_deep_scrub_stamp":"2023-11-18T21:29:10.403422+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.403422+0000","objects_scrubbed":8,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:31:46.910785+0000","scrub_duration":0.016723597999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"31'80","reported_seq":116,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:40.509735+0000","last_change":"2023-11-18T21:29:40.509842+0000","last_active":"2023-11-18T21:29:40.509735+0000","last_peered":"2023-11-18T21:29:40.509735+0000","last_clean":"2023-11-18T21:29:40.509735+0000","last_became_active":"2023-11-18T20:59:35.834153+0000","last_became_peered":"2023-11-18T20:59:35.834153+0000","last_unstale":"2023-11-18T21:29:40.509735+0000","last_undegraded":"2023-11-18T21:29:40.509735+0000","last_fullsized":"2023-11-18T21:29:40.509735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'80","last_scrub_stamp":"2023-11-18T21:29:40.509503+0000","last_deep_scrub":"31'80","last_deep_scrub_stamp":"2023-11-18T21:29:40.509503+0000","last_clean_scrub_stamp":"2023-11-18T21:29:40.509503+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:54:28.749972+0000","scrub_duration":0.0094143319999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'47","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:05.922625+0000","last_change":"2023-11-18T21:29:05.922677+0000","last_active":"2023-11-18T21:29:05.922625+0000","last_peered":"2023-11-18T21:29:05.922625+0000","last_clean":"2023-11-18T21:29:05.922625+0000","last_became_active":"2023-11-18T20:59:27.840852+0000","last_became_peered":"2023-11-18T20:59:27.840852+0000","last_unstale":"2023-11-18T21:29:05.922625+0000","last_undegraded":"2023-11-18T21:29:05.922625+0000","last_fullsized":"2023-11-18T21:29:05.922625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-11-18T21:29:05.922425+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-11-18T21:29:05.922425+0000","last_clean_scrub_stamp":"2023-11-18T21:29:05.922425+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:01:12.622028+0000","scrub_duration":0.004098544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"31'842","reported_seq":885,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:08.033951+0000","last_change":"2023-11-18T21:29:08.034015+0000","last_active":"2023-11-18T21:29:08.033951+0000","last_peered":"2023-11-18T21:29:08.033951+0000","last_clean":"2023-11-18T21:29:08.033951+0000","last_became_active":"2023-11-18T20:59:25.351149+0000","last_became_peered":"2023-11-18T20:59:25.351149+0000","last_unstale":"2023-11-18T21:29:08.033951+0000","last_undegraded":"2023-11-18T21:29:08.033951+0000","last_fullsized":"2023-11-18T21:29:08.033951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'842","last_scrub_stamp":"2023-11-18T21:29:08.033755+0000","last_deep_scrub":"31'842","last_deep_scrub_stamp":"2023-11-18T21:29:08.033755+0000","last_clean_scrub_stamp":"2023-11-18T21:29:08.033755+0000","objects_scrubbed":3,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:37:31.925547+0000","scrub_duration":0.027073499000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3704571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":4031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"31'77","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:37.496469+0000","last_change":"2023-11-18T20:59:35.844046+0000","last_active":"2023-11-18T21:28:37.496469+0000","last_peered":"2023-11-18T21:28:37.496469+0000","last_clean":"2023-11-18T21:28:37.496469+0000","last_became_active":"2023-11-18T20:59:35.843208+0000","last_became_peered":"2023-11-18T20:59:35.843208+0000","last_unstale":"2023-11-18T21:28:37.496469+0000","last_undegraded":"2023-11-18T21:28:37.496469+0000","last_fullsized":"2023-11-18T21:28:37.496469+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":6277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'59","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:58.427612+0000","last_change":"2023-11-18T21:28:58.427716+0000","last_active":"2023-11-18T21:28:58.427612+0000","last_peered":"2023-11-18T21:28:58.427612+0000","last_clean":"2023-11-18T21:28:58.427612+0000","last_became_active":"2023-11-18T20:59:27.866233+0000","last_became_peered":"2023-11-18T20:59:27.866233+0000","last_unstale":"2023-11-18T21:28:58.427612+0000","last_undegraded":"2023-11-18T21:28:58.427612+0000","last_fullsized":"2023-11-18T21:28:58.427612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:28:58.427386+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:28:58.427386+0000","last_clean_scrub_stamp":"2023-11-18T21:28:58.427386+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:17:54.424458+0000","scrub_duration":0.002651498,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"31'96","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:39.338901+0000","last_change":"2023-11-18T21:29:39.338963+0000","last_active":"2023-11-18T21:29:39.338901+0000","last_peered":"2023-11-18T21:29:39.338901+0000","last_clean":"2023-11-18T21:29:39.338901+0000","last_became_active":"2023-11-18T20:59:25.362287+0000","last_became_peered":"2023-11-18T20:59:25.362287+0000","last_unstale":"2023-11-18T21:29:39.338901+0000","last_undegraded":"2023-11-18T21:29:39.338901+0000","last_fullsized":"2023-11-18T21:29:39.338901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'96","last_scrub_stamp":"2023-11-18T21:29:39.338721+0000","last_deep_scrub":"31'96","last_deep_scrub_stamp":"2023-11-18T21:29:39.338721+0000","last_clean_scrub_stamp":"2023-11-18T21:29:39.338721+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:42:56.158719+0000","scrub_duration":0.0095503240000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"31'78","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:27:42.503073+0000","last_change":"2023-11-18T20:59:35.846859+0000","last_active":"2023-11-18T21:27:42.503073+0000","last_peered":"2023-11-18T21:27:42.503073+0000","last_clean":"2023-11-18T21:27:42.503073+0000","last_became_active":"2023-11-18T20:59:35.845378+0000","last_became_peered":"2023-11-18T20:59:35.845378+0000","last_unstale":"2023-11-18T21:27:42.503073+0000","last_undegraded":"2023-11-18T21:27:42.503073+0000","last_fullsized":"2023-11-18T21:27:42.503073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"31'57","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:15.247166+0000","last_change":"2023-11-18T21:29:15.247218+0000","last_active":"2023-11-18T21:29:15.247166+0000","last_peered":"2023-11-18T21:29:15.247166+0000","last_clean":"2023-11-18T21:29:15.247166+0000","last_became_active":"2023-11-18T20:59:27.863435+0000","last_became_peered":"2023-11-18T20:59:27.863435+0000","last_unstale":"2023-11-18T21:29:15.247166+0000","last_undegraded":"2023-11-18T21:29:15.247166+0000","last_fullsized":"2023-11-18T21:29:15.247166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'57","last_scrub_stamp":"2023-11-18T21:29:15.246973+0000","last_deep_scrub":"31'57","last_deep_scrub_stamp":"2023-11-18T21:29:15.246973+0000","last_clean_scrub_stamp":"2023-11-18T21:29:15.246973+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:10:06.349372+0000","scrub_duration":0.0043063679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"31'128","reported_seq":279,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:09.391461+0000","last_change":"2023-11-18T21:29:09.391544+0000","last_active":"2023-11-18T21:29:09.391461+0000","last_peered":"2023-11-18T21:29:09.391461+0000","last_clean":"2023-11-18T21:29:09.391461+0000","last_became_active":"2023-11-18T20:59:25.361313+0000","last_became_peered":"2023-11-18T20:59:25.361313+0000","last_unstale":"2023-11-18T21:29:09.391461+0000","last_undegraded":"2023-11-18T21:29:09.391461+0000","last_fullsized":"2023-11-18T21:29:09.391461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'128","last_scrub_stamp":"2023-11-18T21:29:09.391288+0000","last_deep_scrub":"31'128","last_deep_scrub_stamp":"2023-11-18T21:29:09.391288+0000","last_clean_scrub_stamp":"2023-11-18T21:29:09.391288+0000","objects_scrubbed":7,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:23:14.357002+0000","scrub_duration":0.014106417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25371,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":112,"num_write":121,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"31'82","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:37.558768+0000","last_change":"2023-11-18T20:59:35.832893+0000","last_active":"2023-11-18T21:28:37.558768+0000","last_peered":"2023-11-18T21:28:37.558768+0000","last_clean":"2023-11-18T21:28:37.558768+0000","last_became_active":"2023-11-18T20:59:35.832562+0000","last_became_peered":"2023-11-18T20:59:35.832562+0000","last_unstale":"2023-11-18T21:28:37.558768+0000","last_undegraded":"2023-11-18T21:28:37.558768+0000","last_fullsized":"2023-11-18T21:28:37.558768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":7445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'55","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:20.042056+0000","last_change":"2023-11-18T21:29:20.042114+0000","last_active":"2023-11-18T21:29:20.042056+0000","last_peered":"2023-11-18T21:29:20.042056+0000","last_clean":"2023-11-18T21:29:20.042056+0000","last_became_active":"2023-11-18T20:59:27.865971+0000","last_became_peered":"2023-11-18T20:59:27.865971+0000","last_unstale":"2023-11-18T21:29:20.042056+0000","last_undegraded":"2023-11-18T21:29:20.042056+0000","last_fullsized":"2023-11-18T21:29:20.042056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'55","last_scrub_stamp":"2023-11-18T21:29:20.041863+0000","last_deep_scrub":"31'55","last_deep_scrub_stamp":"2023-11-18T21:29:20.041863+0000","last_clean_scrub_stamp":"2023-11-18T21:29:20.041863+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:57:22.816534+0000","scrub_duration":0.0043334610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"31'1155","reported_seq":1198,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:00.190019+0000","last_change":"2023-11-18T21:29:00.190050+0000","last_active":"2023-11-18T21:29:00.190019+0000","last_peered":"2023-11-18T21:29:00.190019+0000","last_clean":"2023-11-18T21:29:00.190019+0000","last_became_active":"2023-11-18T20:59:25.349577+0000","last_became_peered":"2023-11-18T20:59:25.349577+0000","last_unstale":"2023-11-18T21:29:00.190019+0000","last_undegraded":"2023-11-18T21:29:00.190019+0000","last_fullsized":"2023-11-18T21:29:00.190019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1155","last_scrub_stamp":"2023-11-18T21:29:00.189950+0000","last_deep_scrub":"31'1155","last_deep_scrub_stamp":"2023-11-18T21:29:00.189950+0000","last_clean_scrub_stamp":"2023-11-18T21:29:00.189950+0000","objects_scrubbed":6,"log_size":1155,"log_dups_size":0,"ondisk_log_size":1155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:24:28.834089+0000","scrub_duration":0.028314013999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":4577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"31'99","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:35.193890+0000","last_change":"2023-11-18T21:29:35.193946+0000","last_active":"2023-11-18T21:29:35.193890+0000","last_peered":"2023-11-18T21:29:35.193890+0000","last_clean":"2023-11-18T21:29:35.193890+0000","last_became_active":"2023-11-18T20:59:35.848000+0000","last_became_peered":"2023-11-18T20:59:35.848000+0000","last_unstale":"2023-11-18T21:29:35.193890+0000","last_undegraded":"2023-11-18T21:29:35.193890+0000","last_fullsized":"2023-11-18T21:29:35.193890+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'99","last_scrub_stamp":"2023-11-18T21:29:35.193692+0000","last_deep_scrub":"31'99","last_deep_scrub_stamp":"2023-11-18T21:29:35.193692+0000","last_clean_scrub_stamp":"2023-11-18T21:29:35.193692+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:29:45.480808+0000","scrub_duration":0.011025439,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":10947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"31'51","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.379806+0000","last_change":"2023-11-18T21:29:21.379912+0000","last_active":"2023-11-18T21:29:21.379806+0000","last_peered":"2023-11-18T21:29:21.379806+0000","last_clean":"2023-11-18T21:29:21.379806+0000","last_became_active":"2023-11-18T20:59:27.891260+0000","last_became_peered":"2023-11-18T20:59:27.891260+0000","last_unstale":"2023-11-18T21:29:21.379806+0000","last_undegraded":"2023-11-18T21:29:21.379806+0000","last_fullsized":"2023-11-18T21:29:21.379806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2023-11-18T21:29:21.379550+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2023-11-18T21:29:21.379550+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.379550+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:03:51.816695+0000","scrub_duration":0.0038841679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"31'71","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:11.342090+0000","last_change":"2023-11-18T21:29:11.342215+0000","last_active":"2023-11-18T21:29:11.342090+0000","last_peered":"2023-11-18T21:29:11.342090+0000","last_clean":"2023-11-18T21:29:11.342090+0000","last_became_active":"2023-11-18T20:59:25.363289+0000","last_became_peered":"2023-11-18T20:59:25.363289+0000","last_unstale":"2023-11-18T21:29:11.342090+0000","last_undegraded":"2023-11-18T21:29:11.342090+0000","last_fullsized":"2023-11-18T21:29:11.342090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'71","last_scrub_stamp":"2023-11-18T21:29:11.341853+0000","last_deep_scrub":"31'71","last_deep_scrub_stamp":"2023-11-18T21:29:11.341853+0000","last_clean_scrub_stamp":"2023-11-18T21:29:11.341853+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:12.433430+0000","scrub_duration":0.011087723000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"31'68","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:25.228214+0000","last_change":"2023-11-18T21:29:25.228273+0000","last_active":"2023-11-18T21:29:25.228214+0000","last_peered":"2023-11-18T21:29:25.228214+0000","last_clean":"2023-11-18T21:29:25.228214+0000","last_became_active":"2023-11-18T20:59:35.771263+0000","last_became_peered":"2023-11-18T20:59:35.771263+0000","last_unstale":"2023-11-18T21:29:25.228214+0000","last_undegraded":"2023-11-18T21:29:25.228214+0000","last_fullsized":"2023-11-18T21:29:25.228214+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'68","last_scrub_stamp":"2023-11-18T21:29:25.228021+0000","last_deep_scrub":"31'68","last_deep_scrub_stamp":"2023-11-18T21:29:25.228021+0000","last_clean_scrub_stamp":"2023-11-18T21:29:25.228021+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:35:19.729693+0000","scrub_duration":0.011176386999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":272,"num_write":61,"num_write_kb":11998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"31'64","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:24.399773+0000","last_change":"2023-11-18T21:29:24.399827+0000","last_active":"2023-11-18T21:29:24.399773+0000","last_peered":"2023-11-18T21:29:24.399773+0000","last_clean":"2023-11-18T21:29:24.399773+0000","last_became_active":"2023-11-18T20:59:27.832589+0000","last_became_peered":"2023-11-18T20:59:27.832589+0000","last_unstale":"2023-11-18T21:29:24.399773+0000","last_undegraded":"2023-11-18T21:29:24.399773+0000","last_fullsized":"2023-11-18T21:29:24.399773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'64","last_scrub_stamp":"2023-11-18T21:29:24.399584+0000","last_deep_scrub":"31'64","last_deep_scrub_stamp":"2023-11-18T21:29:24.399584+0000","last_clean_scrub_stamp":"2023-11-18T21:29:24.399584+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:43.047794+0000","scrub_duration":0.0056386020000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"31'119","reported_seq":271,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.002973+0000","last_change":"2023-11-18T21:29:10.003016+0000","last_active":"2023-11-18T21:29:10.002973+0000","last_peered":"2023-11-18T21:29:10.002973+0000","last_clean":"2023-11-18T21:29:10.002973+0000","last_became_active":"2023-11-18T20:59:25.493373+0000","last_became_peered":"2023-11-18T20:59:25.493373+0000","last_unstale":"2023-11-18T21:29:10.002973+0000","last_undegraded":"2023-11-18T21:29:10.002973+0000","last_fullsized":"2023-11-18T21:29:10.002973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-11-18T21:29:10.002888+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-11-18T21:29:10.002888+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.002888+0000","objects_scrubbed":3,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:52:08.702511+0000","scrub_duration":0.0088310239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20332,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":112,"num_write":115,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'93","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:20.232616+0000","last_change":"2023-11-18T21:29:20.232660+0000","last_active":"2023-11-18T21:29:20.232616+0000","last_peered":"2023-11-18T21:29:20.232616+0000","last_clean":"2023-11-18T21:29:20.232616+0000","last_became_active":"2023-11-18T20:59:35.772563+0000","last_became_peered":"2023-11-18T20:59:35.772563+0000","last_unstale":"2023-11-18T21:29:20.232616+0000","last_undegraded":"2023-11-18T21:29:20.232616+0000","last_fullsized":"2023-11-18T21:29:20.232616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'93","last_scrub_stamp":"2023-11-18T21:29:20.232464+0000","last_deep_scrub":"31'93","last_deep_scrub_stamp":"2023-11-18T21:29:20.232464+0000","last_clean_scrub_stamp":"2023-11-18T21:29:20.232464+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:47:01.640494+0000","scrub_duration":0.01013846,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":9621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'57","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:13.159776+0000","last_change":"2023-11-18T21:29:13.159830+0000","last_active":"2023-11-18T21:29:13.159776+0000","last_peered":"2023-11-18T21:29:13.159776+0000","last_clean":"2023-11-18T21:29:13.159776+0000","last_became_active":"2023-11-18T20:59:27.891883+0000","last_became_peered":"2023-11-18T20:59:27.891883+0000","last_unstale":"2023-11-18T21:29:13.159776+0000","last_undegraded":"2023-11-18T21:29:13.159776+0000","last_fullsized":"2023-11-18T21:29:13.159776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'57","last_scrub_stamp":"2023-11-18T21:29:13.159570+0000","last_deep_scrub":"31'57","last_deep_scrub_stamp":"2023-11-18T21:29:13.159570+0000","last_clean_scrub_stamp":"2023-11-18T21:29:13.159570+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:07.593699+0000","scrub_duration":0.0038753820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"31'159","reported_seq":202,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:57.910143+0000","last_change":"2023-11-18T21:28:57.910171+0000","last_active":"2023-11-18T21:28:57.910143+0000","last_peered":"2023-11-18T21:28:57.910143+0000","last_clean":"2023-11-18T21:28:57.910143+0000","last_became_active":"2023-11-18T20:59:25.496680+0000","last_became_peered":"2023-11-18T20:59:25.496680+0000","last_unstale":"2023-11-18T21:28:57.910143+0000","last_undegraded":"2023-11-18T21:28:57.910143+0000","last_fullsized":"2023-11-18T21:28:57.910143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'159","last_scrub_stamp":"2023-11-18T21:28:57.910062+0000","last_deep_scrub":"31'159","last_deep_scrub_stamp":"2023-11-18T21:28:57.910062+0000","last_clean_scrub_stamp":"2023-11-18T21:28:57.910062+0000","objects_scrubbed":3,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:17.803669+0000","scrub_duration":0.0065099140000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"31'67","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:34.234865+0000","last_change":"2023-11-18T21:29:34.234959+0000","last_active":"2023-11-18T21:29:34.234865+0000","last_peered":"2023-11-18T21:29:34.234865+0000","last_clean":"2023-11-18T21:29:34.234865+0000","last_became_active":"2023-11-18T20:59:35.838830+0000","last_became_peered":"2023-11-18T20:59:35.838830+0000","last_unstale":"2023-11-18T21:29:34.234865+0000","last_undegraded":"2023-11-18T21:29:34.234865+0000","last_fullsized":"2023-11-18T21:29:34.234865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'67","last_scrub_stamp":"2023-11-18T21:29:34.234654+0000","last_deep_scrub":"31'67","last_deep_scrub_stamp":"2023-11-18T21:29:34.234654+0000","last_clean_scrub_stamp":"2023-11-18T21:29:34.234654+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:18:49.849158+0000","scrub_duration":0.0091543920000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":8132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"31'63","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:37.254546+0000","last_change":"2023-11-18T21:29:37.254608+0000","last_active":"2023-11-18T21:29:37.254546+0000","last_peered":"2023-11-18T21:29:37.254546+0000","last_clean":"2023-11-18T21:29:37.254546+0000","last_became_active":"2023-11-18T20:59:35.838375+0000","last_became_peered":"2023-11-18T20:59:35.838375+0000","last_unstale":"2023-11-18T21:29:37.254546+0000","last_undegraded":"2023-11-18T21:29:37.254546+0000","last_fullsized":"2023-11-18T21:29:37.254546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:37.254333+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:37.254333+0000","last_clean_scrub_stamp":"2023-11-18T21:29:37.254333+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:22.727567+0000","scrub_duration":0.0086027900000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"31'61","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:18.243224+0000","last_change":"2023-11-18T21:29:18.243275+0000","last_active":"2023-11-18T21:29:18.243224+0000","last_peered":"2023-11-18T21:29:18.243224+0000","last_clean":"2023-11-18T21:29:18.243224+0000","last_became_active":"2023-11-18T20:59:27.688522+0000","last_became_peered":"2023-11-18T20:59:27.688522+0000","last_unstale":"2023-11-18T21:29:18.243224+0000","last_undegraded":"2023-11-18T21:29:18.243224+0000","last_fullsized":"2023-11-18T21:29:18.243224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'61","last_scrub_stamp":"2023-11-18T21:29:18.243035+0000","last_deep_scrub":"31'61","last_deep_scrub_stamp":"2023-11-18T21:29:18.243035+0000","last_clean_scrub_stamp":"2023-11-18T21:29:18.243035+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:55.389095+0000","scrub_duration":0.00420858,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"31'8","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:26.322379+0000","last_change":"2023-11-18T21:29:26.322435+0000","last_active":"2023-11-18T21:29:26.322379+0000","last_peered":"2023-11-18T21:29:26.322379+0000","last_clean":"2023-11-18T21:29:26.322379+0000","last_became_active":"2023-11-18T20:59:25.493357+0000","last_became_peered":"2023-11-18T20:59:25.493357+0000","last_unstale":"2023-11-18T21:29:26.322379+0000","last_undegraded":"2023-11-18T21:29:26.322379+0000","last_fullsized":"2023-11-18T21:29:26.322379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-11-18T21:29:26.322202+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-11-18T21:29:26.322202+0000","last_clean_scrub_stamp":"2023-11-18T21:29:26.322202+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:05:42.445909+0000","scrub_duration":0.0068924219999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'97","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:47.353961+0000","last_change":"2023-11-18T20:59:35.776653+0000","last_active":"2023-11-18T21:28:47.353961+0000","last_peered":"2023-11-18T21:28:47.353961+0000","last_clean":"2023-11-18T21:28:47.353961+0000","last_became_active":"2023-11-18T20:59:35.776138+0000","last_became_peered":"2023-11-18T20:59:35.776138+0000","last_unstale":"2023-11-18T21:28:47.353961+0000","last_undegraded":"2023-11-18T21:28:47.353961+0000","last_fullsized":"2023-11-18T21:28:47.353961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:34.328065+0000","last_clean_scrub_stamp":"2023-11-18T20:59:34.328065+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'54","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:00.665722+0000","last_change":"2023-11-18T21:29:00.665764+0000","last_active":"2023-11-18T21:29:00.665722+0000","last_peered":"2023-11-18T21:29:00.665722+0000","last_clean":"2023-11-18T21:29:00.665722+0000","last_became_active":"2023-11-18T20:59:27.860537+0000","last_became_peered":"2023-11-18T20:59:27.860537+0000","last_unstale":"2023-11-18T21:29:00.665722+0000","last_undegraded":"2023-11-18T21:29:00.665722+0000","last_fullsized":"2023-11-18T21:29:00.665722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-11-18T21:29:00.665560+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-11-18T21:29:00.665560+0000","last_clean_scrub_stamp":"2023-11-18T21:29:00.665560+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:11:31.387422+0000","scrub_duration":0.0036286529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"31'231","reported_seq":497,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:03.310448+0000","last_change":"2023-11-18T21:29:03.310510+0000","last_active":"2023-11-18T21:29:03.310448+0000","last_peered":"2023-11-18T21:29:03.310448+0000","last_clean":"2023-11-18T21:29:03.310448+0000","last_became_active":"2023-11-18T20:59:25.354690+0000","last_became_peered":"2023-11-18T20:59:25.354690+0000","last_unstale":"2023-11-18T21:29:03.310448+0000","last_undegraded":"2023-11-18T21:29:03.310448+0000","last_fullsized":"2023-11-18T21:29:03.310448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'231","last_scrub_stamp":"2023-11-18T21:29:03.310260+0000","last_deep_scrub":"31'231","last_deep_scrub_stamp":"2023-11-18T21:29:03.310260+0000","last_clean_scrub_stamp":"2023-11-18T21:29:03.310260+0000","objects_scrubbed":3,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:11:13.929892+0000","scrub_duration":0.0098773730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34720,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":223,"num_read_kb":227,"num_write":228,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"31'179","reported_seq":384,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:28.310099+0000","last_change":"2023-11-18T21:29:28.310160+0000","last_active":"2023-11-18T21:29:28.310099+0000","last_peered":"2023-11-18T21:29:28.310099+0000","last_clean":"2023-11-18T21:29:28.310099+0000","last_became_active":"2023-11-18T20:59:25.346192+0000","last_became_peered":"2023-11-18T20:59:25.346192+0000","last_unstale":"2023-11-18T21:29:28.310099+0000","last_undegraded":"2023-11-18T21:29:28.310099+0000","last_fullsized":"2023-11-18T21:29:28.310099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'179","last_scrub_stamp":"2023-11-18T21:29:28.309914+0000","last_deep_scrub":"31'179","last_deep_scrub_stamp":"2023-11-18T21:29:28.309914+0000","last_clean_scrub_stamp":"2023-11-18T21:29:28.309914+0000","objects_scrubbed":4,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:54:16.550383+0000","scrub_duration":0.010160943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":165,"num_write":171,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'63","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:00.370654+0000","last_change":"2023-11-18T21:29:00.370654+0000","last_active":"2023-11-18T21:29:00.370654+0000","last_peered":"2023-11-18T21:29:00.370654+0000","last_clean":"2023-11-18T21:29:00.370654+0000","last_became_active":"2023-11-18T20:59:27.867886+0000","last_became_peered":"2023-11-18T20:59:27.867886+0000","last_unstale":"2023-11-18T21:29:00.370654+0000","last_undegraded":"2023-11-18T21:29:00.370654+0000","last_fullsized":"2023-11-18T21:29:00.370654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:00.370401+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:00.370401+0000","last_clean_scrub_stamp":"2023-11-18T21:29:00.370401+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:00:07.902842+0000","scrub_duration":0.0051850940000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'95","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:36.225204+0000","last_change":"2023-11-18T21:29:36.225258+0000","last_active":"2023-11-18T21:29:36.225204+0000","last_peered":"2023-11-18T21:29:36.225204+0000","last_clean":"2023-11-18T21:29:36.225204+0000","last_became_active":"2023-11-18T20:59:35.850427+0000","last_became_peered":"2023-11-18T20:59:35.850427+0000","last_unstale":"2023-11-18T21:29:36.225204+0000","last_undegraded":"2023-11-18T21:29:36.225204+0000","last_fullsized":"2023-11-18T21:29:36.225204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'95","last_scrub_stamp":"2023-11-18T21:29:36.225007+0000","last_deep_scrub":"31'95","last_deep_scrub_stamp":"2023-11-18T21:29:36.225007+0000","last_clean_scrub_stamp":"2023-11-18T21:29:36.225007+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:12:52.127534+0000","scrub_duration":0.0094896419999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2347","reported_seq":2390,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:14.533218+0000","last_change":"2023-11-18T21:29:14.533218+0000","last_active":"2023-11-18T21:29:14.533218+0000","last_peered":"2023-11-18T21:29:14.533218+0000","last_clean":"2023-11-18T21:29:14.533218+0000","last_became_active":"2023-11-18T20:59:25.460449+0000","last_became_peered":"2023-11-18T20:59:25.460449+0000","last_unstale":"2023-11-18T21:29:14.533218+0000","last_undegraded":"2023-11-18T21:29:14.533218+0000","last_fullsized":"2023-11-18T21:29:14.533218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2347","last_scrub_stamp":"2023-11-18T21:29:14.532977+0000","last_deep_scrub":"31'2347","last_deep_scrub_stamp":"2023-11-18T21:29:14.532977+0000","last_clean_scrub_stamp":"2023-11-18T21:29:14.532977+0000","objects_scrubbed":4,"log_size":2347,"log_dups_size":0,"ondisk_log_size":2347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:11:42.664738+0000","scrub_duration":0.056368952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8759326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2333,"num_write_kb":9750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"31'69","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:16.019065+0000","last_change":"2023-11-18T21:29:16.019065+0000","last_active":"2023-11-18T21:29:16.019065+0000","last_peered":"2023-11-18T21:29:16.019065+0000","last_clean":"2023-11-18T21:29:16.019065+0000","last_became_active":"2023-11-18T20:59:27.840528+0000","last_became_peered":"2023-11-18T20:59:27.840528+0000","last_unstale":"2023-11-18T21:29:16.019065+0000","last_undegraded":"2023-11-18T21:29:16.019065+0000","last_fullsized":"2023-11-18T21:29:16.019065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'69","last_scrub_stamp":"2023-11-18T21:29:16.018825+0000","last_deep_scrub":"31'69","last_deep_scrub_stamp":"2023-11-18T21:29:16.018825+0000","last_clean_scrub_stamp":"2023-11-18T21:29:16.018825+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:40.995064+0000","scrub_duration":0.0034129389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"31'65","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:29.278401+0000","last_change":"2023-11-18T21:29:29.278401+0000","last_active":"2023-11-18T21:29:29.278401+0000","last_peered":"2023-11-18T21:29:29.278401+0000","last_clean":"2023-11-18T21:29:29.278401+0000","last_became_active":"2023-11-18T20:59:35.775977+0000","last_became_peered":"2023-11-18T20:59:35.775977+0000","last_unstale":"2023-11-18T21:29:29.278401+0000","last_undegraded":"2023-11-18T21:29:29.278401+0000","last_fullsized":"2023-11-18T21:29:29.278401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'65","last_scrub_stamp":"2023-11-18T21:29:29.278165+0000","last_deep_scrub":"31'65","last_deep_scrub_stamp":"2023-11-18T21:29:29.278165+0000","last_clean_scrub_stamp":"2023-11-18T21:29:29.278165+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:10:20.380564+0000","scrub_duration":0.0083929169999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"31'59","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:06.116859+0000","last_change":"2023-11-18T21:29:06.116910+0000","last_active":"2023-11-18T21:29:06.116859+0000","last_peered":"2023-11-18T21:29:06.116859+0000","last_clean":"2023-11-18T21:29:06.116859+0000","last_became_active":"2023-11-18T20:59:27.887716+0000","last_became_peered":"2023-11-18T20:59:27.887716+0000","last_unstale":"2023-11-18T21:29:06.116859+0000","last_undegraded":"2023-11-18T21:29:06.116859+0000","last_fullsized":"2023-11-18T21:29:06.116859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:29:06.116671+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:29:06.116671+0000","last_clean_scrub_stamp":"2023-11-18T21:29:06.116671+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:30:14.804753+0000","scrub_duration":0.0043744070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"31'67","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:13.326825+0000","last_change":"2023-11-18T21:29:13.326866+0000","last_active":"2023-11-18T21:29:13.326825+0000","last_peered":"2023-11-18T21:29:13.326825+0000","last_clean":"2023-11-18T21:29:13.326825+0000","last_became_active":"2023-11-18T20:59:27.680712+0000","last_became_peered":"2023-11-18T20:59:27.680712+0000","last_unstale":"2023-11-18T21:29:13.326825+0000","last_undegraded":"2023-11-18T21:29:13.326825+0000","last_fullsized":"2023-11-18T21:29:13.326825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'67","last_scrub_stamp":"2023-11-18T21:29:13.326649+0000","last_deep_scrub":"31'67","last_deep_scrub_stamp":"2023-11-18T21:29:13.326649+0000","last_clean_scrub_stamp":"2023-11-18T21:29:13.326649+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:24:41.970789+0000","scrub_duration":0.0032687520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"31'57","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.582692+0000","last_change":"2023-11-18T21:29:04.582839+0000","last_active":"2023-11-18T21:29:04.582692+0000","last_peered":"2023-11-18T21:29:04.582692+0000","last_clean":"2023-11-18T21:29:04.582692+0000","last_became_active":"2023-11-18T20:59:27.835120+0000","last_became_peered":"2023-11-18T20:59:27.835120+0000","last_unstale":"2023-11-18T21:29:04.582692+0000","last_undegraded":"2023-11-18T21:29:04.582692+0000","last_fullsized":"2023-11-18T21:29:04.582692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'57","last_scrub_stamp":"2023-11-18T21:29:04.582340+0000","last_deep_scrub":"31'57","last_deep_scrub_stamp":"2023-11-18T21:29:04.582340+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.582340+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:59:50.451724+0000","scrub_duration":0.0037119219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"31'59","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.454897+0000","last_change":"2023-11-18T21:29:21.454950+0000","last_active":"2023-11-18T21:29:21.454897+0000","last_peered":"2023-11-18T21:29:21.454897+0000","last_clean":"2023-11-18T21:29:21.454897+0000","last_became_active":"2023-11-18T20:59:27.833049+0000","last_became_peered":"2023-11-18T20:59:27.833049+0000","last_unstale":"2023-11-18T21:29:21.454897+0000","last_undegraded":"2023-11-18T21:29:21.454897+0000","last_fullsized":"2023-11-18T21:29:21.454897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:29:21.454712+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:29:21.454712+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.454712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:47:46.800202+0000","scrub_duration":0.0049077629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"31'40","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:26.307522+0000","last_change":"2023-11-18T21:29:26.307573+0000","last_active":"2023-11-18T21:29:26.307522+0000","last_peered":"2023-11-18T21:29:26.307522+0000","last_clean":"2023-11-18T21:29:26.307522+0000","last_became_active":"2023-11-18T20:59:27.878353+0000","last_became_peered":"2023-11-18T20:59:27.878353+0000","last_unstale":"2023-11-18T21:29:26.307522+0000","last_undegraded":"2023-11-18T21:29:26.307522+0000","last_fullsized":"2023-11-18T21:29:26.307522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2023-11-18T21:29:26.307321+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2023-11-18T21:29:26.307321+0000","last_clean_scrub_stamp":"2023-11-18T21:29:26.307321+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:37:50.199113+0000","scrub_duration":0.0043578209999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'50","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:13.172428+0000","last_change":"2023-11-18T21:29:13.172491+0000","last_active":"2023-11-18T21:29:13.172428+0000","last_peered":"2023-11-18T21:29:13.172428+0000","last_clean":"2023-11-18T21:29:13.172428+0000","last_became_active":"2023-11-18T20:59:27.866165+0000","last_became_peered":"2023-11-18T20:59:27.866165+0000","last_unstale":"2023-11-18T21:29:13.172428+0000","last_undegraded":"2023-11-18T21:29:13.172428+0000","last_fullsized":"2023-11-18T21:29:13.172428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'50","last_scrub_stamp":"2023-11-18T21:29:13.172214+0000","last_deep_scrub":"31'50","last_deep_scrub_stamp":"2023-11-18T21:29:13.172214+0000","last_clean_scrub_stamp":"2023-11-18T21:29:13.172214+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:07.606343+0000","scrub_duration":0.0036780150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"31'55","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:17.154740+0000","last_change":"2023-11-18T21:29:17.154844+0000","last_active":"2023-11-18T21:29:17.154740+0000","last_peered":"2023-11-18T21:29:17.154740+0000","last_clean":"2023-11-18T21:29:17.154740+0000","last_became_active":"2023-11-18T20:59:27.893918+0000","last_became_peered":"2023-11-18T20:59:27.893918+0000","last_unstale":"2023-11-18T21:29:17.154740+0000","last_undegraded":"2023-11-18T21:29:17.154740+0000","last_fullsized":"2023-11-18T21:29:17.154740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'55","last_scrub_stamp":"2023-11-18T21:29:17.154505+0000","last_deep_scrub":"31'55","last_deep_scrub_stamp":"2023-11-18T21:29:17.154505+0000","last_clean_scrub_stamp":"2023-11-18T21:29:17.154505+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:11:47.876366+0000","scrub_duration":0.0043464080000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"31'49","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:32.411248+0000","last_change":"2023-11-18T21:29:32.411301+0000","last_active":"2023-11-18T21:29:32.411248+0000","last_peered":"2023-11-18T21:29:32.411248+0000","last_clean":"2023-11-18T21:29:32.411248+0000","last_became_active":"2023-11-18T20:59:27.838509+0000","last_became_peered":"2023-11-18T20:59:27.838509+0000","last_unstale":"2023-11-18T21:29:32.411248+0000","last_undegraded":"2023-11-18T21:29:32.411248+0000","last_fullsized":"2023-11-18T21:29:32.411248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'49","last_scrub_stamp":"2023-11-18T21:29:32.411044+0000","last_deep_scrub":"31'49","last_deep_scrub_stamp":"2023-11-18T21:29:32.411044+0000","last_clean_scrub_stamp":"2023-11-18T21:29:32.411044+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:02.848189+0000","scrub_duration":0.0038599979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"31'60","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:43.628865+0000","last_change":"2023-11-18T20:59:27.836167+0000","last_active":"2023-11-18T21:28:43.628865+0000","last_peered":"2023-11-18T21:28:43.628865+0000","last_clean":"2023-11-18T21:28:43.628865+0000","last_became_active":"2023-11-18T20:59:27.835226+0000","last_became_peered":"2023-11-18T20:59:27.835226+0000","last_unstale":"2023-11-18T21:28:43.628865+0000","last_undegraded":"2023-11-18T21:28:43.628865+0000","last_fullsized":"2023-11-18T21:28:43.628865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T20:59:26.114784+0000","last_clean_scrub_stamp":"2023-11-18T20:59:26.114784+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'73","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:17.463973+0000","last_change":"2023-11-18T21:29:17.463992+0000","last_active":"2023-11-18T21:29:17.463973+0000","last_peered":"2023-11-18T21:29:17.463973+0000","last_clean":"2023-11-18T21:29:17.463973+0000","last_became_active":"2023-11-18T20:59:27.889325+0000","last_became_peered":"2023-11-18T20:59:27.889325+0000","last_unstale":"2023-11-18T21:29:17.463973+0000","last_undegraded":"2023-11-18T21:29:17.463973+0000","last_fullsized":"2023-11-18T21:29:17.463973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2023-11-18T21:29:17.463894+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2023-11-18T21:29:17.463894+0000","last_clean_scrub_stamp":"2023-11-18T21:29:17.463894+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:46.668018+0000","scrub_duration":0.0034258880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"31'63","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:09.876728+0000","last_change":"2023-11-18T21:29:09.876832+0000","last_active":"2023-11-18T21:29:09.876728+0000","last_peered":"2023-11-18T21:29:09.876728+0000","last_clean":"2023-11-18T21:29:09.876728+0000","last_became_active":"2023-11-18T20:59:27.866609+0000","last_became_peered":"2023-11-18T20:59:27.866609+0000","last_unstale":"2023-11-18T21:29:09.876728+0000","last_undegraded":"2023-11-18T21:29:09.876728+0000","last_fullsized":"2023-11-18T21:29:09.876728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:09.876438+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:09.876438+0000","last_clean_scrub_stamp":"2023-11-18T21:29:09.876438+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:54:07.883741+0000","scrub_duration":0.0036686549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'64","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:31.201416+0000","last_change":"2023-11-18T21:29:31.201468+0000","last_active":"2023-11-18T21:29:31.201416+0000","last_peered":"2023-11-18T21:29:31.201416+0000","last_clean":"2023-11-18T21:29:31.201416+0000","last_became_active":"2023-11-18T20:59:27.882976+0000","last_became_peered":"2023-11-18T20:59:27.882976+0000","last_unstale":"2023-11-18T21:29:31.201416+0000","last_undegraded":"2023-11-18T21:29:31.201416+0000","last_fullsized":"2023-11-18T21:29:31.201416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'64","last_scrub_stamp":"2023-11-18T21:29:31.201226+0000","last_deep_scrub":"31'64","last_deep_scrub_stamp":"2023-11-18T21:29:31.201226+0000","last_clean_scrub_stamp":"2023-11-18T21:29:31.201226+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:31:12.185608+0000","scrub_duration":0.0050063130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"31'51","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:27.220154+0000","last_change":"2023-11-18T21:29:27.220208+0000","last_active":"2023-11-18T21:29:27.220154+0000","last_peered":"2023-11-18T21:29:27.220154+0000","last_clean":"2023-11-18T21:29:27.220154+0000","last_became_active":"2023-11-18T20:59:27.872627+0000","last_became_peered":"2023-11-18T20:59:27.872627+0000","last_unstale":"2023-11-18T21:29:27.220154+0000","last_undegraded":"2023-11-18T21:29:27.220154+0000","last_fullsized":"2023-11-18T21:29:27.220154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2023-11-18T21:29:27.219959+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2023-11-18T21:29:27.219959+0000","last_clean_scrub_stamp":"2023-11-18T21:29:27.219959+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:53:24.228418+0000","scrub_duration":0.0036165360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"31'60","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:41.338930+0000","last_change":"2023-11-18T21:29:41.338983+0000","last_active":"2023-11-18T21:29:41.338930+0000","last_peered":"2023-11-18T21:29:41.338930+0000","last_clean":"2023-11-18T21:29:41.338930+0000","last_became_active":"2023-11-18T20:59:27.686311+0000","last_became_peered":"2023-11-18T20:59:27.686311+0000","last_unstale":"2023-11-18T21:29:41.338930+0000","last_undegraded":"2023-11-18T21:29:41.338930+0000","last_fullsized":"2023-11-18T21:29:41.338930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'60","last_scrub_stamp":"2023-11-18T21:29:41.338713+0000","last_deep_scrub":"31'60","last_deep_scrub_stamp":"2023-11-18T21:29:41.338713+0000","last_clean_scrub_stamp":"2023-11-18T21:29:41.338713+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:17:04.917738+0000","scrub_duration":0.0038950859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'65","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:16.293918+0000","last_change":"2023-11-18T21:29:16.293970+0000","last_active":"2023-11-18T21:29:16.293918+0000","last_peered":"2023-11-18T21:29:16.293918+0000","last_clean":"2023-11-18T21:29:16.293918+0000","last_became_active":"2023-11-18T20:59:27.891767+0000","last_became_peered":"2023-11-18T20:59:27.891767+0000","last_unstale":"2023-11-18T21:29:16.293918+0000","last_undegraded":"2023-11-18T21:29:16.293918+0000","last_fullsized":"2023-11-18T21:29:16.293918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'65","last_scrub_stamp":"2023-11-18T21:29:16.293729+0000","last_deep_scrub":"31'65","last_deep_scrub_stamp":"2023-11-18T21:29:16.293729+0000","last_clean_scrub_stamp":"2023-11-18T21:29:16.293729+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:14.707891+0000","scrub_duration":0.0040253770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"31'51","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:02.549989+0000","last_change":"2023-11-18T21:29:02.550040+0000","last_active":"2023-11-18T21:29:02.549989+0000","last_peered":"2023-11-18T21:29:02.549989+0000","last_clean":"2023-11-18T21:29:02.549989+0000","last_became_active":"2023-11-18T20:59:27.866153+0000","last_became_peered":"2023-11-18T20:59:27.866153+0000","last_unstale":"2023-11-18T21:29:02.549989+0000","last_undegraded":"2023-11-18T21:29:02.549989+0000","last_fullsized":"2023-11-18T21:29:02.549989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2023-11-18T21:29:02.549808+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2023-11-18T21:29:02.549808+0000","last_clean_scrub_stamp":"2023-11-18T21:29:02.549808+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:40:23.065850+0000","scrub_duration":0.0075603520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'60","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:14.476356+0000","last_change":"2023-11-18T21:29:14.476409+0000","last_active":"2023-11-18T21:29:14.476356+0000","last_peered":"2023-11-18T21:29:14.476356+0000","last_clean":"2023-11-18T21:29:14.476356+0000","last_became_active":"2023-11-18T20:59:27.889704+0000","last_became_peered":"2023-11-18T20:59:27.889704+0000","last_unstale":"2023-11-18T21:29:14.476356+0000","last_undegraded":"2023-11-18T21:29:14.476356+0000","last_fullsized":"2023-11-18T21:29:14.476356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'60","last_scrub_stamp":"2023-11-18T21:29:14.476160+0000","last_deep_scrub":"31'60","last_deep_scrub_stamp":"2023-11-18T21:29:14.476160+0000","last_clean_scrub_stamp":"2023-11-18T21:29:14.476160+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:24.226769+0000","scrub_duration":0.0034077449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"31'63","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:31.385927+0000","last_change":"2023-11-18T21:29:31.385979+0000","last_active":"2023-11-18T21:29:31.385927+0000","last_peered":"2023-11-18T21:29:31.385927+0000","last_clean":"2023-11-18T21:29:31.385927+0000","last_became_active":"2023-11-18T20:59:27.871337+0000","last_became_peered":"2023-11-18T20:59:27.871337+0000","last_unstale":"2023-11-18T21:29:31.385927+0000","last_undegraded":"2023-11-18T21:29:31.385927+0000","last_fullsized":"2023-11-18T21:29:31.385927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:31.385720+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:31.385720+0000","last_clean_scrub_stamp":"2023-11-18T21:29:31.385720+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:04.606258+0000","scrub_duration":0.0039053080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"31'53","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.326477+0000","last_change":"2023-11-18T21:29:21.326574+0000","last_active":"2023-11-18T21:29:21.326477+0000","last_peered":"2023-11-18T21:29:21.326477+0000","last_clean":"2023-11-18T21:29:21.326477+0000","last_became_active":"2023-11-18T20:59:27.866560+0000","last_became_peered":"2023-11-18T20:59:27.866560+0000","last_unstale":"2023-11-18T21:29:21.326477+0000","last_undegraded":"2023-11-18T21:29:21.326477+0000","last_fullsized":"2023-11-18T21:29:21.326477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2023-11-18T21:29:21.326191+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2023-11-18T21:29:21.326191+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.326191+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:43:08.584061+0000","scrub_duration":0.0036324149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"31'52","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:29.377883+0000","last_change":"2023-11-18T21:29:29.377933+0000","last_active":"2023-11-18T21:29:29.377883+0000","last_peered":"2023-11-18T21:29:29.377883+0000","last_clean":"2023-11-18T21:29:29.377883+0000","last_became_active":"2023-11-18T20:59:27.878485+0000","last_became_peered":"2023-11-18T20:59:27.878485+0000","last_unstale":"2023-11-18T21:29:29.377883+0000","last_undegraded":"2023-11-18T21:29:29.377883+0000","last_fullsized":"2023-11-18T21:29:29.377883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'52","last_scrub_stamp":"2023-11-18T21:29:29.377688+0000","last_deep_scrub":"31'52","last_deep_scrub_stamp":"2023-11-18T21:29:29.377688+0000","last_clean_scrub_stamp":"2023-11-18T21:29:29.377688+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:34:18.245718+0000","scrub_duration":0.0049288709999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"31'53","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:28.253949+0000","last_change":"2023-11-18T21:29:28.254005+0000","last_active":"2023-11-18T21:29:28.253949+0000","last_peered":"2023-11-18T21:29:28.253949+0000","last_clean":"2023-11-18T21:29:28.253949+0000","last_became_active":"2023-11-18T20:59:27.873255+0000","last_became_peered":"2023-11-18T20:59:27.873255+0000","last_unstale":"2023-11-18T21:29:28.253949+0000","last_undegraded":"2023-11-18T21:29:28.253949+0000","last_fullsized":"2023-11-18T21:29:28.253949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2023-11-18T21:29:28.253752+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2023-11-18T21:29:28.253752+0000","last_clean_scrub_stamp":"2023-11-18T21:29:28.253752+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:54:27.671849+0000","scrub_duration":0.0035530050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"31'53","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:25.200247+0000","last_change":"2023-11-18T21:29:25.200303+0000","last_active":"2023-11-18T21:29:25.200247+0000","last_peered":"2023-11-18T21:29:25.200247+0000","last_clean":"2023-11-18T21:29:25.200247+0000","last_became_active":"2023-11-18T20:59:27.866901+0000","last_became_peered":"2023-11-18T20:59:27.866901+0000","last_unstale":"2023-11-18T21:29:25.200247+0000","last_undegraded":"2023-11-18T21:29:25.200247+0000","last_fullsized":"2023-11-18T21:29:25.200247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2023-11-18T21:29:25.200025+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2023-11-18T21:29:25.200025+0000","last_clean_scrub_stamp":"2023-11-18T21:29:25.200025+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:05.757428+0000","scrub_duration":0.0035374320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"31'59","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:16.986904+0000","last_change":"2023-11-18T21:29:16.986958+0000","last_active":"2023-11-18T21:29:16.986904+0000","last_peered":"2023-11-18T21:29:16.986904+0000","last_clean":"2023-11-18T21:29:16.986904+0000","last_became_active":"2023-11-18T20:59:27.888068+0000","last_became_peered":"2023-11-18T20:59:27.888068+0000","last_unstale":"2023-11-18T21:29:16.986904+0000","last_undegraded":"2023-11-18T21:29:16.986904+0000","last_fullsized":"2023-11-18T21:29:16.986904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:29:16.986691+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:29:16.986691+0000","last_clean_scrub_stamp":"2023-11-18T21:29:16.986691+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:37.454968+0000","scrub_duration":0.0038750759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"31'46","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.156428+0000","last_change":"2023-11-18T21:29:21.156480+0000","last_active":"2023-11-18T21:29:21.156428+0000","last_peered":"2023-11-18T21:29:21.156428+0000","last_clean":"2023-11-18T21:29:21.156428+0000","last_became_active":"2023-11-18T20:59:27.682936+0000","last_became_peered":"2023-11-18T20:59:27.682936+0000","last_unstale":"2023-11-18T21:29:21.156428+0000","last_undegraded":"2023-11-18T21:29:21.156428+0000","last_fullsized":"2023-11-18T21:29:21.156428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-11-18T21:29:21.156224+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-11-18T21:29:21.156224+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.156224+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:45.036534+0000","scrub_duration":0.0072266860000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"31'66","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:38.474090+0000","last_change":"2023-11-18T21:29:38.474142+0000","last_active":"2023-11-18T21:29:38.474090+0000","last_peered":"2023-11-18T21:29:38.474090+0000","last_clean":"2023-11-18T21:29:38.474090+0000","last_became_active":"2023-11-18T20:59:27.865401+0000","last_became_peered":"2023-11-18T20:59:27.865401+0000","last_unstale":"2023-11-18T21:29:38.474090+0000","last_undegraded":"2023-11-18T21:29:38.474090+0000","last_fullsized":"2023-11-18T21:29:38.474090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'66","last_scrub_stamp":"2023-11-18T21:29:38.473892+0000","last_deep_scrub":"31'66","last_deep_scrub_stamp":"2023-11-18T21:29:38.473892+0000","last_clean_scrub_stamp":"2023-11-18T21:29:38.473892+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:05:54.597599+0000","scrub_duration":0.0042396279999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"31'51","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:59.113381+0000","last_change":"2023-11-18T21:28:59.113381+0000","last_active":"2023-11-18T21:28:59.113381+0000","last_peered":"2023-11-18T21:28:59.113381+0000","last_clean":"2023-11-18T21:28:59.113381+0000","last_became_active":"2023-11-18T20:59:27.864956+0000","last_became_peered":"2023-11-18T20:59:27.864956+0000","last_unstale":"2023-11-18T21:28:59.113381+0000","last_undegraded":"2023-11-18T21:28:59.113381+0000","last_fullsized":"2023-11-18T21:28:59.113381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2023-11-18T21:28:59.113103+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2023-11-18T21:28:59.113103+0000","last_clean_scrub_stamp":"2023-11-18T21:28:59.113103+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:50.215502+0000","scrub_duration":0.0040903290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"31'38","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:05.149488+0000","last_change":"2023-11-18T21:29:05.149488+0000","last_active":"2023-11-18T21:29:05.149488+0000","last_peered":"2023-11-18T21:29:05.149488+0000","last_clean":"2023-11-18T21:29:05.149488+0000","last_became_active":"2023-11-18T20:59:27.889307+0000","last_became_peered":"2023-11-18T20:59:27.889307+0000","last_unstale":"2023-11-18T21:29:05.149488+0000","last_undegraded":"2023-11-18T21:29:05.149488+0000","last_fullsized":"2023-11-18T21:29:05.149488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2023-11-18T21:29:05.149232+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2023-11-18T21:29:05.149232+0000","last_clean_scrub_stamp":"2023-11-18T21:29:05.149232+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:03.563394+0000","scrub_duration":0.0040852270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'47","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:18.033021+0000","last_change":"2023-11-18T21:29:18.033021+0000","last_active":"2023-11-18T21:29:18.033021+0000","last_peered":"2023-11-18T21:29:18.033021+0000","last_clean":"2023-11-18T21:29:18.033021+0000","last_became_active":"2023-11-18T20:59:27.865625+0000","last_became_peered":"2023-11-18T20:59:27.865625+0000","last_unstale":"2023-11-18T21:29:18.033021+0000","last_undegraded":"2023-11-18T21:29:18.033021+0000","last_fullsized":"2023-11-18T21:29:18.033021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-11-18T21:29:18.032773+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-11-18T21:29:18.032773+0000","last_clean_scrub_stamp":"2023-11-18T21:29:18.032773+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:47.236897+0000","scrub_duration":0.004443911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"31'54","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:14.138618+0000","last_change":"2023-11-18T21:29:14.138618+0000","last_active":"2023-11-18T21:29:14.138618+0000","last_peered":"2023-11-18T21:29:14.138618+0000","last_clean":"2023-11-18T21:29:14.138618+0000","last_became_active":"2023-11-18T20:59:27.891753+0000","last_became_peered":"2023-11-18T20:59:27.891753+0000","last_unstale":"2023-11-18T21:29:14.138618+0000","last_undegraded":"2023-11-18T21:29:14.138618+0000","last_fullsized":"2023-11-18T21:29:14.138618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-11-18T21:29:14.138212+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-11-18T21:29:14.138212+0000","last_clean_scrub_stamp":"2023-11-18T21:29:14.138212+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:03:12.661609+0000","scrub_duration":0.0047151750000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"31'63","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.507019+0000","last_change":"2023-11-18T21:29:04.507071+0000","last_active":"2023-11-18T21:29:04.507019+0000","last_peered":"2023-11-18T21:29:04.507019+0000","last_clean":"2023-11-18T21:29:04.507019+0000","last_became_active":"2023-11-18T20:59:27.836899+0000","last_became_peered":"2023-11-18T20:59:27.836899+0000","last_unstale":"2023-11-18T21:29:04.507019+0000","last_undegraded":"2023-11-18T21:29:04.507019+0000","last_fullsized":"2023-11-18T21:29:04.507019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:04.506836+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:04.506836+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.506836+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:01.723462+0000","scrub_duration":0.003664133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"31'58","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:08.464394+0000","last_change":"2023-11-18T21:29:08.464448+0000","last_active":"2023-11-18T21:29:08.464394+0000","last_peered":"2023-11-18T21:29:08.464394+0000","last_clean":"2023-11-18T21:29:08.464394+0000","last_became_active":"2023-11-18T20:59:27.863732+0000","last_became_peered":"2023-11-18T20:59:27.863732+0000","last_unstale":"2023-11-18T21:29:08.464394+0000","last_undegraded":"2023-11-18T21:29:08.464394+0000","last_fullsized":"2023-11-18T21:29:08.464394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'58","last_scrub_stamp":"2023-11-18T21:29:08.464206+0000","last_deep_scrub":"31'58","last_deep_scrub_stamp":"2023-11-18T21:29:08.464206+0000","last_clean_scrub_stamp":"2023-11-18T21:29:08.464206+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:58.000184+0000","scrub_duration":0.0036243820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"31'63","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.067794+0000","last_change":"2023-11-18T21:29:21.067914+0000","last_active":"2023-11-18T21:29:21.067794+0000","last_peered":"2023-11-18T21:29:21.067794+0000","last_clean":"2023-11-18T21:29:21.067794+0000","last_became_active":"2023-11-18T20:59:27.871167+0000","last_became_peered":"2023-11-18T20:59:27.871167+0000","last_unstale":"2023-11-18T21:29:21.067794+0000","last_undegraded":"2023-11-18T21:29:21.067794+0000","last_fullsized":"2023-11-18T21:29:21.067794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:21.067516+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:21.067516+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.067516+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:39.715726+0000","scrub_duration":0.0077063610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":448,"num_write":2451,"num_write_kb":251040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2621,"ondisk_log_size":2621,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3577,"ondisk_log_size":3577,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23672018,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":675,"num_read_kb":695,"num_write":9681,"num_write_kb":28189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47595520,"data_stored":47344036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8555,"ondisk_log_size":8555,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509818,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":181032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.91400000000000003,"15min":0.89200000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.34799999999999998},"max":{"1min":1.512,"5min":1.5589999999999999,"15min":1.7649999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.89400000000000002,"15min":0.93200000000000005},"min":{"1min":0.53900000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1739999999999999,"5min":1.4950000000000001,"15min":1.5449999999999999},"last":0.90400000000000003}]},{"osd":1,"last update":"Sat Nov 18 21:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.91300000000000003,"15min":0.92100000000000004},"min":{"1min":0.48899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.2290000000000001,"5min":1.6579999999999999,"15min":1.7210000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.91000000000000003,"15min":0.93300000000000005},"min":{"1min":0.47699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.333,"5min":1.4319999999999999,"15min":2.524},"last":0.83199999999999996}]},{"osd":2,"last update":"Sat Nov 18 21:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.032,"15min":1.044},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.2929999999999999,"5min":1.585,"15min":1.694},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.96999999999999997,"15min":1.0069999999999999},"min":{"1min":0.50700000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2330000000000001,"5min":1.524,"15min":1.589},"last":1.2390000000000001}]},{"osd":3,"last update":"Sat Nov 18 21:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.98399999999999999,"15min":1.002},"min":{"1min":0.55300000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.296,"5min":1.7509999999999999,"15min":1.831},"last":0.87},{"interface":"front","average":{"1min":1.042,"5min":1.036,"15min":1.0509999999999999},"min":{"1min":0.56599999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3560000000000001,"5min":1.627,"15min":2.4430000000000001},"last":1.0089999999999999}]},{"osd":4,"last update":"Sat Nov 18 21:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.94599999999999995},"min":{"1min":0.53600000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.399,"5min":1.4299999999999999,"15min":1.601},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0589999999999999,"15min":1.0640000000000001},"min":{"1min":0.59399999999999997,"5min":0.498,"15min":0.40100000000000002},"max":{"1min":1.3899999999999999,"5min":2.266,"15min":2.266},"last":1.0509999999999999}]},{"osd":5,"last update":"Sat Nov 18 21:28:57 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.006,"15min":1.028},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.4179999999999999,"5min":1.6799999999999999,"15min":1.7509999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.081,"15min":1.109},"min":{"1min":0.46200000000000002,"5min":0.437,"15min":0.434},"max":{"1min":1.4810000000000001,"5min":1.643,"15min":2.0619999999999998},"last":1.1930000000000001}]},{"osd":6,"last update":"Sat Nov 18 21:28:57 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.109,"15min":1.149},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4350000000000001,"5min":1.7150000000000001,"15min":2.1659999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.1659999999999999,"15min":1.1799999999999999},"min":{"1min":0.61899999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.7330000000000001,"5min":2.181,"15min":2.181},"last":0.78600000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509818,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72804,"kb_used_data":15260,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299036,"statfs":{"total":96636764160,"available":96562212864,"internally_reserved":0,"allocated":15626240,"data_stored":15415703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93600000000000005,"15min":0.91400000000000003},"min":{"1min":0.55800000000000005,"5min":0.312,"15min":0.312},"max":{"1min":1.4590000000000001,"5min":1.52,"15min":1.72},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92300000000000004,"15min":0.95599999999999996},"min":{"1min":0.56999999999999995,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.3799999999999999,"5min":1.597,"15min":1.9950000000000001},"last":0.59199999999999997}]},{"osd":1,"last update":"Sat Nov 18 21:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.96299999999999997,"15min":0.94599999999999995},"min":{"1min":0.63600000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.887},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.95499999999999996,"15min":0.98899999999999999},"min":{"1min":0.61399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.302,"5min":1.417,"15min":3.73},"last":0.74199999999999999}]},{"osd":2,"last update":"Sat Nov 18 21:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.94099999999999995,"15min":0.95599999999999996},"min":{"1min":0.67300000000000004,"5min":0.51600000000000001,"15min":0.498},"max":{"1min":1.2,"5min":1.48,"15min":1.6459999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0049999999999999,"15min":1.0469999999999999},"min":{"1min":0.751,"5min":0.505,"15min":0.505},"max":{"1min":1.7,"5min":1.8380000000000001,"15min":1.964},"last":1.081}]},{"osd":3,"last update":"Sat Nov 18 21:29:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0409999999999999,"15min":1.048},"min":{"1min":0.68600000000000005,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3240000000000001,"5min":1.702,"15min":1.8759999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.93799999999999994,"5min":1.01,"15min":1.0589999999999999},"min":{"1min":0.70799999999999996,"5min":0.55400000000000005,"15min":0.42399999999999999},"max":{"1min":1.3480000000000001,"5min":1.665,"15min":3.9889999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Sat Nov 18 21:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.004,"15min":1.0309999999999999},"min":{"1min":0.61799999999999999,"5min":0.35099999999999998,"15min":0.318},"max":{"1min":1.554,"5min":1.7529999999999999,"15min":2.1030000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0800000000000001,"15min":1.1020000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.38900000000000001},"max":{"1min":1.359,"5min":1.782,"15min":1.873},"last":1.0149999999999999}]},{"osd":5,"last update":"Sat Nov 18 21:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.03,"15min":1.0640000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.38600000000000001},"max":{"1min":1.24,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.147,"5min":1.1499999999999999,"15min":1.1759999999999999},"min":{"1min":0.77400000000000002,"5min":0.55000000000000004,"15min":0.35999999999999999},"max":{"1min":1.998,"5min":2.194,"15min":2.3700000000000001},"last":1.194}]},{"osd":7,"last update":"Sat Nov 18 21:29:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.159,"15min":1.1930000000000001},"min":{"1min":0.79000000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3759999999999999,"5min":1.909,"15min":2.1379999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1659999999999999,"15min":1.206},"min":{"1min":0.70799999999999996,"5min":0.57499999999999996,"15min":0.45300000000000001},"max":{"1min":1.4039999999999999,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.052}]}]},{"osd":5,"up_from":15,"seq":64424509818,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62884,"kb_used_data":9500,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308956,"statfs":{"total":96636764160,"available":96572370944,"internally_reserved":0,"allocated":9728000,"data_stored":9504573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.91000000000000003,"15min":0.90900000000000003},"min":{"1min":0.70599999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.262},{"interface":"front","average":{"1min":1,"5min":0.92100000000000004,"15min":0.94499999999999995},"min":{"1min":0.54100000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.3200000000000001,"5min":1.496,"15min":2.0600000000000001},"last":0.78200000000000003}]},{"osd":1,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93200000000000005,"15min":0.91900000000000004},"min":{"1min":0.55700000000000005,"5min":0.437,"15min":0.437},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.79},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.94399999999999995,"15min":0.96599999999999997},"min":{"1min":0.71999999999999997,"5min":0.46700000000000003,"15min":0.39700000000000002},"max":{"1min":1.3859999999999999,"5min":1.474,"15min":1.794},"last":1.048}]},{"osd":2,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.93600000000000005,"15min":0.95499999999999996},"min":{"1min":0.56899999999999995,"5min":0.55100000000000005,"15min":0.39500000000000002},"max":{"1min":1.397,"5min":1.4610000000000001,"15min":2.1379999999999999},"last":1.194},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.028,"15min":1.016},"min":{"1min":0.747,"5min":0.626,"15min":0.41199999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.6659999999999999},"last":1.2230000000000001}]},{"osd":3,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.002,"15min":1.024},"min":{"1min":0.77700000000000002,"5min":0.60199999999999998,"15min":0.53700000000000003},"max":{"1min":1.2,"5min":1.4139999999999999,"15min":1.5960000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.038,"5min":1.0509999999999999,"15min":1.0880000000000001},"min":{"1min":0.73099999999999998,"5min":0.51600000000000001,"15min":0.38100000000000001},"max":{"1min":1.468,"5min":1.5449999999999999,"15min":2.2080000000000002},"last":1.1000000000000001}]},{"osd":4,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.97599999999999998,"15min":0.98399999999999999},"min":{"1min":0.52700000000000002,"5min":0.48299999999999998,"15min":0.42699999999999999},"max":{"1min":1.5069999999999999,"5min":1.6279999999999999,"15min":1.9099999999999999},"last":1.3},{"interface":"front","average":{"1min":1.171,"5min":1.0800000000000001,"15min":1.093},"min":{"1min":0.66000000000000003,"5min":0.501,"15min":0.439},"max":{"1min":1.5,"5min":1.585,"15min":2.4359999999999999},"last":1.351}]},{"osd":6,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.038,"15min":1.0760000000000001},"min":{"1min":0.65300000000000002,"5min":0.41799999999999998,"15min":0.32500000000000001},"max":{"1min":1.546,"5min":1.6299999999999999,"15min":2.2909999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.145,"5min":1.1100000000000001,"15min":1.1200000000000001},"min":{"1min":0.75600000000000001,"5min":0.60899999999999999,"15min":0.36299999999999999},"max":{"1min":1.6180000000000001,"5min":1.883,"15min":2.0019999999999998},"last":1.389}]},{"osd":7,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.1679999999999999,"15min":1.1759999999999999},"min":{"1min":0.76700000000000002,"5min":0.57199999999999995,"15min":0.50700000000000001},"max":{"1min":1.5669999999999999,"5min":1.6839999999999999,"15min":2.0209999999999999},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1699999999999999,"15min":1.2250000000000001},"min":{"1min":0.68300000000000005,"5min":0.51300000000000001,"15min":0.41499999999999998},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.2789999999999999},"last":0.89400000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509817,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60828,"kb_used_data":7444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311012,"statfs":{"total":96636764160,"available":96574476288,"internally_reserved":0,"allocated":7622656,"data_stored":7382745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.71499999999999997},"min":{"1min":0.34899999999999998,"5min":0.33700000000000002,"15min":0.309},"max":{"1min":1.125,"5min":1.458,"15min":1.458},"last":1.1839999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.748,"15min":0.76800000000000002},"min":{"1min":0.44500000000000001,"5min":0.30099999999999999,"15min":0.27800000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.605},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.83599999999999997,"15min":0.83799999999999997},"min":{"1min":0.39200000000000002,"5min":0.372,"15min":0.34899999999999998},"max":{"1min":1.593,"5min":1.593,"15min":1.7549999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75800000000000001,"15min":0.76800000000000002},"min":{"1min":0.40999999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.05,"5min":1.629,"15min":1.629},"last":0.73199999999999998}]},{"osd":2,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.99199999999999999,"15min":1.018},"min":{"1min":0.47399999999999998,"5min":0.46800000000000003,"15min":0.42599999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.847},"last":1.071},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.97699999999999998,"15min":1.012},"min":{"1min":0.48099999999999998,"5min":0.36699999999999999,"15min":0.32900000000000001},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.794},"last":0.89500000000000002}]},{"osd":4,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0469999999999999,"15min":1.077},"min":{"1min":0.67100000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.744,"5min":1.744,"15min":2.0630000000000002},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.0349999999999999,"15min":1.056},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.439},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.968},"last":1.038}]},{"osd":5,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.105,"15min":1.1140000000000001},"min":{"1min":0.69799999999999995,"5min":0.52700000000000002,"15min":0.45200000000000001},"max":{"1min":1.788,"5min":1.788,"15min":2.1709999999999998},"last":1.25},{"interface":"front","average":{"1min":0.999,"5min":1.0700000000000001,"15min":1.1000000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.304,"5min":1.736,"15min":1.798},"last":0.96499999999999997}]},{"osd":6,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.111,"15min":1.1519999999999999},"min":{"1min":0.64300000000000002,"5min":0.51100000000000001,"15min":0.48599999999999999},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.927},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.117,"15min":1.1419999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5880000000000001,"5min":1.8600000000000001,"15min":1.929},"last":1.2050000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1739999999999999,"15min":1.2070000000000001},"min":{"1min":0.61199999999999999,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.482,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.113},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2270000000000001,"15min":1.26},"min":{"1min":0.69199999999999995,"5min":0.68100000000000005,"15min":0.60299999999999998},"max":{"1min":1.7669999999999999,"5min":2.1120000000000001,"15min":2.3719999999999999},"last":1.1559999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509817,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36000,"kb_used_data":4824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335840,"statfs":{"total":96636764160,"available":96599900160,"internally_reserved":0,"allocated":4939776,"data_stored":4726754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70099999999999996,"15min":0.73399999999999999},"min":{"1min":0.42699999999999999,"5min":0.247,"15min":0.24299999999999999},"max":{"1min":1.151,"5min":1.2829999999999999,"15min":2.04},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.39800000000000002,"5min":0.28999999999999998,"15min":0.27300000000000002},"max":{"1min":1.204,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.94599999999999995}]},{"osd":1,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.84699999999999998,"15min":0.86499999999999999},"min":{"1min":0.42499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.397,"5min":1.5129999999999999,"15min":1.978},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.85099999999999998,"15min":0.88300000000000001},"min":{"1min":0.46500000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.1919999999999999,"5min":1.552,"15min":1.919},"last":0.78100000000000003}]},{"osd":3,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":4.3540000000000001,"5min":1.528,"15min":1.0680000000000001},"min":{"1min":0.45100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":68.629000000000005,"5min":68.629000000000005,"15min":68.629000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.998,"5min":1.012,"15min":1.0189999999999999},"min":{"1min":0.51900000000000002,"5min":0.32200000000000001,"15min":0.309},"max":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"last":1.2010000000000001}]},{"osd":4,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.079,"15min":1.111},"min":{"1min":0.71499999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.2649999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1180000000000001,"15min":1.1579999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5620000000000001,"5min":2.161,"15min":2.161},"last":1.1719999999999999}]},{"osd":5,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.2330000000000001,"15min":1.212},"min":{"1min":0.84599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":10.427,"5min":10.427,"15min":10.427},"last":1.099},{"interface":"front","average":{"1min":1.393,"5min":1.1659999999999999,"15min":1.1599999999999999},"min":{"1min":0.78100000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":6.7999999999999998,"5min":6.7999999999999998,"15min":6.7999999999999998},"last":1.1479999999999999}]},{"osd":6,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1399999999999999,"15min":1.1679999999999999},"min":{"1min":0.68700000000000006,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5509999999999999,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.232,"15min":1.2509999999999999},"min":{"1min":0.76100000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.532,"5min":1.994,"15min":2.1800000000000002},"last":0.99199999999999999}]},{"osd":7,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2470000000000001,"15min":1.2869999999999999},"min":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.2310000000000001,"15min":1.2529999999999999},"min":{"1min":0.61899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.3570000000000002,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":0.90100000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509816,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":966656,"data_stored":748254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.754,"15min":0.746},"min":{"1min":0.51900000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":1.208,"5min":1.359,"15min":1.4330000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78200000000000003,"15min":0.80800000000000005},"min":{"1min":0.41399999999999998,"5min":0.318,"15min":0.318},"max":{"1min":1.0760000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.76400000000000001}]},{"osd":2,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.80900000000000005,"15min":0.80200000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0960000000000001,"5min":1.6859999999999999,"15min":1.706},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.89600000000000002,"15min":0.90700000000000003},"min":{"1min":0.48499999999999999,"5min":0.41599999999999998,"15min":0.35099999999999998},"max":{"1min":1.155,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.86799999999999999}]},{"osd":3,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.44600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.169,"5min":1.7170000000000001,"15min":1.881},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.92700000000000005,"15min":0.95199999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3640000000000001,"5min":1.6519999999999999,"15min":1.73},"last":0.92000000000000004}]},{"osd":4,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":1.0249999999999999,"15min":1.0489999999999999},"min":{"1min":0.505,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.228,"5min":1.6399999999999999,"15min":1.867},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.161,"15min":1.1759999999999999},"min":{"1min":0.60799999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.361,"5min":1.716,"15min":1.9039999999999999},"last":0.98999999999999999}]},{"osd":5,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.129,"15min":1.1579999999999999},"min":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.53200000000000003},"max":{"1min":1.353,"5min":1.8660000000000001,"15min":2.0230000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.103,"15min":1.127},"min":{"1min":0.71399999999999997,"5min":0.59799999999999998,"15min":0.59199999999999997},"max":{"1min":1.28,"5min":1.6819999999999999,"15min":1.8400000000000001},"last":0.83499999999999996}]},{"osd":6,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2669999999999999,"15min":1.266},"min":{"1min":0.81399999999999995,"5min":0.64200000000000002,"15min":0.59999999999999998},"max":{"1min":1.5409999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.1910000000000001,"15min":1.2310000000000001},"min":{"1min":0.624,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.819,"5min":1.8819999999999999,"15min":2.0600000000000001},"last":1.2250000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.2310000000000001,"15min":1.284},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.915,"5min":1.9530000000000001,"15min":2.1389999999999998},"last":1.012},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1899999999999999,"15min":1.2330000000000001},"min":{"1min":0.70399999999999996,"5min":0.66000000000000003,"15min":0.65400000000000003},"max":{"1min":1.4710000000000001,"5min":1.806,"15min":1.988},"last":0.96299999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509816,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60764,"kb_used_data":7380,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311076,"statfs":{"total":96636764160,"available":96574541824,"internally_reserved":0,"allocated":7557120,"data_stored":7321877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71099999999999997,"15min":0.73699999999999999},"min":{"1min":0.39800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0049999999999999,"5min":1.4750000000000001,"15min":1.7370000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.82599999999999996},"min":{"1min":0.433,"5min":0.34399999999999997,"15min":0.29799999999999999},"max":{"1min":1.149,"5min":1.321,"15min":1.8560000000000001},"last":0.76600000000000001}]},{"osd":2,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.85299999999999998,"15min":0.876},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.29199999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.7190000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.52100000000000002,"5min":0.38500000000000001,"15min":0.317},"max":{"1min":1.0569999999999999,"5min":1.5820000000000001,"15min":1.8959999999999999},"last":0.97899999999999998}]},{"osd":3,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.85799999999999998,"15min":0.89100000000000001},"min":{"1min":0.52400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.288,"5min":1.756,"15min":1.869},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.008,"15min":1.0129999999999999},"min":{"1min":0.58899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4059999999999999,"5min":1.6180000000000001,"15min":1.9259999999999999},"last":1.0609999999999999}]},{"osd":4,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0009999999999999,"15min":1.0149999999999999},"min":{"1min":0.68000000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.29,"5min":1.55,"15min":1.9610000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.111,"15min":1.1160000000000001},"min":{"1min":0.79500000000000004,"5min":0.59099999999999997,"15min":0.47899999999999998},"max":{"1min":1.339,"5min":2.101,"15min":2.101},"last":1.1399999999999999}]},{"osd":5,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.115,"15min":1.1599999999999999},"min":{"1min":0.68999999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.478,"5min":1.667,"15min":2.1669999999999998},"last":1.478},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0649999999999999,"15min":1.0940000000000001},"min":{"1min":0.56699999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.282,"5min":1.728,"15min":2.1280000000000001},"last":0.92700000000000005}]},{"osd":6,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.1459999999999999,"15min":1.202},"min":{"1min":0.72399999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.502,"5min":1.9910000000000001,"15min":2.101},"last":1.262},{"interface":"front","average":{"1min":1.127,"5min":1.1759999999999999,"15min":1.2250000000000001},"min":{"1min":0.80100000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5720000000000001,"5min":1.831,"15min":2.2480000000000002},"last":1.5720000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2430000000000001,"15min":1.284},"min":{"1min":0.752,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.623,"5min":1.77,"15min":2.2410000000000001},"last":1.623},{"interface":"front","average":{"1min":1.123,"5min":1.1890000000000001,"15min":1.1910000000000001},"min":{"1min":0.70399999999999996,"5min":0.64400000000000002,"15min":0.60099999999999998},"max":{"1min":1.4450000000000001,"5min":1.972,"15min":1.972},"last":1.1100000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542520,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35648,"kb_used_data":4472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336192,"statfs":{"total":96636764160,"available":96600260608,"internally_reserved":0,"allocated":4579328,"data_stored":4332954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.88900000000000001,"15min":0.90300000000000002},"min":{"1min":0.53800000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3280000000000001,"5min":1.544,"15min":1.544},"last":1.298},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.878,"15min":0.90400000000000003},"min":{"1min":0.58799999999999997,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":1.347,"5min":1.4139999999999999,"15min":1.6319999999999999},"last":0.83999999999999997}]},{"osd":1,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.89700000000000002,"15min":0.92100000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.302,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93799999999999994,"15min":0.95999999999999996},"min":{"1min":0.505,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.262,"5min":1.454,"15min":1.7689999999999999},"last":1.401}]},{"osd":2,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.94299999999999995,"15min":0.97599999999999998},"min":{"1min":0.55400000000000005,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":1.302,"5min":1.613,"15min":1.708},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.997,"15min":1.012},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.29,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":1.5089999999999999}]},{"osd":3,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.97299999999999998,"15min":0.996},"min":{"1min":0.621,"5min":0.52800000000000002,"15min":0.44500000000000001},"max":{"1min":1.2390000000000001,"5min":1.5349999999999999,"15min":2.2370000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0800000000000001,"15min":1.103},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2250000000000001,"5min":1.752,"15min":1.8220000000000001},"last":1.3500000000000001}]},{"osd":5,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.98599999999999999,"15min":1.0089999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.38500000000000001},"max":{"1min":1.6279999999999999,"5min":1.6779999999999999,"15min":2.016},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.01,"5min":0.995,"15min":1.026},"min":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.34300000000000003},"max":{"1min":1.5369999999999999,"5min":1.5880000000000001,"15min":1.821},"last":1.137}]},{"osd":6,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.0349999999999999,"15min":1.0720000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":1.387,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.258},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.165,"15min":1.194},"min":{"1min":0.54000000000000004,"5min":0.53100000000000003,"15min":0.44500000000000001},"max":{"1min":1.5640000000000001,"5min":1.76,"15min":2.1230000000000002},"last":1.601}]},{"osd":7,"last update":"Sat Nov 18 21:28:55 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1279999999999999,"15min":1.149},"min":{"1min":0.64800000000000002,"5min":0.439,"15min":0.379},"max":{"1min":1.806,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.218,"15min":1.2549999999999999},"min":{"1min":0.60599999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.7290000000000001,"5min":1.996,"15min":2.1160000000000001},"last":1.556}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7225344,"data_stored":7185737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":21746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4608000,"data_stored":4590614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7290880,"data_stored":7246605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4247552,"data_stored":4196814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8802304,"data_stored":8778065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15294464,"data_stored":15279563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":44892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T21:29:43.704 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:43.704 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:43.705 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:43.705 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:43.705 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:43.705 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:43.705 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:43.705 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:43.705 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:43.706 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-18T20:59:34.328065+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=34, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:43.706 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-11-18T20:59:26.114784+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=20, tm_min=59, tm_sec=26, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=21, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T21:29:43.706 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-18T21:30:01.232 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:32:01.276 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:01.258 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:32:01.302 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:01.418 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:32:01.405 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:01.425 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:32:01.413 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:01.456 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:32:01.445 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:01.462 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:32:01.451 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:01.620 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:32:01.663 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:01.752 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:32:01.740 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:01.771 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:32:01.760 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:03.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:30:03.071 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:30:03.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T21:30:03.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.827+0000 7fb32ce46640 1 Processor -- start 2023-11-18T21:30:03.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.831+0000 7fb32ce46640 1 -- start start 2023-11-18T21:30:03.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.831+0000 7fb32ce46640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb32815a130 0x7fb328161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:03.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.831+0000 7fb32ce46640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb328159590 con 0x7fb3280722f0 2023-11-18T21:30:03.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.831+0000 7fb32ce46640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb328156190 con 0x7fb3280726d0 2023-11-18T21:30:03.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.831+0000 7fb32ce46640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb328155fa0 con 0x7fb32815a130 2023-11-18T21:30:03.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.831+0000 7fb325d9b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb3280726d0 0x7fb328159a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:41324/0 (socket says 172.21.15.49:41324) 2023-11-18T21:30:03.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.831+0000 7fb325d9b640 1 -- 172.21.15.49:0/2869996201 learned_addr learned my addr 172.21.15.49:0/2869996201 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:30:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.855+0000 7fb32559a640 1 -- 172.21.15.49:0/2869996201 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166527371 0 0) 0x7fb328156190 con 0x7fb3280726d0 2023-11-18T21:30:03.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.855+0000 7fb32559a640 1 -- 172.21.15.49:0/2869996201 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb314005740 con 0x7fb3280726d0 2023-11-18T21:30:03.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.935+0000 7fb326d9d640 1 --2- 172.21.15.49:0/2869996201 >> v2:172.21.15.49:3300/0 conn(0x7fb32815a130 0x7fb328161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:03.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.951+0000 7fb326d9d640 1 -- 172.21.15.49:0/2869996201 >> v1:172.21.15.106:6789/0 conn(0x7fb3280726d0 legacy=0x7fb328159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:03.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.951+0000 7fb326d9d640 1 -- 172.21.15.49:0/2869996201 >> v1:172.21.15.49:6789/0 conn(0x7fb3280722f0 legacy=0x7fb3280c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:03.954 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.951+0000 7fb326d9d640 1 -- 172.21.15.49:0/2869996201 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb328156470 con 0x7fb32815a130 2023-11-18T21:30:03.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:03.979+0000 7fb326d9d640 1 --2- 172.21.15.49:0/2869996201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32815a130 0x7fb328161930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb3180097c0 tx=0x7fb31801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9428f6a9cc5578 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:04.197 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.195+0000 7fb32559a640 1 -- 172.21.15.49:0/2869996201 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3180ab600 con 0x7fb32815a130 2023-11-18T21:30:04.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.195+0000 7fb32559a640 1 -- 172.21.15.49:0/2869996201 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3180a7050 con 0x7fb32815a130 2023-11-18T21:30:04.198 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.195+0000 7fb32559a640 1 -- 172.21.15.49:0/2869996201 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3180ab980 con 0x7fb32815a130 2023-11-18T21:30:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.199+0000 7fb32ce46640 1 -- 172.21.15.49:0/2869996201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32815a130 msgr2=0x7fb328161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.199+0000 7fb32ce46640 1 --2- 172.21.15.49:0/2869996201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32815a130 0x7fb328161930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb3180097c0 tx=0x7fb31801c3c0 comp rx=0 tx=0).stop 2023-11-18T21:30:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.199+0000 7fb32ce46640 1 -- 172.21.15.49:0/2869996201 shutdown_connections 2023-11-18T21:30:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.199+0000 7fb32ce46640 1 --2- 172.21.15.49:0/2869996201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32815a130 0x7fb328161930 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.199+0000 7fb32ce46640 1 -- 172.21.15.49:0/2869996201 >> 172.21.15.49:0/2869996201 conn(0x7fb32806b670 msgr2=0x7fb32806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.199+0000 7fb32ce46640 1 -- 172.21.15.49:0/2869996201 shutdown_connections 2023-11-18T21:30:04.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.199+0000 7fb32ce46640 1 -- 172.21.15.49:0/2869996201 wait complete. 2023-11-18T21:30:04.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.199+0000 7fb32ce46640 1 Processor -- start 2023-11-18T21:30:04.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.199+0000 7fb32ce46640 1 -- start start 2023-11-18T21:30:04.202 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.203+0000 7fb32ce46640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb3280722f0 0x7fb3281f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:04.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.203+0000 7fb32ce46640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3280726d0 0x7fb32814e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:04.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.203+0000 7fb32ce46640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32815a130 0x7fb3280c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:04.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.203+0000 7fb32ce46640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32814aa40 con 0x7fb32815a130 2023-11-18T21:30:04.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.203+0000 7fb32ce46640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32814dd20 con 0x7fb3280726d0 2023-11-18T21:30:04.203 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.203+0000 7fb32ce46640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32813e3d0 con 0x7fb3280722f0 2023-11-18T21:30:04.206 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.207+0000 7fb32659c640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb3280722f0 0x7fb3281f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.207+0000 7fb32659c640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb3280722f0 0x7fb3281f5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:48782/0 (socket says 172.21.15.49:48782) 2023-11-18T21:30:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.207+0000 7fb32659c640 1 -- 172.21.15.49:0/1859482666 learned_addr learned my addr 172.21.15.49:0/1859482666 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:30:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.207+0000 7fb325d9b640 1 --2- 172.21.15.49:0/1859482666 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3280726d0 0x7fb32814e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:04.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.211+0000 7fb326d9d640 1 --2- 172.21.15.49:0/1859482666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32815a130 0x7fb3280c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:04.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.211+0000 7fb325d9b640 1 -- 172.21.15.49:0/1859482666 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb3280722f0 msgr2=0x7fb3281f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:04.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.211+0000 7fb325d9b640 1 --2- 172.21.15.49:0/1859482666 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb3280722f0 0x7fb3281f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:04.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.211+0000 7fb325d9b640 1 -- 172.21.15.49:0/1859482666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32815a130 msgr2=0x7fb3280c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:04.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.211+0000 7fb325d9b640 1 --2- 172.21.15.49:0/1859482666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32815a130 0x7fb3280c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:04.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.211+0000 7fb325d9b640 1 -- 172.21.15.49:0/1859482666 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb318009420 con 0x7fb3280726d0 2023-11-18T21:30:04.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.215+0000 7fb325d9b640 1 --2- 172.21.15.49:0/1859482666 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3280726d0 0x7fb32814e730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c430 tx=0x7fb31000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:04.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.219+0000 7fb31effd640 1 -- 172.21.15.49:0/1859482666 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310005cf0 con 0x7fb3280726d0 2023-11-18T21:30:04.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.219+0000 7fb31effd640 1 -- 172.21.15.49:0/1859482666 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb310005e50 con 0x7fb3280726d0 2023-11-18T21:30:04.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.219+0000 7fb32ce46640 1 -- 172.21.15.49:0/1859482666 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3281f6280 con 0x7fb3280726d0 2023-11-18T21:30:04.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.219+0000 7fb31effd640 1 -- 172.21.15.49:0/1859482666 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100072d0 con 0x7fb3280726d0 2023-11-18T21:30:04.222 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.219+0000 7fb32ce46640 1 -- 172.21.15.49:0/1859482666 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3281f5540 con 0x7fb3280726d0 2023-11-18T21:30:04.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.223+0000 7fb32ce46640 1 -- 172.21.15.49:0/1859482666 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3280c6d60 con 0x7fb3280726d0 2023-11-18T21:30:04.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.499+0000 7fb31effd640 1 -- 172.21.15.49:0/1859482666 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb310007430 con 0x7fb3280726d0 2023-11-18T21:30:04.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.499+0000 7fb31effd640 1 --2- 172.21.15.49:0/1859482666 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb3080664c0 0x7fb308068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:04.500 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.499+0000 7fb32659c640 1 --2- 172.21.15.49:0/1859482666 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb3080664c0 0x7fb308068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:04.501 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.499+0000 7fb32659c640 1 --2- 172.21.15.49:0/1859482666 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb3080664c0 0x7fb308068980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb320007fd0 tx=0x7fb320009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:04.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.507+0000 7fb31effd640 1 -- 172.21.15.49:0/1859482666 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fb310054a50 con 0x7fb3280726d0 2023-11-18T21:30:04.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.587+0000 7fb31effd640 1 -- 172.21.15.49:0/1859482666 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb310050d90 con 0x7fb3280726d0 2023-11-18T21:30:04.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.775+0000 7fb32ce46640 1 -- 172.21.15.49:0/1859482666 --> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3281505b0 con 0x7fb3080664c0 2023-11-18T21:30:04.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.803+0000 7fb31effd640 1 -- 172.21.15.49:0/1859482666 <== mgr.4103 v2:172.21.15.106:6800/2832976331 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371617 (secure 0 0 0) 0x7fb32000fe00 con 0x7fb3080664c0 2023-11-18T21:30:04.809 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:30:04.812 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-11-18T21:30:04.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.811+0000 7fb32ce46640 1 -- 172.21.15.49:0/1859482666 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb3080664c0 msgr2=0x7fb308068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:04.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.811+0000 7fb32ce46640 1 --2- 172.21.15.49:0/1859482666 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb3080664c0 0x7fb308068980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb320007fd0 tx=0x7fb320009040 comp rx=0 tx=0).stop 2023-11-18T21:30:04.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.811+0000 7fb32ce46640 1 -- 172.21.15.49:0/1859482666 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3280726d0 msgr2=0x7fb32814e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:04.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.811+0000 7fb32ce46640 1 --2- 172.21.15.49:0/1859482666 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3280726d0 0x7fb32814e730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c430 tx=0x7fb31000c8f0 comp rx=0 tx=0).stop 2023-11-18T21:30:04.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.811+0000 7fb32ce46640 1 -- 172.21.15.49:0/1859482666 shutdown_connections 2023-11-18T21:30:04.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.811+0000 7fb32ce46640 1 --2- 172.21.15.49:0/1859482666 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb3080664c0 0x7fb308068980 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:04.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.811+0000 7fb32ce46640 1 --2- 172.21.15.49:0/1859482666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32815a130 0x7fb3280c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:04.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.811+0000 7fb32ce46640 1 --2- 172.21.15.49:0/1859482666 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3280726d0 0x7fb32814e730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:04.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.811+0000 7fb32ce46640 1 --2- 172.21.15.49:0/1859482666 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb3280722f0 0x7fb3281f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:04.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.811+0000 7fb32ce46640 1 -- 172.21.15.49:0/1859482666 >> 172.21.15.49:0/1859482666 conn(0x7fb32806b670 msgr2=0x7fb328159950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:04.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.811+0000 7fb32ce46640 1 -- 172.21.15.49:0/1859482666 shutdown_connections 2023-11-18T21:30:04.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:04.811+0000 7fb32ce46640 1 -- 172.21.15.49:0/1859482666 wait complete. 2023-11-18T21:30:04.828 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":970,"stamp":"2023-11-18T21:30:04.570613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24262386,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":804,"num_read_kb":1243,"num_write":12291,"num_write_kb":281645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14872,"ondisk_log_size":14872,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":388472,"kb_used_data":50232,"kb_used_omap":12,"kb_used_meta":338163,"kb_avail":754586248,"statfs":{"total":773094113280,"available":772696317952,"internally_reserved":0,"allocated":51437568,"data_stored":49613892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":346279473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004877"},"pg_stats":[{"pgid":"2.1f","version":"31'78","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:03.460546+0000","last_change":"2023-11-18T21:29:03.460610+0000","last_active":"2023-11-18T21:29:03.460546+0000","last_peered":"2023-11-18T21:29:03.460546+0000","last_clean":"2023-11-18T21:29:03.460546+0000","last_became_active":"2023-11-18T20:59:25.349869+0000","last_became_peered":"2023-11-18T20:59:25.349869+0000","last_unstale":"2023-11-18T21:29:03.460546+0000","last_undegraded":"2023-11-18T21:29:03.460546+0000","last_fullsized":"2023-11-18T21:29:03.460546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'78","last_scrub_stamp":"2023-11-18T21:29:03.460361+0000","last_deep_scrub":"31'78","last_deep_scrub_stamp":"2023-11-18T21:29:03.460361+0000","last_clean_scrub_stamp":"2023-11-18T21:29:03.460361+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:24:19.786896+0000","scrub_duration":0.011799875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'45","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:26.382457+0000","last_change":"2023-11-18T21:29:26.382457+0000","last_active":"2023-11-18T21:29:26.382457+0000","last_peered":"2023-11-18T21:29:26.382457+0000","last_clean":"2023-11-18T21:29:26.382457+0000","last_became_active":"2023-11-18T20:59:27.895678+0000","last_became_peered":"2023-11-18T20:59:27.895678+0000","last_unstale":"2023-11-18T21:29:26.382457+0000","last_undegraded":"2023-11-18T21:29:26.382457+0000","last_fullsized":"2023-11-18T21:29:26.382457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2023-11-18T21:29:26.382073+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2023-11-18T21:29:26.382073+0000","last_clean_scrub_stamp":"2023-11-18T21:29:26.382073+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:28.880730+0000","scrub_duration":0.0048445019999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"31'87","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:22.248822+0000","last_change":"2023-11-18T21:29:22.248881+0000","last_active":"2023-11-18T21:29:22.248822+0000","last_peered":"2023-11-18T21:29:22.248822+0000","last_clean":"2023-11-18T21:29:22.248822+0000","last_became_active":"2023-11-18T20:59:35.848140+0000","last_became_peered":"2023-11-18T20:59:35.848140+0000","last_unstale":"2023-11-18T21:29:22.248822+0000","last_undegraded":"2023-11-18T21:29:22.248822+0000","last_fullsized":"2023-11-18T21:29:22.248822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2023-11-18T21:29:22.248610+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2023-11-18T21:29:22.248610+0000","last_clean_scrub_stamp":"2023-11-18T21:29:22.248610+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:23:17.258588+0000","scrub_duration":0.0083978449999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:13.501955+0000","last_change":"2023-11-18T21:29:13.501955+0000","last_active":"2023-11-18T21:29:13.501955+0000","last_peered":"2023-11-18T21:29:13.501955+0000","last_clean":"2023-11-18T21:29:13.501955+0000","last_became_active":"2023-11-18T20:59:25.463001+0000","last_became_peered":"2023-11-18T20:59:25.463001+0000","last_unstale":"2023-11-18T21:29:13.501955+0000","last_undegraded":"2023-11-18T21:29:13.501955+0000","last_fullsized":"2023-11-18T21:29:13.501955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-11-18T21:29:13.501715+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-11-18T21:29:13.501715+0000","last_clean_scrub_stamp":"2023-11-18T21:29:13.501715+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:31.013864+0000","scrub_duration":0.0034647580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"31'59","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:59.668147+0000","last_change":"2023-11-18T21:28:59.668198+0000","last_active":"2023-11-18T21:28:59.668147+0000","last_peered":"2023-11-18T21:28:59.668147+0000","last_clean":"2023-11-18T21:28:59.668147+0000","last_became_active":"2023-11-18T20:59:27.836937+0000","last_became_peered":"2023-11-18T20:59:27.836937+0000","last_unstale":"2023-11-18T21:28:59.668147+0000","last_undegraded":"2023-11-18T21:28:59.668147+0000","last_fullsized":"2023-11-18T21:28:59.668147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:28:59.667928+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:28:59.667928+0000","last_clean_scrub_stamp":"2023-11-18T21:28:59.667928+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:50.770327+0000","scrub_duration":0.0051257619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"31'91","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:20.239104+0000","last_change":"2023-11-18T21:29:20.239161+0000","last_active":"2023-11-18T21:29:20.239104+0000","last_peered":"2023-11-18T21:29:20.239104+0000","last_clean":"2023-11-18T21:29:20.239104+0000","last_became_active":"2023-11-18T20:59:35.842552+0000","last_became_peered":"2023-11-18T20:59:35.842552+0000","last_unstale":"2023-11-18T21:29:20.239104+0000","last_undegraded":"2023-11-18T21:29:20.239104+0000","last_fullsized":"2023-11-18T21:29:20.239104+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'91","last_scrub_stamp":"2023-11-18T21:29:20.238911+0000","last_deep_scrub":"31'91","last_deep_scrub_stamp":"2023-11-18T21:29:20.238911+0000","last_clean_scrub_stamp":"2023-11-18T21:29:20.238911+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:09.774889+0000","scrub_duration":0.010430183000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"31'182","reported_seq":225,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:06.070791+0000","last_change":"2023-11-18T21:29:06.070791+0000","last_active":"2023-11-18T21:29:06.070791+0000","last_peered":"2023-11-18T21:29:06.070791+0000","last_clean":"2023-11-18T21:29:06.070791+0000","last_became_active":"2023-11-18T20:59:25.497070+0000","last_became_peered":"2023-11-18T20:59:25.497070+0000","last_unstale":"2023-11-18T21:29:06.070791+0000","last_undegraded":"2023-11-18T21:29:06.070791+0000","last_fullsized":"2023-11-18T21:29:06.070791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'182","last_scrub_stamp":"2023-11-18T21:29:06.070530+0000","last_deep_scrub":"31'182","last_deep_scrub_stamp":"2023-11-18T21:29:06.070530+0000","last_clean_scrub_stamp":"2023-11-18T21:29:06.070530+0000","objects_scrubbed":7,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:03.287156+0000","scrub_duration":0.017219693000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"31'56","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:19.095416+0000","last_change":"2023-11-18T21:29:19.095416+0000","last_active":"2023-11-18T21:29:19.095416+0000","last_peered":"2023-11-18T21:29:19.095416+0000","last_clean":"2023-11-18T21:29:19.095416+0000","last_became_active":"2023-11-18T20:59:27.867021+0000","last_became_peered":"2023-11-18T20:59:27.867021+0000","last_unstale":"2023-11-18T21:29:19.095416+0000","last_undegraded":"2023-11-18T21:29:19.095416+0000","last_fullsized":"2023-11-18T21:29:19.095416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'56","last_scrub_stamp":"2023-11-18T21:29:19.095175+0000","last_deep_scrub":"31'56","last_deep_scrub_stamp":"2023-11-18T21:29:19.095175+0000","last_clean_scrub_stamp":"2023-11-18T21:29:19.095175+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:24:47.739315+0000","scrub_duration":0.0033730069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'88","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:30.250057+0000","last_change":"2023-11-18T21:29:30.250057+0000","last_active":"2023-11-18T21:29:30.250057+0000","last_peered":"2023-11-18T21:29:30.250057+0000","last_clean":"2023-11-18T21:29:30.250057+0000","last_became_active":"2023-11-18T20:59:35.829636+0000","last_became_peered":"2023-11-18T20:59:35.829636+0000","last_unstale":"2023-11-18T21:29:30.250057+0000","last_undegraded":"2023-11-18T21:29:30.250057+0000","last_fullsized":"2023-11-18T21:29:30.250057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'88","last_scrub_stamp":"2023-11-18T21:29:30.249808+0000","last_deep_scrub":"31'88","last_deep_scrub_stamp":"2023-11-18T21:29:30.249808+0000","last_clean_scrub_stamp":"2023-11-18T21:29:30.249808+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:15:32.715371+0000","scrub_duration":0.0092954140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":32,"num_write":84,"num_write_kb":9481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"31'13","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.970375+0000","last_change":"2023-11-18T21:29:10.970375+0000","last_active":"2023-11-18T21:29:10.970375+0000","last_peered":"2023-11-18T21:29:10.970375+0000","last_clean":"2023-11-18T21:29:10.970375+0000","last_became_active":"2023-11-18T20:59:25.493087+0000","last_became_peered":"2023-11-18T20:59:25.493087+0000","last_unstale":"2023-11-18T21:29:10.970375+0000","last_undegraded":"2023-11-18T21:29:10.970375+0000","last_fullsized":"2023-11-18T21:29:10.970375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2023-11-18T21:29:10.970102+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2023-11-18T21:29:10.970102+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.970102+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:28.482252+0000","scrub_duration":0.0099144660000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"31'65","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:05.584178+0000","last_change":"2023-11-18T21:29:05.584178+0000","last_active":"2023-11-18T21:29:05.584178+0000","last_peered":"2023-11-18T21:29:05.584178+0000","last_clean":"2023-11-18T21:29:05.584178+0000","last_became_active":"2023-11-18T20:59:27.871076+0000","last_became_peered":"2023-11-18T20:59:27.871076+0000","last_unstale":"2023-11-18T21:29:05.584178+0000","last_undegraded":"2023-11-18T21:29:05.584178+0000","last_fullsized":"2023-11-18T21:29:05.584178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'65","last_scrub_stamp":"2023-11-18T21:29:05.583742+0000","last_deep_scrub":"31'65","last_deep_scrub_stamp":"2023-11-18T21:29:05.583742+0000","last_clean_scrub_stamp":"2023-11-18T21:29:05.583742+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:14:13.537695+0000","scrub_duration":0.003124567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"31'63","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:31.224674+0000","last_change":"2023-11-18T21:29:31.224674+0000","last_active":"2023-11-18T21:29:31.224674+0000","last_peered":"2023-11-18T21:29:31.224674+0000","last_clean":"2023-11-18T21:29:31.224674+0000","last_became_active":"2023-11-18T20:59:35.833016+0000","last_became_peered":"2023-11-18T20:59:35.833016+0000","last_unstale":"2023-11-18T21:29:31.224674+0000","last_undegraded":"2023-11-18T21:29:31.224674+0000","last_fullsized":"2023-11-18T21:29:31.224674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:31.224423+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:31.224423+0000","last_clean_scrub_stamp":"2023-11-18T21:29:31.224423+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:11:59.356184+0000","scrub_duration":0.0099963039999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":5002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"31'56","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:12.489906+0000","last_change":"2023-11-18T21:29:12.489906+0000","last_active":"2023-11-18T21:29:12.489906+0000","last_peered":"2023-11-18T21:29:12.489906+0000","last_clean":"2023-11-18T21:29:12.489906+0000","last_became_active":"2023-11-18T20:59:27.681154+0000","last_became_peered":"2023-11-18T20:59:27.681154+0000","last_unstale":"2023-11-18T21:29:12.489906+0000","last_undegraded":"2023-11-18T21:29:12.489906+0000","last_fullsized":"2023-11-18T21:29:12.489906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'56","last_scrub_stamp":"2023-11-18T21:29:12.489669+0000","last_deep_scrub":"31'56","last_deep_scrub_stamp":"2023-11-18T21:29:12.489669+0000","last_clean_scrub_stamp":"2023-11-18T21:29:12.489669+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:46:08.217982+0000","scrub_duration":0.0041585340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"31'145","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:31.368234+0000","last_change":"2023-11-18T21:29:31.368300+0000","last_active":"2023-11-18T21:29:31.368234+0000","last_peered":"2023-11-18T21:29:31.368234+0000","last_clean":"2023-11-18T21:29:31.368234+0000","last_became_active":"2023-11-18T20:59:25.338067+0000","last_became_peered":"2023-11-18T20:59:25.338067+0000","last_unstale":"2023-11-18T21:29:31.368234+0000","last_undegraded":"2023-11-18T21:29:31.368234+0000","last_fullsized":"2023-11-18T21:29:31.368234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'145","last_scrub_stamp":"2023-11-18T21:29:31.368043+0000","last_deep_scrub":"31'145","last_deep_scrub_stamp":"2023-11-18T21:29:31.368043+0000","last_clean_scrub_stamp":"2023-11-18T21:29:31.368043+0000","objects_scrubbed":3,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:00.208920+0000","scrub_duration":0.010539744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395570,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'89","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:33.232573+0000","last_change":"2023-11-18T21:29:33.232573+0000","last_active":"2023-11-18T21:29:33.232573+0000","last_peered":"2023-11-18T21:29:33.232573+0000","last_clean":"2023-11-18T21:29:33.232573+0000","last_became_active":"2023-11-18T21:00:28.755606+0000","last_became_peered":"2023-11-18T21:00:28.755606+0000","last_unstale":"2023-11-18T21:29:33.232573+0000","last_undegraded":"2023-11-18T21:29:33.232573+0000","last_fullsized":"2023-11-18T21:29:33.232573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'89","last_scrub_stamp":"2023-11-18T21:29:33.232313+0000","last_deep_scrub":"31'89","last_deep_scrub_stamp":"2023-11-18T21:29:33.232313+0000","last_clean_scrub_stamp":"2023-11-18T21:29:33.232313+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:17:16.429280+0000","scrub_duration":0.0086994629999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":4704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'54","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:14.305497+0000","last_change":"2023-11-18T21:29:14.305549+0000","last_active":"2023-11-18T21:29:14.305497+0000","last_peered":"2023-11-18T21:29:14.305497+0000","last_clean":"2023-11-18T21:29:14.305497+0000","last_became_active":"2023-11-18T20:59:27.861045+0000","last_became_peered":"2023-11-18T20:59:27.861045+0000","last_unstale":"2023-11-18T21:29:14.305497+0000","last_undegraded":"2023-11-18T21:29:14.305497+0000","last_fullsized":"2023-11-18T21:29:14.305497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-11-18T21:29:14.305304+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-11-18T21:29:14.305304+0000","last_clean_scrub_stamp":"2023-11-18T21:29:14.305304+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:11:24.924936+0000","scrub_duration":0.0068830929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"31'409","reported_seq":454,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.296193+0000","last_change":"2023-11-18T21:29:10.296193+0000","last_active":"2023-11-18T21:29:10.296193+0000","last_peered":"2023-11-18T21:29:10.296193+0000","last_clean":"2023-11-18T21:29:10.296193+0000","last_became_active":"2023-11-18T20:59:25.457871+0000","last_became_peered":"2023-11-18T20:59:25.457871+0000","last_unstale":"2023-11-18T21:29:10.296193+0000","last_undegraded":"2023-11-18T21:29:10.296193+0000","last_fullsized":"2023-11-18T21:29:10.296193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'409","last_scrub_stamp":"2023-11-18T21:29:10.295947+0000","last_deep_scrub":"31'409","last_deep_scrub_stamp":"2023-11-18T21:29:10.295947+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.295947+0000","objects_scrubbed":2,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:46:51.703977+0000","scrub_duration":0.017910031999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":996,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"31'93","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:32.223717+0000","last_change":"2023-11-18T21:29:32.223777+0000","last_active":"2023-11-18T21:29:32.223717+0000","last_peered":"2023-11-18T21:29:32.223717+0000","last_clean":"2023-11-18T21:29:32.223717+0000","last_became_active":"2023-11-18T20:59:35.842583+0000","last_became_peered":"2023-11-18T20:59:35.842583+0000","last_unstale":"2023-11-18T21:29:32.223717+0000","last_undegraded":"2023-11-18T21:29:32.223717+0000","last_fullsized":"2023-11-18T21:29:32.223717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'93","last_scrub_stamp":"2023-11-18T21:29:32.223517+0000","last_deep_scrub":"31'93","last_deep_scrub_stamp":"2023-11-18T21:29:32.223517+0000","last_clean_scrub_stamp":"2023-11-18T21:29:32.223517+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:29.249701+0000","scrub_duration":0.0088994439999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'46","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:11.348582+0000","last_change":"2023-11-18T21:29:11.348582+0000","last_active":"2023-11-18T21:29:11.348582+0000","last_peered":"2023-11-18T21:29:11.348582+0000","last_clean":"2023-11-18T21:29:11.348582+0000","last_became_active":"2023-11-18T20:59:27.687250+0000","last_became_peered":"2023-11-18T20:59:27.687250+0000","last_unstale":"2023-11-18T21:29:11.348582+0000","last_undegraded":"2023-11-18T21:29:11.348582+0000","last_fullsized":"2023-11-18T21:29:11.348582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-11-18T21:29:11.348342+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-11-18T21:29:11.348342+0000","last_clean_scrub_stamp":"2023-11-18T21:29:11.348342+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:38:22.498619+0000","scrub_duration":0.0033288079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"31'206","reported_seq":251,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.475145+0000","last_change":"2023-11-18T21:29:04.475145+0000","last_active":"2023-11-18T21:29:04.475145+0000","last_peered":"2023-11-18T21:29:04.475145+0000","last_clean":"2023-11-18T21:29:04.475145+0000","last_became_active":"2023-11-18T20:59:25.351318+0000","last_became_peered":"2023-11-18T20:59:25.351318+0000","last_unstale":"2023-11-18T21:29:04.475145+0000","last_undegraded":"2023-11-18T21:29:04.475145+0000","last_fullsized":"2023-11-18T21:29:04.475145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'206","last_scrub_stamp":"2023-11-18T21:29:04.474913+0000","last_deep_scrub":"31'206","last_deep_scrub_stamp":"2023-11-18T21:29:04.474913+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.474913+0000","objects_scrubbed":4,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:35.853099+0000","scrub_duration":0.010175724000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'80","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:27.249747+0000","last_change":"2023-11-18T21:29:27.249804+0000","last_active":"2023-11-18T21:29:27.249747+0000","last_peered":"2023-11-18T21:29:27.249747+0000","last_clean":"2023-11-18T21:29:27.249747+0000","last_became_active":"2023-11-18T20:59:35.834894+0000","last_became_peered":"2023-11-18T20:59:35.834894+0000","last_unstale":"2023-11-18T21:29:27.249747+0000","last_undegraded":"2023-11-18T21:29:27.249747+0000","last_fullsized":"2023-11-18T21:29:27.249747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'80","last_scrub_stamp":"2023-11-18T21:29:27.249554+0000","last_deep_scrub":"31'80","last_deep_scrub_stamp":"2023-11-18T21:29:27.249554+0000","last_clean_scrub_stamp":"2023-11-18T21:29:27.249554+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:21.683683+0000","scrub_duration":0.0092037430000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":144,"num_write":72,"num_write_kb":6857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"31'48","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:07.569471+0000","last_change":"2023-11-18T21:29:07.569471+0000","last_active":"2023-11-18T21:29:07.569471+0000","last_peered":"2023-11-18T21:29:07.569471+0000","last_clean":"2023-11-18T21:29:07.569471+0000","last_became_active":"2023-11-18T20:59:27.686692+0000","last_became_peered":"2023-11-18T20:59:27.686692+0000","last_unstale":"2023-11-18T21:29:07.569471+0000","last_undegraded":"2023-11-18T21:29:07.569471+0000","last_fullsized":"2023-11-18T21:29:07.569471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2023-11-18T21:29:07.568991+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2023-11-18T21:29:07.568991+0000","last_clean_scrub_stamp":"2023-11-18T21:29:07.568991+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:57:10.343662+0000","scrub_duration":0.0041715520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"31'9","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:00.073730+0000","last_change":"2023-11-18T21:29:00.073730+0000","last_active":"2023-11-18T21:29:00.073730+0000","last_peered":"2023-11-18T21:29:00.073730+0000","last_clean":"2023-11-18T21:29:00.073730+0000","last_became_active":"2023-11-18T20:59:25.347022+0000","last_became_peered":"2023-11-18T20:59:25.347022+0000","last_unstale":"2023-11-18T21:29:00.073730+0000","last_undegraded":"2023-11-18T21:29:00.073730+0000","last_fullsized":"2023-11-18T21:29:00.073730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2023-11-18T21:29:00.073501+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2023-11-18T21:29:00.073501+0000","last_clean_scrub_stamp":"2023-11-18T21:29:00.073501+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:11:30.795362+0000","scrub_duration":0.005583368,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'120","reported_seq":157,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:35.101741+0000","last_change":"2023-11-18T21:29:35.101857+0000","last_active":"2023-11-18T21:29:35.101741+0000","last_peered":"2023-11-18T21:29:35.101741+0000","last_clean":"2023-11-18T21:29:35.101741+0000","last_became_active":"2023-11-18T20:59:35.770923+0000","last_became_peered":"2023-11-18T20:59:35.770923+0000","last_unstale":"2023-11-18T21:29:35.101741+0000","last_undegraded":"2023-11-18T21:29:35.101741+0000","last_fullsized":"2023-11-18T21:29:35.101741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'120","last_scrub_stamp":"2023-11-18T21:29:35.101483+0000","last_deep_scrub":"31'120","last_deep_scrub_stamp":"2023-11-18T21:29:35.101483+0000","last_clean_scrub_stamp":"2023-11-18T21:29:35.101483+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:42:04.305607+0000","scrub_duration":0.012082028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'44","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:29.245086+0000","last_change":"2023-11-18T21:29:29.245086+0000","last_active":"2023-11-18T21:29:29.245086+0000","last_peered":"2023-11-18T21:29:29.245086+0000","last_clean":"2023-11-18T21:29:29.245086+0000","last_became_active":"2023-11-18T20:59:27.689156+0000","last_became_peered":"2023-11-18T20:59:27.689156+0000","last_unstale":"2023-11-18T21:29:29.245086+0000","last_undegraded":"2023-11-18T21:29:29.245086+0000","last_fullsized":"2023-11-18T21:29:29.245086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'44","last_scrub_stamp":"2023-11-18T21:29:29.244816+0000","last_deep_scrub":"31'44","last_deep_scrub_stamp":"2023-11-18T21:29:29.244816+0000","last_clean_scrub_stamp":"2023-11-18T21:29:29.244816+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:37.524227+0000","scrub_duration":0.0033979600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"31'16","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:36.400403+0000","last_change":"2023-11-18T21:29:36.400403+0000","last_active":"2023-11-18T21:29:36.400403+0000","last_peered":"2023-11-18T21:29:36.400403+0000","last_clean":"2023-11-18T21:29:36.400403+0000","last_became_active":"2023-11-18T20:59:25.346318+0000","last_became_peered":"2023-11-18T20:59:25.346318+0000","last_unstale":"2023-11-18T21:29:36.400403+0000","last_undegraded":"2023-11-18T21:29:36.400403+0000","last_fullsized":"2023-11-18T21:29:36.400403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2023-11-18T21:29:36.400067+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2023-11-18T21:29:36.400067+0000","last_clean_scrub_stamp":"2023-11-18T21:29:36.400067+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:07:10.357774+0000","scrub_duration":0.011649005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"31'81","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:19.205259+0000","last_change":"2023-11-18T21:29:19.205374+0000","last_active":"2023-11-18T21:29:19.205259+0000","last_peered":"2023-11-18T21:29:19.205259+0000","last_clean":"2023-11-18T21:29:19.205259+0000","last_became_active":"2023-11-18T20:59:35.833407+0000","last_became_peered":"2023-11-18T20:59:35.833407+0000","last_unstale":"2023-11-18T21:29:19.205259+0000","last_undegraded":"2023-11-18T21:29:19.205259+0000","last_fullsized":"2023-11-18T21:29:19.205259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'81","last_scrub_stamp":"2023-11-18T21:29:19.205015+0000","last_deep_scrub":"31'81","last_deep_scrub_stamp":"2023-11-18T21:29:19.205015+0000","last_clean_scrub_stamp":"2023-11-18T21:29:19.205015+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:16.421641+0000","scrub_duration":0.0093240909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":9489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'53","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:27.263926+0000","last_change":"2023-11-18T21:29:27.263926+0000","last_active":"2023-11-18T21:29:27.263926+0000","last_peered":"2023-11-18T21:29:27.263926+0000","last_clean":"2023-11-18T21:29:27.263926+0000","last_became_active":"2023-11-18T20:59:27.863358+0000","last_became_peered":"2023-11-18T20:59:27.863358+0000","last_unstale":"2023-11-18T21:29:27.263926+0000","last_undegraded":"2023-11-18T21:29:27.263926+0000","last_fullsized":"2023-11-18T21:29:27.263926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2023-11-18T21:29:27.263671+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2023-11-18T21:29:27.263671+0000","last_clean_scrub_stamp":"2023-11-18T21:29:27.263671+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:01:59.423966+0000","scrub_duration":0.0060545679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"31'153","reported_seq":198,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:06.548239+0000","last_change":"2023-11-18T21:29:06.548239+0000","last_active":"2023-11-18T21:29:06.548239+0000","last_peered":"2023-11-18T21:29:06.548239+0000","last_clean":"2023-11-18T21:29:06.548239+0000","last_became_active":"2023-11-18T20:59:25.350705+0000","last_became_peered":"2023-11-18T20:59:25.350705+0000","last_unstale":"2023-11-18T21:29:06.548239+0000","last_undegraded":"2023-11-18T21:29:06.548239+0000","last_fullsized":"2023-11-18T21:29:06.548239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-11-18T21:29:06.547908+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-11-18T21:29:06.547908+0000","last_clean_scrub_stamp":"2023-11-18T21:29:06.547908+0000","objects_scrubbed":4,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:17:24.614328+0000","scrub_duration":0.011886097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"31'89","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:40.145455+0000","last_change":"2023-11-18T21:29:40.145455+0000","last_active":"2023-11-18T21:29:40.145455+0000","last_peered":"2023-11-18T21:29:40.145455+0000","last_clean":"2023-11-18T21:29:40.145455+0000","last_became_active":"2023-11-18T20:59:35.840533+0000","last_became_peered":"2023-11-18T20:59:35.840533+0000","last_unstale":"2023-11-18T21:29:40.145455+0000","last_undegraded":"2023-11-18T21:29:40.145455+0000","last_fullsized":"2023-11-18T21:29:40.145455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'89","last_scrub_stamp":"2023-11-18T21:29:40.145195+0000","last_deep_scrub":"31'89","last_deep_scrub_stamp":"2023-11-18T21:29:40.145195+0000","last_clean_scrub_stamp":"2023-11-18T21:29:40.145195+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:27:09.819028+0000","scrub_duration":0.011320111000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":9026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"31'60","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:23.268453+0000","last_change":"2023-11-18T21:29:23.268503+0000","last_active":"2023-11-18T21:29:23.268453+0000","last_peered":"2023-11-18T21:29:23.268453+0000","last_clean":"2023-11-18T21:29:23.268453+0000","last_became_active":"2023-11-18T20:59:27.868355+0000","last_became_peered":"2023-11-18T20:59:27.868355+0000","last_unstale":"2023-11-18T21:29:23.268453+0000","last_undegraded":"2023-11-18T21:29:23.268453+0000","last_fullsized":"2023-11-18T21:29:23.268453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'60","last_scrub_stamp":"2023-11-18T21:29:23.268260+0000","last_deep_scrub":"31'60","last_deep_scrub_stamp":"2023-11-18T21:29:23.268260+0000","last_clean_scrub_stamp":"2023-11-18T21:29:23.268260+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:20.484886+0000","scrub_duration":0.0031106860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"31'97","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:29.323993+0000","last_change":"2023-11-18T21:29:29.324057+0000","last_active":"2023-11-18T21:29:29.323993+0000","last_peered":"2023-11-18T21:29:29.323993+0000","last_clean":"2023-11-18T21:29:29.323993+0000","last_became_active":"2023-11-18T20:59:25.349346+0000","last_became_peered":"2023-11-18T20:59:25.349346+0000","last_unstale":"2023-11-18T21:29:29.323993+0000","last_undegraded":"2023-11-18T21:29:29.323993+0000","last_fullsized":"2023-11-18T21:29:29.323993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'97","last_scrub_stamp":"2023-11-18T21:29:29.323804+0000","last_deep_scrub":"31'97","last_deep_scrub_stamp":"2023-11-18T21:29:29.323804+0000","last_clean_scrub_stamp":"2023-11-18T21:29:29.323804+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:27.515175+0000","scrub_duration":0.0095652810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"31'98","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:47.493634+0000","last_change":"2023-11-18T21:29:47.493687+0000","last_active":"2023-11-18T21:29:47.493634+0000","last_peered":"2023-11-18T21:29:47.493634+0000","last_clean":"2023-11-18T21:29:47.493634+0000","last_became_active":"2023-11-18T20:59:35.846458+0000","last_became_peered":"2023-11-18T20:59:35.846458+0000","last_unstale":"2023-11-18T21:29:47.493634+0000","last_undegraded":"2023-11-18T21:29:47.493634+0000","last_fullsized":"2023-11-18T21:29:47.493634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2023-11-18T21:29:47.493467+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2023-11-18T21:29:47.493467+0000","last_clean_scrub_stamp":"2023-11-18T21:29:47.493467+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:36:11.707569+0000","scrub_duration":0.0089391639999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":10588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"31'50","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.160928+0000","last_change":"2023-11-18T21:29:04.160980+0000","last_active":"2023-11-18T21:29:04.160928+0000","last_peered":"2023-11-18T21:29:04.160928+0000","last_clean":"2023-11-18T21:29:04.160928+0000","last_became_active":"2023-11-18T20:59:27.887876+0000","last_became_peered":"2023-11-18T20:59:27.887876+0000","last_unstale":"2023-11-18T21:29:04.160928+0000","last_undegraded":"2023-11-18T21:29:04.160928+0000","last_fullsized":"2023-11-18T21:29:04.160928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'50","last_scrub_stamp":"2023-11-18T21:29:04.160739+0000","last_deep_scrub":"31'50","last_deep_scrub_stamp":"2023-11-18T21:29:04.160739+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.160739+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:11:22.163473+0000","scrub_duration":0.00435988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:12.457669+0000","last_change":"2023-11-18T21:29:12.457723+0000","last_active":"2023-11-18T21:29:12.457669+0000","last_peered":"2023-11-18T21:29:12.457669+0000","last_clean":"2023-11-18T21:29:12.457669+0000","last_became_active":"2023-11-18T20:59:25.459235+0000","last_became_peered":"2023-11-18T20:59:25.459235+0000","last_unstale":"2023-11-18T21:29:12.457669+0000","last_undegraded":"2023-11-18T21:29:12.457669+0000","last_fullsized":"2023-11-18T21:29:12.457669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-11-18T21:29:12.457455+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-11-18T21:29:12.457455+0000","last_clean_scrub_stamp":"2023-11-18T21:29:12.457455+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:52:11.157078+0000","scrub_duration":0.0039406650000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:35.492575+0000","last_change":"2023-11-18T21:29:35.492633+0000","last_active":"2023-11-18T21:29:35.492575+0000","last_peered":"2023-11-18T21:29:35.492575+0000","last_clean":"2023-11-18T21:29:35.492575+0000","last_became_active":"2023-11-18T20:59:35.834275+0000","last_became_peered":"2023-11-18T20:59:35.834275+0000","last_unstale":"2023-11-18T21:29:35.492575+0000","last_undegraded":"2023-11-18T21:29:35.492575+0000","last_fullsized":"2023-11-18T21:29:35.492575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'83","last_scrub_stamp":"2023-11-18T21:29:35.492360+0000","last_deep_scrub":"31'83","last_deep_scrub_stamp":"2023-11-18T21:29:35.492360+0000","last_clean_scrub_stamp":"2023-11-18T21:29:35.492360+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:18:31.489432+0000","scrub_duration":0.0095908969999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'61","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:30.233299+0000","last_change":"2023-11-18T21:29:30.233299+0000","last_active":"2023-11-18T21:29:30.233299+0000","last_peered":"2023-11-18T21:29:30.233299+0000","last_clean":"2023-11-18T21:29:30.233299+0000","last_became_active":"2023-11-18T21:00:28.720412+0000","last_became_peered":"2023-11-18T21:00:28.720412+0000","last_unstale":"2023-11-18T21:29:30.233299+0000","last_undegraded":"2023-11-18T21:29:30.233299+0000","last_fullsized":"2023-11-18T21:29:30.233299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'61","last_scrub_stamp":"2023-11-18T21:29:30.232988+0000","last_deep_scrub":"31'61","last_deep_scrub_stamp":"2023-11-18T21:29:30.232988+0000","last_clean_scrub_stamp":"2023-11-18T21:29:30.232988+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:12:00.954850+0000","scrub_duration":0.0059738029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"31'657","reported_seq":702,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:23.405929+0000","last_change":"2023-11-18T21:29:23.406084+0000","last_active":"2023-11-18T21:29:23.405929+0000","last_peered":"2023-11-18T21:29:23.405929+0000","last_clean":"2023-11-18T21:29:23.405929+0000","last_became_active":"2023-11-18T20:59:25.354716+0000","last_became_peered":"2023-11-18T20:59:25.354716+0000","last_unstale":"2023-11-18T21:29:23.405929+0000","last_undegraded":"2023-11-18T21:29:23.405929+0000","last_fullsized":"2023-11-18T21:29:23.405929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'657","last_scrub_stamp":"2023-11-18T21:29:23.405635+0000","last_deep_scrub":"31'657","last_deep_scrub_stamp":"2023-11-18T21:29:23.405635+0000","last_clean_scrub_stamp":"2023-11-18T21:29:23.405635+0000","objects_scrubbed":2,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:12:17.734571+0000","scrub_duration":0.022876138000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":3369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'79","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:38.514076+0000","last_change":"2023-11-18T21:29:38.514135+0000","last_active":"2023-11-18T21:29:38.514076+0000","last_peered":"2023-11-18T21:29:38.514076+0000","last_clean":"2023-11-18T21:29:38.514076+0000","last_became_active":"2023-11-18T20:59:35.838732+0000","last_became_peered":"2023-11-18T20:59:35.838732+0000","last_unstale":"2023-11-18T21:29:38.514076+0000","last_undegraded":"2023-11-18T21:29:38.514076+0000","last_fullsized":"2023-11-18T21:29:38.514076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'79","last_scrub_stamp":"2023-11-18T21:29:38.513857+0000","last_deep_scrub":"31'79","last_deep_scrub_stamp":"2023-11-18T21:29:38.513857+0000","last_clean_scrub_stamp":"2023-11-18T21:29:38.513857+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:40:59.029899+0000","scrub_duration":0.0080516670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"31'54","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:36.396805+0000","last_change":"2023-11-18T21:29:36.396805+0000","last_active":"2023-11-18T21:29:36.396805+0000","last_peered":"2023-11-18T21:29:36.396805+0000","last_clean":"2023-11-18T21:29:36.396805+0000","last_became_active":"2023-11-18T20:59:27.838664+0000","last_became_peered":"2023-11-18T20:59:27.838664+0000","last_unstale":"2023-11-18T21:29:36.396805+0000","last_undegraded":"2023-11-18T21:29:36.396805+0000","last_fullsized":"2023-11-18T21:29:36.396805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-11-18T21:29:36.396470+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-11-18T21:29:36.396470+0000","last_clean_scrub_stamp":"2023-11-18T21:29:36.396470+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:12:30.725407+0000","scrub_duration":0.0035553899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"31'166","reported_seq":284,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.394094+0000","last_change":"2023-11-18T21:29:04.394160+0000","last_active":"2023-11-18T21:29:04.394094+0000","last_peered":"2023-11-18T21:29:04.394094+0000","last_clean":"2023-11-18T21:29:04.394094+0000","last_became_active":"2023-11-18T20:59:25.458075+0000","last_became_peered":"2023-11-18T20:59:25.458075+0000","last_unstale":"2023-11-18T21:29:04.394094+0000","last_undegraded":"2023-11-18T21:29:04.394094+0000","last_fullsized":"2023-11-18T21:29:04.394094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'166","last_scrub_stamp":"2023-11-18T21:29:04.393926+0000","last_deep_scrub":"31'166","last_deep_scrub_stamp":"2023-11-18T21:29:04.393926+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.393926+0000","objects_scrubbed":4,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:21:30.888691+0000","scrub_duration":0.0067038549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18647,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":79,"num_write":158,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"31'81","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:32.437782+0000","last_change":"2023-11-18T21:29:32.437782+0000","last_active":"2023-11-18T21:29:32.437782+0000","last_peered":"2023-11-18T21:29:32.437782+0000","last_clean":"2023-11-18T21:29:32.437782+0000","last_became_active":"2023-11-18T20:59:35.832891+0000","last_became_peered":"2023-11-18T20:59:35.832891+0000","last_unstale":"2023-11-18T21:29:32.437782+0000","last_undegraded":"2023-11-18T21:29:32.437782+0000","last_fullsized":"2023-11-18T21:29:32.437782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'81","last_scrub_stamp":"2023-11-18T21:29:32.437527+0000","last_deep_scrub":"31'81","last_deep_scrub_stamp":"2023-11-18T21:29:32.437527+0000","last_clean_scrub_stamp":"2023-11-18T21:29:32.437527+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:18:04.554309+0000","scrub_duration":0.0090556939999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"31'58","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:11.258017+0000","last_change":"2023-11-18T21:29:11.258075+0000","last_active":"2023-11-18T21:29:11.258017+0000","last_peered":"2023-11-18T21:29:11.258017+0000","last_clean":"2023-11-18T21:29:11.258017+0000","last_became_active":"2023-11-18T20:59:27.889115+0000","last_became_peered":"2023-11-18T20:59:27.889115+0000","last_unstale":"2023-11-18T21:29:11.258017+0000","last_undegraded":"2023-11-18T21:29:11.258017+0000","last_fullsized":"2023-11-18T21:29:11.258017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'58","last_scrub_stamp":"2023-11-18T21:29:11.257818+0000","last_deep_scrub":"31'58","last_deep_scrub_stamp":"2023-11-18T21:29:11.257818+0000","last_clean_scrub_stamp":"2023-11-18T21:29:11.257818+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:12:06.078536+0000","scrub_duration":0.003715884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"31'9","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:37.358639+0000","last_change":"2023-11-18T21:29:37.358639+0000","last_active":"2023-11-18T21:29:37.358639+0000","last_peered":"2023-11-18T21:29:37.358639+0000","last_clean":"2023-11-18T21:29:37.358639+0000","last_became_active":"2023-11-18T20:59:25.459405+0000","last_became_peered":"2023-11-18T20:59:25.459405+0000","last_unstale":"2023-11-18T21:29:37.358639+0000","last_undegraded":"2023-11-18T21:29:37.358639+0000","last_fullsized":"2023-11-18T21:29:37.358639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2023-11-18T21:29:37.358401+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2023-11-18T21:29:37.358401+0000","last_clean_scrub_stamp":"2023-11-18T21:29:37.358401+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:07.232883+0000","scrub_duration":0.006636154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"31'64","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:48.513548+0000","last_change":"2023-11-18T21:29:48.513548+0000","last_active":"2023-11-18T21:29:48.513548+0000","last_peered":"2023-11-18T21:29:48.513548+0000","last_clean":"2023-11-18T21:29:48.513548+0000","last_became_active":"2023-11-18T20:59:35.835644+0000","last_became_peered":"2023-11-18T20:59:35.835644+0000","last_unstale":"2023-11-18T21:29:48.513548+0000","last_undegraded":"2023-11-18T21:29:48.513548+0000","last_fullsized":"2023-11-18T21:29:48.513548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'64","last_scrub_stamp":"2023-11-18T21:29:48.513275+0000","last_deep_scrub":"31'64","last_deep_scrub_stamp":"2023-11-18T21:29:48.513275+0000","last_clean_scrub_stamp":"2023-11-18T21:29:48.513275+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:27:07.172923+0000","scrub_duration":0.0097431630000000009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"31'47","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:19.284666+0000","last_change":"2023-11-18T21:29:19.284778+0000","last_active":"2023-11-18T21:29:19.284666+0000","last_peered":"2023-11-18T21:29:19.284666+0000","last_clean":"2023-11-18T21:29:19.284666+0000","last_became_active":"2023-11-18T20:59:27.890499+0000","last_became_peered":"2023-11-18T20:59:27.890499+0000","last_unstale":"2023-11-18T21:29:19.284666+0000","last_undegraded":"2023-11-18T21:29:19.284666+0000","last_fullsized":"2023-11-18T21:29:19.284666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-11-18T21:29:19.284440+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-11-18T21:29:19.284440+0000","last_clean_scrub_stamp":"2023-11-18T21:29:19.284440+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:18:47.615835+0000","scrub_duration":0.0039795910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"31'13","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:32.389678+0000","last_change":"2023-11-18T21:29:32.389731+0000","last_active":"2023-11-18T21:29:32.389678+0000","last_peered":"2023-11-18T21:29:32.389678+0000","last_clean":"2023-11-18T21:29:32.389678+0000","last_became_active":"2023-11-18T20:59:25.338020+0000","last_became_peered":"2023-11-18T20:59:25.338020+0000","last_unstale":"2023-11-18T21:29:32.389678+0000","last_undegraded":"2023-11-18T21:29:32.389678+0000","last_fullsized":"2023-11-18T21:29:32.389678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2023-11-18T21:29:32.389550+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2023-11-18T21:29:32.389550+0000","last_clean_scrub_stamp":"2023-11-18T21:29:32.389550+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:37.143132+0000","scrub_duration":0.011491572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:55.904332+0000","last_change":"2023-11-18T21:28:55.904332+0000","last_active":"2023-11-18T21:28:55.904332+0000","last_peered":"2023-11-18T21:28:55.904332+0000","last_clean":"2023-11-18T21:28:55.904332+0000","last_became_active":"2023-11-18T20:58:44.731076+0000","last_became_peered":"2023-11-18T20:58:44.731076+0000","last_unstale":"2023-11-18T21:28:55.904332+0000","last_undegraded":"2023-11-18T21:28:55.904332+0000","last_fullsized":"2023-11-18T21:28:55.904332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-11-18T21:28:55.904224+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-11-18T21:28:55.904224+0000","last_clean_scrub_stamp":"2023-11-18T21:28:55.904224+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:05:55.057907+0000","scrub_duration":0.010934374,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'66","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:46.467065+0000","last_change":"2023-11-18T21:29:46.467124+0000","last_active":"2023-11-18T21:29:46.467065+0000","last_peered":"2023-11-18T21:29:46.467065+0000","last_clean":"2023-11-18T21:29:46.467065+0000","last_became_active":"2023-11-18T20:59:35.771146+0000","last_became_peered":"2023-11-18T20:59:35.771146+0000","last_unstale":"2023-11-18T21:29:46.467065+0000","last_undegraded":"2023-11-18T21:29:46.467065+0000","last_fullsized":"2023-11-18T21:29:46.467065+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'66","last_scrub_stamp":"2023-11-18T21:29:46.466849+0000","last_deep_scrub":"31'66","last_deep_scrub_stamp":"2023-11-18T21:29:46.466849+0000","last_clean_scrub_stamp":"2023-11-18T21:29:46.466849+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:02:06.490175+0000","scrub_duration":0.010707275,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":6116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"31'58","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:40.307000+0000","last_change":"2023-11-18T21:29:40.307040+0000","last_active":"2023-11-18T21:29:40.307000+0000","last_peered":"2023-11-18T21:29:40.307000+0000","last_clean":"2023-11-18T21:29:40.307000+0000","last_became_active":"2023-11-18T20:59:27.683316+0000","last_became_peered":"2023-11-18T20:59:27.683316+0000","last_unstale":"2023-11-18T21:29:40.307000+0000","last_undegraded":"2023-11-18T21:29:40.307000+0000","last_fullsized":"2023-11-18T21:29:40.307000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'58","last_scrub_stamp":"2023-11-18T21:29:40.306849+0000","last_deep_scrub":"31'58","last_deep_scrub_stamp":"2023-11-18T21:29:40.306849+0000","last_clean_scrub_stamp":"2023-11-18T21:29:40.306849+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:53:06.877436+0000","scrub_duration":0.0032485679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"31'668","reported_seq":712,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:08.356740+0000","last_change":"2023-11-18T21:29:08.356797+0000","last_active":"2023-11-18T21:29:08.356740+0000","last_peered":"2023-11-18T21:29:08.356740+0000","last_clean":"2023-11-18T21:29:08.356740+0000","last_became_active":"2023-11-18T20:59:25.356883+0000","last_became_peered":"2023-11-18T20:59:25.356883+0000","last_unstale":"2023-11-18T21:29:08.356740+0000","last_undegraded":"2023-11-18T21:29:08.356740+0000","last_fullsized":"2023-11-18T21:29:08.356740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'668","last_scrub_stamp":"2023-11-18T21:29:08.356563+0000","last_deep_scrub":"31'668","last_deep_scrub_stamp":"2023-11-18T21:29:08.356563+0000","last_clean_scrub_stamp":"2023-11-18T21:29:08.356563+0000","objects_scrubbed":3,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:31:33.757650+0000","scrub_duration":0.021449706999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3370313,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"31'82","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:28.221389+0000","last_change":"2023-11-18T21:29:28.221446+0000","last_active":"2023-11-18T21:29:28.221389+0000","last_peered":"2023-11-18T21:29:28.221389+0000","last_clean":"2023-11-18T21:29:28.221389+0000","last_became_active":"2023-11-18T20:59:35.833790+0000","last_became_peered":"2023-11-18T20:59:35.833790+0000","last_unstale":"2023-11-18T21:29:28.221389+0000","last_undegraded":"2023-11-18T21:29:28.221389+0000","last_fullsized":"2023-11-18T21:29:28.221389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'82","last_scrub_stamp":"2023-11-18T21:29:28.221111+0000","last_deep_scrub":"31'82","last_deep_scrub_stamp":"2023-11-18T21:29:28.221111+0000","last_clean_scrub_stamp":"2023-11-18T21:29:28.221111+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:52:26.920735+0000","scrub_duration":0.010842701,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":7460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'56","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:19.076942+0000","last_change":"2023-11-18T21:29:19.077045+0000","last_active":"2023-11-18T21:29:19.076942+0000","last_peered":"2023-11-18T21:29:19.076942+0000","last_clean":"2023-11-18T21:29:19.076942+0000","last_became_active":"2023-11-18T20:59:27.872733+0000","last_became_peered":"2023-11-18T20:59:27.872733+0000","last_unstale":"2023-11-18T21:29:19.076942+0000","last_undegraded":"2023-11-18T21:29:19.076942+0000","last_fullsized":"2023-11-18T21:29:19.076942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'56","last_scrub_stamp":"2023-11-18T21:29:19.076632+0000","last_deep_scrub":"31'56","last_deep_scrub_stamp":"2023-11-18T21:29:19.076632+0000","last_clean_scrub_stamp":"2023-11-18T21:29:19.076632+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:47:44.422123+0000","scrub_duration":0.0042975579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"31'8","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.425651+0000","last_change":"2023-11-18T21:29:10.425770+0000","last_active":"2023-11-18T21:29:10.425651+0000","last_peered":"2023-11-18T21:29:10.425651+0000","last_clean":"2023-11-18T21:29:10.425651+0000","last_became_active":"2023-11-18T20:59:25.496694+0000","last_became_peered":"2023-11-18T20:59:25.496694+0000","last_unstale":"2023-11-18T21:29:10.425651+0000","last_undegraded":"2023-11-18T21:29:10.425651+0000","last_fullsized":"2023-11-18T21:29:10.425651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-11-18T21:29:10.425430+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-11-18T21:29:10.425430+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.425430+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:35:04.927101+0000","scrub_duration":0.0074186599999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'95","reported_seq":132,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:50.559191+0000","last_change":"2023-11-18T21:29:50.559244+0000","last_active":"2023-11-18T21:29:50.559191+0000","last_peered":"2023-11-18T21:29:50.559191+0000","last_clean":"2023-11-18T21:29:50.559191+0000","last_became_active":"2023-11-18T20:59:35.828446+0000","last_became_peered":"2023-11-18T20:59:35.828446+0000","last_unstale":"2023-11-18T21:29:50.559191+0000","last_undegraded":"2023-11-18T21:29:50.559191+0000","last_fullsized":"2023-11-18T21:29:50.559191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'95","last_scrub_stamp":"2023-11-18T21:29:50.559000+0000","last_deep_scrub":"31'95","last_deep_scrub_stamp":"2023-11-18T21:29:50.559000+0000","last_clean_scrub_stamp":"2023-11-18T21:29:50.559000+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:55.088012+0000","scrub_duration":0.010098839,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":11010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"31'55","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:56.199386+0000","last_change":"2023-11-18T21:28:56.199412+0000","last_active":"2023-11-18T21:28:56.199386+0000","last_peered":"2023-11-18T21:28:56.199386+0000","last_clean":"2023-11-18T21:28:56.199386+0000","last_became_active":"2023-11-18T20:59:27.870220+0000","last_became_peered":"2023-11-18T20:59:27.870220+0000","last_unstale":"2023-11-18T21:28:56.199386+0000","last_undegraded":"2023-11-18T21:28:56.199386+0000","last_fullsized":"2023-11-18T21:28:56.199386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'55","last_scrub_stamp":"2023-11-18T21:28:56.199297+0000","last_deep_scrub":"31'55","last_deep_scrub_stamp":"2023-11-18T21:28:56.199297+0000","last_clean_scrub_stamp":"2023-11-18T21:28:56.199297+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:51:50.633425+0000","scrub_duration":0.003736053,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"31'14","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:07.506880+0000","last_change":"2023-11-18T21:29:07.506940+0000","last_active":"2023-11-18T21:29:07.506880+0000","last_peered":"2023-11-18T21:29:07.506880+0000","last_clean":"2023-11-18T21:29:07.506880+0000","last_became_active":"2023-11-18T20:59:25.457392+0000","last_became_peered":"2023-11-18T20:59:25.457392+0000","last_unstale":"2023-11-18T21:29:07.506880+0000","last_undegraded":"2023-11-18T21:29:07.506880+0000","last_fullsized":"2023-11-18T21:29:07.506880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-11-18T21:29:07.506693+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-11-18T21:29:07.506693+0000","last_clean_scrub_stamp":"2023-11-18T21:29:07.506693+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:33:54.342375+0000","scrub_duration":0.0081357319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"31'70","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:50.535248+0000","last_change":"2023-11-18T21:29:50.535248+0000","last_active":"2023-11-18T21:29:50.535248+0000","last_peered":"2023-11-18T21:29:50.535248+0000","last_clean":"2023-11-18T21:29:50.535248+0000","last_became_active":"2023-11-18T20:59:35.831147+0000","last_became_peered":"2023-11-18T20:59:35.831147+0000","last_unstale":"2023-11-18T21:29:50.535248+0000","last_undegraded":"2023-11-18T21:29:50.535248+0000","last_fullsized":"2023-11-18T21:29:50.535248+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'70","last_scrub_stamp":"2023-11-18T21:29:50.534993+0000","last_deep_scrub":"31'70","last_deep_scrub_stamp":"2023-11-18T21:29:50.534993+0000","last_clean_scrub_stamp":"2023-11-18T21:29:50.534993+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:09:08.776075+0000","scrub_duration":0.011106616999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"31'58","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.132781+0000","last_change":"2023-11-18T21:29:10.132883+0000","last_active":"2023-11-18T21:29:10.132781+0000","last_peered":"2023-11-18T21:29:10.132781+0000","last_clean":"2023-11-18T21:29:10.132781+0000","last_became_active":"2023-11-18T20:59:27.894931+0000","last_became_peered":"2023-11-18T20:59:27.894931+0000","last_unstale":"2023-11-18T21:29:10.132781+0000","last_undegraded":"2023-11-18T21:29:10.132781+0000","last_fullsized":"2023-11-18T21:29:10.132781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'58","last_scrub_stamp":"2023-11-18T21:29:10.132550+0000","last_deep_scrub":"31'58","last_deep_scrub_stamp":"2023-11-18T21:29:10.132550+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.132550+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:23:05.142528+0000","scrub_duration":0.0037235850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"31'208","reported_seq":252,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:09.031548+0000","last_change":"2023-11-18T21:29:09.031667+0000","last_active":"2023-11-18T21:29:09.031548+0000","last_peered":"2023-11-18T21:29:09.031548+0000","last_clean":"2023-11-18T21:29:09.031548+0000","last_became_active":"2023-11-18T20:59:25.457932+0000","last_became_peered":"2023-11-18T20:59:25.457932+0000","last_unstale":"2023-11-18T21:29:09.031548+0000","last_undegraded":"2023-11-18T21:29:09.031548+0000","last_fullsized":"2023-11-18T21:29:09.031548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'208","last_scrub_stamp":"2023-11-18T21:29:09.031320+0000","last_deep_scrub":"31'208","last_deep_scrub_stamp":"2023-11-18T21:29:09.031320+0000","last_clean_scrub_stamp":"2023-11-18T21:29:09.031320+0000","objects_scrubbed":2,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:35:03.532991+0000","scrub_duration":0.011462553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":499,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"31'58","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:23.107901+0000","last_change":"2023-11-18T21:29:23.107901+0000","last_active":"2023-11-18T21:29:23.107901+0000","last_peered":"2023-11-18T21:29:23.107901+0000","last_clean":"2023-11-18T21:29:23.107901+0000","last_became_active":"2023-11-18T20:59:35.831804+0000","last_became_peered":"2023-11-18T20:59:35.831804+0000","last_unstale":"2023-11-18T21:29:23.107901+0000","last_undegraded":"2023-11-18T21:29:23.107901+0000","last_fullsized":"2023-11-18T21:29:23.107901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'58","last_scrub_stamp":"2023-11-18T21:29:23.107505+0000","last_deep_scrub":"31'58","last_deep_scrub_stamp":"2023-11-18T21:29:23.107505+0000","last_clean_scrub_stamp":"2023-11-18T21:29:23.107505+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:21.521667+0000","scrub_duration":0.0098175209999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":9539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'55","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:42.379660+0000","last_change":"2023-11-18T21:29:42.379660+0000","last_active":"2023-11-18T21:29:42.379660+0000","last_peered":"2023-11-18T21:29:42.379660+0000","last_clean":"2023-11-18T21:29:42.379660+0000","last_became_active":"2023-11-18T20:59:27.884143+0000","last_became_peered":"2023-11-18T20:59:27.884143+0000","last_unstale":"2023-11-18T21:29:42.379660+0000","last_undegraded":"2023-11-18T21:29:42.379660+0000","last_fullsized":"2023-11-18T21:29:42.379660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'55","last_scrub_stamp":"2023-11-18T21:29:42.379410+0000","last_deep_scrub":"31'55","last_deep_scrub_stamp":"2023-11-18T21:29:42.379410+0000","last_clean_scrub_stamp":"2023-11-18T21:29:42.379410+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:50:22.385492+0000","scrub_duration":0.0040276779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"31'155","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.403695+0000","last_change":"2023-11-18T21:29:10.403695+0000","last_active":"2023-11-18T21:29:10.403695+0000","last_peered":"2023-11-18T21:29:10.403695+0000","last_clean":"2023-11-18T21:29:10.403695+0000","last_became_active":"2023-11-18T20:59:25.362350+0000","last_became_peered":"2023-11-18T20:59:25.362350+0000","last_unstale":"2023-11-18T21:29:10.403695+0000","last_undegraded":"2023-11-18T21:29:10.403695+0000","last_fullsized":"2023-11-18T21:29:10.403695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'155","last_scrub_stamp":"2023-11-18T21:29:10.403422+0000","last_deep_scrub":"31'155","last_deep_scrub_stamp":"2023-11-18T21:29:10.403422+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.403422+0000","objects_scrubbed":8,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:31:46.910785+0000","scrub_duration":0.016723597999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"31'80","reported_seq":116,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:40.509735+0000","last_change":"2023-11-18T21:29:40.509842+0000","last_active":"2023-11-18T21:29:40.509735+0000","last_peered":"2023-11-18T21:29:40.509735+0000","last_clean":"2023-11-18T21:29:40.509735+0000","last_became_active":"2023-11-18T20:59:35.834153+0000","last_became_peered":"2023-11-18T20:59:35.834153+0000","last_unstale":"2023-11-18T21:29:40.509735+0000","last_undegraded":"2023-11-18T21:29:40.509735+0000","last_fullsized":"2023-11-18T21:29:40.509735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'80","last_scrub_stamp":"2023-11-18T21:29:40.509503+0000","last_deep_scrub":"31'80","last_deep_scrub_stamp":"2023-11-18T21:29:40.509503+0000","last_clean_scrub_stamp":"2023-11-18T21:29:40.509503+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:54:28.749972+0000","scrub_duration":0.0094143319999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'47","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:05.922677+0000","last_change":"2023-11-18T21:29:05.922677+0000","last_active":"2023-11-18T21:29:05.922677+0000","last_peered":"2023-11-18T21:29:05.922677+0000","last_clean":"2023-11-18T21:29:05.922677+0000","last_became_active":"2023-11-18T20:59:27.840852+0000","last_became_peered":"2023-11-18T20:59:27.840852+0000","last_unstale":"2023-11-18T21:29:05.922677+0000","last_undegraded":"2023-11-18T21:29:05.922677+0000","last_fullsized":"2023-11-18T21:29:05.922677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-11-18T21:29:05.922425+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-11-18T21:29:05.922425+0000","last_clean_scrub_stamp":"2023-11-18T21:29:05.922425+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:01:12.622028+0000","scrub_duration":0.004098544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"31'842","reported_seq":886,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:08.034015+0000","last_change":"2023-11-18T21:29:08.034015+0000","last_active":"2023-11-18T21:29:08.034015+0000","last_peered":"2023-11-18T21:29:08.034015+0000","last_clean":"2023-11-18T21:29:08.034015+0000","last_became_active":"2023-11-18T20:59:25.351149+0000","last_became_peered":"2023-11-18T20:59:25.351149+0000","last_unstale":"2023-11-18T21:29:08.034015+0000","last_undegraded":"2023-11-18T21:29:08.034015+0000","last_fullsized":"2023-11-18T21:29:08.034015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'842","last_scrub_stamp":"2023-11-18T21:29:08.033755+0000","last_deep_scrub":"31'842","last_deep_scrub_stamp":"2023-11-18T21:29:08.033755+0000","last_clean_scrub_stamp":"2023-11-18T21:29:08.033755+0000","objects_scrubbed":3,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:37:31.925547+0000","scrub_duration":0.027073499000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3704571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":4031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"31'77","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:43.510226+0000","last_change":"2023-11-18T21:29:43.510321+0000","last_active":"2023-11-18T21:29:43.510226+0000","last_peered":"2023-11-18T21:29:43.510226+0000","last_clean":"2023-11-18T21:29:43.510226+0000","last_became_active":"2023-11-18T20:59:35.843208+0000","last_became_peered":"2023-11-18T20:59:35.843208+0000","last_unstale":"2023-11-18T21:29:43.510226+0000","last_undegraded":"2023-11-18T21:29:43.510226+0000","last_fullsized":"2023-11-18T21:29:43.510226+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'77","last_scrub_stamp":"2023-11-18T21:29:43.509956+0000","last_deep_scrub":"31'77","last_deep_scrub_stamp":"2023-11-18T21:29:43.509956+0000","last_clean_scrub_stamp":"2023-11-18T21:29:43.509956+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:41.701327+0000","scrub_duration":0.0097027429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":6277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'59","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:58.427716+0000","last_change":"2023-11-18T21:28:58.427716+0000","last_active":"2023-11-18T21:28:58.427716+0000","last_peered":"2023-11-18T21:28:58.427716+0000","last_clean":"2023-11-18T21:28:58.427716+0000","last_became_active":"2023-11-18T20:59:27.866233+0000","last_became_peered":"2023-11-18T20:59:27.866233+0000","last_unstale":"2023-11-18T21:28:58.427716+0000","last_undegraded":"2023-11-18T21:28:58.427716+0000","last_fullsized":"2023-11-18T21:28:58.427716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:28:58.427386+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:28:58.427386+0000","last_clean_scrub_stamp":"2023-11-18T21:28:58.427386+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:17:54.424458+0000","scrub_duration":0.002651498,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"31'96","reported_seq":140,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:39.338963+0000","last_change":"2023-11-18T21:29:39.338963+0000","last_active":"2023-11-18T21:29:39.338963+0000","last_peered":"2023-11-18T21:29:39.338963+0000","last_clean":"2023-11-18T21:29:39.338963+0000","last_became_active":"2023-11-18T20:59:25.362287+0000","last_became_peered":"2023-11-18T20:59:25.362287+0000","last_unstale":"2023-11-18T21:29:39.338963+0000","last_undegraded":"2023-11-18T21:29:39.338963+0000","last_fullsized":"2023-11-18T21:29:39.338963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'96","last_scrub_stamp":"2023-11-18T21:29:39.338721+0000","last_deep_scrub":"31'96","last_deep_scrub_stamp":"2023-11-18T21:29:39.338721+0000","last_clean_scrub_stamp":"2023-11-18T21:29:39.338721+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:42:56.158719+0000","scrub_duration":0.0095503240000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"31'78","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:43.536950+0000","last_change":"2023-11-18T21:29:43.537004+0000","last_active":"2023-11-18T21:29:43.536950+0000","last_peered":"2023-11-18T21:29:43.536950+0000","last_clean":"2023-11-18T21:29:43.536950+0000","last_became_active":"2023-11-18T20:59:35.845378+0000","last_became_peered":"2023-11-18T20:59:35.845378+0000","last_unstale":"2023-11-18T21:29:43.536950+0000","last_undegraded":"2023-11-18T21:29:43.536950+0000","last_fullsized":"2023-11-18T21:29:43.536950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'78","last_scrub_stamp":"2023-11-18T21:29:43.536753+0000","last_deep_scrub":"31'78","last_deep_scrub_stamp":"2023-11-18T21:29:43.536753+0000","last_clean_scrub_stamp":"2023-11-18T21:29:43.536753+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:42:12.740877+0000","scrub_duration":0.0095263090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":6777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"31'57","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:15.247218+0000","last_change":"2023-11-18T21:29:15.247218+0000","last_active":"2023-11-18T21:29:15.247218+0000","last_peered":"2023-11-18T21:29:15.247218+0000","last_clean":"2023-11-18T21:29:15.247218+0000","last_became_active":"2023-11-18T20:59:27.863435+0000","last_became_peered":"2023-11-18T20:59:27.863435+0000","last_unstale":"2023-11-18T21:29:15.247218+0000","last_undegraded":"2023-11-18T21:29:15.247218+0000","last_fullsized":"2023-11-18T21:29:15.247218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'57","last_scrub_stamp":"2023-11-18T21:29:15.246973+0000","last_deep_scrub":"31'57","last_deep_scrub_stamp":"2023-11-18T21:29:15.246973+0000","last_clean_scrub_stamp":"2023-11-18T21:29:15.246973+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:10:06.349372+0000","scrub_duration":0.0043063679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"31'128","reported_seq":280,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:09.391544+0000","last_change":"2023-11-18T21:29:09.391544+0000","last_active":"2023-11-18T21:29:09.391544+0000","last_peered":"2023-11-18T21:29:09.391544+0000","last_clean":"2023-11-18T21:29:09.391544+0000","last_became_active":"2023-11-18T20:59:25.361313+0000","last_became_peered":"2023-11-18T20:59:25.361313+0000","last_unstale":"2023-11-18T21:29:09.391544+0000","last_undegraded":"2023-11-18T21:29:09.391544+0000","last_fullsized":"2023-11-18T21:29:09.391544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'128","last_scrub_stamp":"2023-11-18T21:29:09.391288+0000","last_deep_scrub":"31'128","last_deep_scrub_stamp":"2023-11-18T21:29:09.391288+0000","last_clean_scrub_stamp":"2023-11-18T21:29:09.391288+0000","objects_scrubbed":7,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:23:14.357002+0000","scrub_duration":0.014106417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25371,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":112,"num_write":121,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"31'82","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:47.491364+0000","last_change":"2023-11-18T21:29:47.491484+0000","last_active":"2023-11-18T21:29:47.491364+0000","last_peered":"2023-11-18T21:29:47.491364+0000","last_clean":"2023-11-18T21:29:47.491364+0000","last_became_active":"2023-11-18T20:59:35.832562+0000","last_became_peered":"2023-11-18T20:59:35.832562+0000","last_unstale":"2023-11-18T21:29:47.491364+0000","last_undegraded":"2023-11-18T21:29:47.491364+0000","last_fullsized":"2023-11-18T21:29:47.491364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'82","last_scrub_stamp":"2023-11-18T21:29:47.491038+0000","last_deep_scrub":"31'82","last_deep_scrub_stamp":"2023-11-18T21:29:47.491038+0000","last_clean_scrub_stamp":"2023-11-18T21:29:47.491038+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:45:03.240152+0000","scrub_duration":0.011463243999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":7445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'55","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:20.042056+0000","last_change":"2023-11-18T21:29:20.042114+0000","last_active":"2023-11-18T21:29:20.042056+0000","last_peered":"2023-11-18T21:29:20.042056+0000","last_clean":"2023-11-18T21:29:20.042056+0000","last_became_active":"2023-11-18T20:59:27.865971+0000","last_became_peered":"2023-11-18T20:59:27.865971+0000","last_unstale":"2023-11-18T21:29:20.042056+0000","last_undegraded":"2023-11-18T21:29:20.042056+0000","last_fullsized":"2023-11-18T21:29:20.042056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'55","last_scrub_stamp":"2023-11-18T21:29:20.041863+0000","last_deep_scrub":"31'55","last_deep_scrub_stamp":"2023-11-18T21:29:20.041863+0000","last_clean_scrub_stamp":"2023-11-18T21:29:20.041863+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:57:22.816534+0000","scrub_duration":0.0043334610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"31'1155","reported_seq":1199,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:00.190050+0000","last_change":"2023-11-18T21:29:00.190050+0000","last_active":"2023-11-18T21:29:00.190050+0000","last_peered":"2023-11-18T21:29:00.190050+0000","last_clean":"2023-11-18T21:29:00.190050+0000","last_became_active":"2023-11-18T20:59:25.349577+0000","last_became_peered":"2023-11-18T20:59:25.349577+0000","last_unstale":"2023-11-18T21:29:00.190050+0000","last_undegraded":"2023-11-18T21:29:00.190050+0000","last_fullsized":"2023-11-18T21:29:00.190050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1155","last_scrub_stamp":"2023-11-18T21:29:00.189950+0000","last_deep_scrub":"31'1155","last_deep_scrub_stamp":"2023-11-18T21:29:00.189950+0000","last_clean_scrub_stamp":"2023-11-18T21:29:00.189950+0000","objects_scrubbed":6,"log_size":1155,"log_dups_size":0,"ondisk_log_size":1155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:24:28.834089+0000","scrub_duration":0.028314013999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":4577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"31'99","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:35.193946+0000","last_change":"2023-11-18T21:29:35.193946+0000","last_active":"2023-11-18T21:29:35.193946+0000","last_peered":"2023-11-18T21:29:35.193946+0000","last_clean":"2023-11-18T21:29:35.193946+0000","last_became_active":"2023-11-18T20:59:35.848000+0000","last_became_peered":"2023-11-18T20:59:35.848000+0000","last_unstale":"2023-11-18T21:29:35.193946+0000","last_undegraded":"2023-11-18T21:29:35.193946+0000","last_fullsized":"2023-11-18T21:29:35.193946+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'99","last_scrub_stamp":"2023-11-18T21:29:35.193692+0000","last_deep_scrub":"31'99","last_deep_scrub_stamp":"2023-11-18T21:29:35.193692+0000","last_clean_scrub_stamp":"2023-11-18T21:29:35.193692+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:29:45.480808+0000","scrub_duration":0.011025439,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":10947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"31'51","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.379912+0000","last_change":"2023-11-18T21:29:21.379912+0000","last_active":"2023-11-18T21:29:21.379912+0000","last_peered":"2023-11-18T21:29:21.379912+0000","last_clean":"2023-11-18T21:29:21.379912+0000","last_became_active":"2023-11-18T20:59:27.891260+0000","last_became_peered":"2023-11-18T20:59:27.891260+0000","last_unstale":"2023-11-18T21:29:21.379912+0000","last_undegraded":"2023-11-18T21:29:21.379912+0000","last_fullsized":"2023-11-18T21:29:21.379912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2023-11-18T21:29:21.379550+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2023-11-18T21:29:21.379550+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.379550+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:03:51.816695+0000","scrub_duration":0.0038841679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"31'71","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:11.342090+0000","last_change":"2023-11-18T21:29:11.342215+0000","last_active":"2023-11-18T21:29:11.342090+0000","last_peered":"2023-11-18T21:29:11.342090+0000","last_clean":"2023-11-18T21:29:11.342090+0000","last_became_active":"2023-11-18T20:59:25.363289+0000","last_became_peered":"2023-11-18T20:59:25.363289+0000","last_unstale":"2023-11-18T21:29:11.342090+0000","last_undegraded":"2023-11-18T21:29:11.342090+0000","last_fullsized":"2023-11-18T21:29:11.342090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'71","last_scrub_stamp":"2023-11-18T21:29:11.341853+0000","last_deep_scrub":"31'71","last_deep_scrub_stamp":"2023-11-18T21:29:11.341853+0000","last_clean_scrub_stamp":"2023-11-18T21:29:11.341853+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:12.433430+0000","scrub_duration":0.011087723000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"31'68","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:25.228273+0000","last_change":"2023-11-18T21:29:25.228273+0000","last_active":"2023-11-18T21:29:25.228273+0000","last_peered":"2023-11-18T21:29:25.228273+0000","last_clean":"2023-11-18T21:29:25.228273+0000","last_became_active":"2023-11-18T20:59:35.771263+0000","last_became_peered":"2023-11-18T20:59:35.771263+0000","last_unstale":"2023-11-18T21:29:25.228273+0000","last_undegraded":"2023-11-18T21:29:25.228273+0000","last_fullsized":"2023-11-18T21:29:25.228273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'68","last_scrub_stamp":"2023-11-18T21:29:25.228021+0000","last_deep_scrub":"31'68","last_deep_scrub_stamp":"2023-11-18T21:29:25.228021+0000","last_clean_scrub_stamp":"2023-11-18T21:29:25.228021+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:35:19.729693+0000","scrub_duration":0.011176386999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":272,"num_write":61,"num_write_kb":11998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"31'64","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:24.399773+0000","last_change":"2023-11-18T21:29:24.399827+0000","last_active":"2023-11-18T21:29:24.399773+0000","last_peered":"2023-11-18T21:29:24.399773+0000","last_clean":"2023-11-18T21:29:24.399773+0000","last_became_active":"2023-11-18T20:59:27.832589+0000","last_became_peered":"2023-11-18T20:59:27.832589+0000","last_unstale":"2023-11-18T21:29:24.399773+0000","last_undegraded":"2023-11-18T21:29:24.399773+0000","last_fullsized":"2023-11-18T21:29:24.399773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'64","last_scrub_stamp":"2023-11-18T21:29:24.399584+0000","last_deep_scrub":"31'64","last_deep_scrub_stamp":"2023-11-18T21:29:24.399584+0000","last_clean_scrub_stamp":"2023-11-18T21:29:24.399584+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:43.047794+0000","scrub_duration":0.0056386020000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"31'119","reported_seq":271,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:10.002973+0000","last_change":"2023-11-18T21:29:10.003016+0000","last_active":"2023-11-18T21:29:10.002973+0000","last_peered":"2023-11-18T21:29:10.002973+0000","last_clean":"2023-11-18T21:29:10.002973+0000","last_became_active":"2023-11-18T20:59:25.493373+0000","last_became_peered":"2023-11-18T20:59:25.493373+0000","last_unstale":"2023-11-18T21:29:10.002973+0000","last_undegraded":"2023-11-18T21:29:10.002973+0000","last_fullsized":"2023-11-18T21:29:10.002973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-11-18T21:29:10.002888+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-11-18T21:29:10.002888+0000","last_clean_scrub_stamp":"2023-11-18T21:29:10.002888+0000","objects_scrubbed":3,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:52:08.702511+0000","scrub_duration":0.0088310239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20332,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":112,"num_write":115,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'93","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:20.232660+0000","last_change":"2023-11-18T21:29:20.232660+0000","last_active":"2023-11-18T21:29:20.232660+0000","last_peered":"2023-11-18T21:29:20.232660+0000","last_clean":"2023-11-18T21:29:20.232660+0000","last_became_active":"2023-11-18T20:59:35.772563+0000","last_became_peered":"2023-11-18T20:59:35.772563+0000","last_unstale":"2023-11-18T21:29:20.232660+0000","last_undegraded":"2023-11-18T21:29:20.232660+0000","last_fullsized":"2023-11-18T21:29:20.232660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'93","last_scrub_stamp":"2023-11-18T21:29:20.232464+0000","last_deep_scrub":"31'93","last_deep_scrub_stamp":"2023-11-18T21:29:20.232464+0000","last_clean_scrub_stamp":"2023-11-18T21:29:20.232464+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:47:01.640494+0000","scrub_duration":0.01013846,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":9621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'57","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:13.159776+0000","last_change":"2023-11-18T21:29:13.159830+0000","last_active":"2023-11-18T21:29:13.159776+0000","last_peered":"2023-11-18T21:29:13.159776+0000","last_clean":"2023-11-18T21:29:13.159776+0000","last_became_active":"2023-11-18T20:59:27.891883+0000","last_became_peered":"2023-11-18T20:59:27.891883+0000","last_unstale":"2023-11-18T21:29:13.159776+0000","last_undegraded":"2023-11-18T21:29:13.159776+0000","last_fullsized":"2023-11-18T21:29:13.159776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'57","last_scrub_stamp":"2023-11-18T21:29:13.159570+0000","last_deep_scrub":"31'57","last_deep_scrub_stamp":"2023-11-18T21:29:13.159570+0000","last_clean_scrub_stamp":"2023-11-18T21:29:13.159570+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:07.593699+0000","scrub_duration":0.0038753820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"31'159","reported_seq":202,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:57.910143+0000","last_change":"2023-11-18T21:28:57.910171+0000","last_active":"2023-11-18T21:28:57.910143+0000","last_peered":"2023-11-18T21:28:57.910143+0000","last_clean":"2023-11-18T21:28:57.910143+0000","last_became_active":"2023-11-18T20:59:25.496680+0000","last_became_peered":"2023-11-18T20:59:25.496680+0000","last_unstale":"2023-11-18T21:28:57.910143+0000","last_undegraded":"2023-11-18T21:28:57.910143+0000","last_fullsized":"2023-11-18T21:28:57.910143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'159","last_scrub_stamp":"2023-11-18T21:28:57.910062+0000","last_deep_scrub":"31'159","last_deep_scrub_stamp":"2023-11-18T21:28:57.910062+0000","last_clean_scrub_stamp":"2023-11-18T21:28:57.910062+0000","objects_scrubbed":3,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:17.803669+0000","scrub_duration":0.0065099140000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"31'67","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:34.234959+0000","last_change":"2023-11-18T21:29:34.234959+0000","last_active":"2023-11-18T21:29:34.234959+0000","last_peered":"2023-11-18T21:29:34.234959+0000","last_clean":"2023-11-18T21:29:34.234959+0000","last_became_active":"2023-11-18T20:59:35.838830+0000","last_became_peered":"2023-11-18T20:59:35.838830+0000","last_unstale":"2023-11-18T21:29:34.234959+0000","last_undegraded":"2023-11-18T21:29:34.234959+0000","last_fullsized":"2023-11-18T21:29:34.234959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'67","last_scrub_stamp":"2023-11-18T21:29:34.234654+0000","last_deep_scrub":"31'67","last_deep_scrub_stamp":"2023-11-18T21:29:34.234654+0000","last_clean_scrub_stamp":"2023-11-18T21:29:34.234654+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:18:49.849158+0000","scrub_duration":0.0091543920000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":8132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"31'63","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:37.254608+0000","last_change":"2023-11-18T21:29:37.254608+0000","last_active":"2023-11-18T21:29:37.254608+0000","last_peered":"2023-11-18T21:29:37.254608+0000","last_clean":"2023-11-18T21:29:37.254608+0000","last_became_active":"2023-11-18T20:59:35.838375+0000","last_became_peered":"2023-11-18T20:59:35.838375+0000","last_unstale":"2023-11-18T21:29:37.254608+0000","last_undegraded":"2023-11-18T21:29:37.254608+0000","last_fullsized":"2023-11-18T21:29:37.254608+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:37.254333+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:37.254333+0000","last_clean_scrub_stamp":"2023-11-18T21:29:37.254333+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:22.727567+0000","scrub_duration":0.0086027900000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"31'61","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:18.243224+0000","last_change":"2023-11-18T21:29:18.243275+0000","last_active":"2023-11-18T21:29:18.243224+0000","last_peered":"2023-11-18T21:29:18.243224+0000","last_clean":"2023-11-18T21:29:18.243224+0000","last_became_active":"2023-11-18T20:59:27.688522+0000","last_became_peered":"2023-11-18T20:59:27.688522+0000","last_unstale":"2023-11-18T21:29:18.243224+0000","last_undegraded":"2023-11-18T21:29:18.243224+0000","last_fullsized":"2023-11-18T21:29:18.243224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'61","last_scrub_stamp":"2023-11-18T21:29:18.243035+0000","last_deep_scrub":"31'61","last_deep_scrub_stamp":"2023-11-18T21:29:18.243035+0000","last_clean_scrub_stamp":"2023-11-18T21:29:18.243035+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:52:55.389095+0000","scrub_duration":0.00420858,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"31'8","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:26.322379+0000","last_change":"2023-11-18T21:29:26.322435+0000","last_active":"2023-11-18T21:29:26.322379+0000","last_peered":"2023-11-18T21:29:26.322379+0000","last_clean":"2023-11-18T21:29:26.322379+0000","last_became_active":"2023-11-18T20:59:25.493357+0000","last_became_peered":"2023-11-18T20:59:25.493357+0000","last_unstale":"2023-11-18T21:29:26.322379+0000","last_undegraded":"2023-11-18T21:29:26.322379+0000","last_fullsized":"2023-11-18T21:29:26.322379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-11-18T21:29:26.322202+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-11-18T21:29:26.322202+0000","last_clean_scrub_stamp":"2023-11-18T21:29:26.322202+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:05:42.445909+0000","scrub_duration":0.0068924219999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'97","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:51.568063+0000","last_change":"2023-11-18T21:29:51.568182+0000","last_active":"2023-11-18T21:29:51.568063+0000","last_peered":"2023-11-18T21:29:51.568063+0000","last_clean":"2023-11-18T21:29:51.568063+0000","last_became_active":"2023-11-18T20:59:35.776138+0000","last_became_peered":"2023-11-18T20:59:35.776138+0000","last_unstale":"2023-11-18T21:29:51.568063+0000","last_undegraded":"2023-11-18T21:29:51.568063+0000","last_fullsized":"2023-11-18T21:29:51.568063+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'97","last_scrub_stamp":"2023-11-18T21:29:51.567751+0000","last_deep_scrub":"31'97","last_deep_scrub_stamp":"2023-11-18T21:29:51.567751+0000","last_clean_scrub_stamp":"2023-11-18T21:29:51.567751+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:39:38.649711+0000","scrub_duration":0.0094688540000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'54","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:00.665722+0000","last_change":"2023-11-18T21:29:00.665764+0000","last_active":"2023-11-18T21:29:00.665722+0000","last_peered":"2023-11-18T21:29:00.665722+0000","last_clean":"2023-11-18T21:29:00.665722+0000","last_became_active":"2023-11-18T20:59:27.860537+0000","last_became_peered":"2023-11-18T20:59:27.860537+0000","last_unstale":"2023-11-18T21:29:00.665722+0000","last_undegraded":"2023-11-18T21:29:00.665722+0000","last_fullsized":"2023-11-18T21:29:00.665722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-11-18T21:29:00.665560+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-11-18T21:29:00.665560+0000","last_clean_scrub_stamp":"2023-11-18T21:29:00.665560+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:11:31.387422+0000","scrub_duration":0.0036286529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"31'231","reported_seq":497,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:03.310448+0000","last_change":"2023-11-18T21:29:03.310510+0000","last_active":"2023-11-18T21:29:03.310448+0000","last_peered":"2023-11-18T21:29:03.310448+0000","last_clean":"2023-11-18T21:29:03.310448+0000","last_became_active":"2023-11-18T20:59:25.354690+0000","last_became_peered":"2023-11-18T20:59:25.354690+0000","last_unstale":"2023-11-18T21:29:03.310448+0000","last_undegraded":"2023-11-18T21:29:03.310448+0000","last_fullsized":"2023-11-18T21:29:03.310448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'231","last_scrub_stamp":"2023-11-18T21:29:03.310260+0000","last_deep_scrub":"31'231","last_deep_scrub_stamp":"2023-11-18T21:29:03.310260+0000","last_clean_scrub_stamp":"2023-11-18T21:29:03.310260+0000","objects_scrubbed":3,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:11:13.929892+0000","scrub_duration":0.0098773730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34720,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":223,"num_read_kb":227,"num_write":228,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"31'179","reported_seq":384,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:28.310099+0000","last_change":"2023-11-18T21:29:28.310160+0000","last_active":"2023-11-18T21:29:28.310099+0000","last_peered":"2023-11-18T21:29:28.310099+0000","last_clean":"2023-11-18T21:29:28.310099+0000","last_became_active":"2023-11-18T20:59:25.346192+0000","last_became_peered":"2023-11-18T20:59:25.346192+0000","last_unstale":"2023-11-18T21:29:28.310099+0000","last_undegraded":"2023-11-18T21:29:28.310099+0000","last_fullsized":"2023-11-18T21:29:28.310099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'179","last_scrub_stamp":"2023-11-18T21:29:28.309914+0000","last_deep_scrub":"31'179","last_deep_scrub_stamp":"2023-11-18T21:29:28.309914+0000","last_clean_scrub_stamp":"2023-11-18T21:29:28.309914+0000","objects_scrubbed":4,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:54:16.550383+0000","scrub_duration":0.010160943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":165,"num_write":171,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'63","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:00.370654+0000","last_change":"2023-11-18T21:29:00.370654+0000","last_active":"2023-11-18T21:29:00.370654+0000","last_peered":"2023-11-18T21:29:00.370654+0000","last_clean":"2023-11-18T21:29:00.370654+0000","last_became_active":"2023-11-18T20:59:27.867886+0000","last_became_peered":"2023-11-18T20:59:27.867886+0000","last_unstale":"2023-11-18T21:29:00.370654+0000","last_undegraded":"2023-11-18T21:29:00.370654+0000","last_fullsized":"2023-11-18T21:29:00.370654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:00.370401+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:00.370401+0000","last_clean_scrub_stamp":"2023-11-18T21:29:00.370401+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:00:07.902842+0000","scrub_duration":0.0051850940000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'95","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:36.225204+0000","last_change":"2023-11-18T21:29:36.225258+0000","last_active":"2023-11-18T21:29:36.225204+0000","last_peered":"2023-11-18T21:29:36.225204+0000","last_clean":"2023-11-18T21:29:36.225204+0000","last_became_active":"2023-11-18T20:59:35.850427+0000","last_became_peered":"2023-11-18T20:59:35.850427+0000","last_unstale":"2023-11-18T21:29:36.225204+0000","last_undegraded":"2023-11-18T21:29:36.225204+0000","last_fullsized":"2023-11-18T21:29:36.225204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'95","last_scrub_stamp":"2023-11-18T21:29:36.225007+0000","last_deep_scrub":"31'95","last_deep_scrub_stamp":"2023-11-18T21:29:36.225007+0000","last_clean_scrub_stamp":"2023-11-18T21:29:36.225007+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:12:52.127534+0000","scrub_duration":0.0094896419999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2347","reported_seq":2390,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:14.533218+0000","last_change":"2023-11-18T21:29:14.533218+0000","last_active":"2023-11-18T21:29:14.533218+0000","last_peered":"2023-11-18T21:29:14.533218+0000","last_clean":"2023-11-18T21:29:14.533218+0000","last_became_active":"2023-11-18T20:59:25.460449+0000","last_became_peered":"2023-11-18T20:59:25.460449+0000","last_unstale":"2023-11-18T21:29:14.533218+0000","last_undegraded":"2023-11-18T21:29:14.533218+0000","last_fullsized":"2023-11-18T21:29:14.533218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2347","last_scrub_stamp":"2023-11-18T21:29:14.532977+0000","last_deep_scrub":"31'2347","last_deep_scrub_stamp":"2023-11-18T21:29:14.532977+0000","last_clean_scrub_stamp":"2023-11-18T21:29:14.532977+0000","objects_scrubbed":4,"log_size":2347,"log_dups_size":0,"ondisk_log_size":2347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:11:42.664738+0000","scrub_duration":0.056368952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8759326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2333,"num_write_kb":9750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"31'69","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:16.019065+0000","last_change":"2023-11-18T21:29:16.019065+0000","last_active":"2023-11-18T21:29:16.019065+0000","last_peered":"2023-11-18T21:29:16.019065+0000","last_clean":"2023-11-18T21:29:16.019065+0000","last_became_active":"2023-11-18T20:59:27.840528+0000","last_became_peered":"2023-11-18T20:59:27.840528+0000","last_unstale":"2023-11-18T21:29:16.019065+0000","last_undegraded":"2023-11-18T21:29:16.019065+0000","last_fullsized":"2023-11-18T21:29:16.019065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'69","last_scrub_stamp":"2023-11-18T21:29:16.018825+0000","last_deep_scrub":"31'69","last_deep_scrub_stamp":"2023-11-18T21:29:16.018825+0000","last_clean_scrub_stamp":"2023-11-18T21:29:16.018825+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:40.995064+0000","scrub_duration":0.0034129389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"31'65","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:29.278401+0000","last_change":"2023-11-18T21:29:29.278401+0000","last_active":"2023-11-18T21:29:29.278401+0000","last_peered":"2023-11-18T21:29:29.278401+0000","last_clean":"2023-11-18T21:29:29.278401+0000","last_became_active":"2023-11-18T20:59:35.775977+0000","last_became_peered":"2023-11-18T20:59:35.775977+0000","last_unstale":"2023-11-18T21:29:29.278401+0000","last_undegraded":"2023-11-18T21:29:29.278401+0000","last_fullsized":"2023-11-18T21:29:29.278401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'65","last_scrub_stamp":"2023-11-18T21:29:29.278165+0000","last_deep_scrub":"31'65","last_deep_scrub_stamp":"2023-11-18T21:29:29.278165+0000","last_clean_scrub_stamp":"2023-11-18T21:29:29.278165+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:10:20.380564+0000","scrub_duration":0.0083929169999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":6083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"31'59","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:06.116859+0000","last_change":"2023-11-18T21:29:06.116910+0000","last_active":"2023-11-18T21:29:06.116859+0000","last_peered":"2023-11-18T21:29:06.116859+0000","last_clean":"2023-11-18T21:29:06.116859+0000","last_became_active":"2023-11-18T20:59:27.887716+0000","last_became_peered":"2023-11-18T20:59:27.887716+0000","last_unstale":"2023-11-18T21:29:06.116859+0000","last_undegraded":"2023-11-18T21:29:06.116859+0000","last_fullsized":"2023-11-18T21:29:06.116859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:29:06.116671+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:29:06.116671+0000","last_clean_scrub_stamp":"2023-11-18T21:29:06.116671+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:30:14.804753+0000","scrub_duration":0.0043744070000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"31'67","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:13.326825+0000","last_change":"2023-11-18T21:29:13.326866+0000","last_active":"2023-11-18T21:29:13.326825+0000","last_peered":"2023-11-18T21:29:13.326825+0000","last_clean":"2023-11-18T21:29:13.326825+0000","last_became_active":"2023-11-18T20:59:27.680712+0000","last_became_peered":"2023-11-18T20:59:27.680712+0000","last_unstale":"2023-11-18T21:29:13.326825+0000","last_undegraded":"2023-11-18T21:29:13.326825+0000","last_fullsized":"2023-11-18T21:29:13.326825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'67","last_scrub_stamp":"2023-11-18T21:29:13.326649+0000","last_deep_scrub":"31'67","last_deep_scrub_stamp":"2023-11-18T21:29:13.326649+0000","last_clean_scrub_stamp":"2023-11-18T21:29:13.326649+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:24:41.970789+0000","scrub_duration":0.0032687520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"31'57","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.582692+0000","last_change":"2023-11-18T21:29:04.582839+0000","last_active":"2023-11-18T21:29:04.582692+0000","last_peered":"2023-11-18T21:29:04.582692+0000","last_clean":"2023-11-18T21:29:04.582692+0000","last_became_active":"2023-11-18T20:59:27.835120+0000","last_became_peered":"2023-11-18T20:59:27.835120+0000","last_unstale":"2023-11-18T21:29:04.582692+0000","last_undegraded":"2023-11-18T21:29:04.582692+0000","last_fullsized":"2023-11-18T21:29:04.582692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'57","last_scrub_stamp":"2023-11-18T21:29:04.582340+0000","last_deep_scrub":"31'57","last_deep_scrub_stamp":"2023-11-18T21:29:04.582340+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.582340+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:59:50.451724+0000","scrub_duration":0.0037119219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"31'59","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.454897+0000","last_change":"2023-11-18T21:29:21.454950+0000","last_active":"2023-11-18T21:29:21.454897+0000","last_peered":"2023-11-18T21:29:21.454897+0000","last_clean":"2023-11-18T21:29:21.454897+0000","last_became_active":"2023-11-18T20:59:27.833049+0000","last_became_peered":"2023-11-18T20:59:27.833049+0000","last_unstale":"2023-11-18T21:29:21.454897+0000","last_undegraded":"2023-11-18T21:29:21.454897+0000","last_fullsized":"2023-11-18T21:29:21.454897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:29:21.454712+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:29:21.454712+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.454712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:47:46.800202+0000","scrub_duration":0.0049077629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"31'40","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:26.307573+0000","last_change":"2023-11-18T21:29:26.307573+0000","last_active":"2023-11-18T21:29:26.307573+0000","last_peered":"2023-11-18T21:29:26.307573+0000","last_clean":"2023-11-18T21:29:26.307573+0000","last_became_active":"2023-11-18T20:59:27.878353+0000","last_became_peered":"2023-11-18T20:59:27.878353+0000","last_unstale":"2023-11-18T21:29:26.307573+0000","last_undegraded":"2023-11-18T21:29:26.307573+0000","last_fullsized":"2023-11-18T21:29:26.307573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2023-11-18T21:29:26.307321+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2023-11-18T21:29:26.307321+0000","last_clean_scrub_stamp":"2023-11-18T21:29:26.307321+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:37:50.199113+0000","scrub_duration":0.0043578209999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'50","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:13.172491+0000","last_change":"2023-11-18T21:29:13.172491+0000","last_active":"2023-11-18T21:29:13.172491+0000","last_peered":"2023-11-18T21:29:13.172491+0000","last_clean":"2023-11-18T21:29:13.172491+0000","last_became_active":"2023-11-18T20:59:27.866165+0000","last_became_peered":"2023-11-18T20:59:27.866165+0000","last_unstale":"2023-11-18T21:29:13.172491+0000","last_undegraded":"2023-11-18T21:29:13.172491+0000","last_fullsized":"2023-11-18T21:29:13.172491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'50","last_scrub_stamp":"2023-11-18T21:29:13.172214+0000","last_deep_scrub":"31'50","last_deep_scrub_stamp":"2023-11-18T21:29:13.172214+0000","last_clean_scrub_stamp":"2023-11-18T21:29:13.172214+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:52:07.606343+0000","scrub_duration":0.0036780150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"31'55","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:17.154844+0000","last_change":"2023-11-18T21:29:17.154844+0000","last_active":"2023-11-18T21:29:17.154844+0000","last_peered":"2023-11-18T21:29:17.154844+0000","last_clean":"2023-11-18T21:29:17.154844+0000","last_became_active":"2023-11-18T20:59:27.893918+0000","last_became_peered":"2023-11-18T20:59:27.893918+0000","last_unstale":"2023-11-18T21:29:17.154844+0000","last_undegraded":"2023-11-18T21:29:17.154844+0000","last_fullsized":"2023-11-18T21:29:17.154844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'55","last_scrub_stamp":"2023-11-18T21:29:17.154505+0000","last_deep_scrub":"31'55","last_deep_scrub_stamp":"2023-11-18T21:29:17.154505+0000","last_clean_scrub_stamp":"2023-11-18T21:29:17.154505+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:11:47.876366+0000","scrub_duration":0.0043464080000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"31'49","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:32.411301+0000","last_change":"2023-11-18T21:29:32.411301+0000","last_active":"2023-11-18T21:29:32.411301+0000","last_peered":"2023-11-18T21:29:32.411301+0000","last_clean":"2023-11-18T21:29:32.411301+0000","last_became_active":"2023-11-18T20:59:27.838509+0000","last_became_peered":"2023-11-18T20:59:27.838509+0000","last_unstale":"2023-11-18T21:29:32.411301+0000","last_undegraded":"2023-11-18T21:29:32.411301+0000","last_fullsized":"2023-11-18T21:29:32.411301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'49","last_scrub_stamp":"2023-11-18T21:29:32.411044+0000","last_deep_scrub":"31'49","last_deep_scrub_stamp":"2023-11-18T21:29:32.411044+0000","last_clean_scrub_stamp":"2023-11-18T21:29:32.411044+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:02.848189+0000","scrub_duration":0.0038599979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"31'60","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:45.441609+0000","last_change":"2023-11-18T21:29:45.441609+0000","last_active":"2023-11-18T21:29:45.441609+0000","last_peered":"2023-11-18T21:29:45.441609+0000","last_clean":"2023-11-18T21:29:45.441609+0000","last_became_active":"2023-11-18T20:59:27.835226+0000","last_became_peered":"2023-11-18T20:59:27.835226+0000","last_unstale":"2023-11-18T21:29:45.441609+0000","last_undegraded":"2023-11-18T21:29:45.441609+0000","last_fullsized":"2023-11-18T21:29:45.441609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'60","last_scrub_stamp":"2023-11-18T21:29:45.441359+0000","last_deep_scrub":"31'60","last_deep_scrub_stamp":"2023-11-18T21:29:45.441359+0000","last_clean_scrub_stamp":"2023-11-18T21:29:45.441359+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:21.550592+0000","scrub_duration":0.004846833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'73","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:17.463973+0000","last_change":"2023-11-18T21:29:17.463992+0000","last_active":"2023-11-18T21:29:17.463973+0000","last_peered":"2023-11-18T21:29:17.463973+0000","last_clean":"2023-11-18T21:29:17.463973+0000","last_became_active":"2023-11-18T20:59:27.889325+0000","last_became_peered":"2023-11-18T20:59:27.889325+0000","last_unstale":"2023-11-18T21:29:17.463973+0000","last_undegraded":"2023-11-18T21:29:17.463973+0000","last_fullsized":"2023-11-18T21:29:17.463973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2023-11-18T21:29:17.463894+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2023-11-18T21:29:17.463894+0000","last_clean_scrub_stamp":"2023-11-18T21:29:17.463894+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:46.668018+0000","scrub_duration":0.0034258880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"31'63","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:09.876728+0000","last_change":"2023-11-18T21:29:09.876832+0000","last_active":"2023-11-18T21:29:09.876728+0000","last_peered":"2023-11-18T21:29:09.876728+0000","last_clean":"2023-11-18T21:29:09.876728+0000","last_became_active":"2023-11-18T20:59:27.866609+0000","last_became_peered":"2023-11-18T20:59:27.866609+0000","last_unstale":"2023-11-18T21:29:09.876728+0000","last_undegraded":"2023-11-18T21:29:09.876728+0000","last_fullsized":"2023-11-18T21:29:09.876728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:09.876438+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:09.876438+0000","last_clean_scrub_stamp":"2023-11-18T21:29:09.876438+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:54:07.883741+0000","scrub_duration":0.0036686549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"31'64","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:31.201416+0000","last_change":"2023-11-18T21:29:31.201468+0000","last_active":"2023-11-18T21:29:31.201416+0000","last_peered":"2023-11-18T21:29:31.201416+0000","last_clean":"2023-11-18T21:29:31.201416+0000","last_became_active":"2023-11-18T20:59:27.882976+0000","last_became_peered":"2023-11-18T20:59:27.882976+0000","last_unstale":"2023-11-18T21:29:31.201416+0000","last_undegraded":"2023-11-18T21:29:31.201416+0000","last_fullsized":"2023-11-18T21:29:31.201416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'64","last_scrub_stamp":"2023-11-18T21:29:31.201226+0000","last_deep_scrub":"31'64","last_deep_scrub_stamp":"2023-11-18T21:29:31.201226+0000","last_clean_scrub_stamp":"2023-11-18T21:29:31.201226+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:31:12.185608+0000","scrub_duration":0.0050063130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"31'51","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:27.220154+0000","last_change":"2023-11-18T21:29:27.220208+0000","last_active":"2023-11-18T21:29:27.220154+0000","last_peered":"2023-11-18T21:29:27.220154+0000","last_clean":"2023-11-18T21:29:27.220154+0000","last_became_active":"2023-11-18T20:59:27.872627+0000","last_became_peered":"2023-11-18T20:59:27.872627+0000","last_unstale":"2023-11-18T21:29:27.220154+0000","last_undegraded":"2023-11-18T21:29:27.220154+0000","last_fullsized":"2023-11-18T21:29:27.220154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2023-11-18T21:29:27.219959+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2023-11-18T21:29:27.219959+0000","last_clean_scrub_stamp":"2023-11-18T21:29:27.219959+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:53:24.228418+0000","scrub_duration":0.0036165360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"31'60","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:41.338930+0000","last_change":"2023-11-18T21:29:41.338983+0000","last_active":"2023-11-18T21:29:41.338930+0000","last_peered":"2023-11-18T21:29:41.338930+0000","last_clean":"2023-11-18T21:29:41.338930+0000","last_became_active":"2023-11-18T20:59:27.686311+0000","last_became_peered":"2023-11-18T20:59:27.686311+0000","last_unstale":"2023-11-18T21:29:41.338930+0000","last_undegraded":"2023-11-18T21:29:41.338930+0000","last_fullsized":"2023-11-18T21:29:41.338930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'60","last_scrub_stamp":"2023-11-18T21:29:41.338713+0000","last_deep_scrub":"31'60","last_deep_scrub_stamp":"2023-11-18T21:29:41.338713+0000","last_clean_scrub_stamp":"2023-11-18T21:29:41.338713+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:17:04.917738+0000","scrub_duration":0.0038950859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'65","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:16.293970+0000","last_change":"2023-11-18T21:29:16.293970+0000","last_active":"2023-11-18T21:29:16.293970+0000","last_peered":"2023-11-18T21:29:16.293970+0000","last_clean":"2023-11-18T21:29:16.293970+0000","last_became_active":"2023-11-18T20:59:27.891767+0000","last_became_peered":"2023-11-18T20:59:27.891767+0000","last_unstale":"2023-11-18T21:29:16.293970+0000","last_undegraded":"2023-11-18T21:29:16.293970+0000","last_fullsized":"2023-11-18T21:29:16.293970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'65","last_scrub_stamp":"2023-11-18T21:29:16.293729+0000","last_deep_scrub":"31'65","last_deep_scrub_stamp":"2023-11-18T21:29:16.293729+0000","last_clean_scrub_stamp":"2023-11-18T21:29:16.293729+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:14.707891+0000","scrub_duration":0.0040253770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"31'51","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:02.550040+0000","last_change":"2023-11-18T21:29:02.550040+0000","last_active":"2023-11-18T21:29:02.550040+0000","last_peered":"2023-11-18T21:29:02.550040+0000","last_clean":"2023-11-18T21:29:02.550040+0000","last_became_active":"2023-11-18T20:59:27.866153+0000","last_became_peered":"2023-11-18T20:59:27.866153+0000","last_unstale":"2023-11-18T21:29:02.550040+0000","last_undegraded":"2023-11-18T21:29:02.550040+0000","last_fullsized":"2023-11-18T21:29:02.550040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2023-11-18T21:29:02.549808+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2023-11-18T21:29:02.549808+0000","last_clean_scrub_stamp":"2023-11-18T21:29:02.549808+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:40:23.065850+0000","scrub_duration":0.0075603520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'60","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:14.476409+0000","last_change":"2023-11-18T21:29:14.476409+0000","last_active":"2023-11-18T21:29:14.476409+0000","last_peered":"2023-11-18T21:29:14.476409+0000","last_clean":"2023-11-18T21:29:14.476409+0000","last_became_active":"2023-11-18T20:59:27.889704+0000","last_became_peered":"2023-11-18T20:59:27.889704+0000","last_unstale":"2023-11-18T21:29:14.476409+0000","last_undegraded":"2023-11-18T21:29:14.476409+0000","last_fullsized":"2023-11-18T21:29:14.476409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'60","last_scrub_stamp":"2023-11-18T21:29:14.476160+0000","last_deep_scrub":"31'60","last_deep_scrub_stamp":"2023-11-18T21:29:14.476160+0000","last_clean_scrub_stamp":"2023-11-18T21:29:14.476160+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:39:24.226769+0000","scrub_duration":0.0034077449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"31'63","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:31.385979+0000","last_change":"2023-11-18T21:29:31.385979+0000","last_active":"2023-11-18T21:29:31.385979+0000","last_peered":"2023-11-18T21:29:31.385979+0000","last_clean":"2023-11-18T21:29:31.385979+0000","last_became_active":"2023-11-18T20:59:27.871337+0000","last_became_peered":"2023-11-18T20:59:27.871337+0000","last_unstale":"2023-11-18T21:29:31.385979+0000","last_undegraded":"2023-11-18T21:29:31.385979+0000","last_fullsized":"2023-11-18T21:29:31.385979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:31.385720+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:31.385720+0000","last_clean_scrub_stamp":"2023-11-18T21:29:31.385720+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:29:04.606258+0000","scrub_duration":0.0039053080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"31'53","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.326574+0000","last_change":"2023-11-18T21:29:21.326574+0000","last_active":"2023-11-18T21:29:21.326574+0000","last_peered":"2023-11-18T21:29:21.326574+0000","last_clean":"2023-11-18T21:29:21.326574+0000","last_became_active":"2023-11-18T20:59:27.866560+0000","last_became_peered":"2023-11-18T20:59:27.866560+0000","last_unstale":"2023-11-18T21:29:21.326574+0000","last_undegraded":"2023-11-18T21:29:21.326574+0000","last_fullsized":"2023-11-18T21:29:21.326574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2023-11-18T21:29:21.326191+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2023-11-18T21:29:21.326191+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.326191+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:43:08.584061+0000","scrub_duration":0.0036324149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"31'52","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:29.377883+0000","last_change":"2023-11-18T21:29:29.377933+0000","last_active":"2023-11-18T21:29:29.377883+0000","last_peered":"2023-11-18T21:29:29.377883+0000","last_clean":"2023-11-18T21:29:29.377883+0000","last_became_active":"2023-11-18T20:59:27.878485+0000","last_became_peered":"2023-11-18T20:59:27.878485+0000","last_unstale":"2023-11-18T21:29:29.377883+0000","last_undegraded":"2023-11-18T21:29:29.377883+0000","last_fullsized":"2023-11-18T21:29:29.377883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'52","last_scrub_stamp":"2023-11-18T21:29:29.377688+0000","last_deep_scrub":"31'52","last_deep_scrub_stamp":"2023-11-18T21:29:29.377688+0000","last_clean_scrub_stamp":"2023-11-18T21:29:29.377688+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:34:18.245718+0000","scrub_duration":0.0049288709999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"31'53","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:28.253949+0000","last_change":"2023-11-18T21:29:28.254005+0000","last_active":"2023-11-18T21:29:28.253949+0000","last_peered":"2023-11-18T21:29:28.253949+0000","last_clean":"2023-11-18T21:29:28.253949+0000","last_became_active":"2023-11-18T20:59:27.873255+0000","last_became_peered":"2023-11-18T20:59:27.873255+0000","last_unstale":"2023-11-18T21:29:28.253949+0000","last_undegraded":"2023-11-18T21:29:28.253949+0000","last_fullsized":"2023-11-18T21:29:28.253949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2023-11-18T21:29:28.253752+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2023-11-18T21:29:28.253752+0000","last_clean_scrub_stamp":"2023-11-18T21:29:28.253752+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:54:27.671849+0000","scrub_duration":0.0035530050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"31'53","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:25.200247+0000","last_change":"2023-11-18T21:29:25.200303+0000","last_active":"2023-11-18T21:29:25.200247+0000","last_peered":"2023-11-18T21:29:25.200247+0000","last_clean":"2023-11-18T21:29:25.200247+0000","last_became_active":"2023-11-18T20:59:27.866901+0000","last_became_peered":"2023-11-18T20:59:27.866901+0000","last_unstale":"2023-11-18T21:29:25.200247+0000","last_undegraded":"2023-11-18T21:29:25.200247+0000","last_fullsized":"2023-11-18T21:29:25.200247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2023-11-18T21:29:25.200025+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2023-11-18T21:29:25.200025+0000","last_clean_scrub_stamp":"2023-11-18T21:29:25.200025+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:05.757428+0000","scrub_duration":0.0035374320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"31'59","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:16.986904+0000","last_change":"2023-11-18T21:29:16.986958+0000","last_active":"2023-11-18T21:29:16.986904+0000","last_peered":"2023-11-18T21:29:16.986904+0000","last_clean":"2023-11-18T21:29:16.986904+0000","last_became_active":"2023-11-18T20:59:27.888068+0000","last_became_peered":"2023-11-18T20:59:27.888068+0000","last_unstale":"2023-11-18T21:29:16.986904+0000","last_undegraded":"2023-11-18T21:29:16.986904+0000","last_fullsized":"2023-11-18T21:29:16.986904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'59","last_scrub_stamp":"2023-11-18T21:29:16.986691+0000","last_deep_scrub":"31'59","last_deep_scrub_stamp":"2023-11-18T21:29:16.986691+0000","last_clean_scrub_stamp":"2023-11-18T21:29:16.986691+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:57:37.454968+0000","scrub_duration":0.0038750759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"31'46","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.156428+0000","last_change":"2023-11-18T21:29:21.156480+0000","last_active":"2023-11-18T21:29:21.156428+0000","last_peered":"2023-11-18T21:29:21.156428+0000","last_clean":"2023-11-18T21:29:21.156428+0000","last_became_active":"2023-11-18T20:59:27.682936+0000","last_became_peered":"2023-11-18T20:59:27.682936+0000","last_unstale":"2023-11-18T21:29:21.156428+0000","last_undegraded":"2023-11-18T21:29:21.156428+0000","last_fullsized":"2023-11-18T21:29:21.156428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-11-18T21:29:21.156224+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-11-18T21:29:21.156224+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.156224+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:45.036534+0000","scrub_duration":0.0072266860000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"31'66","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:38.474090+0000","last_change":"2023-11-18T21:29:38.474142+0000","last_active":"2023-11-18T21:29:38.474090+0000","last_peered":"2023-11-18T21:29:38.474090+0000","last_clean":"2023-11-18T21:29:38.474090+0000","last_became_active":"2023-11-18T20:59:27.865401+0000","last_became_peered":"2023-11-18T20:59:27.865401+0000","last_unstale":"2023-11-18T21:29:38.474090+0000","last_undegraded":"2023-11-18T21:29:38.474090+0000","last_fullsized":"2023-11-18T21:29:38.474090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'66","last_scrub_stamp":"2023-11-18T21:29:38.473892+0000","last_deep_scrub":"31'66","last_deep_scrub_stamp":"2023-11-18T21:29:38.473892+0000","last_clean_scrub_stamp":"2023-11-18T21:29:38.473892+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:05:54.597599+0000","scrub_duration":0.0042396279999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"31'51","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:28:59.113381+0000","last_change":"2023-11-18T21:28:59.113381+0000","last_active":"2023-11-18T21:28:59.113381+0000","last_peered":"2023-11-18T21:28:59.113381+0000","last_clean":"2023-11-18T21:28:59.113381+0000","last_became_active":"2023-11-18T20:59:27.864956+0000","last_became_peered":"2023-11-18T20:59:27.864956+0000","last_unstale":"2023-11-18T21:28:59.113381+0000","last_undegraded":"2023-11-18T21:28:59.113381+0000","last_fullsized":"2023-11-18T21:28:59.113381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2023-11-18T21:28:59.113103+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2023-11-18T21:28:59.113103+0000","last_clean_scrub_stamp":"2023-11-18T21:28:59.113103+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:50.215502+0000","scrub_duration":0.0040903290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"31'38","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:05.149488+0000","last_change":"2023-11-18T21:29:05.149488+0000","last_active":"2023-11-18T21:29:05.149488+0000","last_peered":"2023-11-18T21:29:05.149488+0000","last_clean":"2023-11-18T21:29:05.149488+0000","last_became_active":"2023-11-18T20:59:27.889307+0000","last_became_peered":"2023-11-18T20:59:27.889307+0000","last_unstale":"2023-11-18T21:29:05.149488+0000","last_undegraded":"2023-11-18T21:29:05.149488+0000","last_fullsized":"2023-11-18T21:29:05.149488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2023-11-18T21:29:05.149232+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2023-11-18T21:29:05.149232+0000","last_clean_scrub_stamp":"2023-11-18T21:29:05.149232+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:03.563394+0000","scrub_duration":0.0040852270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'47","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:18.033021+0000","last_change":"2023-11-18T21:29:18.033021+0000","last_active":"2023-11-18T21:29:18.033021+0000","last_peered":"2023-11-18T21:29:18.033021+0000","last_clean":"2023-11-18T21:29:18.033021+0000","last_became_active":"2023-11-18T20:59:27.865625+0000","last_became_peered":"2023-11-18T20:59:27.865625+0000","last_unstale":"2023-11-18T21:29:18.033021+0000","last_undegraded":"2023-11-18T21:29:18.033021+0000","last_fullsized":"2023-11-18T21:29:18.033021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-11-18T21:29:18.032773+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-11-18T21:29:18.032773+0000","last_clean_scrub_stamp":"2023-11-18T21:29:18.032773+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:47.236897+0000","scrub_duration":0.004443911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"31'54","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:14.138618+0000","last_change":"2023-11-18T21:29:14.138618+0000","last_active":"2023-11-18T21:29:14.138618+0000","last_peered":"2023-11-18T21:29:14.138618+0000","last_clean":"2023-11-18T21:29:14.138618+0000","last_became_active":"2023-11-18T20:59:27.891753+0000","last_became_peered":"2023-11-18T20:59:27.891753+0000","last_unstale":"2023-11-18T21:29:14.138618+0000","last_undegraded":"2023-11-18T21:29:14.138618+0000","last_fullsized":"2023-11-18T21:29:14.138618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-11-18T21:29:14.138212+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-11-18T21:29:14.138212+0000","last_clean_scrub_stamp":"2023-11-18T21:29:14.138212+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:03:12.661609+0000","scrub_duration":0.0047151750000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"31'63","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:04.507019+0000","last_change":"2023-11-18T21:29:04.507071+0000","last_active":"2023-11-18T21:29:04.507019+0000","last_peered":"2023-11-18T21:29:04.507019+0000","last_clean":"2023-11-18T21:29:04.507019+0000","last_became_active":"2023-11-18T20:59:27.836899+0000","last_became_peered":"2023-11-18T20:59:27.836899+0000","last_unstale":"2023-11-18T21:29:04.507019+0000","last_undegraded":"2023-11-18T21:29:04.507019+0000","last_fullsized":"2023-11-18T21:29:04.507019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:04.506836+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:04.506836+0000","last_clean_scrub_stamp":"2023-11-18T21:29:04.506836+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:01.723462+0000","scrub_duration":0.003664133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"31'58","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:08.464394+0000","last_change":"2023-11-18T21:29:08.464448+0000","last_active":"2023-11-18T21:29:08.464394+0000","last_peered":"2023-11-18T21:29:08.464394+0000","last_clean":"2023-11-18T21:29:08.464394+0000","last_became_active":"2023-11-18T20:59:27.863732+0000","last_became_peered":"2023-11-18T20:59:27.863732+0000","last_unstale":"2023-11-18T21:29:08.464394+0000","last_undegraded":"2023-11-18T21:29:08.464394+0000","last_fullsized":"2023-11-18T21:29:08.464394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'58","last_scrub_stamp":"2023-11-18T21:29:08.464206+0000","last_deep_scrub":"31'58","last_deep_scrub_stamp":"2023-11-18T21:29:08.464206+0000","last_clean_scrub_stamp":"2023-11-18T21:29:08.464206+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:58.000184+0000","scrub_duration":0.0036243820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"31'63","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-18T21:29:21.067794+0000","last_change":"2023-11-18T21:29:21.067914+0000","last_active":"2023-11-18T21:29:21.067794+0000","last_peered":"2023-11-18T21:29:21.067794+0000","last_clean":"2023-11-18T21:29:21.067794+0000","last_became_active":"2023-11-18T20:59:27.871167+0000","last_became_peered":"2023-11-18T20:59:27.871167+0000","last_unstale":"2023-11-18T21:29:21.067794+0000","last_undegraded":"2023-11-18T21:29:21.067794+0000","last_fullsized":"2023-11-18T21:29:21.067794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2023-11-18T21:29:21.067516+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2023-11-18T21:29:21.067516+0000","last_clean_scrub_stamp":"2023-11-18T21:29:21.067516+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:58:39.715726+0000","scrub_duration":0.0077063610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":448,"num_write":2451,"num_write_kb":251040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2621,"ondisk_log_size":2621,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3577,"ondisk_log_size":3577,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23672018,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":675,"num_read_kb":695,"num_write":9681,"num_write_kb":28189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47595520,"data_stored":47344036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8555,"ondisk_log_size":8555,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509822,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":181032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92900000000000005,"15min":0.89900000000000002},"min":{"1min":0.65500000000000003,"5min":0.377,"15min":0.34799999999999998},"max":{"1min":1.3160000000000001,"5min":1.5589999999999999,"15min":1.7649999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.90300000000000002,"15min":0.93200000000000005},"min":{"1min":0.59699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1919999999999999,"5min":1.4950000000000001,"15min":1.5449999999999999},"last":0.94399999999999995}]},{"osd":1,"last update":"Sat Nov 18 21:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.93000000000000005,"15min":0.92100000000000004},"min":{"1min":0.55700000000000005,"5min":0.374,"15min":0.374},"max":{"1min":1.3919999999999999,"5min":1.6579999999999999,"15min":1.7210000000000001},"last":0.995},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.72999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1359999999999999,"5min":1.4319999999999999,"15min":2.524},"last":1.0860000000000001}]},{"osd":2,"last update":"Sat Nov 18 21:30:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0509999999999999,"15min":1.0449999999999999},"min":{"1min":0.78200000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.498,"5min":1.585,"15min":1.694},"last":1.498},{"interface":"front","average":{"1min":1.0600000000000001,"5min":0.99299999999999999,"15min":1.0129999999999999},"min":{"1min":0.71299999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.284,"5min":1.524,"15min":1.589},"last":1.048}]},{"osd":3,"last update":"Sat Nov 18 21:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.98799999999999999,"15min":0.999},"min":{"1min":0.69099999999999995,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.397,"5min":1.7509999999999999,"15min":1.831},"last":1.194},{"interface":"front","average":{"1min":1.044,"5min":1.036,"15min":1.0489999999999999},"min":{"1min":0.83299999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4690000000000001,"5min":1.627,"15min":2.4430000000000001},"last":1.29}]},{"osd":4,"last update":"Sat Nov 18 21:30:00 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.93500000000000005,"15min":0.95299999999999996},"min":{"1min":0.68100000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.3560000000000001,"5min":1.4299999999999999,"15min":1.601},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.0680000000000001,"15min":1.0629999999999999},"min":{"1min":0.65900000000000003,"5min":0.498,"15min":0.40100000000000002},"max":{"1min":1.5049999999999999,"5min":2.266,"15min":2.266},"last":1.452}]},{"osd":5,"last update":"Sat Nov 18 21:30:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0189999999999999,"15min":1.032},"min":{"1min":0.68999999999999995,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5489999999999999,"5min":1.6799999999999999,"15min":1.7509999999999999},"last":1.397},{"interface":"front","average":{"1min":1.089,"5min":1.099,"15min":1.109},"min":{"1min":0.78100000000000003,"5min":0.437,"15min":0.434},"max":{"1min":1.375,"5min":1.643,"15min":2.0619999999999998},"last":1.2609999999999999}]},{"osd":6,"last update":"Sat Nov 18 21:30:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.131,"15min":1.1539999999999999},"min":{"1min":0.93600000000000005,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.304,"5min":1.7150000000000001,"15min":2.1659999999999999},"last":1.157},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1839999999999999,"15min":1.1830000000000001},"min":{"1min":0.73899999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.585,"5min":2.181,"15min":2.181},"last":1.341}]}]},{"osd":6,"up_from":15,"seq":64424509822,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72804,"kb_used_data":15260,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299036,"statfs":{"total":96636764160,"available":96562212864,"internally_reserved":0,"allocated":15626240,"data_stored":15415703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93600000000000005,"15min":0.91400000000000003},"min":{"1min":0.55800000000000005,"5min":0.312,"15min":0.312},"max":{"1min":1.4590000000000001,"5min":1.52,"15min":1.72},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92300000000000004,"15min":0.95599999999999996},"min":{"1min":0.56999999999999995,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.3799999999999999,"5min":1.597,"15min":1.9950000000000001},"last":1.109}]},{"osd":1,"last update":"Sat Nov 18 21:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.96299999999999997,"15min":0.94599999999999995},"min":{"1min":0.63600000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.887},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.95499999999999996,"15min":0.98899999999999999},"min":{"1min":0.61399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.302,"5min":1.417,"15min":3.73},"last":0.97099999999999997}]},{"osd":2,"last update":"Sat Nov 18 21:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.94099999999999995,"15min":0.95599999999999996},"min":{"1min":0.67300000000000004,"5min":0.51600000000000001,"15min":0.498},"max":{"1min":1.2,"5min":1.48,"15min":1.6459999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0049999999999999,"15min":1.0469999999999999},"min":{"1min":0.751,"5min":0.505,"15min":0.505},"max":{"1min":1.7,"5min":1.8380000000000001,"15min":1.964},"last":0.71799999999999997}]},{"osd":3,"last update":"Sat Nov 18 21:29:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0409999999999999,"15min":1.048},"min":{"1min":0.68600000000000005,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3240000000000001,"5min":1.702,"15min":1.8759999999999999},"last":1.413},{"interface":"front","average":{"1min":0.93799999999999994,"5min":1.01,"15min":1.0589999999999999},"min":{"1min":0.70799999999999996,"5min":0.55400000000000005,"15min":0.42399999999999999},"max":{"1min":1.3480000000000001,"5min":1.665,"15min":3.9889999999999999},"last":0.82499999999999996}]},{"osd":4,"last update":"Sat Nov 18 21:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.004,"15min":1.0309999999999999},"min":{"1min":0.61799999999999999,"5min":0.35099999999999998,"15min":0.318},"max":{"1min":1.554,"5min":1.7529999999999999,"15min":2.1030000000000002},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0800000000000001,"15min":1.1020000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.38900000000000001},"max":{"1min":1.359,"5min":1.782,"15min":1.873},"last":1.2529999999999999}]},{"osd":5,"last update":"Sat Nov 18 21:29:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.03,"15min":1.0640000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.38600000000000001},"max":{"1min":1.24,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.1499999999999999,"15min":1.1759999999999999},"min":{"1min":0.77400000000000002,"5min":0.55000000000000004,"15min":0.35999999999999999},"max":{"1min":1.998,"5min":2.194,"15min":2.3700000000000001},"last":1.042}]},{"osd":7,"last update":"Sat Nov 18 21:29:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.159,"15min":1.1930000000000001},"min":{"1min":0.79000000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3759999999999999,"5min":1.909,"15min":2.1379999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1659999999999999,"15min":1.206},"min":{"1min":0.70799999999999996,"5min":0.57499999999999996,"15min":0.45300000000000001},"max":{"1min":1.4039999999999999,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.1890000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509822,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62884,"kb_used_data":9500,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94308956,"statfs":{"total":96636764160,"available":96572370944,"internally_reserved":0,"allocated":9728000,"data_stored":9504573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.91000000000000003,"15min":0.90900000000000003},"min":{"1min":0.70599999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.88500000000000001},{"interface":"front","average":{"1min":1,"5min":0.92100000000000004,"15min":0.94499999999999995},"min":{"1min":0.54100000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.3200000000000001,"5min":1.496,"15min":2.0600000000000001},"last":1.2909999999999999}]},{"osd":1,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93200000000000005,"15min":0.91900000000000004},"min":{"1min":0.55700000000000005,"5min":0.437,"15min":0.437},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.79},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.94399999999999995,"15min":0.96599999999999997},"min":{"1min":0.71999999999999997,"5min":0.46700000000000003,"15min":0.39700000000000002},"max":{"1min":1.3859999999999999,"5min":1.474,"15min":1.794},"last":1.163}]},{"osd":2,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.93600000000000005,"15min":0.95499999999999996},"min":{"1min":0.56899999999999995,"5min":0.55100000000000005,"15min":0.39500000000000002},"max":{"1min":1.397,"5min":1.4610000000000001,"15min":2.1379999999999999},"last":1.038},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.028,"15min":1.016},"min":{"1min":0.747,"5min":0.626,"15min":0.41199999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.6659999999999999},"last":0.82999999999999996}]},{"osd":3,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.002,"15min":1.024},"min":{"1min":0.77700000000000002,"5min":0.60199999999999998,"15min":0.53700000000000003},"max":{"1min":1.2,"5min":1.4139999999999999,"15min":1.5960000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0509999999999999,"15min":1.0880000000000001},"min":{"1min":0.73099999999999998,"5min":0.51600000000000001,"15min":0.38100000000000001},"max":{"1min":1.468,"5min":1.5449999999999999,"15min":2.2080000000000002},"last":1.2150000000000001}]},{"osd":4,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.97599999999999998,"15min":0.98399999999999999},"min":{"1min":0.52700000000000002,"5min":0.48299999999999998,"15min":0.42699999999999999},"max":{"1min":1.5069999999999999,"5min":1.6279999999999999,"15min":1.9099999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.171,"5min":1.0800000000000001,"15min":1.093},"min":{"1min":0.66000000000000003,"5min":0.501,"15min":0.439},"max":{"1min":1.5,"5min":1.585,"15min":2.4359999999999999},"last":0.995}]},{"osd":6,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.038,"15min":1.0760000000000001},"min":{"1min":0.65300000000000002,"5min":0.41799999999999998,"15min":0.32500000000000001},"max":{"1min":1.546,"5min":1.6299999999999999,"15min":2.2909999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.1100000000000001,"15min":1.1200000000000001},"min":{"1min":0.75600000000000001,"5min":0.60899999999999999,"15min":0.36299999999999999},"max":{"1min":1.6180000000000001,"5min":1.883,"15min":2.0019999999999998},"last":0.92700000000000005}]},{"osd":7,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.1679999999999999,"15min":1.1759999999999999},"min":{"1min":0.76700000000000002,"5min":0.57199999999999995,"15min":0.50700000000000001},"max":{"1min":1.5669999999999999,"5min":1.6839999999999999,"15min":2.0209999999999999},"last":1.323},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1699999999999999,"15min":1.2250000000000001},"min":{"1min":0.68300000000000005,"5min":0.51300000000000001,"15min":0.41499999999999998},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.2789999999999999},"last":1.3640000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509821,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60828,"kb_used_data":7444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311012,"statfs":{"total":96636764160,"available":96574476288,"internally_reserved":0,"allocated":7622656,"data_stored":7382745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.71499999999999997},"min":{"1min":0.34899999999999998,"5min":0.33700000000000002,"15min":0.309},"max":{"1min":1.125,"5min":1.458,"15min":1.458},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.748,"15min":0.76800000000000002},"min":{"1min":0.44500000000000001,"5min":0.30099999999999999,"15min":0.27800000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.605},"last":0.77000000000000002}]},{"osd":1,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.83599999999999997,"15min":0.83799999999999997},"min":{"1min":0.39200000000000002,"5min":0.372,"15min":0.34899999999999998},"max":{"1min":1.593,"5min":1.593,"15min":1.7549999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75800000000000001,"15min":0.76800000000000002},"min":{"1min":0.40999999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.05,"5min":1.629,"15min":1.629},"last":1.2909999999999999}]},{"osd":2,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.99199999999999999,"15min":1.018},"min":{"1min":0.47399999999999998,"5min":0.46800000000000003,"15min":0.42599999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.847},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.97699999999999998,"15min":1.012},"min":{"1min":0.48099999999999998,"5min":0.36699999999999999,"15min":0.32900000000000001},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.794},"last":0.87}]},{"osd":4,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0469999999999999,"15min":1.077},"min":{"1min":0.67100000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.744,"5min":1.744,"15min":2.0630000000000002},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.0349999999999999,"15min":1.056},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.439},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.968},"last":0.91500000000000004}]},{"osd":5,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.105,"15min":1.1140000000000001},"min":{"1min":0.69799999999999995,"5min":0.52700000000000002,"15min":0.45200000000000001},"max":{"1min":1.788,"5min":1.788,"15min":2.1709999999999998},"last":1.165},{"interface":"front","average":{"1min":0.999,"5min":1.0700000000000001,"15min":1.1000000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.304,"5min":1.736,"15min":1.798},"last":1.3779999999999999}]},{"osd":6,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.111,"15min":1.1519999999999999},"min":{"1min":0.64300000000000002,"5min":0.51100000000000001,"15min":0.48599999999999999},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.927},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.117,"15min":1.1419999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5880000000000001,"5min":1.8600000000000001,"15min":1.929},"last":1.0720000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1739999999999999,"15min":1.2070000000000001},"min":{"1min":0.61199999999999999,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.482,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2270000000000001,"15min":1.26},"min":{"1min":0.69199999999999995,"5min":0.68100000000000005,"15min":0.60299999999999998},"max":{"1min":1.7669999999999999,"5min":2.1120000000000001,"15min":2.3719999999999999},"last":1.137}]}]},{"osd":2,"up_from":15,"seq":64424509821,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36000,"kb_used_data":4824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335840,"statfs":{"total":96636764160,"available":96599900160,"internally_reserved":0,"allocated":4939776,"data_stored":4726754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70099999999999996,"15min":0.73399999999999999},"min":{"1min":0.42699999999999999,"5min":0.247,"15min":0.24299999999999999},"max":{"1min":1.151,"5min":1.2829999999999999,"15min":2.04},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.39800000000000002,"5min":0.28999999999999998,"15min":0.27300000000000002},"max":{"1min":1.204,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.73899999999999999}]},{"osd":1,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.84699999999999998,"15min":0.86499999999999999},"min":{"1min":0.42499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.397,"5min":1.5129999999999999,"15min":1.978},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.85099999999999998,"15min":0.88300000000000001},"min":{"1min":0.46500000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.1919999999999999,"5min":1.552,"15min":1.919},"last":1.0109999999999999}]},{"osd":3,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":4.3540000000000001,"5min":1.528,"15min":1.0680000000000001},"min":{"1min":0.45100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":68.629000000000005,"5min":68.629000000000005,"15min":68.629000000000005},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.998,"5min":1.012,"15min":1.0189999999999999},"min":{"1min":0.51900000000000002,"5min":0.32200000000000001,"15min":0.309},"max":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"last":0.80100000000000005}]},{"osd":4,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.079,"15min":1.111},"min":{"1min":0.71499999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.2649999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1180000000000001,"15min":1.1579999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5620000000000001,"5min":2.161,"15min":2.161},"last":1.278}]},{"osd":5,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.2330000000000001,"15min":1.212},"min":{"1min":0.84599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":10.427,"5min":10.427,"15min":10.427},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.1659999999999999,"15min":1.1599999999999999},"min":{"1min":0.78100000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":6.7999999999999998,"5min":6.7999999999999998,"15min":6.7999999999999998},"last":0.95599999999999996}]},{"osd":6,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1399999999999999,"15min":1.1679999999999999},"min":{"1min":0.68700000000000006,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5509999999999999,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.232,"15min":1.2509999999999999},"min":{"1min":0.76100000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.532,"5min":1.994,"15min":2.1800000000000002},"last":0.92200000000000004}]},{"osd":7,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2470000000000001,"15min":1.2869999999999999},"min":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":1.129},{"interface":"front","average":{"1min":1.286,"5min":1.2310000000000001,"15min":1.2529999999999999},"min":{"1min":0.61899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.3570000000000002,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.069}]}]},{"osd":1,"up_from":15,"seq":64424509820,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":966656,"data_stored":748254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.754,"15min":0.746},"min":{"1min":0.51900000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":1.208,"5min":1.359,"15min":1.4330000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78200000000000003,"15min":0.80800000000000005},"min":{"1min":0.41399999999999998,"5min":0.318,"15min":0.318},"max":{"1min":1.0760000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.80900000000000005,"15min":0.80200000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0960000000000001,"5min":1.6859999999999999,"15min":1.706},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.89600000000000002,"15min":0.90700000000000003},"min":{"1min":0.48499999999999999,"5min":0.41599999999999998,"15min":0.35099999999999998},"max":{"1min":1.155,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.84699999999999998}]},{"osd":3,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.44600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.169,"5min":1.7170000000000001,"15min":1.881},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.92700000000000005,"15min":0.95199999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3640000000000001,"5min":1.6519999999999999,"15min":1.73},"last":0.90500000000000003}]},{"osd":4,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":1.0249999999999999,"15min":1.0489999999999999},"min":{"1min":0.505,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.228,"5min":1.6399999999999999,"15min":1.867},"last":0.999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.161,"15min":1.1759999999999999},"min":{"1min":0.60799999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.361,"5min":1.716,"15min":1.9039999999999999},"last":1.4079999999999999}]},{"osd":5,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.129,"15min":1.1579999999999999},"min":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.53200000000000003},"max":{"1min":1.353,"5min":1.8660000000000001,"15min":2.0230000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.103,"15min":1.127},"min":{"1min":0.71399999999999997,"5min":0.59799999999999998,"15min":0.59199999999999997},"max":{"1min":1.28,"5min":1.6819999999999999,"15min":1.8400000000000001},"last":1.1100000000000001}]},{"osd":6,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2669999999999999,"15min":1.266},"min":{"1min":0.81399999999999995,"5min":0.64200000000000002,"15min":0.59999999999999998},"max":{"1min":1.5409999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.1910000000000001,"15min":1.2310000000000001},"min":{"1min":0.624,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.819,"5min":1.8819999999999999,"15min":2.0600000000000001},"last":1.054}]},{"osd":7,"last update":"Sat Nov 18 21:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.2310000000000001,"15min":1.284},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.915,"5min":1.9530000000000001,"15min":2.1389999999999998},"last":1.149},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1899999999999999,"15min":1.2330000000000001},"min":{"1min":0.70399999999999996,"5min":0.66000000000000003,"15min":0.65400000000000003},"max":{"1min":1.4710000000000001,"5min":1.806,"15min":1.988},"last":1.22}]}]},{"osd":0,"up_from":15,"seq":64424509820,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60764,"kb_used_data":7380,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311076,"statfs":{"total":96636764160,"available":96574541824,"internally_reserved":0,"allocated":7557120,"data_stored":7321877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71099999999999997,"15min":0.73699999999999999},"min":{"1min":0.39800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0049999999999999,"5min":1.4750000000000001,"15min":1.7370000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.82599999999999996},"min":{"1min":0.433,"5min":0.34399999999999997,"15min":0.29799999999999999},"max":{"1min":1.149,"5min":1.321,"15min":1.8560000000000001},"last":0.76300000000000001}]},{"osd":2,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.85299999999999998,"15min":0.876},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.29199999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.7190000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.52100000000000002,"5min":0.38500000000000001,"15min":0.317},"max":{"1min":1.0569999999999999,"5min":1.5820000000000001,"15min":1.8959999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.85799999999999998,"15min":0.89100000000000001},"min":{"1min":0.52400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.288,"5min":1.756,"15min":1.869},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.008,"15min":1.0129999999999999},"min":{"1min":0.58899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4059999999999999,"5min":1.6180000000000001,"15min":1.9259999999999999},"last":1.1739999999999999}]},{"osd":4,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0009999999999999,"15min":1.0149999999999999},"min":{"1min":0.68000000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.29,"5min":1.55,"15min":1.9610000000000001},"last":1.119},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.111,"15min":1.1160000000000001},"min":{"1min":0.79500000000000004,"5min":0.59099999999999997,"15min":0.47899999999999998},"max":{"1min":1.339,"5min":2.101,"15min":2.101},"last":1.387}]},{"osd":5,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.115,"15min":1.1599999999999999},"min":{"1min":0.68999999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.478,"5min":1.667,"15min":2.1669999999999998},"last":1.036},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0649999999999999,"15min":1.0940000000000001},"min":{"1min":0.56699999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.282,"5min":1.728,"15min":2.1280000000000001},"last":1.4359999999999999}]},{"osd":6,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.1459999999999999,"15min":1.202},"min":{"1min":0.72399999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.502,"5min":1.9910000000000001,"15min":2.101},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.1759999999999999,"15min":1.2250000000000001},"min":{"1min":0.80100000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5720000000000001,"5min":1.831,"15min":2.2480000000000002},"last":1.25}]},{"osd":7,"last update":"Sat Nov 18 21:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2430000000000001,"15min":1.284},"min":{"1min":0.752,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.623,"5min":1.77,"15min":2.2410000000000001},"last":1.323},{"interface":"front","average":{"1min":1.123,"5min":1.1890000000000001,"15min":1.1910000000000001},"min":{"1min":0.70399999999999996,"5min":0.64400000000000002,"15min":0.60099999999999998},"max":{"1min":1.4450000000000001,"5min":1.972,"15min":1.972},"last":1.54}]}]},{"osd":4,"up_from":14,"seq":60129542524,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35648,"kb_used_data":4472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336192,"statfs":{"total":96636764160,"available":96600260608,"internally_reserved":0,"allocated":4579328,"data_stored":4332954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 21:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.51100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.298,"5min":1.544,"15min":1.544},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.79500000000000004,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":1.341,"5min":1.397,"15min":1.6319999999999999},"last":1.284}]},{"osd":1,"last update":"Sat Nov 18 21:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.89300000000000002,"15min":0.92100000000000004},"min":{"1min":0.60999999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2809999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.94799999999999995,"15min":0.95699999999999996},"min":{"1min":0.73499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.7689999999999999},"last":1.133}]},{"osd":2,"last update":"Sat Nov 18 21:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.95199999999999996,"15min":0.97499999999999998},"min":{"1min":0.64600000000000002,"5min":0.53500000000000003,"15min":0.432},"max":{"1min":1.3340000000000001,"5min":1.613,"15min":1.708},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.99099999999999999,"15min":1.0089999999999999},"min":{"1min":0.59199999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5089999999999999,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":1.054}]},{"osd":3,"last update":"Sat Nov 18 21:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.96299999999999997,"15min":0.98899999999999999},"min":{"1min":0.59699999999999998,"5min":0.52800000000000002,"15min":0.44500000000000001},"max":{"1min":1.204,"5min":1.5349999999999999,"15min":2.2370000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.093,"5min":1.077,"15min":1.1020000000000001},"min":{"1min":0.77000000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3500000000000001,"5min":1.752,"15min":1.8220000000000001},"last":1.1579999999999999}]},{"osd":5,"last update":"Sat Nov 18 21:29:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.97699999999999998,"15min":1.01},"min":{"1min":0.61699999999999999,"5min":0.46500000000000002,"15min":0.38500000000000001},"max":{"1min":1.3360000000000001,"5min":1.6279999999999999,"15min":2.016},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.997,"15min":1.022},"min":{"1min":0.74299999999999999,"5min":0.54600000000000004,"15min":0.34300000000000003},"max":{"1min":1.2569999999999999,"5min":1.5880000000000001,"15min":1.821},"last":1.0960000000000001}]},{"osd":6,"last update":"Sat Nov 18 21:29:55 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0249999999999999,"15min":1.0740000000000001},"min":{"1min":0.63500000000000001,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":1.3839999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.1559999999999999,"15min":1.1970000000000001},"min":{"1min":0.61199999999999999,"5min":0.54000000000000004,"15min":0.44500000000000001},"max":{"1min":1.601,"5min":1.6990000000000001,"15min":2.1230000000000002},"last":1.2310000000000001}]},{"osd":7,"last update":"Sat Nov 18 21:29:55 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1220000000000001,"15min":1.1539999999999999},"min":{"1min":0.752,"5min":0.439,"15min":0.379},"max":{"1min":1.4510000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.204},{"interface":"front","average":{"1min":1.226,"5min":1.216,"15min":1.254},"min":{"1min":0.82799999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.556,"5min":1.996,"15min":2.1160000000000001},"last":1.25}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7225344,"data_stored":7185737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":21746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4608000,"data_stored":4590614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7290880,"data_stored":7246605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4247552,"data_stored":4196814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8802304,"data_stored":8778065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15294464,"data_stored":15279563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":44892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T21:30:04.838 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-18T21:30:05.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.003+0000 7efc99084640 1 Processor -- start 2023-11-18T21:30:05.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.003+0000 7efc99084640 1 -- start start 2023-11-18T21:30:05.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.003+0000 7efc99084640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc94151340 0x7efc9406ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:05.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.003+0000 7efc99084640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9406f4a0 con 0x7efc940c40e0 2023-11-18T21:30:05.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.003+0000 7efc99084640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc94070be0 con 0x7efc94151720 2023-11-18T21:30:05.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.003+0000 7efc99084640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc94072570 con 0x7efc94151340 2023-11-18T21:30:05.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.003+0000 7efc9359e640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efc940c40e0 0x7efc940c70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40616/0 (socket says 172.21.15.49:40616) 2023-11-18T21:30:05.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.003+0000 7efc9359e640 1 -- 172.21.15.49:0/1466812461 learned_addr learned my addr 172.21.15.49:0/1466812461 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:30:05.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.007+0000 7efc9259c640 1 -- 172.21.15.49:0/1466812461 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038526643 0 0) 0x7efc9406f4a0 con 0x7efc940c40e0 2023-11-18T21:30:05.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.007+0000 7efc9259c640 1 -- 172.21.15.49:0/1466812461 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc80003530 con 0x7efc940c40e0 2023-11-18T21:30:05.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.011+0000 7efc9259c640 1 -- 172.21.15.49:0/1466812461 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1997365174 0 0) 0x7efc80003530 con 0x7efc940c40e0 2023-11-18T21:30:05.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.011+0000 7efc9259c640 1 -- 172.21.15.49:0/1466812461 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc94151340 msgr2=0x7efc9406ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:05.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.011+0000 7efc9259c640 1 --2- 172.21.15.49:0/1466812461 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc94151340 0x7efc9406ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:05.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.011+0000 7efc9259c640 1 -- 172.21.15.49:0/1466812461 >> v1:172.21.15.106:6789/0 conn(0x7efc94151720 legacy=0x7efc94157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:05.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.011+0000 7efc9259c640 1 -- 172.21.15.49:0/1466812461 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94070e80 con 0x7efc940c40e0 2023-11-18T21:30:05.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.011+0000 7efc9259c640 1 -- 172.21.15.49:0/1466812461 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7efc8c001a00 con 0x7efc940c40e0 2023-11-18T21:30:05.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.011+0000 7efc9259c640 1 -- 172.21.15.49:0/1466812461 >> v1:172.21.15.49:6789/0 conn(0x7efc940c40e0 legacy=0x7efc940c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:05.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.011+0000 7efc9259c640 1 --2- 172.21.15.49:0/1466812461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc80003a20 0x7efc80003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:05.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.011+0000 7efc9259c640 1 --2- 172.21.15.49:0/1466812461 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc94151340 0x7efc800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:05.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.011+0000 7efc9259c640 1 --2- 172.21.15.49:0/1466812461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80004e30 0x7efc8000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:05.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.011+0000 7efc9259c640 1 -- 172.21.15.49:0/1466812461 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc80005520 con 0x7efc80004e30 2023-11-18T21:30:05.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.011+0000 7efc9259c640 1 -- 172.21.15.49:0/1466812461 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc80005690 con 0x7efc80003a20 2023-11-18T21:30:05.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.011+0000 7efc9259c640 1 -- 172.21.15.49:0/1466812461 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8000bf50 con 0x7efc94151340 2023-11-18T21:30:05.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.011+0000 7efc9359e640 1 --2- 172.21.15.49:0/1466812461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80004e30 0x7efc8000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:05.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.015+0000 7efc92d9d640 1 --2- 172.21.15.49:0/1466812461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc80003a20 0x7efc80003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:05.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.019+0000 7efc9359e640 1 -- 172.21.15.49:0/1466812461 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc94151340 msgr2=0x7efc800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:05.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.019+0000 7efc9359e640 1 --2- 172.21.15.49:0/1466812461 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc94151340 0x7efc800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:05.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.019+0000 7efc9359e640 1 -- 172.21.15.49:0/1466812461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc80003a20 msgr2=0x7efc80003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:05.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.019+0000 7efc9359e640 1 --2- 172.21.15.49:0/1466812461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc80003a20 0x7efc80003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:05.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.019+0000 7efc9359e640 1 -- 172.21.15.49:0/1466812461 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc80003530 con 0x7efc80004e30 2023-11-18T21:30:05.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.027+0000 7efc9359e640 1 --2- 172.21.15.49:0/1466812461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80004e30 0x7efc8000b990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00a810 tx=0x7efc8c01d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb1f16a99fc58ad server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:05.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.127+0000 7efc9259c640 1 -- 172.21.15.49:0/1466812461 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0ad630 con 0x7efc80004e30 2023-11-18T21:30:05.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.127+0000 7efc9259c640 1 -- 172.21.15.49:0/1466812461 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c0a8070 con 0x7efc80004e30 2023-11-18T21:30:05.130 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.131+0000 7efc9259c640 1 -- 172.21.15.49:0/1466812461 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0ad9d0 con 0x7efc80004e30 2023-11-18T21:30:05.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.131+0000 7efc99084640 1 -- 172.21.15.49:0/1466812461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80004e30 msgr2=0x7efc8000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:05.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.131+0000 7efc99084640 1 --2- 172.21.15.49:0/1466812461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80004e30 0x7efc8000b990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00a810 tx=0x7efc8c01d300 comp rx=0 tx=0).stop 2023-11-18T21:30:05.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.131+0000 7efc9359e640 1 -- 172.21.15.49:0/1466812461 reap_dead start 2023-11-18T21:30:05.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.131+0000 7efc99084640 1 -- 172.21.15.49:0/1466812461 shutdown_connections 2023-11-18T21:30:05.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.131+0000 7efc99084640 1 -- 172.21.15.49:0/1466812461 >> 172.21.15.49:0/1466812461 conn(0x7efc9406c6a0 msgr2=0x7efc9406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:05.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.131+0000 7efc99084640 1 -- 172.21.15.49:0/1466812461 shutdown_connections 2023-11-18T21:30:05.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.131+0000 7efc99084640 1 -- 172.21.15.49:0/1466812461 wait complete. 2023-11-18T21:30:05.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.131+0000 7efc99084640 1 Processor -- start 2023-11-18T21:30:05.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.131+0000 7efc99084640 1 -- start start 2023-11-18T21:30:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.135+0000 7efc99084640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80004e30 0x7efc94154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.135+0000 7efc99084640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc9415b120 0x7efc94152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.135+0000 7efc99084640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc94153070 0x7efc9414c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.135+0000 7efc99084640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc94151b20 con 0x7efc80004e30 2023-11-18T21:30:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.135+0000 7efc99084640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc94153520 con 0x7efc94153070 2023-11-18T21:30:05.135 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.135+0000 7efc99084640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc941ef300 con 0x7efc9415b120 2023-11-18T21:30:05.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.135+0000 7efc92d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80004e30 0x7efc94154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:05.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.135+0000 7efc92d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80004e30 0x7efc94154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44896/0 (socket says 172.21.15.49:44896) 2023-11-18T21:30:05.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.135+0000 7efc92d9d640 1 -- 172.21.15.49:0/1974277384 learned_addr learned my addr 172.21.15.49:0/1974277384 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:30:05.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.139+0000 7efc92d9d640 1 -- 172.21.15.49:0/1974277384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc9415b120 msgr2=0x7efc94152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:05.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.139+0000 7efc92d9d640 1 --2- 172.21.15.49:0/1974277384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc9415b120 0x7efc94152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:05.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.139+0000 7efc92d9d640 1 -- 172.21.15.49:0/1974277384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc94153070 msgr2=0x7efc9414c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:05.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.139+0000 7efc92d9d640 1 --2- 172.21.15.49:0/1974277384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc94153070 0x7efc9414c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:05.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.139+0000 7efc92d9d640 1 -- 172.21.15.49:0/1974277384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94151d70 con 0x7efc80004e30 2023-11-18T21:30:05.143 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.143+0000 7efc92d9d640 1 --2- 172.21.15.49:0/1974277384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80004e30 0x7efc94154140 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efc8400d800 tx=0x7efc8400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:05.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.147+0000 7efc8b7fe640 1 -- 172.21.15.49:0/1974277384 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc840095c0 con 0x7efc80004e30 2023-11-18T21:30:05.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.147+0000 7efc8b7fe640 1 -- 172.21.15.49:0/1974277384 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84009740 con 0x7efc80004e30 2023-11-18T21:30:05.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.147+0000 7efc8b7fe640 1 -- 172.21.15.49:0/1974277384 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84009af0 con 0x7efc80004e30 2023-11-18T21:30:05.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.147+0000 7efc99084640 1 -- 172.21.15.49:0/1974277384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc94152050 con 0x7efc80004e30 2023-11-18T21:30:05.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.147+0000 7efc99084640 1 -- 172.21.15.49:0/1974277384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc94152610 con 0x7efc80004e30 2023-11-18T21:30:05.149 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.147+0000 7efc99084640 1 -- 172.21.15.49:0/1974277384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc940c6cb0 con 0x7efc80004e30 2023-11-18T21:30:05.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.415+0000 7efc8b7fe640 1 -- 172.21.15.49:0/1974277384 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efc84009c50 con 0x7efc80004e30 2023-11-18T21:30:05.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.415+0000 7efc8b7fe640 1 --2- 172.21.15.49:0/1974277384 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efc740664f0 0x7efc740689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:05.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.415+0000 7efc8bfff640 1 --2- 172.21.15.49:0/1974277384 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efc740664f0 0x7efc740689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:05.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.419+0000 7efc8bfff640 1 --2- 172.21.15.49:0/1974277384 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efc740664f0 0x7efc740689b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efc7c007fd0 tx=0x7efc7c0079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:05.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.451+0000 7efc8b7fe640 1 -- 172.21.15.49:0/1974277384 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7efc84055b80 con 0x7efc80004e30 2023-11-18T21:30:05.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.451+0000 7efc8b7fe640 1 -- 172.21.15.49:0/1974277384 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc84051ec0 con 0x7efc80004e30 2023-11-18T21:30:05.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.615+0000 7efc99084640 1 -- 172.21.15.49:0/1974277384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7efc94067520 con 0x7efc80004e30 2023-11-18T21:30:05.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.839+0000 7efc8b7fe640 1 -- 172.21.15.49:0/1974277384 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7efc840180c0 con 0x7efc80004e30 2023-11-18T21:30:05.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.839+0000 7efc8b7fe640 1 -- 172.21.15.49:0/1974277384 <== mon.0 v2:172.21.15.49:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efc8405ddd0 con 0x7efc80004e30 2023-11-18T21:30:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.839+0000 7efc99084640 1 -- 172.21.15.49:0/1974277384 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efc740664f0 msgr2=0x7efc740689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.839+0000 7efc99084640 1 --2- 172.21.15.49:0/1974277384 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efc740664f0 0x7efc740689b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efc7c007fd0 tx=0x7efc7c0079a0 comp rx=0 tx=0).stop 2023-11-18T21:30:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.839+0000 7efc99084640 1 -- 172.21.15.49:0/1974277384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80004e30 msgr2=0x7efc94154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.839+0000 7efc99084640 1 --2- 172.21.15.49:0/1974277384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80004e30 0x7efc94154140 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efc8400d800 tx=0x7efc8400dcc0 comp rx=0 tx=0).stop 2023-11-18T21:30:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.839+0000 7efc99084640 1 -- 172.21.15.49:0/1974277384 shutdown_connections 2023-11-18T21:30:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.839+0000 7efc99084640 1 --2- 172.21.15.49:0/1974277384 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7efc740664f0 0x7efc740689b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:05.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.839+0000 7efc99084640 1 --2- 172.21.15.49:0/1974277384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc94153070 0x7efc9414c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:05.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.839+0000 7efc99084640 1 --2- 172.21.15.49:0/1974277384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc9415b120 0x7efc94152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:05.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.839+0000 7efc99084640 1 --2- 172.21.15.49:0/1974277384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc80004e30 0x7efc94154140 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:05.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.839+0000 7efc99084640 1 -- 172.21.15.49:0/1974277384 >> 172.21.15.49:0/1974277384 conn(0x7efc9406c6a0 msgr2=0x7efc9406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:05.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.839+0000 7efc99084640 1 -- 172.21.15.49:0/1974277384 shutdown_connections 2023-11-18T21:30:05.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:05.839+0000 7efc99084640 1 -- 172.21.15.49:0/1974277384 wait complete. 2023-11-18T21:30:05.865 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-18T21:30:05.865 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T21:30:06.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.003+0000 7f4c57498640 1 Processor -- start 2023-11-18T21:30:06.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.003+0000 7f4c57498640 1 -- start start 2023-11-18T21:30:06.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.003+0000 7f4c57498640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c500c4630 0x7f4c500c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:06.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.003+0000 7f4c57498640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4c500c4a10 0x7f4c501596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:06.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.003+0000 7f4c57498640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4c50159c00 0x7f4c5014fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:06.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.003+0000 7f4c57498640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c500c4f40 con 0x7f4c500c4630 2023-11-18T21:30:06.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.003+0000 7f4c57498640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5015a6c0 con 0x7f4c500c4a10 2023-11-18T21:30:06.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.003+0000 7f4c57498640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c501560d0 con 0x7f4c50159c00 2023-11-18T21:30:06.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.003+0000 7f4c55234640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c500c4630 0x7f4c500c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:06.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.003+0000 7f4c55234640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c500c4630 0x7f4c500c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48062/0 (socket says 172.21.15.49:48062) 2023-11-18T21:30:06.004 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.003+0000 7f4c55234640 1 -- 172.21.15.49:0/3442401758 learned_addr learned my addr 172.21.15.49:0/3442401758 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:30:06.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.007+0000 7f4c55234640 1 -- 172.21.15.49:0/3442401758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4c50159c00 msgr2=0x7f4c5014fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:06.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.007+0000 7f4c55234640 1 --2- 172.21.15.49:0/3442401758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4c50159c00 0x7f4c5014fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:06.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.007+0000 7f4c55234640 1 -- 172.21.15.49:0/3442401758 >> v2:172.21.15.106:3300/0 conn(0x7f4c500c4a10 msgr2=0x7f4c501596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:06.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.007+0000 7f4c55234640 1 --2- 172.21.15.49:0/3442401758 >> v2:172.21.15.106:3300/0 conn(0x7f4c500c4a10 0x7f4c501596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:06.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.007+0000 7f4c55234640 1 -- 172.21.15.49:0/3442401758 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c500c72b0 con 0x7f4c500c4630 2023-11-18T21:30:06.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.011+0000 7f4c55234640 1 --2- 172.21.15.49:0/3442401758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c500c4630 0x7f4c500c6d70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4c5006f850 tx=0x7f4c4c020f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b5594e09207a81 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:06.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.019+0000 7f4c47fff640 1 -- 172.21.15.49:0/3442401758 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c0aabe0 con 0x7f4c500c4630 2023-11-18T21:30:06.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.019+0000 7f4c47fff640 1 -- 172.21.15.49:0/3442401758 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4c4c0aad40 con 0x7f4c500c4630 2023-11-18T21:30:06.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.019+0000 7f4c47fff640 1 -- 172.21.15.49:0/3442401758 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c0b2680 con 0x7f4c500c4630 2023-11-18T21:30:06.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.019+0000 7f4c57498640 1 -- 172.21.15.49:0/3442401758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c500c4630 msgr2=0x7f4c500c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:06.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.019+0000 7f4c57498640 1 --2- 172.21.15.49:0/3442401758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c500c4630 0x7f4c500c6d70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4c5006f850 tx=0x7f4c4c020f20 comp rx=0 tx=0).stop 2023-11-18T21:30:06.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.019+0000 7f4c57498640 1 -- 172.21.15.49:0/3442401758 shutdown_connections 2023-11-18T21:30:06.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.019+0000 7f4c57498640 1 --2- 172.21.15.49:0/3442401758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4c50159c00 0x7f4c5014fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:06.021 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.019+0000 7f4c57498640 1 --2- 172.21.15.49:0/3442401758 >> v2:172.21.15.106:3300/0 conn(0x7f4c500c4a10 0x7f4c501596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:06.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.019+0000 7f4c57498640 1 --2- 172.21.15.49:0/3442401758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c500c4630 0x7f4c500c6d70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:06.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.019+0000 7f4c57498640 1 -- 172.21.15.49:0/3442401758 >> 172.21.15.49:0/3442401758 conn(0x7f4c5006c6a0 msgr2=0x7f4c5006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:06.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.019+0000 7f4c57498640 1 -- 172.21.15.49:0/3442401758 shutdown_connections 2023-11-18T21:30:06.022 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.019+0000 7f4c57498640 1 -- 172.21.15.49:0/3442401758 wait complete. 2023-11-18T21:30:06.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.023+0000 7f4c57498640 1 Processor -- start 2023-11-18T21:30:06.023 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.023+0000 7f4c57498640 1 -- start start 2023-11-18T21:30:06.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.023+0000 7f4c57498640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c500c4630 0x7f4c50158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:06.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.023+0000 7f4c57498640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c500c4a10 0x7f4c501ee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:06.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.023+0000 7f4c57498640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4c50159c00 0x7f4c501479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:06.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.023+0000 7f4c57498640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c501eee10 con 0x7f4c500c4630 2023-11-18T21:30:06.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.023+0000 7f4c57498640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50158c20 con 0x7f4c500c4a10 2023-11-18T21:30:06.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.023+0000 7f4c57498640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c501eb420 con 0x7f4c50159c00 2023-11-18T21:30:06.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.027+0000 7f4c55a35640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4c50159c00 0x7f4c501479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:06.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.031+0000 7f4c55a35640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4c50159c00 0x7f4c501479d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:50168/0 (socket says 172.21.15.49:50168) 2023-11-18T21:30:06.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.031+0000 7f4c54a33640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c500c4a10 0x7f4c501ee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:06.030 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.031+0000 7f4c55a35640 1 -- 172.21.15.49:0/882776708 learned_addr learned my addr 172.21.15.49:0/882776708 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:30:06.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.031+0000 7f4c55234640 1 --2- 172.21.15.49:0/882776708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c500c4630 0x7f4c50158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:06.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.035+0000 7f4c54a33640 1 -- 172.21.15.49:0/882776708 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4c50159c00 msgr2=0x7f4c501479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:06.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.035+0000 7f4c54a33640 1 --2- 172.21.15.49:0/882776708 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4c50159c00 0x7f4c501479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:06.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.035+0000 7f4c54a33640 1 -- 172.21.15.49:0/882776708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c500c4630 msgr2=0x7f4c50158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:06.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.035+0000 7f4c54a33640 1 --2- 172.21.15.49:0/882776708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c500c4630 0x7f4c50158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:06.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.035+0000 7f4c54a33640 1 -- 172.21.15.49:0/882776708 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c0094d0 con 0x7f4c500c4a10 2023-11-18T21:30:06.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.039+0000 7f4c54a33640 1 --2- 172.21.15.49:0/882776708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c500c4a10 0x7f4c501ee8d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000b3c0 tx=0x7f4c4000b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:06.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.043+0000 7f4c45ffb640 1 -- 172.21.15.49:0/882776708 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40011830 con 0x7f4c500c4a10 2023-11-18T21:30:06.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.043+0000 7f4c57498640 1 -- 172.21.15.49:0/882776708 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c501eb8b0 con 0x7f4c500c4a10 2023-11-18T21:30:06.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.043+0000 7f4c57498640 1 -- 172.21.15.49:0/882776708 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c501eaaf0 con 0x7f4c500c4a10 2023-11-18T21:30:06.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.043+0000 7f4c57498640 1 -- 172.21.15.49:0/882776708 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c501eb5b0 con 0x7f4c500c4a10 2023-11-18T21:30:06.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.047+0000 7f4c45ffb640 1 -- 172.21.15.49:0/882776708 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4c40009200 con 0x7f4c500c4a10 2023-11-18T21:30:06.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.047+0000 7f4c45ffb640 1 -- 172.21.15.49:0/882776708 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40011bd0 con 0x7f4c500c4a10 2023-11-18T21:30:06.348 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.347+0000 7f4c45ffb640 1 -- 172.21.15.49:0/882776708 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4c40011d30 con 0x7f4c500c4a10 2023-11-18T21:30:06.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.347+0000 7f4c45ffb640 1 --2- 172.21.15.49:0/882776708 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4c340664a0 0x7f4c34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:06.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.347+0000 7f4c55234640 1 --2- 172.21.15.49:0/882776708 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4c340664a0 0x7f4c34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:06.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.351+0000 7f4c55234640 1 --2- 172.21.15.49:0/882776708 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4c340664a0 0x7f4c34068960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0b4000 tx=0x7f4c4c0ac070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:06.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.355+0000 7f4c45ffb640 1 -- 172.21.15.49:0/882776708 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4c40055ec0 con 0x7f4c500c4a10 2023-11-18T21:30:06.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.403+0000 7f4c45ffb640 1 -- 172.21.15.49:0/882776708 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c40055590 con 0x7f4c500c4a10 2023-11-18T21:30:06.608 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.607+0000 7f4c57498640 1 -- 172.21.15.49:0/882776708 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c50067520 con 0x7f4c500c4a10 2023-11-18T21:30:06.822 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.819+0000 7f4c45ffb640 1 -- 172.21.15.49:0/882776708 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+6564 (secure 0 0 0) 0x7f4c40055120 con 0x7f4c500c4a10 2023-11-18T21:30:06.822 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:30:06.822 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1013296856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1013296856},{"type":"v1","addr":"172.21.15.49:6833","nonce":1013296856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:59:27.571192+0000","modified":"2023-11-18T21:29:58.455541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4252,"mds_1":4238,"mds_2":4235,"mds_3":4197,"mds_4":4194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4194":{"gid":4194,"name":"c","rank":4,"incarnation":19,"state":"up:active","state_seq":21,"addr":"172.21.15.49:6835/3397458527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3397458527},{"type":"v1","addr":"172.21.15.49:6835","nonce":3397458527}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4197":{"gid":4197,"name":"d","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.106:6835/2795994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2795994685},{"type":"v1","addr":"172.21.15.106:6835","nonce":2795994685}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4235":{"gid":4235,"name":"f","rank":2,"incarnation":15,"state":"up:active","state_seq":17,"addr":"172.21.15.106:6837/2839781261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":2839781261},{"type":"v1","addr":"172.21.15.106:6837","nonce":2839781261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4238":{"gid":4238,"name":"b","rank":1,"incarnation":11,"state":"up:active","state_seq":16,"addr":"172.21.15.106:6839/957974967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":957974967},{"type":"v1","addr":"172.21.15.106:6839","nonce":957974967}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4252":{"gid":4252,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.49:6837/321839377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":321839377},{"type":"v1","addr":"172.21.15.49:6837","nonce":321839377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T21:30:06.823 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2023-11-18T21:30:06.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.823+0000 7f4c57498640 1 -- 172.21.15.49:0/882776708 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4c340664a0 msgr2=0x7f4c34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:06.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.823+0000 7f4c57498640 1 --2- 172.21.15.49:0/882776708 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4c340664a0 0x7f4c34068960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0b4000 tx=0x7f4c4c0ac070 comp rx=0 tx=0).stop 2023-11-18T21:30:06.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.823+0000 7f4c57498640 1 -- 172.21.15.49:0/882776708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c500c4a10 msgr2=0x7f4c501ee8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:06.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.823+0000 7f4c57498640 1 --2- 172.21.15.49:0/882776708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c500c4a10 0x7f4c501ee8d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000b3c0 tx=0x7f4c4000b880 comp rx=0 tx=0).stop 2023-11-18T21:30:06.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.823+0000 7f4c57498640 1 -- 172.21.15.49:0/882776708 shutdown_connections 2023-11-18T21:30:06.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.823+0000 7f4c57498640 1 --2- 172.21.15.49:0/882776708 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4c340664a0 0x7f4c34068960 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:06.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.823+0000 7f4c57498640 1 --2- 172.21.15.49:0/882776708 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4c50159c00 0x7f4c501479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:06.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.823+0000 7f4c57498640 1 --2- 172.21.15.49:0/882776708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c500c4a10 0x7f4c501ee8d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:06.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.823+0000 7f4c57498640 1 --2- 172.21.15.49:0/882776708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c500c4630 0x7f4c50158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:06.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.823+0000 7f4c57498640 1 -- 172.21.15.49:0/882776708 >> 172.21.15.49:0/882776708 conn(0x7f4c5006c6a0 msgr2=0x7f4c5006ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:06.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.823+0000 7f4c57498640 1 -- 172.21.15.49:0/882776708 shutdown_connections 2023-11-18T21:30:06.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.823+0000 7f4c57498640 1 -- 172.21.15.49:0/882776708 wait complete. 2023-11-18T21:30:06.845 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T21:30:06.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.971+0000 7f00297c9640 1 Processor -- start 2023-11-18T21:30:06.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.971+0000 7f00297c9640 1 -- start start 2023-11-18T21:30:06.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.975+0000 7f00297c9640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0024151720 0x7f002406ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:06.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.975+0000 7f00297c9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f00240c40e0 0x7f00240c4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:06.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.975+0000 7f00297c9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002406f4a0 con 0x7f0024151340 2023-11-18T21:30:06.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.975+0000 7f00297c9640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0024072570 con 0x7f0024151720 2023-11-18T21:30:06.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.975+0000 7f00297c9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0024070be0 con 0x7f00240c40e0 2023-11-18T21:30:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.975+0000 7f00227fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0024151720 0x7f002406ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.975+0000 7f0022ffd640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0024151340 0x7f0024157c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46448/0 (socket says 172.21.15.49:46448) 2023-11-18T21:30:06.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.975+0000 7f0022ffd640 1 -- 172.21.15.49:0/364486735 learned_addr learned my addr 172.21.15.49:0/364486735 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:30:06.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.975+0000 7f00237fe640 1 --2- 172.21.15.49:0/364486735 >> v2:172.21.15.106:3300/0 conn(0x7f00240c40e0 0x7f00240c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:06.981 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.979+0000 7f00227fc640 1 -- 172.21.15.49:0/364486735 >> v2:172.21.15.106:3300/0 conn(0x7f00240c40e0 msgr2=0x7f00240c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:06.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.979+0000 7f00227fc640 1 --2- 172.21.15.49:0/364486735 >> v2:172.21.15.106:3300/0 conn(0x7f00240c40e0 0x7f00240c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:06.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.979+0000 7f00227fc640 1 -- 172.21.15.49:0/364486735 >> v1:172.21.15.49:6789/0 conn(0x7f0024151340 legacy=0x7f0024157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:06.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.979+0000 7f00227fc640 1 -- 172.21.15.49:0/364486735 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0024070e80 con 0x7f0024151720 2023-11-18T21:30:06.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.987+0000 7f00227fc640 1 --2- 172.21.15.49:0/364486735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0024151720 0x7f002406ee10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f002406c1d0 tx=0x7f001401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e8940e8f01a292 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:06.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.991+0000 7f0021ffb640 1 -- 172.21.15.49:0/364486735 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00140a7070 con 0x7f0024151720 2023-11-18T21:30:06.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.991+0000 7f0021ffb640 1 -- 172.21.15.49:0/364486735 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00140ab430 con 0x7f0024151720 2023-11-18T21:30:06.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.991+0000 7f0021ffb640 1 -- 172.21.15.49:0/364486735 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00140ab7e0 con 0x7f0024151720 2023-11-18T21:30:06.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.991+0000 7f00297c9640 1 -- 172.21.15.49:0/364486735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0024151720 msgr2=0x7f002406ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:06.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.991+0000 7f00297c9640 1 --2- 172.21.15.49:0/364486735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0024151720 0x7f002406ee10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f002406c1d0 tx=0x7f001401c430 comp rx=0 tx=0).stop 2023-11-18T21:30:06.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.991+0000 7f00297c9640 1 -- 172.21.15.49:0/364486735 shutdown_connections 2023-11-18T21:30:06.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.991+0000 7f00297c9640 1 --2- 172.21.15.49:0/364486735 >> v2:172.21.15.106:3300/0 conn(0x7f00240c40e0 0x7f00240c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:06.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.991+0000 7f00297c9640 1 --2- 172.21.15.49:0/364486735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0024151720 0x7f002406ee10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:06.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.991+0000 7f00297c9640 1 -- 172.21.15.49:0/364486735 >> 172.21.15.49:0/364486735 conn(0x7f002406c6a0 msgr2=0x7f002406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:06.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.991+0000 7f00297c9640 1 -- 172.21.15.49:0/364486735 shutdown_connections 2023-11-18T21:30:06.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.991+0000 7f00297c9640 1 -- 172.21.15.49:0/364486735 wait complete. 2023-11-18T21:30:06.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.995+0000 7f00297c9640 1 Processor -- start 2023-11-18T21:30:06.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.995+0000 7f00297c9640 1 -- start start 2023-11-18T21:30:06.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.995+0000 7f00297c9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00240c40e0 0x7f0024147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:06.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.995+0000 7f00297c9640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0024151340 0x7f002414fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:06.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.995+0000 7f00297c9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0024151720 0x7f0024148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:06.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.995+0000 7f00297c9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0024146af0 con 0x7f00240c40e0 2023-11-18T21:30:06.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.995+0000 7f00297c9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0024142350 con 0x7f0024151720 2023-11-18T21:30:06.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.995+0000 7f00297c9640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00240c5160 con 0x7f0024151340 2023-11-18T21:30:06.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.995+0000 7f0022ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00240c40e0 0x7f0024147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:06.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.995+0000 7f0022ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00240c40e0 0x7f0024147d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48084/0 (socket says 172.21.15.49:48084) 2023-11-18T21:30:06.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.995+0000 7f0022ffd640 1 -- 172.21.15.49:0/2699421700 learned_addr learned my addr 172.21.15.49:0/2699421700 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:30:06.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.995+0000 7f00237fe640 1 --2- 172.21.15.49:0/2699421700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0024151720 0x7f0024148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:06.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.995+0000 7f00227fc640 1 --2- 172.21.15.49:0/2699421700 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0024151340 0x7f002414fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:07.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.999+0000 7f0022ffd640 1 -- 172.21.15.49:0/2699421700 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0024151340 msgr2=0x7f002414fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:07.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.999+0000 7f0022ffd640 1 --2- 172.21.15.49:0/2699421700 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0024151340 0x7f002414fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:07.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.999+0000 7f0022ffd640 1 -- 172.21.15.49:0/2699421700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0024151720 msgr2=0x7f0024148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:07.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.999+0000 7f0022ffd640 1 --2- 172.21.15.49:0/2699421700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0024151720 0x7f0024148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:07.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:06.999+0000 7f0022ffd640 1 -- 172.21.15.49:0/2699421700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0014009420 con 0x7f00240c40e0 2023-11-18T21:30:07.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.003+0000 7f0022ffd640 1 --2- 172.21.15.49:0/2699421700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00240c40e0 0x7f0024147d30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f001800c500 tx=0x7f001800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:07.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.007+0000 7f000b7fe640 1 -- 172.21.15.49:0/2699421700 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0018005cf0 con 0x7f00240c40e0 2023-11-18T21:30:07.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.007+0000 7f000b7fe640 1 -- 172.21.15.49:0/2699421700 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0018005e50 con 0x7f00240c40e0 2023-11-18T21:30:07.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.007+0000 7f000b7fe640 1 -- 172.21.15.49:0/2699421700 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0018007310 con 0x7f00240c40e0 2023-11-18T21:30:07.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.007+0000 7f00297c9640 1 -- 172.21.15.49:0/2699421700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0024156be0 con 0x7f00240c40e0 2023-11-18T21:30:07.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.007+0000 7f00297c9640 1 -- 172.21.15.49:0/2699421700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00241f0170 con 0x7f00240c40e0 2023-11-18T21:30:07.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.007+0000 7f00297c9640 1 -- 172.21.15.49:0/2699421700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0024067520 con 0x7f00240c40e0 2023-11-18T21:30:07.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.027+0000 7f000b7fe640 1 -- 172.21.15.49:0/2699421700 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0018007470 con 0x7f00240c40e0 2023-11-18T21:30:07.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.027+0000 7f000b7fe640 1 --2- 172.21.15.49:0/2699421700 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0010066470 0x7f0010068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:07.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.027+0000 7f00227fc640 1 --2- 172.21.15.49:0/2699421700 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0010066470 0x7f0010068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.027+0000 7f00227fc640 1 --2- 172.21.15.49:0/2699421700 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0010066470 0x7f0010068930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f00140af000 tx=0x7f00140b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:07.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.027+0000 7f000b7fe640 1 -- 172.21.15.49:0/2699421700 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f0018007720 con 0x7f00240c40e0 2023-11-18T21:30:07.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.307+0000 7f000b7fe640 1 -- 172.21.15.49:0/2699421700 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f00180548b0 con 0x7f00240c40e0 2023-11-18T21:30:07.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.515+0000 7f00297c9640 1 -- 172.21.15.49:0/2699421700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00240ca760 con 0x7f00240c40e0 2023-11-18T21:30:07.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.547+0000 7f000b7fe640 1 -- 172.21.15.49:0/2699421700 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+6564 (secure 0 0 0) 0x7f0018017070 con 0x7f00240c40e0 2023-11-18T21:30:07.549 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:30:07.550 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4191,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1013296856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1013296856},{"type":"v1","addr":"172.21.15.49:6833","nonce":1013296856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T20:59:27.571192+0000","modified":"2023-11-18T21:29:58.455541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4252,"mds_1":4238,"mds_2":4235,"mds_3":4197,"mds_4":4194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4194":{"gid":4194,"name":"c","rank":4,"incarnation":19,"state":"up:active","state_seq":21,"addr":"172.21.15.49:6835/3397458527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3397458527},{"type":"v1","addr":"172.21.15.49:6835","nonce":3397458527}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4197":{"gid":4197,"name":"d","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.106:6835/2795994685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2795994685},{"type":"v1","addr":"172.21.15.106:6835","nonce":2795994685}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4235":{"gid":4235,"name":"f","rank":2,"incarnation":15,"state":"up:active","state_seq":17,"addr":"172.21.15.106:6837/2839781261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":2839781261},{"type":"v1","addr":"172.21.15.106:6837","nonce":2839781261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4238":{"gid":4238,"name":"b","rank":1,"incarnation":11,"state":"up:active","state_seq":16,"addr":"172.21.15.106:6839/957974967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":957974967},{"type":"v1","addr":"172.21.15.106:6839","nonce":957974967}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4252":{"gid":4252,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.49:6837/321839377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":321839377},{"type":"v1","addr":"172.21.15.49:6837","nonce":321839377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T21:30:07.550 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 106 2023-11-18T21:30:07.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.551+0000 7f00297c9640 1 -- 172.21.15.49:0/2699421700 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0010066470 msgr2=0x7f0010068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:07.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.551+0000 7f00297c9640 1 --2- 172.21.15.49:0/2699421700 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0010066470 0x7f0010068930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f00140af000 tx=0x7f00140b6040 comp rx=0 tx=0).stop 2023-11-18T21:30:07.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.551+0000 7f00297c9640 1 -- 172.21.15.49:0/2699421700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00240c40e0 msgr2=0x7f0024147d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:07.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.551+0000 7f00297c9640 1 --2- 172.21.15.49:0/2699421700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00240c40e0 0x7f0024147d30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f001800c500 tx=0x7f001800c9c0 comp rx=0 tx=0).stop 2023-11-18T21:30:07.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.551+0000 7f00297c9640 1 -- 172.21.15.49:0/2699421700 shutdown_connections 2023-11-18T21:30:07.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.551+0000 7f00297c9640 1 --2- 172.21.15.49:0/2699421700 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0010066470 0x7f0010068930 secure :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f00140af000 tx=0x7f00140b6040 comp rx=0 tx=0).stop 2023-11-18T21:30:07.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.551+0000 7f00297c9640 1 --2- 172.21.15.49:0/2699421700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0024151720 0x7f0024148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:07.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.551+0000 7f00297c9640 1 --2- 172.21.15.49:0/2699421700 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0024151340 0x7f002414fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:07.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.551+0000 7f00297c9640 1 --2- 172.21.15.49:0/2699421700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00240c40e0 0x7f0024147d30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:07.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.551+0000 7f00297c9640 1 -- 172.21.15.49:0/2699421700 >> 172.21.15.49:0/2699421700 conn(0x7f002406c6a0 msgr2=0x7f00240735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:07.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.551+0000 7f00297c9640 1 -- 172.21.15.49:0/2699421700 shutdown_connections 2023-11-18T21:30:07.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.551+0000 7f00297c9640 1 -- 172.21.15.49:0/2699421700 wait complete. 2023-11-18T21:30:07.572 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T21:30:07.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.699+0000 7ff7e509a640 1 Processor -- start 2023-11-18T21:30:07.699 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.699+0000 7ff7e509a640 1 -- start start 2023-11-18T21:30:07.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.699+0000 7ff7e509a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7e015cde0 0x7ff7e006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:07.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.699+0000 7ff7e509a640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e006bdf0 con 0x7ff7e015d1c0 2023-11-18T21:30:07.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.699+0000 7ff7e509a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e015d940 con 0x7ff7e00c8890 2023-11-18T21:30:07.700 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.699+0000 7ff7e509a640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e0070520 con 0x7ff7e015cde0 2023-11-18T21:30:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.699+0000 7ff7df59e640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff7e015d1c0 0x7ff7e0153490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46458/0 (socket says 172.21.15.49:46458) 2023-11-18T21:30:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.699+0000 7ff7df59e640 1 -- 172.21.15.49:0/1964489651 learned_addr learned my addr 172.21.15.49:0/1964489651 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:30:07.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.703+0000 7ff7ddd9b640 1 -- 172.21.15.49:0/1964489651 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284825059 0 0) 0x7ff7e006bdf0 con 0x7ff7e015d1c0 2023-11-18T21:30:07.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.703+0000 7ff7ddd9b640 1 -- 172.21.15.49:0/1964489651 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c8003530 con 0x7ff7e015d1c0 2023-11-18T21:30:07.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.707+0000 7ff7ddd9b640 1 -- 172.21.15.49:0/1964489651 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 634385182 0 0) 0x7ff7c8003530 con 0x7ff7e015d1c0 2023-11-18T21:30:07.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.707+0000 7ff7ddd9b640 1 -- 172.21.15.49:0/1964489651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7e015cde0 msgr2=0x7ff7e006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:07.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.707+0000 7ff7ddd9b640 1 --2- 172.21.15.49:0/1964489651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7e015cde0 0x7ff7e006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:07.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.707+0000 7ff7ddd9b640 1 -- 172.21.15.49:0/1964489651 >> v1:172.21.15.106:6789/0 conn(0x7ff7e00c8890 legacy=0x7ff7e00c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:07.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.707+0000 7ff7ddd9b640 1 -- 172.21.15.49:0/1964489651 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e00c7e00 con 0x7ff7e015d1c0 2023-11-18T21:30:07.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.707+0000 7ff7ddd9b640 1 -- 172.21.15.49:0/1964489651 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7ff7d8001a00 con 0x7ff7e015d1c0 2023-11-18T21:30:07.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.707+0000 7ff7ddd9b640 1 -- 172.21.15.49:0/1964489651 >> v1:172.21.15.49:6789/0 conn(0x7ff7e015d1c0 legacy=0x7ff7e0153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:07.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.707+0000 7ff7ddd9b640 1 --2- 172.21.15.49:0/1964489651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7c8003a20 0x7ff7c8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:07.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.707+0000 7ff7ddd9b640 1 --2- 172.21.15.49:0/1964489651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7e015cde0 0x7ff7c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:07.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.707+0000 7ff7ddd9b640 1 --2- 172.21.15.49:0/1964489651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7c8004e30 0x7ff7c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:07.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.707+0000 7ff7ddd9b640 1 -- 172.21.15.49:0/1964489651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e0070520 con 0x7ff7c8003a20 2023-11-18T21:30:07.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.707+0000 7ff7ddd9b640 1 -- 172.21.15.49:0/1964489651 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8005550 con 0x7ff7c8004e30 2023-11-18T21:30:07.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.707+0000 7ff7ddd9b640 1 -- 172.21.15.49:0/1964489651 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c800bed0 con 0x7ff7e015cde0 2023-11-18T21:30:07.711 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.711+0000 7ff7ded9d640 1 --2- 172.21.15.49:0/1964489651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7c8003a20 0x7ff7c8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.715+0000 7ff7ded9d640 1 -- 172.21.15.49:0/1964489651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7e015cde0 msgr2=0x7ff7c80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.715+0000 7ff7ded9d640 1 --2- 172.21.15.49:0/1964489651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7e015cde0 0x7ff7c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:07.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.715+0000 7ff7ded9d640 1 -- 172.21.15.49:0/1964489651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7c8004e30 msgr2=0x7ff7c800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:07.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.715+0000 7ff7ded9d640 1 --2- 172.21.15.49:0/1964489651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7c8004e30 0x7ff7c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:07.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.715+0000 7ff7ded9d640 1 -- 172.21.15.49:0/1964489651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c8003530 con 0x7ff7c8003a20 2023-11-18T21:30:07.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.715+0000 7ff7ded9d640 1 --2- 172.21.15.49:0/1964489651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7c8003a20 0x7ff7c8003e20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009890 tx=0x7ff7d401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06df05fc1cb5dea server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:07.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.723+0000 7ff7ddd9b640 1 -- 172.21.15.49:0/1964489651 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40ab600 con 0x7ff7c8003a20 2023-11-18T21:30:07.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.723+0000 7ff7ddd9b640 1 -- 172.21.15.49:0/1964489651 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff7d40a7050 con 0x7ff7c8003a20 2023-11-18T21:30:07.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.723+0000 7ff7ddd9b640 1 -- 172.21.15.49:0/1964489651 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40aba20 con 0x7ff7c8003a20 2023-11-18T21:30:07.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.723+0000 7ff7e509a640 1 -- 172.21.15.49:0/1964489651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7c8003a20 msgr2=0x7ff7c8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:07.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.723+0000 7ff7e509a640 1 --2- 172.21.15.49:0/1964489651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7c8003a20 0x7ff7c8003e20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009890 tx=0x7ff7d401c370 comp rx=0 tx=0).stop 2023-11-18T21:30:07.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.723+0000 7ff7df59e640 1 -- 172.21.15.49:0/1964489651 reap_dead start 2023-11-18T21:30:07.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.723+0000 7ff7e509a640 1 -- 172.21.15.49:0/1964489651 shutdown_connections 2023-11-18T21:30:07.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.723+0000 7ff7e509a640 1 -- 172.21.15.49:0/1964489651 >> 172.21.15.49:0/1964489651 conn(0x7ff7e0070900 msgr2=0x7ff7e0070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:07.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.723+0000 7ff7e509a640 1 -- 172.21.15.49:0/1964489651 shutdown_connections 2023-11-18T21:30:07.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.723+0000 7ff7e509a640 1 -- 172.21.15.49:0/1964489651 wait complete. 2023-11-18T21:30:07.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.723+0000 7ff7e509a640 1 Processor -- start 2023-11-18T21:30:07.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.723+0000 7ff7e509a640 1 -- start start 2023-11-18T21:30:07.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.727+0000 7ff7e509a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7c8003a20 0x7ff7e0153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:07.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.727+0000 7ff7e509a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7e01527e0 0x7ff7e0150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:07.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.727+0000 7ff7e509a640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7e01f3d80 0x7ff7e01f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:07.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.727+0000 7ff7e509a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e014fef0 con 0x7ff7c8003a20 2023-11-18T21:30:07.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.727+0000 7ff7e509a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e014e320 con 0x7ff7e01527e0 2023-11-18T21:30:07.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.727+0000 7ff7e509a640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e01f4720 con 0x7ff7e01f3d80 2023-11-18T21:30:07.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.727+0000 7ff7ded9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7c8003a20 0x7ff7e0153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:07.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.727+0000 7ff7ded9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7c8003a20 0x7ff7e0153fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48106/0 (socket says 172.21.15.49:48106) 2023-11-18T21:30:07.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.727+0000 7ff7ded9d640 1 -- 172.21.15.49:0/2784336882 learned_addr learned my addr 172.21.15.49:0/2784336882 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:30:07.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.731+0000 7ff7ded9d640 1 -- 172.21.15.49:0/2784336882 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7e01f3d80 msgr2=0x7ff7e01f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:07.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.731+0000 7ff7ded9d640 1 --2- 172.21.15.49:0/2784336882 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7e01f3d80 0x7ff7e01f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:07.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.731+0000 7ff7ded9d640 1 -- 172.21.15.49:0/2784336882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7e01527e0 msgr2=0x7ff7e0150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:07.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.731+0000 7ff7ded9d640 1 --2- 172.21.15.49:0/2784336882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7e01527e0 0x7ff7e0150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:07.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.731+0000 7ff7ded9d640 1 -- 172.21.15.49:0/2784336882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e014e5c0 con 0x7ff7c8003a20 2023-11-18T21:30:07.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.731+0000 7ff7ded9d640 1 --2- 172.21.15.49:0/2784336882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7c8003a20 0x7ff7e0153fb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff7d401cc10 tx=0x7ff7c8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.735+0000 7ff7c77fe640 1 -- 172.21.15.49:0/2784336882 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40ab600 con 0x7ff7c8003a20 2023-11-18T21:30:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.735+0000 7ff7c77fe640 1 -- 172.21.15.49:0/2784336882 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff7d40b4400 con 0x7ff7c8003a20 2023-11-18T21:30:07.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.735+0000 7ff7c77fe640 1 -- 172.21.15.49:0/2784336882 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40b47d0 con 0x7ff7c8003a20 2023-11-18T21:30:07.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.739+0000 7ff7e509a640 1 -- 172.21.15.49:0/2784336882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e014f2e0 con 0x7ff7c8003a20 2023-11-18T21:30:07.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.739+0000 7ff7e509a640 1 -- 172.21.15.49:0/2784336882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e014f8a0 con 0x7ff7c8003a20 2023-11-18T21:30:07.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.739+0000 7ff7e509a640 1 -- 172.21.15.49:0/2784336882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e0073e70 con 0x7ff7c8003a20 2023-11-18T21:30:07.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.759+0000 7ff7c77fe640 1 -- 172.21.15.49:0/2784336882 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff7d40b2040 con 0x7ff7c8003a20 2023-11-18T21:30:07.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.759+0000 7ff7c77fe640 1 --2- 172.21.15.49:0/2784336882 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff7cc0664c0 0x7ff7cc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:07.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.759+0000 7ff7de59c640 1 --2- 172.21.15.49:0/2784336882 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff7cc0664c0 0x7ff7cc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:07.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:07.759+0000 7ff7de59c640 1 --2- 172.21.15.49:0/2784336882 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff7cc0664c0 0x7ff7cc068980 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0007fd0 tx=0x7ff7d00079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:08.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.047+0000 7ff7c77fe640 1 -- 172.21.15.49:0/2784336882 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff7d40efab0 con 0x7ff7c8003a20 2023-11-18T21:30:08.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.047+0000 7ff7c77fe640 1 -- 172.21.15.49:0/2784336882 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff7d40eb660 con 0x7ff7c8003a20 2023-11-18T21:30:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.211+0000 7ff7e509a640 1 -- 172.21.15.49:0/2784336882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7e00cc1a0 con 0x7ff7c8003a20 2023-11-18T21:30:08.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.299+0000 7ff7c77fe640 1 -- 172.21.15.49:0/2784336882 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18408 (secure 0 0 0) 0x7ff7d40b0030 con 0x7ff7c8003a20 2023-11-18T21:30:08.301 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-11-18T21:30:08.301 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":31,"fsid":"4b788c4a-a91a-4c5d-8f44-e74d82d94e56","created":"2023-11-18T20:58:17.608688+0000","modified":"2023-11-18T21:00:28.529922+0000","last_up_change":"2023-11-18T20:58:40.711049+0000","last_in_change":"2023-11-18T20:58:30.808766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T20:58:42.362631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T20:59:22.756454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T20:59:25.252588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T20:59:33.423071+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2e82789c-653c-439e-bcd4-3c0cdef4c063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6801","nonce":53487446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6803","nonce":53487446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6807","nonce":53487446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":53487446},{"type":"v1","addr":"172.21.15.49:6805","nonce":53487446}]},"public_addr":"172.21.15.49:6801/53487446","cluster_addr":"172.21.15.49:6803/53487446","heartbeat_back_addr":"172.21.15.49:6807/53487446","heartbeat_front_addr":"172.21.15.49:6805/53487446","state":["exists","up"]},{"osd":1,"uuid":"c32343bd-4898-436a-b4ec-567e6e297acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6809","nonce":2801920874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6811","nonce":2801920874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6815","nonce":2801920874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2801920874},{"type":"v1","addr":"172.21.15.49:6813","nonce":2801920874}]},"public_addr":"172.21.15.49:6809/2801920874","cluster_addr":"172.21.15.49:6811/2801920874","heartbeat_back_addr":"172.21.15.49:6815/2801920874","heartbeat_front_addr":"172.21.15.49:6813/2801920874","state":["exists","up"]},{"osd":2,"uuid":"f32e9aed-e0ed-46c2-85c7-b425ab0a4948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6817","nonce":3310490448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6819","nonce":3310490448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6823","nonce":3310490448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3310490448},{"type":"v1","addr":"172.21.15.49:6821","nonce":3310490448}]},"public_addr":"172.21.15.49:6817/3310490448","cluster_addr":"172.21.15.49:6819/3310490448","heartbeat_back_addr":"172.21.15.49:6823/3310490448","heartbeat_front_addr":"172.21.15.49:6821/3310490448","state":["exists","up"]},{"osd":3,"uuid":"a7c2f5ac-b626-488c-af87-849bc58080e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6825","nonce":2157206456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6827","nonce":2157206456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6831","nonce":2157206456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2157206456},{"type":"v1","addr":"172.21.15.49:6829","nonce":2157206456}]},"public_addr":"172.21.15.49:6825/2157206456","cluster_addr":"172.21.15.49:6827/2157206456","heartbeat_back_addr":"172.21.15.49:6831/2157206456","heartbeat_front_addr":"172.21.15.49:6829/2157206456","state":["exists","up"]},{"osd":4,"uuid":"821c3fe8-e191-46b9-9423-0894312d43b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6819","nonce":3891839772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6821","nonce":3891839772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6825","nonce":3891839772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3891839772},{"type":"v1","addr":"172.21.15.106:6823","nonce":3891839772}]},"public_addr":"172.21.15.106:6819/3891839772","cluster_addr":"172.21.15.106:6821/3891839772","heartbeat_back_addr":"172.21.15.106:6825/3891839772","heartbeat_front_addr":"172.21.15.106:6823/3891839772","state":["exists","up"]},{"osd":5,"uuid":"5545dbc5-bd88-48b0-bc93-8543097d1f24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6803","nonce":728068152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6805","nonce":728068152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6809","nonce":728068152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":728068152},{"type":"v1","addr":"172.21.15.106:6807","nonce":728068152}]},"public_addr":"172.21.15.106:6803/728068152","cluster_addr":"172.21.15.106:6805/728068152","heartbeat_back_addr":"172.21.15.106:6809/728068152","heartbeat_front_addr":"172.21.15.106:6807/728068152","state":["exists","up"]},{"osd":6,"uuid":"86a4a7ca-400e-4aea-ae0c-360adbf409b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6827","nonce":283622084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6829","nonce":283622084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6833","nonce":283622084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":283622084},{"type":"v1","addr":"172.21.15.106:6831","nonce":283622084}]},"public_addr":"172.21.15.106:6827/283622084","cluster_addr":"172.21.15.106:6829/283622084","heartbeat_back_addr":"172.21.15.106:6833/283622084","heartbeat_front_addr":"172.21.15.106:6831/283622084","state":["exists","up"]},{"osd":7,"uuid":"5031f219-8897-4960-870b-9946c5ab2901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6811","nonce":2002613814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6813","nonce":2002613814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6817","nonce":2002613814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2002613814},{"type":"v1","addr":"172.21.15.106:6815","nonce":2002613814}]},"public_addr":"172.21.15.106:6811/2002613814","cluster_addr":"172.21.15.106:6813/2002613814","heartbeat_back_addr":"172.21.15.106:6817/2002613814","heartbeat_front_addr":"172.21.15.106:6815/2002613814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.645820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.808952+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.836111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.876351+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.035967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.727368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.786119+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T20:58:36.795586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T21:30:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.303+0000 7ff7e509a640 1 -- 172.21.15.49:0/2784336882 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff7cc0664c0 msgr2=0x7ff7cc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.303+0000 7ff7e509a640 1 --2- 172.21.15.49:0/2784336882 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff7cc0664c0 0x7ff7cc068980 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0007fd0 tx=0x7ff7d00079a0 comp rx=0 tx=0).stop 2023-11-18T21:30:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.303+0000 7ff7e509a640 1 -- 172.21.15.49:0/2784336882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7c8003a20 msgr2=0x7ff7e0153fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.303+0000 7ff7e509a640 1 --2- 172.21.15.49:0/2784336882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7c8003a20 0x7ff7e0153fb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff7d401cc10 tx=0x7ff7c8005800 comp rx=0 tx=0).stop 2023-11-18T21:30:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.303+0000 7ff7e509a640 1 -- 172.21.15.49:0/2784336882 shutdown_connections 2023-11-18T21:30:08.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.303+0000 7ff7e509a640 1 --2- 172.21.15.49:0/2784336882 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7ff7cc0664c0 0x7ff7cc068980 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.303+0000 7ff7e509a640 1 --2- 172.21.15.49:0/2784336882 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7e01f3d80 0x7ff7e01f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.303+0000 7ff7e509a640 1 --2- 172.21.15.49:0/2784336882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7e01527e0 0x7ff7e0150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.303+0000 7ff7e509a640 1 --2- 172.21.15.49:0/2784336882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7c8003a20 0x7ff7e0153fb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.303+0000 7ff7e509a640 1 -- 172.21.15.49:0/2784336882 >> 172.21.15.49:0/2784336882 conn(0x7ff7e0070900 msgr2=0x7ff7e006e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.303+0000 7ff7e509a640 1 -- 172.21.15.49:0/2784336882 shutdown_connections 2023-11-18T21:30:08.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.303+0000 7ff7e509a640 1 -- 172.21.15.49:0/2784336882 wait complete. 2023-11-18T21:30:08.324 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-18T21:30:08.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.447+0000 7f2d39280640 1 Processor -- start 2023-11-18T21:30:08.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.447+0000 7f2d39280640 1 -- start start 2023-11-18T21:30:08.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.451+0000 7f2d39280640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d340c4630 0x7f2d340c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:08.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.451+0000 7f2d39280640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d340c4a10 0x7f2d341596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:08.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.451+0000 7f2d39280640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d340c72b0 con 0x7f2d34159c00 2023-11-18T21:30:08.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.451+0000 7f2d39280640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d340c4f40 con 0x7f2d340c4a10 2023-11-18T21:30:08.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.451+0000 7f2d39280640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3415a6c0 con 0x7f2d340c4630 2023-11-18T21:30:08.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.451+0000 7f2d327fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d340c4a10 0x7f2d341596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:08.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.451+0000 7f2d327fc640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d340c4a10 0x7f2d341596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48112/0 (socket says 172.21.15.49:48112) 2023-11-18T21:30:08.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.451+0000 7f2d327fc640 1 -- 172.21.15.49:0/84752854 learned_addr learned my addr 172.21.15.49:0/84752854 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:30:08.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.451+0000 7f2d32ffd640 1 --2- 172.21.15.49:0/84752854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d340c4630 0x7f2d340c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:08.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.455+0000 7f2d327fc640 1 -- 172.21.15.49:0/84752854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d340c4630 msgr2=0x7f2d340c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:08.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.455+0000 7f2d327fc640 1 --2- 172.21.15.49:0/84752854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d340c4630 0x7f2d340c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:08.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.455+0000 7f2d327fc640 1 -- 172.21.15.49:0/84752854 >> v1:172.21.15.106:6789/0 conn(0x7f2d34159c00 legacy=0x7f2d3414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:08.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.455+0000 7f2d327fc640 1 -- 172.21.15.49:0/84752854 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3415a100 con 0x7f2d340c4a10 2023-11-18T21:30:08.464 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.463+0000 7f2d327fc640 1 --2- 172.21.15.49:0/84752854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d340c4a10 0x7f2d341596c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2d280098d0 tx=0x7f2d2801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10017e61641abec1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.475+0000 7f2d31ffb640 1 -- 172.21.15.49:0/84752854 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280a8a10 con 0x7f2d340c4a10 2023-11-18T21:30:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.475+0000 7f2d31ffb640 1 -- 172.21.15.49:0/84752854 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2d280a8b70 con 0x7f2d340c4a10 2023-11-18T21:30:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.475+0000 7f2d31ffb640 1 -- 172.21.15.49:0/84752854 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280b0440 con 0x7f2d340c4a10 2023-11-18T21:30:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.475+0000 7f2d39280640 1 -- 172.21.15.49:0/84752854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d340c4a10 msgr2=0x7f2d341596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.475+0000 7f2d39280640 1 --2- 172.21.15.49:0/84752854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d340c4a10 0x7f2d341596c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2d280098d0 tx=0x7f2d2801ed10 comp rx=0 tx=0).stop 2023-11-18T21:30:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.475+0000 7f2d39280640 1 -- 172.21.15.49:0/84752854 shutdown_connections 2023-11-18T21:30:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.475+0000 7f2d39280640 1 --2- 172.21.15.49:0/84752854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d340c4a10 0x7f2d341596c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.475+0000 7f2d39280640 1 --2- 172.21.15.49:0/84752854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d340c4630 0x7f2d340c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.475+0000 7f2d39280640 1 -- 172.21.15.49:0/84752854 >> 172.21.15.49:0/84752854 conn(0x7f2d3406c6a0 msgr2=0x7f2d3406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.475+0000 7f2d39280640 1 -- 172.21.15.49:0/84752854 shutdown_connections 2023-11-18T21:30:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.475+0000 7f2d39280640 1 -- 172.21.15.49:0/84752854 wait complete. 2023-11-18T21:30:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.479+0000 7f2d39280640 1 Processor -- start 2023-11-18T21:30:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.479+0000 7f2d39280640 1 -- start start 2023-11-18T21:30:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.479+0000 7f2d39280640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d340c4630 0x7f2d34157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.479+0000 7f2d39280640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d340c4a10 0x7f2d341efd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.479+0000 7f2d39280640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d34159c00 0x7f2d341556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.479+0000 7f2d39280640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d341f02d0 con 0x7f2d340c4630 2023-11-18T21:30:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.479+0000 7f2d39280640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34158360 con 0x7f2d340c4a10 2023-11-18T21:30:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.479+0000 7f2d39280640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34158640 con 0x7f2d34159c00 2023-11-18T21:30:08.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.479+0000 7f2d327fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d340c4a10 0x7f2d341efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:08.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.479+0000 7f2d337fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d34159c00 0x7f2d341556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:08.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.483+0000 7f2d32ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d340c4630 0x7f2d34157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:08.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.483+0000 7f2d337fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d34159c00 0x7f2d341556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:50222/0 (socket says 172.21.15.49:50222) 2023-11-18T21:30:08.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.483+0000 7f2d337fe640 1 -- 172.21.15.49:0/3813054799 learned_addr learned my addr 172.21.15.49:0/3813054799 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:30:08.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.487+0000 7f2d32ffd640 1 -- 172.21.15.49:0/3813054799 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d34159c00 msgr2=0x7f2d341556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:08.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.487+0000 7f2d32ffd640 1 --2- 172.21.15.49:0/3813054799 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d34159c00 0x7f2d341556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:08.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.487+0000 7f2d32ffd640 1 -- 172.21.15.49:0/3813054799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d340c4a10 msgr2=0x7f2d341efd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:08.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.487+0000 7f2d32ffd640 1 --2- 172.21.15.49:0/3813054799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d340c4a10 0x7f2d341efd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:08.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.487+0000 7f2d32ffd640 1 -- 172.21.15.49:0/3813054799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d280094d0 con 0x7f2d340c4630 2023-11-18T21:30:08.489 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.487+0000 7f2d32ffd640 1 --2- 172.21.15.49:0/3813054799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d340c4630 0x7f2d34157d20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400e870 tx=0x7f2d2400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:08.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.491+0000 7f2d1b7fe640 1 -- 172.21.15.49:0/3813054799 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d240095d0 con 0x7f2d340c4630 2023-11-18T21:30:08.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.491+0000 7f2d1b7fe640 1 -- 172.21.15.49:0/3813054799 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2d2400c940 con 0x7f2d340c4630 2023-11-18T21:30:08.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.491+0000 7f2d1b7fe640 1 -- 172.21.15.49:0/3813054799 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2400ccd0 con 0x7f2d340c4630 2023-11-18T21:30:08.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.491+0000 7f2d39280640 1 -- 172.21.15.49:0/3813054799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d34158920 con 0x7f2d340c4630 2023-11-18T21:30:08.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.491+0000 7f2d39280640 1 -- 172.21.15.49:0/3813054799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d34154ef0 con 0x7f2d340c4630 2023-11-18T21:30:08.494 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.491+0000 7f2d39280640 1 -- 172.21.15.49:0/3813054799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d34067520 con 0x7f2d340c4630 2023-11-18T21:30:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.515+0000 7f2d1b7fe640 1 -- 172.21.15.49:0/3813054799 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2d24013470 con 0x7f2d340c4630 2023-11-18T21:30:08.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.515+0000 7f2d1b7fe640 1 --2- 172.21.15.49:0/3813054799 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2d200664c0 0x7f2d20068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:08.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.515+0000 7f2d327fc640 1 --2- 172.21.15.49:0/3813054799 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2d200664c0 0x7f2d20068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:08.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.515+0000 7f2d327fc640 1 --2- 172.21.15.49:0/3813054799 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2d200664c0 0x7f2d20068980 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2d280b2000 tx=0x7f2d280aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:08.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.795+0000 7f2d1b7fe640 1 -- 172.21.15.49:0/3813054799 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f2d2400ce30 con 0x7f2d340c4630 2023-11-18T21:30:08.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:08.795+0000 7f2d1b7fe640 1 -- 172.21.15.49:0/3813054799 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2d24051ca0 con 0x7f2d340c4630 2023-11-18T21:30:09.018 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.015+0000 7f2d39280640 1 -- 172.21.15.49:0/3813054799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2d340c5c60 con 0x7f2d340c4630 2023-11-18T21:30:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.411+0000 7f2d1b7fe640 1 -- 172.21.15.49:0/3813054799 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v107) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2d24021020 con 0x7f2d340c4630 2023-11-18T21:30:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-18T21:30:09.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.415+0000 7f2d39280640 1 -- 172.21.15.49:0/3813054799 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2d200664c0 msgr2=0x7f2d20068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:09.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.415+0000 7f2d39280640 1 --2- 172.21.15.49:0/3813054799 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2d200664c0 0x7f2d20068980 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2d280b2000 tx=0x7f2d280aa070 comp rx=0 tx=0).stop 2023-11-18T21:30:09.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.415+0000 7f2d39280640 1 -- 172.21.15.49:0/3813054799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d340c4630 msgr2=0x7f2d34157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:09.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.415+0000 7f2d39280640 1 --2- 172.21.15.49:0/3813054799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d340c4630 0x7f2d34157d20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400e870 tx=0x7f2d2400ed30 comp rx=0 tx=0).stop 2023-11-18T21:30:09.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.415+0000 7f2d39280640 1 -- 172.21.15.49:0/3813054799 shutdown_connections 2023-11-18T21:30:09.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.415+0000 7f2d39280640 1 --2- 172.21.15.49:0/3813054799 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f2d200664c0 0x7f2d20068980 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:09.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.415+0000 7f2d39280640 1 --2- 172.21.15.49:0/3813054799 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2d34159c00 0x7f2d341556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:09.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.415+0000 7f2d39280640 1 --2- 172.21.15.49:0/3813054799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d340c4a10 0x7f2d341efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:09.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.415+0000 7f2d39280640 1 --2- 172.21.15.49:0/3813054799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d340c4630 0x7f2d34157d20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:09.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.415+0000 7f2d39280640 1 -- 172.21.15.49:0/3813054799 >> 172.21.15.49:0/3813054799 conn(0x7f2d3406c6a0 msgr2=0x7f2d3406e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:09.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.415+0000 7f2d39280640 1 -- 172.21.15.49:0/3813054799 shutdown_connections 2023-11-18T21:30:09.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.415+0000 7f2d39280640 1 -- 172.21.15.49:0/3813054799 wait complete. 2023-11-18T21:30:09.437 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-18T21:30:09.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.555+0000 7f4343ece640 1 Processor -- start 2023-11-18T21:30:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.555+0000 7f4343ece640 1 -- start start 2023-11-18T21:30:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.555+0000 7f4343ece640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f433c153390 0x7f433c0c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.555+0000 7f4343ece640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433c15ca10 con 0x7f433c06b210 2023-11-18T21:30:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.555+0000 7f4343ece640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433c159f90 con 0x7f433c15d740 2023-11-18T21:30:09.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.555+0000 7f4343ece640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433c15a250 con 0x7f433c153390 2023-11-18T21:30:09.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.555+0000 7f4341c6a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f433c153390 0x7f433c0c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:09.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.555+0000 7f4341c6a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f433c153390 0x7f433c0c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.49:50636/0 (socket says 172.21.15.49:50636) 2023-11-18T21:30:09.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.555+0000 7f4341c6a640 1 -- 172.21.15.49:0/2083077813 learned_addr learned my addr 172.21.15.49:0/2083077813 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:30:09.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.559+0000 7f4341c6a640 1 -- 172.21.15.49:0/2083077813 >> v1:172.21.15.106:6789/0 conn(0x7f433c15d740 legacy=0x7f433c159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:09.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.559+0000 7f4341c6a640 1 -- 172.21.15.49:0/2083077813 >> v1:172.21.15.49:6789/0 conn(0x7f433c06b210 legacy=0x7f433c0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:09.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.559+0000 7f4341c6a640 1 -- 172.21.15.49:0/2083077813 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c15cc60 con 0x7f433c153390 2023-11-18T21:30:09.568 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.567+0000 7f4341c6a640 1 --2- 172.21.15.49:0/2083077813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f433c153390 0x7f433c0c61f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f43380098a0 tx=0x7f433801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19f626d07707dd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:09.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.575+0000 7f4340c68640 1 -- 172.21.15.49:0/2083077813 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43380ab600 con 0x7f433c153390 2023-11-18T21:30:09.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.575+0000 7f4340c68640 1 -- 172.21.15.49:0/2083077813 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f43380a7050 con 0x7f433c153390 2023-11-18T21:30:09.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.575+0000 7f4340c68640 1 -- 172.21.15.49:0/2083077813 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43380ab9a0 con 0x7f433c153390 2023-11-18T21:30:09.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.575+0000 7f4343ece640 1 -- 172.21.15.49:0/2083077813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f433c153390 msgr2=0x7f433c0c61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:09.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.575+0000 7f4343ece640 1 --2- 172.21.15.49:0/2083077813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f433c153390 0x7f433c0c61f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f43380098a0 tx=0x7f433801c410 comp rx=0 tx=0).stop 2023-11-18T21:30:09.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.575+0000 7f4343ece640 1 -- 172.21.15.49:0/2083077813 shutdown_connections 2023-11-18T21:30:09.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.575+0000 7f4343ece640 1 --2- 172.21.15.49:0/2083077813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f433c153390 0x7f433c0c61f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:09.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.575+0000 7f4343ece640 1 -- 172.21.15.49:0/2083077813 >> 172.21.15.49:0/2083077813 conn(0x7f433c0713a0 msgr2=0x7f433c0717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:09.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.575+0000 7f4343ece640 1 -- 172.21.15.49:0/2083077813 shutdown_connections 2023-11-18T21:30:09.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.575+0000 7f4343ece640 1 -- 172.21.15.49:0/2083077813 wait complete. 2023-11-18T21:30:09.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.579+0000 7f4343ece640 1 Processor -- start 2023-11-18T21:30:09.579 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.579+0000 7f4343ece640 1 -- start start 2023-11-18T21:30:09.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.579+0000 7f4343ece640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f433c06b210 0x7f433c147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:09.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.579+0000 7f4343ece640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f433c153390 0x7f433c1520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:09.580 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.579+0000 7f4343ece640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f433c15d740 0x7f433c1f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.579+0000 7f4343ece640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c1f5790 con 0x7f433c06b210 2023-11-18T21:30:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.579+0000 7f4343ece640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c148500 con 0x7f433c153390 2023-11-18T21:30:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.579+0000 7f4343ece640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433c146070 con 0x7f433c15d740 2023-11-18T21:30:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.579+0000 7f434246b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f433c15d740 0x7f433c1f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.579+0000 7f4341469640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f433c153390 0x7f433c1520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:09.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.579+0000 7f434246b640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f433c15d740 0x7f433c1f5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:50226/0 (socket says 172.21.15.49:50226) 2023-11-18T21:30:09.582 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.579+0000 7f434246b640 1 -- 172.21.15.49:0/3731320773 learned_addr learned my addr 172.21.15.49:0/3731320773 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:30:09.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.587+0000 7f434246b640 1 -- 172.21.15.49:0/3731320773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f433c153390 msgr2=0x7f433c1520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:09.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.587+0000 7f434246b640 1 --2- 172.21.15.49:0/3731320773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f433c153390 0x7f433c1520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:09.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.587+0000 7f434246b640 1 -- 172.21.15.49:0/3731320773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f433c06b210 msgr2=0x7f433c147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:09.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.587+0000 7f434246b640 1 --2- 172.21.15.49:0/3731320773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f433c06b210 0x7f433c147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:09.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.587+0000 7f434246b640 1 -- 172.21.15.49:0/3731320773 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43380094d0 con 0x7f433c15d740 2023-11-18T21:30:09.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.591+0000 7f434246b640 1 --2- 172.21.15.49:0/3731320773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f433c15d740 0x7f433c1f5c20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f433400c780 tx=0x7f433400cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:09.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.595+0000 7f43327fc640 1 -- 172.21.15.49:0/3731320773 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334003d90 con 0x7f433c15d740 2023-11-18T21:30:09.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.595+0000 7f43327fc640 1 -- 172.21.15.49:0/3731320773 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f433400ce30 con 0x7f433c15d740 2023-11-18T21:30:09.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.595+0000 7f4343ece640 1 -- 172.21.15.49:0/3731320773 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c146310 con 0x7f433c15d740 2023-11-18T21:30:09.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.595+0000 7f43327fc640 1 -- 172.21.15.49:0/3731320773 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43340052b0 con 0x7f433c15d740 2023-11-18T21:30:09.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.595+0000 7f4343ece640 1 -- 172.21.15.49:0/3731320773 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433c152b50 con 0x7f433c15d740 2023-11-18T21:30:09.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.599+0000 7f4343ece640 1 -- 172.21.15.49:0/3731320773 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433c073e70 con 0x7f433c15d740 2023-11-18T21:30:09.968 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.967+0000 7f43327fc640 1 -- 172.21.15.49:0/3731320773 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4334005410 con 0x7f433c15d740 2023-11-18T21:30:09.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.967+0000 7f43327fc640 1 --2- 172.21.15.49:0/3731320773 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f43200664c0 0x7f4320068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:09.969 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.967+0000 7f4341c6a640 1 --2- 172.21.15.49:0/3731320773 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f43200664c0 0x7f4320068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:09.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.971+0000 7f4341c6a640 1 --2- 172.21.15.49:0/3731320773 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f43200664c0 0x7f4320068980 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f43380ad000 tx=0x7f4338008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:09.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.971+0000 7f43327fc640 1 -- 172.21.15.49:0/3731320773 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6948+0+0 (secure 0 0 0) 0x7f4334054cc0 con 0x7f433c15d740 2023-11-18T21:30:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:09.991+0000 7f43327fc640 1 -- 172.21.15.49:0/3731320773 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4334051000 con 0x7f433c15d740 2023-11-18T21:30:10.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:10.195+0000 7f4343ece640 1 -- 172.21.15.49:0/3731320773 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f433c1f5900 con 0x7f433c15d740 2023-11-18T21:30:11.602 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.599+0000 7f43327fc640 1 -- 172.21.15.49:0/3731320773 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v108) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4334017020 con 0x7f433c15d740 2023-11-18T21:30:11.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.603+0000 7f4343ece640 1 -- 172.21.15.49:0/3731320773 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f43200664c0 msgr2=0x7f4320068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:11.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.603+0000 7f4343ece640 1 --2- 172.21.15.49:0/3731320773 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f43200664c0 0x7f4320068980 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f43380ad000 tx=0x7f4338008040 comp rx=0 tx=0).stop 2023-11-18T21:30:11.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.603+0000 7f4343ece640 1 -- 172.21.15.49:0/3731320773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f433c15d740 msgr2=0x7f433c1f5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:11.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.603+0000 7f4343ece640 1 --2- 172.21.15.49:0/3731320773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f433c15d740 0x7f433c1f5c20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f433400c780 tx=0x7f433400cc40 comp rx=0 tx=0).stop 2023-11-18T21:30:11.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.603+0000 7f4343ece640 1 -- 172.21.15.49:0/3731320773 shutdown_connections 2023-11-18T21:30:11.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.603+0000 7f4343ece640 1 --2- 172.21.15.49:0/3731320773 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f43200664c0 0x7f4320068980 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:11.605 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.603+0000 7f4343ece640 1 --2- 172.21.15.49:0/3731320773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f433c15d740 0x7f433c1f5c20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:11.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.603+0000 7f4343ece640 1 --2- 172.21.15.49:0/3731320773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f433c153390 0x7f433c1520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:11.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.603+0000 7f4343ece640 1 --2- 172.21.15.49:0/3731320773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f433c06b210 0x7f433c147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:11.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.603+0000 7f4343ece640 1 -- 172.21.15.49:0/3731320773 >> 172.21.15.49:0/3731320773 conn(0x7f433c0713a0 msgr2=0x7f433c0c8050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:11.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.603+0000 7f4343ece640 1 -- 172.21.15.49:0/3731320773 shutdown_connections 2023-11-18T21:30:11.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.603+0000 7f4343ece640 1 -- 172.21.15.49:0/3731320773 wait complete. 2023-11-18T21:30:11.628 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-18T21:30:11.800 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.799+0000 7f4e547e1640 1 Processor -- start 2023-11-18T21:30:11.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.799+0000 7f4e547e1640 1 -- start start 2023-11-18T21:30:11.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.799+0000 7f4e547e1640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4e4c070ab0 0x7f4e4c161190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:11.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.799+0000 7f4e547e1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4c0c3b10 con 0x7f4e4c14f850 2023-11-18T21:30:11.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.799+0000 7f4e547e1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4c0c46b0 con 0x7f4e4c0c1ed0 2023-11-18T21:30:11.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.799+0000 7f4e547e1640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4c14fc30 con 0x7f4e4c070ab0 2023-11-18T21:30:11.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.803+0000 7f4e51d7c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4e4c0c1ed0 0x7f4e4c06e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.49:33594/0 (socket says 172.21.15.49:33594) 2023-11-18T21:30:11.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.803+0000 7f4e51d7c640 1 -- 172.21.15.49:0/3161030439 learned_addr learned my addr 172.21.15.49:0/3161030439 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:30:11.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.807+0000 7f4e5157b640 1 -- 172.21.15.49:0/3161030439 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434397931 0 0) 0x7f4e4c0c46b0 con 0x7f4e4c0c1ed0 2023-11-18T21:30:11.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.807+0000 7f4e5157b640 1 -- 172.21.15.49:0/3161030439 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e38005740 con 0x7f4e4c0c1ed0 2023-11-18T21:30:11.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e5157b640 1 -- 172.21.15.49:0/3161030439 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2660282230 0 0) 0x7f4e38005740 con 0x7f4e4c0c1ed0 2023-11-18T21:30:11.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e5157b640 1 -- 172.21.15.49:0/3161030439 >> v2:172.21.15.49:3300/0 conn(0x7f4e4c070ab0 msgr2=0x7f4e4c161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:11.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e5157b640 1 --2- 172.21.15.49:0/3161030439 >> v2:172.21.15.49:3300/0 conn(0x7f4e4c070ab0 0x7f4e4c161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:11.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e5157b640 1 -- 172.21.15.49:0/3161030439 >> v1:172.21.15.49:6789/0 conn(0x7f4e4c14f850 legacy=0x7f4e4c0c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:11.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e5157b640 1 -- 172.21.15.49:0/3161030439 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c0c11e0 con 0x7f4e4c0c1ed0 2023-11-18T21:30:11.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e5157b640 1 -- 172.21.15.49:0/3161030439 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 345866295 0 0) 0x7f4e3c001680 con 0x7f4e4c0c1ed0 2023-11-18T21:30:11.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e5157b640 1 -- 172.21.15.49:0/3161030439 >> v1:172.21.15.106:6789/0 conn(0x7f4e4c0c1ed0 legacy=0x7f4e4c06e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:11.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e5157b640 1 --2- 172.21.15.49:0/3161030439 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e38005c50 0x7f4e38006050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:11.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e5157b640 1 --2- 172.21.15.49:0/3161030439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e380069e0 0x7f4e38006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:11.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e5157b640 1 --2- 172.21.15.49:0/3161030439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e380075a0 0x7f4e3800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:11.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e5157b640 1 -- 172.21.15.49:0/3161030439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c14fc30 con 0x7f4e380075a0 2023-11-18T21:30:11.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e5157b640 1 -- 172.21.15.49:0/3161030439 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3800e460 con 0x7f4e380069e0 2023-11-18T21:30:11.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e5157b640 1 -- 172.21.15.49:0/3161030439 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3800e620 con 0x7f4e38005c50 2023-11-18T21:30:11.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e5257d640 1 --2- 172.21.15.49:0/3161030439 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e38005c50 0x7f4e38006050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:11.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.815+0000 7f4e51d7c640 1 --2- 172.21.15.49:0/3161030439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e380069e0 0x7f4e38006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:11.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.819+0000 7f4e52d7e640 1 --2- 172.21.15.49:0/3161030439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e380075a0 0x7f4e3800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:11.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.823+0000 7f4e5257d640 1 -- 172.21.15.49:0/3161030439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e380069e0 msgr2=0x7f4e38006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:11.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.823+0000 7f4e5257d640 1 --2- 172.21.15.49:0/3161030439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e380069e0 0x7f4e38006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:11.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.823+0000 7f4e5257d640 1 -- 172.21.15.49:0/3161030439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e380075a0 msgr2=0x7f4e3800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:11.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.823+0000 7f4e5257d640 1 --2- 172.21.15.49:0/3161030439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e380075a0 0x7f4e3800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:11.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.823+0000 7f4e5257d640 1 -- 172.21.15.49:0/3161030439 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e38005740 con 0x7f4e38005c50 2023-11-18T21:30:11.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.823+0000 7f4e52d7e640 1 -- 172.21.15.49:0/3161030439 reap_dead start 2023-11-18T21:30:11.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.827+0000 7f4e5257d640 1 --2- 172.21.15.49:0/3161030439 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e38005c50 0x7f4e38006050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4e48001650 tx=0x7f4e4801c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e2bd1e06512560f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:11.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e5157b640 1 -- 172.21.15.49:0/3161030439 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e48005270 con 0x7f4e38005c50 2023-11-18T21:30:11.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e5157b640 1 -- 172.21.15.49:0/3161030439 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4e480a7070 con 0x7f4e38005c50 2023-11-18T21:30:11.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e5157b640 1 -- 172.21.15.49:0/3161030439 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e48003620 con 0x7f4e38005c50 2023-11-18T21:30:11.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 -- 172.21.15.49:0/3161030439 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e38005c50 msgr2=0x7f4e38006050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:11.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 --2- 172.21.15.49:0/3161030439 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e38005c50 0x7f4e38006050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4e48001650 tx=0x7f4e4801c2c0 comp rx=0 tx=0).stop 2023-11-18T21:30:11.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 -- 172.21.15.49:0/3161030439 shutdown_connections 2023-11-18T21:30:11.840 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 --2- 172.21.15.49:0/3161030439 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e38005c50 0x7f4e38006050 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:11.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 -- 172.21.15.49:0/3161030439 >> 172.21.15.49:0/3161030439 conn(0x7f4e4c06c6a0 msgr2=0x7f4e4c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:11.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 -- 172.21.15.49:0/3161030439 shutdown_connections 2023-11-18T21:30:11.841 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 -- 172.21.15.49:0/3161030439 wait complete. 2023-11-18T21:30:11.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 Processor -- start 2023-11-18T21:30:11.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 -- start start 2023-11-18T21:30:11.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e38005c50 0x7f4e4c0c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:11.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e4c1579b0 0x7f4e4c14da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:11.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e4c14cfe0 0x7f4e4c14d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:11.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c14c7e0 con 0x7f4e4c1579b0 2023-11-18T21:30:11.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c153460 con 0x7f4e4c14cfe0 2023-11-18T21:30:11.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e547e1640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c1eb4d0 con 0x7f4e38005c50 2023-11-18T21:30:11.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e51d7c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e4c1579b0 0x7f4e4c14da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:11.844 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e51d7c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e4c1579b0 0x7f4e4c14da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48140/0 (socket says 172.21.15.49:48140) 2023-11-18T21:30:11.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.839+0000 7f4e51d7c640 1 -- 172.21.15.49:0/2232663744 learned_addr learned my addr 172.21.15.49:0/2232663744 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:30:11.845 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.843+0000 7f4e52d7e640 1 --2- 172.21.15.49:0/2232663744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e4c14cfe0 0x7f4e4c14d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:11.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.843+0000 7f4e5257d640 1 --2- 172.21.15.49:0/2232663744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e38005c50 0x7f4e4c0c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:11.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.843+0000 7f4e51d7c640 1 -- 172.21.15.49:0/2232663744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e38005c50 msgr2=0x7f4e4c0c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:11.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.843+0000 7f4e51d7c640 1 --2- 172.21.15.49:0/2232663744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e38005c50 0x7f4e4c0c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:11.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.843+0000 7f4e51d7c640 1 -- 172.21.15.49:0/2232663744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e4c14cfe0 msgr2=0x7f4e4c14d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:11.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.843+0000 7f4e51d7c640 1 --2- 172.21.15.49:0/2232663744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e4c14cfe0 0x7f4e4c14d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:11.847 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.843+0000 7f4e51d7c640 1 -- 172.21.15.49:0/2232663744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c1eb7b0 con 0x7f4e4c1579b0 2023-11-18T21:30:11.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.847+0000 7f4e51d7c640 1 --2- 172.21.15.49:0/2232663744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e4c1579b0 0x7f4e4c14da80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c007310 tx=0x7f4e3c0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:11.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.855+0000 7f4e42ffd640 1 -- 172.21.15.49:0/2232663744 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c00f7b0 con 0x7f4e4c1579b0 2023-11-18T21:30:11.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.855+0000 7f4e42ffd640 1 -- 172.21.15.49:0/2232663744 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4e3c00f910 con 0x7f4e4c1579b0 2023-11-18T21:30:11.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.855+0000 7f4e42ffd640 1 -- 172.21.15.49:0/2232663744 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c00fca0 con 0x7f4e4c1579b0 2023-11-18T21:30:11.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.855+0000 7f4e547e1640 1 -- 172.21.15.49:0/2232663744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4c14ca30 con 0x7f4e4c1579b0 2023-11-18T21:30:11.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.855+0000 7f4e547e1640 1 -- 172.21.15.49:0/2232663744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c0c78e0 con 0x7f4e4c1579b0 2023-11-18T21:30:11.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.855+0000 7f4e547e1640 1 -- 172.21.15.49:0/2232663744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4c067520 con 0x7f4e4c1579b0 2023-11-18T21:30:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.875+0000 7f4e42ffd640 1 -- 172.21.15.49:0/2232663744 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e3c01d460 con 0x7f4e4c1579b0 2023-11-18T21:30:11.877 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.875+0000 7f4e42ffd640 1 --2- 172.21.15.49:0/2232663744 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4e300664f0 0x7f4e300689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.875+0000 7f4e5257d640 1 --2- 172.21.15.49:0/2232663744 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4e300664f0 0x7f4e300689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:11.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:11.879+0000 7f4e5257d640 1 --2- 172.21.15.49:0/2232663744 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4e300664f0 0x7f4e300689b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4e480aa000 tx=0x7f4e48005040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:12.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.167+0000 7f4e42ffd640 1 -- 172.21.15.49:0/2232663744 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6948+0+0 (secure 0 0 0) 0x7f4e3c0562c0 con 0x7f4e4c1579b0 2023-11-18T21:30:12.167 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.167+0000 7f4e42ffd640 1 -- 172.21.15.49:0/2232663744 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e3c051f00 con 0x7f4e4c1579b0 2023-11-18T21:30:12.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.339+0000 7f4e547e1640 1 -- 172.21.15.49:0/2232663744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4e4c14bcc0 con 0x7f4e4c1579b0 2023-11-18T21:30:12.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.743+0000 7f4e42ffd640 1 -- 172.21.15.49:0/2232663744 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4e3c055520 con 0x7f4e4c1579b0 2023-11-18T21:30:12.746 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2023-11-18T21:30:12.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.747+0000 7f4e547e1640 1 -- 172.21.15.49:0/2232663744 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4e300664f0 msgr2=0x7f4e300689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:12.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.747+0000 7f4e547e1640 1 --2- 172.21.15.49:0/2232663744 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4e300664f0 0x7f4e300689b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4e480aa000 tx=0x7f4e48005040 comp rx=0 tx=0).stop 2023-11-18T21:30:12.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.747+0000 7f4e547e1640 1 -- 172.21.15.49:0/2232663744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e4c1579b0 msgr2=0x7f4e4c14da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:12.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.747+0000 7f4e547e1640 1 --2- 172.21.15.49:0/2232663744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e4c1579b0 0x7f4e4c14da80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c007310 tx=0x7f4e3c0077d0 comp rx=0 tx=0).stop 2023-11-18T21:30:12.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.747+0000 7f4e547e1640 1 -- 172.21.15.49:0/2232663744 shutdown_connections 2023-11-18T21:30:12.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.747+0000 7f4e547e1640 1 --2- 172.21.15.49:0/2232663744 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f4e300664f0 0x7f4e300689b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:12.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.747+0000 7f4e547e1640 1 --2- 172.21.15.49:0/2232663744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e4c14cfe0 0x7f4e4c14d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:12.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.747+0000 7f4e547e1640 1 --2- 172.21.15.49:0/2232663744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e4c1579b0 0x7f4e4c14da80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:12.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.747+0000 7f4e547e1640 1 --2- 172.21.15.49:0/2232663744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4e38005c50 0x7f4e4c0c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:12.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.747+0000 7f4e547e1640 1 -- 172.21.15.49:0/2232663744 >> 172.21.15.49:0/2232663744 conn(0x7f4e4c06c6a0 msgr2=0x7f4e4c0c63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:12.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.747+0000 7f4e547e1640 1 -- 172.21.15.49:0/2232663744 shutdown_connections 2023-11-18T21:30:12.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.747+0000 7f4e547e1640 1 -- 172.21.15.49:0/2232663744 wait complete. 2023-11-18T21:30:12.776 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-18T21:30:12.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.907+0000 7f0fa94b3640 1 Processor -- start 2023-11-18T21:30:12.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.907+0000 7f0fa94b3640 1 -- start start 2023-11-18T21:30:12.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.907+0000 7f0fa94b3640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0fa4157ba0 0x7f0fa40c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:12.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.907+0000 7f0fa94b3640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0fa40c4f80 0x7f0fa40c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:12.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.907+0000 7f0fa94b3640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa40c6920 con 0x7f0fa413d010 2023-11-18T21:30:12.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.907+0000 7f0fa94b3640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa40c5d30 con 0x7f0fa4157ba0 2023-11-18T21:30:12.911 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.907+0000 7f0fa94b3640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa406f710 con 0x7f0fa40c4f80 2023-11-18T21:30:12.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.915+0000 7f0fa37fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0fa40c4f80 0x7f0fa40c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:12.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.915+0000 7f0fa37fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0fa40c4f80 0x7f0fa40c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.49:50242/0 (socket says 172.21.15.49:50242) 2023-11-18T21:30:12.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.915+0000 7f0fa37fe640 1 -- 172.21.15.49:0/3041714536 learned_addr learned my addr 172.21.15.49:0/3041714536 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:30:12.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.919+0000 7f0fa37fe640 1 -- 172.21.15.49:0/3041714536 >> v2:172.21.15.106:3300/0 conn(0x7f0fa4157ba0 msgr2=0x7f0fa40c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:12.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.919+0000 7f0fa37fe640 1 --2- 172.21.15.49:0/3041714536 >> v2:172.21.15.106:3300/0 conn(0x7f0fa4157ba0 0x7f0fa40c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:12.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.919+0000 7f0fa37fe640 1 -- 172.21.15.49:0/3041714536 >> v1:172.21.15.106:6789/0 conn(0x7f0fa413d010 legacy=0x7f0fa406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:12.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.919+0000 7f0fa37fe640 1 -- 172.21.15.49:0/3041714536 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa40c5ff0 con 0x7f0fa40c4f80 2023-11-18T21:30:12.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.923+0000 7f0fa37fe640 1 --2- 172.21.15.49:0/3041714536 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0fa40c4f80 0x7f0fa40c7c90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009870 tx=0x7f0f9c01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5397a264c22d04e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:12.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.927+0000 7f0fa1ffb640 1 -- 172.21.15.49:0/3041714536 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0ab600 con 0x7f0fa40c4f80 2023-11-18T21:30:12.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.927+0000 7f0fa1ffb640 1 -- 172.21.15.49:0/3041714536 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0f9c0ab760 con 0x7f0fa40c4f80 2023-11-18T21:30:12.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.927+0000 7f0fa1ffb640 1 -- 172.21.15.49:0/3041714536 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0abb10 con 0x7f0fa40c4f80 2023-11-18T21:30:12.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.927+0000 7f0fa94b3640 1 -- 172.21.15.49:0/3041714536 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0fa40c4f80 msgr2=0x7f0fa40c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:12.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.927+0000 7f0fa94b3640 1 --2- 172.21.15.49:0/3041714536 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0fa40c4f80 0x7f0fa40c7c90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009870 tx=0x7f0f9c01c440 comp rx=0 tx=0).stop 2023-11-18T21:30:12.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.927+0000 7f0fa94b3640 1 -- 172.21.15.49:0/3041714536 shutdown_connections 2023-11-18T21:30:12.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.927+0000 7f0fa94b3640 1 --2- 172.21.15.49:0/3041714536 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0fa40c4f80 0x7f0fa40c7c90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:12.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.927+0000 7f0fa94b3640 1 --2- 172.21.15.49:0/3041714536 >> v2:172.21.15.106:3300/0 conn(0x7f0fa4157ba0 0x7f0fa40c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:12.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.927+0000 7f0fa94b3640 1 -- 172.21.15.49:0/3041714536 >> 172.21.15.49:0/3041714536 conn(0x7f0fa40713a0 msgr2=0x7f0fa40717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:12.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.927+0000 7f0fa94b3640 1 -- 172.21.15.49:0/3041714536 shutdown_connections 2023-11-18T21:30:12.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.927+0000 7f0fa94b3640 1 -- 172.21.15.49:0/3041714536 wait complete. 2023-11-18T21:30:12.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.931+0000 7f0fa94b3640 1 Processor -- start 2023-11-18T21:30:12.931 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.931+0000 7f0fa94b3640 1 -- start start 2023-11-18T21:30:12.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.931+0000 7f0fa94b3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fa40c4f80 0x7f0fa41f1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:12.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.931+0000 7f0fa94b3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa413d010 0x7f0fa40c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:12.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.931+0000 7f0fa94b3640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0fa4157ba0 0x7f0fa41f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:12.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.931+0000 7f0fa94b3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa415ad80 con 0x7f0fa413d010 2023-11-18T21:30:12.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.931+0000 7f0fa94b3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa41f1280 con 0x7f0fa40c4f80 2023-11-18T21:30:12.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.931+0000 7f0fa94b3640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40c9820 con 0x7f0fa4157ba0 2023-11-18T21:30:12.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.931+0000 7f0fa27fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa413d010 0x7f0fa40c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:12.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.931+0000 7f0fa37fe640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0fa4157ba0 0x7f0fa41f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:12.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.931+0000 7f0fa27fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa413d010 0x7f0fa40c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48146/0 (socket says 172.21.15.49:48146) 2023-11-18T21:30:12.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.931+0000 7f0fa27fc640 1 -- 172.21.15.49:0/1525483777 learned_addr learned my addr 172.21.15.49:0/1525483777 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:30:12.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.935+0000 7f0fa27fc640 1 -- 172.21.15.49:0/1525483777 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0fa4157ba0 msgr2=0x7f0fa41f0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:12.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.935+0000 7f0fa27fc640 1 --2- 172.21.15.49:0/1525483777 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0fa4157ba0 0x7f0fa41f0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:12.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.935+0000 7f0fa27fc640 1 -- 172.21.15.49:0/1525483777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fa40c4f80 msgr2=0x7f0fa41f1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:12.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.935+0000 7f0fa27fc640 1 --2- 172.21.15.49:0/1525483777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fa40c4f80 0x7f0fa41f1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:12.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.935+0000 7f0fa27fc640 1 -- 172.21.15.49:0/1525483777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0094d0 con 0x7f0fa413d010 2023-11-18T21:30:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.939+0000 7f0fa27fc640 1 --2- 172.21.15.49:0/1525483777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa413d010 0x7f0fa40c9cb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00b550 tx=0x7f0f8c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.943+0000 7f0f9b7fe640 1 -- 172.21.15.49:0/1525483777 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c010610 con 0x7f0fa413d010 2023-11-18T21:30:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.943+0000 7f0f9b7fe640 1 -- 172.21.15.49:0/1525483777 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0f8c010790 con 0x7f0fa413d010 2023-11-18T21:30:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.943+0000 7f0f9b7fe640 1 -- 172.21.15.49:0/1525483777 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c010b60 con 0x7f0fa413d010 2023-11-18T21:30:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.943+0000 7f0fa94b3640 1 -- 172.21.15.49:0/1525483777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa40cb020 con 0x7f0fa413d010 2023-11-18T21:30:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.943+0000 7f0fa94b3640 1 -- 172.21.15.49:0/1525483777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa40c91d0 con 0x7f0fa413d010 2023-11-18T21:30:12.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.943+0000 7f0fa94b3640 1 -- 172.21.15.49:0/1525483777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa4067f20 con 0x7f0fa413d010 2023-11-18T21:30:12.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.963+0000 7f0f9b7fe640 1 -- 172.21.15.49:0/1525483777 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0f8c010cc0 con 0x7f0fa413d010 2023-11-18T21:30:12.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.963+0000 7f0f9b7fe640 1 --2- 172.21.15.49:0/1525483777 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0f84066470 0x7f0f84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:12.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.963+0000 7f0fa2ffd640 1 --2- 172.21.15.49:0/1525483777 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0f84066470 0x7f0f84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:12.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:12.967+0000 7f0fa2ffd640 1 --2- 172.21.15.49:0/1525483777 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0f84066470 0x7f0f84068930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400abb0 tx=0x7f0f94009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:13.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:13.255+0000 7f0f9b7fe640 1 -- 172.21.15.49:0/1525483777 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6510+0+0 (secure 0 0 0) 0x7f0f8c0550a0 con 0x7f0fa413d010 2023-11-18T21:30:13.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:13.255+0000 7f0f9b7fe640 1 -- 172.21.15.49:0/1525483777 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0f8c0513e0 con 0x7f0fa413d010 2023-11-18T21:30:13.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:13.411+0000 7f0fa94b3640 1 -- 172.21.15.49:0/1525483777 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0fa4073e70 con 0x7f0fa413d010 2023-11-18T21:30:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.131+0000 7f0f9b7fe640 1 -- 172.21.15.49:0/1525483777 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0f8c0140d0 con 0x7f0fa413d010 2023-11-18T21:30:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2023-11-18T21:30:14.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.135+0000 7f0fa94b3640 1 -- 172.21.15.49:0/1525483777 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0f84066470 msgr2=0x7f0f84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:14.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.135+0000 7f0fa94b3640 1 --2- 172.21.15.49:0/1525483777 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0f84066470 0x7f0f84068930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400abb0 tx=0x7f0f94009250 comp rx=0 tx=0).stop 2023-11-18T21:30:14.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.135+0000 7f0fa94b3640 1 -- 172.21.15.49:0/1525483777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa413d010 msgr2=0x7f0fa40c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:14.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.135+0000 7f0fa94b3640 1 --2- 172.21.15.49:0/1525483777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa413d010 0x7f0fa40c9cb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00b550 tx=0x7f0f8c00ba10 comp rx=0 tx=0).stop 2023-11-18T21:30:14.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.135+0000 7f0fa94b3640 1 -- 172.21.15.49:0/1525483777 shutdown_connections 2023-11-18T21:30:14.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.135+0000 7f0fa94b3640 1 --2- 172.21.15.49:0/1525483777 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7f0f84066470 0x7f0f84068930 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400abb0 tx=0x7f0f94009250 comp rx=0 tx=0).stop 2023-11-18T21:30:14.136 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.135+0000 7f0fa94b3640 1 --2- 172.21.15.49:0/1525483777 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0fa4157ba0 0x7f0fa41f0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:14.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.135+0000 7f0fa94b3640 1 --2- 172.21.15.49:0/1525483777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa413d010 0x7f0fa40c9cb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:14.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.135+0000 7f0fa94b3640 1 --2- 172.21.15.49:0/1525483777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fa40c4f80 0x7f0fa41f1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:14.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.135+0000 7f0fa94b3640 1 -- 172.21.15.49:0/1525483777 >> 172.21.15.49:0/1525483777 conn(0x7f0fa40713a0 msgr2=0x7f0fa413da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:14.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.135+0000 7f0fa94b3640 1 -- 172.21.15.49:0/1525483777 shutdown_connections 2023-11-18T21:30:14.137 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.135+0000 7f0fa94b3640 1 -- 172.21.15.49:0/1525483777 wait complete. 2023-11-18T21:30:14.162 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-18T21:30:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.295+0000 7fba07d60640 1 Processor -- start 2023-11-18T21:30:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.295+0000 7fba07d60640 1 -- start start 2023-11-18T21:30:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.299+0000 7fba07d60640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba000ce0c0 0x7fba000ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.299+0000 7fba07d60640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fba0015a280 0x7fba00163e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.299+0000 7fba07d60640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba000cd9a0 con 0x7fba000cc3c0 2023-11-18T21:30:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.299+0000 7fba07d60640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba000ca550 con 0x7fba0015a280 2023-11-18T21:30:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.299+0000 7fba07d60640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba000ce9e0 con 0x7fba000ce0c0 2023-11-18T21:30:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.299+0000 7fba062fd640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fba0015a280 0x7fba00163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.299+0000 7fba052fb640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fba000cc3c0 0x7fba00159b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46490/0 (socket says 172.21.15.49:46490) 2023-11-18T21:30:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.299+0000 7fba052fb640 1 -- 172.21.15.49:0/3850063648 learned_addr learned my addr 172.21.15.49:0/3850063648 (peer_addr_for_me v1:172.21.15.49:0/0) 2023-11-18T21:30:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.299+0000 7fba05afc640 1 --2- 172.21.15.49:0/3850063648 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba000ce0c0 0x7fba000ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.303+0000 7fba062fd640 1 -- 172.21.15.49:0/3850063648 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba000ce0c0 msgr2=0x7fba000ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T21:30:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.303+0000 7fba062fd640 1 --2- 172.21.15.49:0/3850063648 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba000ce0c0 0x7fba000ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:14.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.303+0000 7fba062fd640 1 -- 172.21.15.49:0/3850063648 >> v1:172.21.15.49:6789/0 conn(0x7fba000cc3c0 legacy=0x7fba00159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:14.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.303+0000 7fba062fd640 1 -- 172.21.15.49:0/3850063648 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba001596c0 con 0x7fba0015a280 2023-11-18T21:30:14.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.307+0000 7fba062fd640 1 --2- 172.21.15.49:0/3850063648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba0015a280 0x7fba00163e50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00097c0 tx=0x7fb9f001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82e6a7addeb3734 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:14.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.311+0000 7fba04afa640 1 -- 172.21.15.49:0/3850063648 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f00ab680 con 0x7fba0015a280 2023-11-18T21:30:14.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.315+0000 7fba04afa640 1 -- 172.21.15.49:0/3850063648 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb9f00ab7e0 con 0x7fba0015a280 2023-11-18T21:30:14.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.315+0000 7fba04afa640 1 -- 172.21.15.49:0/3850063648 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f00abb90 con 0x7fba0015a280 2023-11-18T21:30:14.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.315+0000 7fba07d60640 1 -- 172.21.15.49:0/3850063648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba0015a280 msgr2=0x7fba00163e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:14.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.315+0000 7fba07d60640 1 --2- 172.21.15.49:0/3850063648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba0015a280 0x7fba00163e50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00097c0 tx=0x7fb9f001c480 comp rx=0 tx=0).stop 2023-11-18T21:30:14.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.315+0000 7fba07d60640 1 -- 172.21.15.49:0/3850063648 shutdown_connections 2023-11-18T21:30:14.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.315+0000 7fba07d60640 1 --2- 172.21.15.49:0/3850063648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba0015a280 0x7fba00163e50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:14.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.315+0000 7fba07d60640 1 --2- 172.21.15.49:0/3850063648 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba000ce0c0 0x7fba000ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:14.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.315+0000 7fba07d60640 1 -- 172.21.15.49:0/3850063648 >> 172.21.15.49:0/3850063648 conn(0x7fba000b07c0 msgr2=0x7fba000b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:14.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.315+0000 7fba07d60640 1 -- 172.21.15.49:0/3850063648 shutdown_connections 2023-11-18T21:30:14.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.315+0000 7fba07d60640 1 -- 172.21.15.49:0/3850063648 wait complete. 2023-11-18T21:30:14.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.319+0000 7fba07d60640 1 Processor -- start 2023-11-18T21:30:14.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.319+0000 7fba07d60640 1 -- start start 2023-11-18T21:30:14.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.319+0000 7fba07d60640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba000cc3c0 0x7fba000c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:14.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.319+0000 7fba07d60640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba000ce0c0 0x7fba000b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:14.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.319+0000 7fba07d60640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba0015a280 0x7fba001f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:14.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.319+0000 7fba07d60640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba000c9050 con 0x7fba000ce0c0 2023-11-18T21:30:14.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.319+0000 7fba07d60640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba001f65a0 con 0x7fba000cc3c0 2023-11-18T21:30:14.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.319+0000 7fba07d60640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba000b36a0 con 0x7fba0015a280 2023-11-18T21:30:14.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.319+0000 7fba052fb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba000ce0c0 0x7fba000b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:14.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.319+0000 7fba052fb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba000ce0c0 0x7fba000b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48164/0 (socket says 172.21.15.49:48164) 2023-11-18T21:30:14.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.319+0000 7fba052fb640 1 -- 172.21.15.49:0/276466704 learned_addr learned my addr 172.21.15.49:0/276466704 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-11-18T21:30:14.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.319+0000 7fba05afc640 1 --2- 172.21.15.49:0/276466704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba000cc3c0 0x7fba000c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:14.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.323+0000 7fba062fd640 1 --2- 172.21.15.49:0/276466704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba0015a280 0x7fba001f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.323+0000 7fba052fb640 1 -- 172.21.15.49:0/276466704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba0015a280 msgr2=0x7fba001f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.323+0000 7fba052fb640 1 --2- 172.21.15.49:0/276466704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba0015a280 0x7fba001f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.323+0000 7fba052fb640 1 -- 172.21.15.49:0/276466704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba000cc3c0 msgr2=0x7fba000c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:14.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.323+0000 7fba052fb640 1 --2- 172.21.15.49:0/276466704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba000cc3c0 0x7fba000c41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:14.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.323+0000 7fba052fb640 1 -- 172.21.15.49:0/276466704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f0009420 con 0x7fba000ce0c0 2023-11-18T21:30:14.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.327+0000 7fba052fb640 1 --2- 172.21.15.49:0/276466704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba000ce0c0 0x7fba000b1800 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400c4d0 tx=0x7fb9f400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:14.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.331+0000 7fb9fe7fc640 1 -- 172.21.15.49:0/276466704 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4005cf0 con 0x7fba000ce0c0 2023-11-18T21:30:14.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.331+0000 7fb9fe7fc640 1 -- 172.21.15.49:0/276466704 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb9f4005e50 con 0x7fba000ce0c0 2023-11-18T21:30:14.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.331+0000 7fb9fe7fc640 1 -- 172.21.15.49:0/276466704 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4007290 con 0x7fba000ce0c0 2023-11-18T21:30:14.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.331+0000 7fba07d60640 1 -- 172.21.15.49:0/276466704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba001f6a30 con 0x7fba000ce0c0 2023-11-18T21:30:14.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.331+0000 7fba07d60640 1 -- 172.21.15.49:0/276466704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba001f5c70 con 0x7fba000ce0c0 2023-11-18T21:30:14.333 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.331+0000 7fba07d60640 1 -- 172.21.15.49:0/276466704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba00067520 con 0x7fba000ce0c0 2023-11-18T21:30:14.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.355+0000 7fb9fe7fc640 1 -- 172.21.15.49:0/276466704 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb9f40073f0 con 0x7fba000ce0c0 2023-11-18T21:30:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.355+0000 7fb9fe7fc640 1 --2- 172.21.15.49:0/276466704 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb9ec066470 0x7fb9ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T21:30:14.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.355+0000 7fba05afc640 1 --2- 172.21.15.49:0/276466704 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb9ec066470 0x7fb9ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T21:30:14.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.355+0000 7fba05afc640 1 --2- 172.21.15.49:0/276466704 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb9ec066470 0x7fb9ec068930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80113e0 tx=0x7fb9f800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T21:30:14.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.659+0000 7fb9fe7fc640 1 -- 172.21.15.49:0/276466704 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6067+0+0 (secure 0 0 0) 0x7fb9f4054a20 con 0x7fba000ce0c0 2023-11-18T21:30:14.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.659+0000 7fb9fe7fc640 1 -- 172.21.15.49:0/276466704 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9f4050d60 con 0x7fba000ce0c0 2023-11-18T21:30:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:14.831+0000 7fba07d60640 1 -- 172.21.15.49:0/276466704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fba000c5410 con 0x7fba000ce0c0 2023-11-18T21:30:15.467 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:15.467+0000 7fb9fe7fc640 1 -- 172.21.15.49:0/276466704 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v35) v1 ==== 178+0+0 (secure 0 0 0) 0x7fb9f4017070 con 0x7fba000ce0c0 2023-11-18T21:30:15.467 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data_ec' removed 2023-11-18T21:30:15.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:15.467+0000 7fba07d60640 1 -- 172.21.15.49:0/276466704 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb9ec066470 msgr2=0x7fb9ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:15.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:15.467+0000 7fba07d60640 1 --2- 172.21.15.49:0/276466704 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb9ec066470 0x7fb9ec068930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80113e0 tx=0x7fb9f800b040 comp rx=0 tx=0).stop 2023-11-18T21:30:15.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:15.467+0000 7fba07d60640 1 -- 172.21.15.49:0/276466704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba000ce0c0 msgr2=0x7fba000b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T21:30:15.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:15.467+0000 7fba07d60640 1 --2- 172.21.15.49:0/276466704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba000ce0c0 0x7fba000b1800 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400c4d0 tx=0x7fb9f400c990 comp rx=0 tx=0).stop 2023-11-18T21:30:15.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:15.467+0000 7fba07d60640 1 -- 172.21.15.49:0/276466704 shutdown_connections 2023-11-18T21:30:15.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:15.467+0000 7fba07d60640 1 --2- 172.21.15.49:0/276466704 >> [v2:172.21.15.106:6800/2832976331,v1:172.21.15.106:6801/2832976331] conn(0x7fb9ec066470 0x7fb9ec068930 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:15.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:15.467+0000 7fba07d60640 1 --2- 172.21.15.49:0/276466704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba0015a280 0x7fba001f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:15.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:15.467+0000 7fba07d60640 1 --2- 172.21.15.49:0/276466704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba000ce0c0 0x7fba000b1800 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:15.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:15.467+0000 7fba07d60640 1 --2- 172.21.15.49:0/276466704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba000cc3c0 0x7fba000c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T21:30:15.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:15.467+0000 7fba07d60640 1 -- 172.21.15.49:0/276466704 >> 172.21.15.49:0/276466704 conn(0x7fba000b07c0 msgr2=0x7fba00151bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T21:30:15.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:15.467+0000 7fba07d60640 1 -- 172.21.15.49:0/276466704 shutdown_connections 2023-11-18T21:30:15.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-11-18T21:30:15.467+0000 7fba07d60640 1 -- 172.21.15.49:0/276466704 wait complete. 2023-11-18T21:30:15.495 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-18T21:30:15.495 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-18T21:30:15.495 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:30:15.495 INFO:tasks.ceph.mds.a:Stopped 2023-11-18T21:30:15.496 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-18T21:30:15.496 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:30:15.496 INFO:tasks.ceph.mds.c:Stopped 2023-11-18T21:30:15.496 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-11-18T21:30:15.497 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:30:15.512 INFO:tasks.ceph.mds.e.smithi049.stderr:2023-11-18T21:30:15.499+0000 b9ab640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 43161) UID: 0 2023-11-18T21:30:15.513 INFO:tasks.ceph.mds.e.smithi049.stderr:2023-11-18T21:30:15.503+0000 b9ab640 -1 mds.e *** got signal Terminated *** 2023-11-18T21:30:17.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-18T21:30:17.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-18T21:30:17.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2023-11-18T21:30:21.598 INFO:tasks.ceph.mds.e:Stopped 2023-11-18T21:30:21.598 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-18T21:30:21.598 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:30:21.598 INFO:tasks.ceph.mds.b:Stopped 2023-11-18T21:30:21.599 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-18T21:30:21.599 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:30:21.599 INFO:tasks.ceph.mds.d:Stopped 2023-11-18T21:30:21.599 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-11-18T21:30:21.599 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:30:21.599 INFO:tasks.ceph.mds.f:Stopped 2023-11-18T21:30:21.599 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-18T21:30:21.600 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-18T21:30:21.600 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:30:21.601 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-11-18T21:30:21.599+0000 7fc1f8090640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 38360) UID: 0 2023-11-18T21:30:21.601 INFO:tasks.ceph.osd.0.smithi049.stderr:2023-11-18T21:30:21.599+0000 7fc1f8090640 -1 osd.0 36 *** Got signal Terminated *** 2023-11-18T21:30:24.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-18T21:30:24.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-18T21:30:24.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2023-11-18T21:30:27.701 INFO:tasks.ceph.osd.0:Stopped 2023-11-18T21:30:27.701 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-18T21:30:27.702 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:30:27.703 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-11-18T21:30:27.703+0000 7f782161a640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 38362) UID: 0 2023-11-18T21:30:27.703 INFO:tasks.ceph.osd.1.smithi049.stderr:2023-11-18T21:30:27.703+0000 7f782161a640 -1 osd.1 37 *** Got signal Terminated *** 2023-11-18T21:30:33.244 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:30:33.247 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:30:33.803 INFO:tasks.ceph.osd.1:Stopped 2023-11-18T21:30:33.803 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-18T21:30:33.804 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:30:33.805 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-11-18T21:30:33.802+0000 7f7b67998640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 38364) UID: 0 2023-11-18T21:30:33.805 INFO:tasks.ceph.osd.2.smithi049.stderr:2023-11-18T21:30:33.802+0000 7f7b67998640 -1 osd.2 39 *** Got signal Terminated *** 2023-11-18T21:30:39.905 INFO:tasks.ceph.osd.2:Stopped 2023-11-18T21:30:39.906 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-18T21:30:39.906 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:30:39.907 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-11-18T21:30:39.906+0000 7f5c704f5640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 38367) UID: 0 2023-11-18T21:30:39.907 INFO:tasks.ceph.osd.3.smithi049.stderr:2023-11-18T21:30:39.906+0000 7f5c704f5640 -1 osd.3 40 *** Got signal Terminated *** 2023-11-18T21:30:46.009 INFO:tasks.ceph.osd.3:Stopped 2023-11-18T21:30:46.009 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-18T21:30:46.009 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:30:46.010 INFO:tasks.ceph.osd.4.smithi106.stderr:2023-11-18T21:30:46.009+0000 7f09de7ff640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 38680) UID: 0 2023-11-18T21:30:46.010 INFO:tasks.ceph.osd.4.smithi106.stderr:2023-11-18T21:30:46.009+0000 7f09de7ff640 -1 osd.4 41 *** Got signal Terminated *** 2023-11-18T21:30:48.485 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:32:48.529 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:48.509 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:32:48.552 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:48.630 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:32:48.618 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:48.763 INFO:tasks.ceph.mon.a.smithi049.stderr:==00:00:32:48.806 38247== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:48.804 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:32:48.794 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:48.842 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:32:48.830 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:48.867 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:32:48.856 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:49.099 INFO:tasks.ceph.mon.c.smithi106.stderr:==00:00:32:49.087 38286== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:49.101 INFO:tasks.ceph.mon.b.smithi106.stderr:==00:00:32:49.091 38284== Warning: unimplemented fcntl command: 1036 2023-11-18T21:30:52.110 INFO:tasks.ceph.osd.4:Stopped 2023-11-18T21:30:52.111 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-18T21:30:52.111 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:30:52.112 INFO:tasks.ceph.osd.5.smithi106.stderr:2023-11-18T21:30:52.113+0000 7f3171ee4640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 38682) UID: 0 2023-11-18T21:30:52.112 INFO:tasks.ceph.osd.5.smithi106.stderr:2023-11-18T21:30:52.113+0000 7f3171ee4640 -1 osd.5 42 *** Got signal Terminated *** 2023-11-18T21:30:58.213 INFO:tasks.ceph.osd.5:Stopped 2023-11-18T21:30:58.213 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-18T21:30:58.213 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:30:58.214 INFO:tasks.ceph.osd.6.smithi106.stderr:2023-11-18T21:30:58.217+0000 7f4709e08640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 38684) UID: 0 2023-11-18T21:30:58.215 INFO:tasks.ceph.osd.6.smithi106.stderr:2023-11-18T21:30:58.217+0000 7f4709e08640 -1 osd.6 43 *** Got signal Terminated *** 2023-11-18T21:30:59.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-18T21:31:03.318 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:31:03.321 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:31:04.315 INFO:tasks.ceph.osd.6:Stopped 2023-11-18T21:31:04.315 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-18T21:31:04.315 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:31:04.316 INFO:tasks.ceph.osd.7.smithi106.stderr:2023-11-18T21:31:04.316+0000 7f070c447640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 38686) UID: 0 2023-11-18T21:31:04.317 INFO:tasks.ceph.osd.7.smithi106.stderr:2023-11-18T21:31:04.316+0000 7f070c447640 -1 osd.7 43 *** Got signal Terminated *** 2023-11-18T21:31:05.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-18T21:31:10.417 INFO:tasks.ceph.osd.7:Stopped 2023-11-18T21:31:10.417 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-18T21:31:10.417 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-18T21:31:10.417 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:31:10.445 INFO:tasks.ceph.mgr.y:Stopped 2023-11-18T21:31:10.445 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-18T21:31:10.445 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:31:10.447 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T21:31:10.444+0000 7f53f433c640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 38282) UID: 0 2023-11-18T21:31:10.447 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-11-18T21:31:10.444+0000 7f53f433c640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-11-18T21:31:10.474 INFO:tasks.ceph.mgr.x:Stopped 2023-11-18T21:31:10.475 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-18T21:31:10.475 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-18T21:31:10.475 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:31:10.509 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-11-18T21:31:10.489+0000 a345640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 38244) UID: 0 2023-11-18T21:31:10.510 INFO:tasks.ceph.mon.a.smithi049.stderr:2023-11-18T21:31:10.489+0000 a345640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-18T21:31:10.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-18T21:31:15.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-11-18T21:31:15.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-18T21:31:16.576 INFO:tasks.ceph.mon.a:Stopped 2023-11-18T21:31:16.576 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-18T21:31:16.577 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:31:16.594 INFO:tasks.ceph.mon.b.smithi106.stderr:2023-11-18T21:31:16.580+0000 a345640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 38277) UID: 0 2023-11-18T21:31:16.595 INFO:tasks.ceph.mon.b.smithi106.stderr:2023-11-18T21:31:16.580+0000 a345640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-11-18T21:31:20.931 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-11-18T21:31:20.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-11-18T21:31:22.678 INFO:tasks.ceph.mon.b:Stopped 2023-11-18T21:31:22.679 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-18T21:31:22.679 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T21:31:22.732 INFO:tasks.ceph.mon.c.smithi106.stderr:2023-11-18T21:31:22.688+0000 a345640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 38280) UID: 0 2023-11-18T21:31:22.733 INFO:tasks.ceph.mon.c.smithi106.stderr:2023-11-18T21:31:22.692+0000 a345640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2023-11-18T21:31:25.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-11-18T21:31:25.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-11-18T21:31:28.780 INFO:tasks.ceph.mon.c:Stopped 2023-11-18T21:31:28.781 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-18T21:31:28.781 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-11-18T21:31:28.798 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-18T21:31:28.799 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-18T21:31:29.010 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-18T21:31:29.010 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-18T21:31:29.212 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-18T21:31:29.212 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-18T21:31:29.395 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi049.front.sepia.ceph.com 2023-11-18T21:31:30.138 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-18T21:31:30.315 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-18T21:31:30.316 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-18T21:31:30.545 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-18T21:31:30.545 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-18T21:31:30.729 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-18T21:31:30.729 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-18T21:31:30.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-11-18T21:31:30.945 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-18T21:31:30.945 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-18T21:31:31.111 INFO:tasks.ceph:Archiving mon data... 2023-11-18T21:31:31.112 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694/data/mon.a.tgz 2023-11-18T21:31:31.112 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2023-11-18T21:31:31.118 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.wSq2348a5H 2023-11-18T21:31:31.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.wSq2348a5H 2023-11-18T21:31:31.239 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.wSq2348a5H 2023-11-18T21:31:31.303 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.wSq2348a5H is 330KB 2023-11-18T21:31:31.365 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.wSq2348a5H 2023-11-18T21:31:31.371 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694/data/mon.b.tgz 2023-11-18T21:31:31.371 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2023-11-18T21:31:31.377 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.8c6hDKnMbP 2023-11-18T21:31:31.377 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8c6hDKnMbP 2023-11-18T21:31:31.504 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.8c6hDKnMbP 2023-11-18T21:31:31.567 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.8c6hDKnMbP is 331KB 2023-11-18T21:31:31.626 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.8c6hDKnMbP 2023-11-18T21:31:31.630 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694/data/mon.c.tgz 2023-11-18T21:31:31.630 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2023-11-18T21:31:31.675 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.kwTIouY7kx 2023-11-18T21:31:31.676 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.kwTIouY7kx 2023-11-18T21:31:31.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.kwTIouY7kx 2023-11-18T21:31:31.864 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.kwTIouY7kx is 331KB 2023-11-18T21:31:31.922 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.kwTIouY7kx 2023-11-18T21:31:31.927 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-18T21:31:31.927 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-18T21:31:31.930 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-18T21:31:31.986 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-18T21:31:31.986 DEBUG:teuthology.orchestra.run.smithi049:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-18T21:31:31.988 DEBUG:teuthology.orchestra.run.smithi106:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-18T21:31:32.026 INFO:teuthology.orchestra.run.smithi049.stdout:/var/log/ceph/valgrind/client.0.log: Leak_StillReachable 2023-11-18T21:31:32.027 INFO:teuthology.orchestra.run.smithi049.stdout:/var/log/ceph/valgrind/mds.a.log: Leak_PossiblyLost 2023-11-18T21:31:32.027 INFO:teuthology.orchestra.run.smithi049.stdout:/var/log/ceph/valgrind/mds.c.log: Leak_PossiblyLost 2023-11-18T21:31:32.027 INFO:teuthology.orchestra.run.smithi049.stdout:/var/log/ceph/valgrind/mon.a.log: Leak_StillReachable 2023-11-18T21:31:32.029 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/client.0.log kind Leak_StillReachable 2023-11-18T21:31:32.029 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/client.0.log 2023-11-18T21:31:32.029 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.a.log kind Leak_PossiblyLost 2023-11-18T21:31:32.029 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.c.log kind Leak_PossiblyLost 2023-11-18T21:31:32.029 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.a.log kind Leak_StillReachable 2023-11-18T21:31:32.030 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.a.log 2023-11-18T21:31:32.059 INFO:teuthology.orchestra.run.smithi106.stdout:/var/log/ceph/valgrind/mds.b.log: Leak_PossiblyLost 2023-11-18T21:31:32.060 INFO:teuthology.orchestra.run.smithi106.stdout:/var/log/ceph/valgrind/mds.d.log: Leak_PossiblyLost 2023-11-18T21:31:32.060 INFO:teuthology.orchestra.run.smithi106.stdout:/var/log/ceph/valgrind/mds.f.log: Leak_PossiblyLost 2023-11-18T21:31:32.060 INFO:teuthology.orchestra.run.smithi106.stdout:/var/log/ceph/valgrind/mon.b.log: Leak_StillReachable 2023-11-18T21:31:32.060 INFO:teuthology.orchestra.run.smithi106.stdout:/var/log/ceph/valgrind/mon.c.log: Leak_StillReachable 2023-11-18T21:31:32.060 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.b.log kind Leak_PossiblyLost 2023-11-18T21:31:32.060 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.d.log kind Leak_PossiblyLost 2023-11-18T21:31:32.060 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.f.log kind Leak_PossiblyLost 2023-11-18T21:31:32.060 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.b.log kind Leak_StillReachable 2023-11-18T21:31:32.060 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.b.log 2023-11-18T21:31:32.060 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.c.log kind Leak_StillReachable 2023-11-18T21:31:32.060 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.c.log 2023-11-18T21:31:32.061 INFO:tasks.ceph:Archiving crash dumps... 2023-11-18T21:31:32.062 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694/remote/smithi049/crash 2023-11-18T21:31:32.063 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-18T21:31:32.081 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694/remote/smithi106/crash 2023-11-18T21:31:32.082 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-18T21:31:32.114 INFO:tasks.ceph:Shutting down logrotate 2023-11-18T21:31:32.114 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:31:32.128 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T21:31:32.198 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-18T21:31:32.212 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-18T21:31:32.249 INFO:tasks.ceph:Compressing logs... 2023-11-18T21:31:32.250 DEBUG:teuthology.orchestra.run.smithi049:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-18T21:31:32.257 DEBUG:teuthology.orchestra.run.smithi106:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-18T21:31:32.278 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43357.log 2023-11-18T21:31:32.279 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47123.log 2023-11-18T21:31:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46863.log 2023-11-18T21:31:32.280 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43357.log.gz 2023-11-18T21:31:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43435.log 2023-11-18T21:31:32.281 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46863.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47123.log.gz 2023-11-18T21:31:32.281 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47383.log 2023-11-18T21:31:32.281 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46863.log.gz 2023-11-18T21:31:32.281 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43435.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-18T21:31:32.281 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43435.log.gz/var/log/ceph/ceph-client.admin.47383.log: 2023-11-18T21:31:32.282 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43305.log 2023-11-18T21:31:32.282 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mgr.y.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47383.log.gz 2023-11-18T21:31:32.282 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47097.log 2023-11-18T21:31:32.282 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44121.log 2023-11-18T21:31:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43305.log: /var/log/ceph/ceph-client.admin.47097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47279.log 2023-11-18T21:31:32.284 INFO:teuthology.orchestra.run.smithi049.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43305.log.gz 2023-11-18T21:31:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44121.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47097.log.gz 2023-11-18T21:31:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44642.log 2023-11-18T21:31:32.284 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44121.log.gz 2023-11-18T21:31:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47175.log 2023-11-18T21:31:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43383.log 2023-11-18T21:31:32.285 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47279.log.gz 2023-11-18T21:31:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44642.log: /var/log/ceph/ceph-client.admin.47175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45273.log 2023-11-18T21:31:32.286 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44642.log.gz 2023-11-18T21:31:32.286 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47175.log.gz 2023-11-18T21:31:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45622.log 2023-11-18T21:31:32.286 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43383.log.gz 2023-11-18T21:31:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45273.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-18T21:31:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45622.log: -- /var/log/ceph/ceph-client.admin.46941.log 2023-11-18T21:31:32.287 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45273.log.gz 2023-11-18T21:31:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46915.log 2023-11-18T21:31:32.287 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45622.log.gz 2023-11-18T21:31:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44336.log 2023-11-18T21:31:32.287 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46941.log.gz 2023-11-18T21:31:32.287 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47253.log 2023-11-18T21:31:32.290 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46915.log.gz 2023-11-18T21:31:32.290 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44645.log 2023-11-18T21:31:32.290 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44336.log: /var/log/ceph/ceph-client.admin.47253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45492.log 2023-11-18T21:31:32.290 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44336.log.gz 2023-11-18T21:31:32.290 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47253.log.gz 2023-11-18T21:31:32.290 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45596.log 2023-11-18T21:31:32.290 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44645.log.gz 2023-11-18T21:31:32.290 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43489.log 2023-11-18T21:31:32.290 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45492.log: /var/log/ceph/ceph-client.admin.45596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44646.log 2023-11-18T21:31:32.291 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45492.log.gz 2023-11-18T21:31:32.291 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45596.log.gz 2023-11-18T21:31:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45900.log 2023-11-18T21:31:32.291 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45648.log 2023-11-18T21:31:32.292 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43489.log.gz 2023-11-18T21:31:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44646.log: /var/log/ceph/ceph-client.admin.45900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45850.log 2023-11-18T21:31:32.292 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44646.log.gz 2023-11-18T21:31:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44310.log 2023-11-18T21:31:32.292 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.45900.log.gz 2023-11-18T21:31:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45850.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45648.log.gz 2023-11-18T21:31:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43119.log 2023-11-18T21:31:32.293 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46609.log 2023-11-18T21:31:32.294 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44310.log.gz 2023-11-18T21:31:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44414.log 2023-11-18T21:31:32.294 INFO:teuthology.orchestra.run.smithi049.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45850.log.gz 2023-11-18T21:31:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46740.log 2023-11-18T21:31:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46609.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43119.log.gz 2023-11-18T21:31:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44414.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-18T21:31:32.294 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44414.log.gz 2023-11-18T21:31:32.294 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46609.log.gz 2023-11-18T21:31:32.294 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46792.log 2023-11-18T21:31:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.2.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46740.log.gz 2023-11-18T21:31:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43068.log 2023-11-18T21:31:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44647.log 2023-11-18T21:31:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46792.log: /var/log/ceph/ceph-client.admin.43068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47045.log 2023-11-18T21:31:32.297 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46792.log.gz 2023-11-18T21:31:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44647.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43068.log.gz 2023-11-18T21:31:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47149.log 2023-11-18T21:31:32.297 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44647.log.gz 2023-11-18T21:31:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45039.log 2023-11-18T21:31:32.297 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47045.log.gz 2023-11-18T21:31:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44823.log 2023-11-18T21:31:32.299 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43239.log 2023-11-18T21:31:32.299 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47149.log.gz 2023-11-18T21:31:32.299 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45039.log.gz 2023-11-18T21:31:32.299 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46531.log 2023-11-18T21:31:32.299 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44823.log.gz 2023-11-18T21:31:32.299 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43239.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-18T21:31:32.299 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43239.log.gz 2023-11-18T21:31:32.299 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43551.log 2023-11-18T21:31:32.301 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3%/var/log/ceph/ceph-mon.a.log: -- replaced with /var/log/ceph/ceph-client.admin.46531.log.gz 2023-11-18T21:31:32.301 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38482.log 2023-11-18T21:31:32.301 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45388.log 2023-11-18T21:31:32.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43551.log: /var/log/ceph/ceph-client.admin.38482.log: gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43551.log.gz 2023-11-18T21:31:32.301 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47331.log 2023-11-18T21:31:32.301 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38482.log.gz 2023-11-18T21:31:32.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45111.log 2023-11-18T21:31:32.303 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45388.log.gz 2023-11-18T21:31:32.303 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45800.log 2023-11-18T21:31:32.303 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46081.log 2023-11-18T21:31:32.303 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47331.log.gz 2023-11-18T21:31:32.303 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45111.log.gz 2023-11-18T21:31:32.303 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.45800.log: /var/log/ceph/ceph-client.admin.45247.log 2023-11-18T21:31:32.303 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44388.log 2023-11-18T21:31:32.303 INFO:teuthology.orchestra.run.smithi049.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-18T21:31:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.46081.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45800.log.gz 2023-11-18T21:31:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45087.log 2023-11-18T21:31:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45750.log 2023-11-18T21:31:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44388.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45247.log.gz 2023-11-18T21:31:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45087.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44388.log.gz 2023-11-18T21:31:32.304 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43274.log 2023-11-18T21:31:32.308 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45087.log.gz 2023-11-18T21:31:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44596.log 2023-11-18T21:31:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46889.log 2023-11-18T21:31:32.309 INFO:teuthology.orchestra.run.smithi049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45750.log.gz 2023-11-18T21:31:32.309 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43274.log.gz/var/log/ceph/ceph-client.admin.44596.log: 2023-11-18T21:31:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44827.log 2023-11-18T21:31:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44636.log 2023-11-18T21:31:32.309 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44596.log.gz 2023-11-18T21:31:32.309 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44440.log 2023-11-18T21:31:32.309 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46889.log.gz 2023-11-18T21:31:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44827.log: /var/log/ceph/ceph-client.admin.44636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46661.log 2023-11-18T21:31:32.309 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44827.log.gz 88.0% 2023-11-18T21:31:32.309 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44636.log.gz 2023-11-18T21:31:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:gzip/var/log/ceph/ceph-client.admin.44440.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44016.log 2023-11-18T21:31:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44492.log 2023-11-18T21:31:32.310 INFO:teuthology.orchestra.run.smithi049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44440.log.gz 2023-11-18T21:31:32.310 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46661.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33444.log 2023-11-18T21:31:32.310 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-11-18T21:31:32.310 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44016.log: /var/log/ceph/ceph-client.admin.44492.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44016.log.gz 2023-11-18T21:31:32.318 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38427.log 2023-11-18T21:31:32.318 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38396.log 2023-11-18T21:31:32.318 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38427.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-18T21:31:32.318 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38396.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38427.log.gz 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38396.log.gz 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38653.log 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38451.log 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38653.log.gz 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38451.log: gzip -5 88.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.38451.log.gz 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr: -- /var/log/ceph/ceph-mds.f.log 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38500.log 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38500.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38500.log.gz 2023-11-18T21:31:32.319 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-18T21:31:32.322 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.audit.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-18T21:31:32.322 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2023-11-18T21:31:32.322 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mds.d.log: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-18T21:31:32.327 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.44492.log.gz -5 2023-11-18T21:31:32.327 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45361.log 2023-11-18T21:31:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.tmp-client.admin.33444.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33444.log.gz 2023-11-18T21:31:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44883.log 2023-11-18T21:31:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46583.log 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45361.log: /var/log/ceph/ceph-client.admin.44883.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45361.log.gz 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44883.log.gz 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46583.log: 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45414.log 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46583.log.gz 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47201.log 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43733.log 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45414.log: /var/log/ceph/ceph-client.admin.47201.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45119.log 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45414.log.gz 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47201.log.gz 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43733.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.43733.log.gz 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38371.log 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44852.log 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8%/var/log/ceph/ceph-client.admin.38371.log: -- replaced with /var/log/ceph/ceph-client.admin.45119.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43463.log 2023-11-18T21:31:32.328 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38371.log.gz 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44640.log 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45333.log 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44852.log.gz 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44640.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43463.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47357.log 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44640.log.gz 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44284.log 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3%/var/log/ceph/ceph-client.admin.47357.log: -- replaced with /var/log/ceph/ceph-client.admin.45333.log.gz 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44837.log 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47357.log.gz 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44284.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44284.log.gz 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44094.log 2023-11-18T21:31:32.329 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44544.log 2023-11-18T21:31:32.330 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44837.log.gz 2023-11-18T21:31:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.44094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45570.log 2023-11-18T21:31:32.330 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44094.log.gz 2023-11-18T21:31:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44544.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44544.log.gz 2023-11-18T21:31:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44836.log 2023-11-18T21:31:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43964.log 2023-11-18T21:31:32.330 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45570.log.gz 2023-11-18T21:31:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44836.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43707.log 2023-11-18T21:31:32.330 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44836.log.gz 2023-11-18T21:31:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45115.log 2023-11-18T21:31:32.330 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43964.log.gz 2023-11-18T21:31:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47227.log 2023-11-18T21:31:32.330 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43707.log.gz 2023-11-18T21:31:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45115.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47413.log 2023-11-18T21:31:32.331 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45115.log.gz 2023-11-18T21:31:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47675.log 2023-11-18T21:31:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47413.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47227.log.gz 2023-11-18T21:31:32.331 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47413.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45466.log 2023-11-18T21:31:32.331 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-11-18T21:31:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47675.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-18T21:31:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45466.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47675.log.gz 2023-11-18T21:31:32.331 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45466.log.gz 2023-11-18T21:31:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47519.log 2023-11-18T21:31:32.332 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2023-11-18T21:31:32.332 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/valgrind/mon.c.log: 93.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2023-11-18T21:31:32.332 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2023-11-18T21:31:32.332 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/valgrind/mds.f.log: 95.4% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2023-11-18T21:31:32.333 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2023-11-18T21:31:32.334 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/valgrind/mds.b.log: 95.4% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2023-11-18T21:31:32.334 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2023-11-18T21:31:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45674.log 2023-11-18T21:31:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47519.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47519.log.gz 2023-11-18T21:31:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47493.log 2023-11-18T21:31:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45674.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45674.log.gz 2023-11-18T21:31:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44173.log 2023-11-18T21:31:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47493.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47493.log.gz 2023-11-18T21:31:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45043.log 2023-11-18T21:31:32.338 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-18T21:31:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47545.log 2023-11-18T21:31:32.338 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44173.log.gz 2023-11-18T21:31:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45043.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45043.log.gz 2023-11-18T21:31:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44855.log 2023-11-18T21:31:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44227.log 2023-11-18T21:31:32.339 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47545.log.gz 2023-11-18T21:31:32.339 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44855.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46635.log 2023-11-18T21:31:32.339 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44855.log.gz 2023-11-18T21:31:32.339 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46688.log 2023-11-18T21:31:32.339 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44227.log.gz 2023-11-18T21:31:32.339 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45544.log 2023-11-18T21:31:32.339 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46688.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46635.log.gz 2023-11-18T21:31:32.339 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47071.log 2023-11-18T21:31:32.339 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46688.log.gz 2023-11-18T21:31:32.339 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43629.log 2023-11-18T21:31:32.342 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/valgrind/mds.d.log: 95.3% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2023-11-18T21:31:32.342 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38628.log 2023-11-18T21:31:32.342 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/valgrind/mon.b.log: 93.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2023-11-18T21:31:32.342 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-18T21:31:32.342 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38628.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38628.log.gz 2023-11-18T21:31:32.342 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-18T21:31:32.345 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47071.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45544.log.gz 2023-11-18T21:31:32.345 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47071.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47597.log 2023-11-18T21:31:32.345 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-11-18T21:31:32.345 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45700.log 2023-11-18T21:31:32.345 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47597.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43629.log.gz 2023-11-18T21:31:32.346 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47597.log.gz 2023-11-18T21:31:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45440.log 2023-11-18T21:31:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44651.log 2023-11-18T21:31:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45440.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45440.log.gz 2023-11-18T21:31:32.346 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45700.log.gz 2023-11-18T21:31:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47623.log 2023-11-18T21:31:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47571.log 2023-11-18T21:31:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47623.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44651.log.gz 2023-11-18T21:31:32.346 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47623.log.gz 2023-11-18T21:31:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43331.log 2023-11-18T21:31:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44042.log 2023-11-18T21:31:32.346 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47571.log.gz 2023-11-18T21:31:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43331.log: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38251.log 2023-11-18T21:31:32.347 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43331.log.gz 2023-11-18T21:31:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45123.log 2023-11-18T21:31:32.348 INFO:teuthology.orchestra.run.smithi049.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44042.log.gz 2023-11-18T21:31:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47305.log 2023-11-18T21:31:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45123.log: 88.2% 93.3% -- replaced with /var/log/ceph/ceph-client.admin.38251.log.gz 2023-11-18T21:31:32.349 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45123.log.gz 2023-11-18T21:31:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44362.log 2023-11-18T21:31:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45307.log 2023-11-18T21:31:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44362.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47305.log.gz 2023-11-18T21:31:32.349 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44362.log.gz 2023-11-18T21:31:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43907.log 2023-11-18T21:31:32.350 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43166.log 2023-11-18T21:31:32.350 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8%/var/log/ceph/ceph-client.admin.43907.log: -- replaced with /var/log/ceph/ceph-client.admin.45307.log.gz 2023-11-18T21:31:32.351 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45518.log 2023-11-18T21:31:32.351 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43166.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.43907.log.gz 2023-11-18T21:31:32.352 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-18T21:31:32.352 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43166.log.gz 2023-11-18T21:31:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46766.log 2023-11-18T21:31:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.audit.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45518.log.gz 2023-11-18T21:31:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-18T21:31:32.355 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46766.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46766.log.gz 2023-11-18T21:31:32.355 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-18T21:31:32.355 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43603.log 2023-11-18T21:31:32.355 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-18T21:31:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.43603.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43603.log.gz 2023-11-18T21:31:32.356 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38476.log 2023-11-18T21:31:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2023-11-18T21:31:32.368 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38601.log 2023-11-18T21:31:32.368 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38476.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38476.log.gz 2023-11-18T21:31:32.371 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2023-11-18T21:31:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/valgrind/client.0.log: 77.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2023-11-18T21:31:32.374 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2023-11-18T21:31:32.376 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-18T21:31:32.376 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/valgrind/mds.a.log: 95.3% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2023-11-18T21:31:32.377 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38601.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38601.log.gz 2023-11-18T21:31:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2023-11-18T21:31:32.392 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/valgrind/mon.a.log: 93.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2023-11-18T21:31:32.407 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2023-11-18T21:31:32.411 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/valgrind/mds.c.log: 95.3% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2023-11-18T21:31:32.423 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44199.log 2023-11-18T21:31:32.424 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/valgrind/mds.e.log: 57.7% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2023-11-18T21:31:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47649.log 2023-11-18T21:31:32.440 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44199.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44199.log.gz 2023-11-18T21:31:32.455 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43523.log 2023-11-18T21:31:32.456 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47649.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47649.log.gz 2023-11-18T21:31:32.463 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44147.log 2023-11-18T21:31:32.464 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43523.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43523.log.gz 2023-11-18T21:31:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46714.log 2023-11-18T21:31:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44147.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44147.log.gz 2023-11-18T21:31:32.479 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47441.log 2023-11-18T21:31:32.479 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46714.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46714.log.gz 2023-11-18T21:31:32.487 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44648.log 2023-11-18T21:31:32.487 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47441.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47441.log.gz 2023-11-18T21:31:32.495 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43655.log 2023-11-18T21:31:32.495 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44648.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44648.log.gz 2023-11-18T21:31:32.503 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43783.log 2023-11-18T21:31:32.504 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43655.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43655.log.gz 2023-11-18T21:31:32.511 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46818.log 2023-11-18T21:31:32.511 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43783.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43783.log.gz 2023-11-18T21:31:32.519 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43577.log 2023-11-18T21:31:32.521 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46818.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46818.log.gz 2023-11-18T21:31:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43409.log 2023-11-18T21:31:32.527 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43577.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43577.log.gz 2023-11-18T21:31:32.535 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46993.log 2023-11-18T21:31:32.535 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43409.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43409.log.gz 2023-11-18T21:31:32.543 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45961.log 2023-11-18T21:31:32.543 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46993.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46993.log.gz 2023-11-18T21:31:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43681.log 2023-11-18T21:31:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45961.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45961.log.gz 2023-11-18T21:31:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46967.log 2023-11-18T21:31:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43681.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43681.log.gz 2023-11-18T21:31:32.571 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44466.log 2023-11-18T21:31:32.571 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46967.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46967.log.gz 2023-11-18T21:31:32.579 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44068.log 2023-11-18T21:31:32.579 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44466.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44466.log.gz 2023-11-18T21:31:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43990.log 2023-11-18T21:31:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44068.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44068.log.gz 2023-11-18T21:31:32.595 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2023-11-18T21:31:32.595 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43990.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43990.log.gz 2023-11-18T21:31:32.615 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46557.log 2023-11-18T21:31:32.623 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.e.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.e.log.gzgzip 2023-11-18T21:31:32.623 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44570.log 2023-11-18T21:31:32.623 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46557.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46557.log.gz 2023-11-18T21:31:32.626 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.4.log: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-18T21:31:32.631 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44253.log 2023-11-18T21:31:32.631 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44570.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44570.log.gz 2023-11-18T21:31:32.639 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44845.log 2023-11-18T21:31:32.639 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44253.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44253.log.gz 2023-11-18T21:31:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47469.log 2023-11-18T21:31:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44845.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44845.log.gz 2023-11-18T21:31:32.659 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47701.log 2023-11-18T21:31:32.659 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47469.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.47469.log.gz 2023-11-18T21:31:32.667 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44518.log 2023-11-18T21:31:32.667 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47701.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47701.log.gz 2023-11-18T21:31:32.675 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45167.log 2023-11-18T21:31:32.675 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44518.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44518.log.gz 2023-11-18T21:31:32.683 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47019.log 2023-11-18T21:31:32.683 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45167.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45167.log.gz 2023-11-18T21:31:32.692 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47019.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47019.log.gz 2023-11-18T21:31:32.876 INFO:teuthology.orchestra.run.smithi106.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-18T21:31:33.013 INFO:teuthology.orchestra.run.smithi106.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-18T21:31:33.834 INFO:teuthology.orchestra.run.smithi049.stderr: 89.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-18T21:31:34.783 INFO:teuthology.orchestra.run.smithi049.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-18T21:31:34.919 INFO:teuthology.orchestra.run.smithi106.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-18T21:31:35.198 INFO:teuthology.orchestra.run.smithi106.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2023-11-18T21:31:35.440 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-18T21:31:35.584 INFO:teuthology.orchestra.run.smithi106.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-18T21:31:35.844 INFO:teuthology.orchestra.run.smithi106.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-18T21:31:35.910 INFO:teuthology.orchestra.run.smithi106.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-18T21:31:35.990 INFO:teuthology.orchestra.run.smithi106.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-18T21:31:36.215 INFO:teuthology.orchestra.run.smithi049.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-18T21:31:36.299 INFO:teuthology.orchestra.run.smithi049.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-18T21:31:36.435 INFO:teuthology.orchestra.run.smithi106.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-18T21:31:36.436 INFO:teuthology.orchestra.run.smithi106.stderr: 2023-11-18T21:31:36.436 INFO:teuthology.orchestra.run.smithi106.stderr:real 0m4.140s 2023-11-18T21:31:36.436 INFO:teuthology.orchestra.run.smithi106.stderr:user 0m23.671s 2023-11-18T21:31:36.436 INFO:teuthology.orchestra.run.smithi106.stderr:sys 0m0.735s 2023-11-18T21:31:36.720 INFO:teuthology.orchestra.run.smithi049.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-18T21:31:37.793 INFO:teuthology.orchestra.run.smithi049.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-18T21:31:38.606 INFO:teuthology.orchestra.run.smithi049.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.46081.log.gz 2023-11-18T21:31:38.607 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-11-18T21:31:38.607 INFO:teuthology.orchestra.run.smithi049.stderr:real 0m6.349s 2023-11-18T21:31:38.607 INFO:teuthology.orchestra.run.smithi049.stderr:user 0m30.474s 2023-11-18T21:31:38.607 INFO:teuthology.orchestra.run.smithi049.stderr:sys 0m0.905s 2023-11-18T21:31:38.608 INFO:tasks.ceph:Archiving logs... 2023-11-18T21:31:38.609 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694/remote/smithi049/log 2023-11-18T21:31:38.609 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-18T21:31:41.837 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694/remote/smithi106/log 2023-11-18T21:31:41.838 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-18T21:31:44.282 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-11-18T21:31:44.284 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-18T21:31:44.294 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-11-18T21:31:44.294 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-18T21:31:44.295 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-18T21:31:44.297 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-18T21:31:44.373 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-18T21:31:44.382 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-18T21:31:44.382 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-18T21:31:44.385 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-18T21:31:44.395 INFO:teuthology.orchestra.run.smithi049.stdout: remote refid st t when poll reach delay offset jitter 2023-11-18T21:31:44.395 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================== 2023-11-18T21:31:44.395 INFO:teuthology.orchestra.run.smithi049.stdout:*hv01.front.sepi 44.4.53.2 2 u 31 64 377 0.096 -8.782 2.598 2023-11-18T21:31:44.395 INFO:teuthology.orchestra.run.smithi049.stdout:+hv02.front.sepi 63.231.80.2 3 u 24 64 377 0.099 -5.384 2.308 2023-11-18T21:31:44.395 INFO:teuthology.orchestra.run.smithi049.stdout:+hv03.front.sepi 74.6.168.72 3 u 22 64 377 0.083 -6.499 2.604 2023-11-18T21:31:44.395 INFO:teuthology.orchestra.run.smithi049.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-11-18T21:31:44.397 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2023-11-18T21:31:44.397 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2023-11-18T21:31:44.397 INFO:teuthology.orchestra.run.smithi106.stdout:*hv01.front.sepi 44.4.53.2 2 u 23 64 377 0.085 -5.900 0.286 2023-11-18T21:31:44.397 INFO:teuthology.orchestra.run.smithi106.stdout:+hv02.front.sepi 63.231.80.2 3 u 22 128 377 0.094 -2.666 0.435 2023-11-18T21:31:44.397 INFO:teuthology.orchestra.run.smithi106.stdout:+hv03.front.sepi 74.6.168.72 3 u 42 64 377 0.093 -3.769 0.296 2023-11-18T21:31:44.397 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-11-18T21:31:44.398 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-18T21:31:44.408 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-18T21:31:44.408 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-18T21:31:44.419 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-18T21:31:44.430 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-18T21:31:44.442 INFO:teuthology.task.internal:Duration was 2922.548827 seconds 2023-11-18T21:31:44.442 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-18T21:31:44.454 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-18T21:31:44.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-18T21:31:44.457 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-18T21:31:44.539 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-18T21:31:44.540 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2023-11-18T21:31:44.540 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-18T21:31:44.550 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2023-11-18T21:31:44.550 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-18T21:31:44.560 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-18T21:31:44.560 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-18T21:31:44.592 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-18T21:31:44.625 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-18T21:31:44.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-18T21:31:44.656 DEBUG:teuthology.orchestra.run.smithi106:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-18T21:31:44.721 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-18T21:31:44.733 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-18T21:31:44.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-18T21:31:44.747 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-18T21:31:44.758 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-18T21:31:44.769 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-18T21:31:44.793 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-18T21:31:44.804 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2023-11-18T21:31:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2023-11-18T21:31:44.823 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-18T21:31:44.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T21:31:44.863 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-18T21:31:44.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T21:31:44.867 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-18T21:31:44.879 INFO:teuthology.task.internal:Transferring archived files... 2023-11-18T21:31:44.879 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694/remote/smithi049 2023-11-18T21:31:44.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-18T21:31:44.926 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694/remote/smithi106 2023-11-18T21:31:44.927 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-18T21:31:44.945 INFO:teuthology.task.internal:Removing archive directory... 2023-11-18T21:31:44.945 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-18T21:31:44.968 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-18T21:31:44.988 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-18T21:31:45.001 INFO:teuthology.task.internal:Not uploading archives. 2023-11-18T21:31:45.001 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-18T21:31:45.029 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-18T21:31:45.029 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-18T21:31:45.031 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-18T21:31:45.037 INFO:teuthology.orchestra.run.smithi049.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 18 21:31 /home/ubuntu/cephtest 2023-11-18T21:31:45.037 INFO:teuthology.orchestra.run.smithi106.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 18 21:31 /home/ubuntu/cephtest 2023-11-18T21:31:45.039 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-18T21:31:45.050 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-18T21:31:45.062 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: saw valgrind issues 2023-11-18T21:31:45.063 INFO:teuthology.nuke:Checking targets against current locks 2023-11-18T21:31:45.091 DEBUG:teuthology.nuke:shortname: smithi049 2023-11-18T21:31:45.092 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-18T21:31:45.117 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-18 20:30:19.614691', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC+ChscoCMEahRQFSUSGVJvVBQnKyYYPResF1d23B+3h1K0uen/ccLMt2ZvhB/2mkhj1XyLHksEObj5XIMC9sCc='} 2023-11-18T21:31:45.121 DEBUG:teuthology.nuke:shortname: smithi106 2023-11-18T21:31:45.121 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-18T21:31:45.141 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461694', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-18 20:30:19.615985', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFAPO3qbOCqVwT7ut+l2Er62zVXJOFja6maelkGd+Fwkr4k5lgYXopvJ7bSIskIqwcXP/cHqjLPzI8AgjjNx2VE='} 2023-11-18T21:31:45.173 INFO:teuthology.orchestra.console.smithi049:Power off 2023-11-18T21:31:45.173 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-18T21:31:45.197 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-11-18T21:31:45.197 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T21:31:45.211 INFO:teuthology.orchestra.console.smithi106:Power off 2023-11-18T21:31:45.212 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-18T21:31:45.221 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-11-18T21:31:45.233 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off 2023-11-18T21:31:45.233 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T21:31:45.259 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2023-11-18T21:31:49.223 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T21:31:49.260 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T21:31:49.332 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-11-18T21:31:49.369 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2023-11-18T21:31:53.334 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T21:31:53.370 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T21:31:53.445 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-11-18T21:31:53.480 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2023-11-18T21:31:53.547 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-11-18T21:31:53.581 INFO:teuthology.orchestra.console.smithi106:Power off completed 2023-11-18T21:31:53.686 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} duration: 2922.548826932907 failure_reason: saw valgrind issues flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-11-18T21:31:53.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-18T21:31:53.779 INFO:teuthology.run:FAIL